1 |
Building Robust Spoken Language Understanding by Cross Attention between Phoneme Sequence and ASR Hypothesis ...
|
|
|
|
Abstract:
Building Spoken Language Understanding (SLU) robust to Automatic Speech Recognition (ASR) errors is an essential issue for various voice-enabled virtual assistants. Considering that most ASR errors are caused by phonetic confusion between similar-sounding expressions, intuitively, leveraging the phoneme sequence of speech can complement ASR hypothesis and enhance the robustness of SLU. This paper proposes a novel model with Cross Attention for SLU (denoted as CASLU). The cross attention block is devised to catch the fine-grained interactions between phoneme and word embeddings in order to make the joint representations catch the phonetic and semantic features of input simultaneously and for overcoming the ASR errors in downstream natural language understanding (NLU) tasks. Extensive experiments are conducted on three datasets, showing the effectiveness and competitiveness of our approach. Additionally, We also validate the universality of CASLU and prove its complementarity when combining with other robust ... : ICASSP 2022 ...
|
|
Keyword:
Audio and Speech Processing eess.AS; Computation and Language cs.CL; FOS Computer and information sciences; FOS Electrical engineering, electronic engineering, information engineering; Sound cs.SD
|
|
URL: https://arxiv.org/abs/2203.12067 https://dx.doi.org/10.48550/arxiv.2203.12067
|
|
BASE
|
|
Hide details
|
|
2 |
An Unsupervised Method for Building Sentence Simplification Corpora in Multiple Languages ...
|
|
|
|
BASE
|
|
Show details
|
|
3 |
An Unsupervised Method for Building Sentence Simplification Corpora in Multiple Languages ...
|
|
|
|
BASE
|
|
Show details
|
|
4 |
Combining Deep Generative Models and Multi-lingual Pretraining for Semi-supervised Document Classification ...
|
|
|
|
BASE
|
|
Show details
|
|
5 |
A Closer Look at Few-Shot Crosslingual Transfer: The Choice of Shots Matters ...
|
|
|
|
BASE
|
|
Show details
|
|
6 |
A Closer Look at Few-Shot Crosslingual Transfer: The Choice of Shots Matters ...
|
|
|
|
BASE
|
|
Show details
|
|
8 |
Assessment of a biofluid mechanics-based model for calculating portal pressure in canines
|
|
|
|
In: BMC Vet Res (2020)
|
|
BASE
|
|
Show details
|
|
9 |
Facing the challenges in ophthalmology clerkship teaching: Is flipped classroom the answer?
|
|
|
|
BASE
|
|
Show details
|
|
11 |
The Interpretation of Chinese Couplets' Syntactic Features: A Comparative Study of Two English Translation Versions of Xiyou Ji**
|
|
Zhu, Yi. - : The University of Queensland, School of Languages and Cultures, 2015
|
|
BASE
|
|
Show details
|
|
12 |
OntoPDF: using a text mining pipeline to generate enriched PDF versions of scientific papers
|
|
|
|
In: Zhu, Yi; Rinaldi, Fabio (2014). OntoPDF: using a text mining pipeline to generate enriched PDF versions of scientific papers. In: 6th International Symposium on Semantic Mining in Biomedicine, Aveiro, Portugal, 6 October 2014 - 7 October 2014, 85-89. (2014)
|
|
BASE
|
|
Show details
|
|
|
|