DE eng

Search in the Catalogues and Directories

Hits 1 – 5 of 5

1
Dual-decoder Transformer for Joint Automatic Speech Recognition and Multilingual Speech Translation ...
Abstract: We introduce dual-decoder Transformer, a new model architecture that jointly performs auto- matic speech recognition (ASR) and multilingual speech translation (ST). Our models are based on the original Transformer architecture (Vaswani et al., 2017) but consist of two decoders, each responsible for one task (ASR or ST). Our major contribution lies in how these decoders interact with each other: one decoder can attend to different information sources from the other via a dual-attention mechanism. We propose two variants of these architectures corresponding to two different levels of dependencies between the decoders, called the parallel and cross dual decoder Transformers, respectively. Extensive experiments on the MuST-C dataset show that our models outperform the previously reported highest translation performance in the multilingual settings, and outperform as well bilingual one-to-one results. Furthermore, our parallel models demon- strate no trade-off between ASR and ST compared to the vanilla multi-task ...
Keyword: Dual-decoder Transformer, multilingual speech translation
URL: https://dx.doi.org/10.5281/zenodo.4773889
https://zenodo.org/record/4773889
BASE
Hide details
2
Dual-decoder Transformer for Joint Automatic Speech Recognition and Multilingual Speech Translation ...
Le, Hang; Pino, Juan; Changhan Wang. - : Zenodo, 2020
BASE
Show details
3
Dual-decoder Transformer for Joint Automatic Speech Recognition and Multilingual Speech Translation ...
Le, Hang; Pino, Juan; Changhan Wang. - : Zenodo, 2020
BASE
Show details
4
Dual-decoder Transformer for Joint Automatic Speech Recognition and Multilingual Speech Translation ...
Le, Hang; Pino, Juan; Changhan Wang. - : Zenodo, 2020
BASE
Show details
5
Dual-decoder Transformer for Joint Automatic Speech Recognition and Multilingual Speech Translation ...
Le, Hang; Pino, Juan; Changhan Wang. - : Zenodo, 2020
BASE
Show details

Catalogues
0
0
0
0
0
0
0
Bibliographies
0
0
0
0
0
0
0
0
0
Linked Open Data catalogues
0
Online resources
0
0
0
0
Open access documents
5
0
0
0
0
© 2013 - 2024 Lin|gu|is|tik | Imprint | Privacy Policy | Datenschutzeinstellungen ändern