1 |
Sparsity and Sentence Structure in Encoder-Decoder Attention of Summarization Systems ...
|
|
|
|
BASE
|
|
Show details
|
|
2 |
Sparsity and Sentence Structure in Encoder-Decoder Attention of Summarization Systems ...
|
|
|
|
BASE
|
|
Show details
|
|
3 |
Sparsity and Sentence Structure in Encoder-Decoder Attention of Summarization Systems ...
|
|
|
|
BASE
|
|
Show details
|
|
4 |
Long-Span Summarization via Local Attention and Content Selection ...
|
|
|
|
BASE
|
|
Show details
|
|
5 |
Long-span summarization via local attention and content selection
|
|
Manakul, Potsawee; Gales, Mark. - : ACL-IJCNLP 2021 - 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, Proceedings of the Conference, 2021
|
|
Abstract:
Transformer-based models have achieved state-of-the-art results in a wide range of natural language processing (NLP) tasks including document summarization. Typically these systems are trained by fine-tuning a large pre-trained model to the target task. One issue with these transformer-based models is that they do not scale well in terms of memory and compute requirements as the input length grows. Thus, for long document summarization, it can be challenging to train or fine-tune these models. In this work, we exploit large pre-trained transformer-based models and address long-span dependencies in abstractive summarization using two methods: local self-attention; and explicit content selection. These approaches are compared on a range of network configurations. Experiments are carried out on standard long-span summarization tasks, including Spotify Podcast, arXiv, and PubMed datasets. We demonstrate that by combining these methods, we can achieve state-of-the-art results on all three tasks in the ROUGE scores. Moreover, without a large-scale GPU card, our approach can achieve comparable or better results than existing approaches. ; 1. ALTA institute, Cambridge Assessment English, University of Cambridge 2. Cambridge International & St John’s College Scholarship
|
|
URL: https://doi.org/10.17863/CAM.69698 https://www.repository.cam.ac.uk/handle/1810/322239
|
|
BASE
|
|
Hide details
|
|
6 |
Complementary Systems for Off-Topic Spoken Response Detection ...
|
|
|
|
BASE
|
|
Show details
|
|
7 |
Automatic detection of accent and lexical pronunciation errors in spontaneous non-native English speech ...
|
|
|
|
BASE
|
|
Show details
|
|
8 |
Non-native children's automatic speech recognition: The INTERSPEECH 2020 shared task ALTA systems ...
|
|
|
|
BASE
|
|
Show details
|
|
9 |
Non-native children's automatic speech recognition: The INTERSPEECH 2020 shared task ALTA systems
|
|
Knill, Katherine; Wang, L; Wang, Y. - : ISCA, 2020. : Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH, 2020
|
|
BASE
|
|
Show details
|
|
10 |
Complementary Systems for Off-Topic Spoken Response Detection
|
|
Raina, Vatsal; Gales, Mark; Knill, Katherine. - : Association for Computational Linguistics, 2020. : https://aclanthology.org/volumes/2020.bea-1/, 2020. : INNOVATIVE USE OF NLP FOR BUILDING EDUCATIONAL APPLICATIONS, 2020
|
|
BASE
|
|
Show details
|
|
11 |
Impact of ASR performance on free speaking language assessment ...
|
|
|
|
BASE
|
|
Show details
|
|
12 |
Phonetic and Graphemic Systems for Multi-Genre Broadcast Transcription ...
|
|
|
|
BASE
|
|
Show details
|
|
13 |
Phonetic and graphemic systems for multi-genre broadcast transcription ...
|
|
|
|
BASE
|
|
Show details
|
|
14 |
Phonetic and graphemic systems for multi-genre broadcast transcription
|
|
Wang, Yu; Chen, X; Gales, Mark. - : IEEE, 2018. : https://ieeexplore.ieee.org/document/8462353, 2018. : ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings, 2018
|
|
BASE
|
|
Show details
|
|
15 |
Impact of ASR performance on free speaking language assessment
|
|
|
|
BASE
|
|
Show details
|
|
16 |
Student-teacher training with diverse decision tree ensembles ...
|
|
|
|
BASE
|
|
Show details
|
|
17 |
Use of graphemic lexicons for spoken language assessment ...
|
|
|
|
BASE
|
|
Show details
|
|
19 |
Student-teacher training with diverse decision tree ensembles
|
|
Wong, Jeremy; Gales, Mark. - : ISCA, 2017. : Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH, 2017
|
|
BASE
|
|
Show details
|
|
20 |
Incorporating uncertainty into deep learning for spoken language assessment
|
|
Malinin, Andrey; Ragni, Anton; Knill, Katherine. - : Association for Computational Linguistics, 2017. : ACL 2017 - 55th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference (Long Papers), 2017
|
|
BASE
|
|
Show details
|
|
|
|