DE eng

Search in the Catalogues and Directories

Hits 1 – 10 of 10

1
Applying the Transformer to Character-level Transduction ...
Wu, Shijie; Cotterell, Ryan; Hulden, Mans. - : ETH Zurich, 2021
Abstract: The transformer has been shown to outperform recurrent neural network-based sequence-to-sequence models in various word-level NLP tasks. Yet for character-level transduction tasks, e.g. morphological inflection generation and historical text normalization, there are few works that outperform recurrent models using the transformer. In an empirical study, we uncover that, in contrast to recurrent sequence-to-sequence models, the batch size plays a crucial role in the performance of the transformer on character-level tasks, and we show that with a large enough batch size, the transformer does indeed outperform recurrent models. We also introduce a simple technique to handle feature-guided character-level transduction that further improves performance. With these insights, we achieve state-of-the-art performance on morphological inflection and historical text normalization. We also show that the transformer outperforms a strong baseline on two other character-level transduction tasks: grapheme-to-phoneme ... : Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume ...
URL: https://dx.doi.org/10.3929/ethz-b-000518998
http://hdl.handle.net/20.500.11850/518998
BASE
Hide details
2
Applying the Transformer to Character-level Transduction
In: Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume (2021)
BASE
Show details
3
SIGMORPHON 2020 Shared Task 0: Typologically Diverse Morphological Inflection ...
BASE
Show details
4
UniMorph 3.0: Universal Morphology
In: Proceedings of the 12th Language Resources and Evaluation Conference (2020)
BASE
Show details
5
UniMorph 3.0: Universal Morphology ...
BASE
Show details
6
The SIGMORPHON 2019 Shared Task: Morphological Analysis in Context and Cross-Lingual Transfer for Inflection ...
BASE
Show details
7
On the Complexity and Typology of Inflectional Morphological Systems
In: Transactions of the Association for Computational Linguistics, Vol 7, Pp 327-342 (2019) (2019)
BASE
Show details
8
Marrying Universal Dependencies and Universal Morphology ...
BASE
Show details
9
On the Complexity and Typology of Inflectional Morphological Systems ...
BASE
Show details
10
Quantifying the Trade-off Between Two Types of Morphological Complexity
In: Proceedings of the Society for Computation in Linguistics (2018)
BASE
Show details

Catalogues
0
0
0
0
0
0
0
Bibliographies
0
0
0
0
0
0
0
0
0
Linked Open Data catalogues
0
Online resources
0
0
0
0
Open access documents
10
0
0
0
0
© 2013 - 2024 Lin|gu|is|tik | Imprint | Privacy Policy | Datenschutzeinstellungen ändern