2 |
Zero-Shot Cross-Lingual Transfer with Meta Learning ...
|
|
|
|
Abstract:
Learning what to share between tasks has been a topic of great importance recently, as strategic sharing of knowledge has been shown to improve downstream task performance. This is particularly important for multilingual applications, as most languages in the world are under-resourced. Here, we consider the setting of training models on multiple different languages at the same time, when little or no data is available for languages other than English. We show that this challenging setup can be approached using meta-learning, where, in addition to training a source language model, another model learns to select which training instances are the most beneficial to the first. We experiment using standard supervised, zero-shot cross-lingual, as well as few-shot cross-lingual settings for different natural language understanding tasks (natural language inference, question answering). Our extensive experimental setup demonstrates the consistent effectiveness of meta-learning for a total of 15 languages. We improve ... : Accepted as long paper in EMNLP2020 main conference ...
|
|
Keyword:
Computation and Language cs.CL; FOS Computer and information sciences
|
|
URL: https://dx.doi.org/10.48550/arxiv.2003.02739 https://arxiv.org/abs/2003.02739
|
|
BASE
|
|
Hide details
|
|
3 |
SIGTYP 2020 Shared Task: Prediction of Typological Features ...
|
|
|
|
BASE
|
|
Show details
|
|
4 |
Uncovering Probabilistic Implications in Typological Knowledge Bases ...
|
|
|
|
BASE
|
|
Show details
|
|
5 |
Back to the Future -- Sequential Alignment of Text Representations ...
|
|
|
|
BASE
|
|
Show details
|
|
7 |
What Do Language Representations Really Represent?
|
|
|
|
In: Bjerva, Johannes; Östling, Robert; Veiga, Maria Han; Tiedemann, Jörg; Augenstein, Isabelle (2019). What Do Language Representations Really Represent? Computational Linguistics, 45(2):381-389. (2019)
|
|
BASE
|
|
Show details
|
|
8 |
Copenhagen at CoNLL--SIGMORPHON 2018: Multilingual Inflection in Context with Explicit Morphosyntactic Decoding ...
|
|
|
|
BASE
|
|
Show details
|
|
9 |
Parameter sharing between dependency parsers for related languages ...
|
|
|
|
BASE
|
|
Show details
|
|
10 |
Multitask and Multilingual Modelling for Lexical Analysis ...
|
|
|
|
BASE
|
|
Show details
|
|
11 |
From Phonology to Syntax: Unsupervised Linguistic Typology at Different Levels with Language Embeddings ...
|
|
|
|
BASE
|
|
Show details
|
|
12 |
The Parallel Meaning Bank: Towards a Multilingual Corpus of Translations Annotated with Compositional Meaning Representations
|
|
|
|
In: 15th Conference of the European Chapter of the Association for Computational Linguistics ; https://hal.archives-ouvertes.fr/hal-01630960 ; 15th Conference of the European Chapter of the Association for Computational Linguistics, Apr 2017, Valencia, Spain. pp.242 - 247 (2017)
|
|
BASE
|
|
Show details
|
|
13 |
Tracking Typological Traits of Uralic Languages in Distributed Language Representations ...
|
|
|
|
BASE
|
|
Show details
|
|
14 |
Articulation rate in Swedish child-directed speech increases as a function of the age of the child even when surprisal is controlled for ...
|
|
|
|
BASE
|
|
Show details
|
|
15 |
One Model to Rule them all: Multitask and Multilingual Modelling for Lexical Analysis ...
|
|
|
|
BASE
|
|
Show details
|
|
16 |
The Parallel Meaning Bank: Towards a Multilingual Corpus of Translations Annotated with Compositional Meaning Representations ...
|
|
|
|
BASE
|
|
Show details
|
|
17 |
Rethinking intertextuality through a word-space and social network approach – the case of Cassiodorus
|
|
|
|
In: https://hal.archives-ouvertes.fr/hal-01279833 ; 2016 (2016)
|
|
BASE
|
|
Show details
|
|
|
|