2 |
XTREME-R: Towards More Challenging and Nuanced Multilingual Evaluation ...
|
|
|
|
BASE
|
|
Show details
|
|
3 |
nmT5 -- Is parallel data still relevant for pre-training massively multilingual language models? ...
|
|
|
|
BASE
|
|
Show details
|
|
4 |
Towards Continual Learning for Multilingual Machine Translation via Vocabulary Substitution ...
|
|
|
|
BASE
|
|
Show details
|
|
5 |
The Power of Scale for Parameter-Efficient Prompt Tuning ...
|
|
|
|
BASE
|
|
Show details
|
|
6 |
TextSETTR: Few-Shot Text Style Extraction and Tunable Targeted Restyling ...
|
|
|
|
BASE
|
|
Show details
|
|
7 |
mT5: A Massively Multilingual Pre-trained Text-to-Text Transformer ...
|
|
|
|
BASE
|
|
Show details
|
|
8 |
Towards Continual Learning for Multilingual Machine Translation via Vocabulary Substitution ...
|
|
|
|
BASE
|
|
Show details
|
|
9 |
mT5: A massively multilingual pre-trained text-to-text transformer ...
|
|
|
|
Abstract:
The recent "Text-to-Text Transfer Transformer" (T5) leveraged a unified text-to-text format and scale to attain state-of-the-art results on a wide variety of English-language NLP tasks. In this paper, we introduce mT5, a multilingual variant of T5 that was pre-trained on a new Common Crawl-based dataset covering 101 languages. We detail the design and modified training of mT5 and demonstrate its state-of-the-art performance on many multilingual benchmarks. We also describe a simple technique to prevent "accidental translation" in the zero-shot setting, where a generative model chooses to (partially) translate its prediction into the wrong language. All of the code and model checkpoints used in this work are publicly available. ...
|
|
Keyword:
Computation and Language cs.CL; FOS Computer and information sciences
|
|
URL: https://dx.doi.org/10.48550/arxiv.2010.11934 https://arxiv.org/abs/2010.11934
|
|
BASE
|
|
Hide details
|
|
10 |
Towards Zero-Shot Multilingual Synthetic Question and Answer Generation for Cross-Lingual Reading Comprehension ...
|
|
|
|
BASE
|
|
Show details
|
|
11 |
LAReQA: Language-agnostic answer retrieval from a multilingual pool ...
|
|
|
|
BASE
|
|
Show details
|
|
12 |
Multilingual Universal Sentence Encoder for Semantic Retrieval ...
|
|
|
|
BASE
|
|
Show details
|
|
13 |
Effective Parallel Corpus Mining using Bilingual Sentence Embeddings ...
|
|
|
|
BASE
|
|
Show details
|
|
15 |
Contrastive Topic: Meanings and Realizations
|
|
|
|
In: Doctoral Dissertations (2014)
|
|
BASE
|
|
Show details
|
|
17 |
Witnessable quantifiers license type-e meaning: Evidence from contrastive topic, equatives and supplements
|
|
|
|
In: Semantics and Linguistic Theory; Proceedings of SALT 22; 286-306 ; 2163-5951 (2012)
|
|
BASE
|
|
Show details
|
|
18 |
Mandarin 'even', `all' and the Trigger of Focus Movement
|
|
|
|
In: University of Pennsylvania Working Papers in Linguistics (2010)
|
|
BASE
|
|
Show details
|
|
|
|