| 1 |
On the Evolution of Syntactic Information Encoded by BERT's Contextualized Representations ...
|
|
|
|
BASE
|
|
Show details
|
|
|
| 2 |
Assessing the Syntactic Capabilities of Transformer-based Multilingual Language Models ...
|
|
|
|
Abstract:
Multilingual Transformer-based language models, usually pretrained on more than 100 languages, have been shown to achieve outstanding results in a wide range of cross-lingual transfer tasks. However, it remains unknown whether the optimization for different languages conditions the capacity of the models to generalize over syntactic structures, and how languages with syntactic phenomena of different complexity are affected. In this work, we explore the syntactic generalization capabilities of the monolingual and multilingual versions of BERT and RoBERTa. More specifically, we evaluate the syntactic generalization potential of the models on English and Spanish tests, comparing the syntactic abilities of monolingual and multilingual models on the same language (English), and of multilingual models on two different languages (English and Spanish). For English, we use the available SyntaxGym test suite; for Spanish, we introduce SyntaxGymES, a novel ensemble of targeted syntactic tests in Spanish, designed to ... : To be published in Findings of ACL 2021 ...
|
|
Keyword:
Computation and Language cs.CL; FOS Computer and information sciences
|
|
URL: https://arxiv.org/abs/2105.04688
https://dx.doi.org/10.48550/arxiv.2105.04688
|
|
BASE
|
|
Hide details
|
|
|
| 3 |
Alternances actancielles et la montée du possesseur : une étude de cas en espagnol
|
|
|
|
In: Langages, n 176, 4, 2009-12-01, pp.10-31 (2009)
|
|
BASE
|
|
Show details
|
|
|
|
|
