2 |
On the Evolution of Syntactic Information Encoded by BERT's Contextualized Representations ...
|
|
|
|
BASE
|
|
Show details
|
|
3 |
How much pretraining data do language models need to learn syntax? ...
|
|
|
|
BASE
|
|
Show details
|
|
4 |
Assessing the Syntactic Capabilities of Transformer-based Multilingual Language Models ...
|
|
|
|
Abstract:
Read paper: https://www.aclanthology.org/2021.findings-acl.333 Abstract: Multilingual Transformer-based language models, usually pretrained on more than 100 languages, have been shown to achieve outstanding results in a wide range of cross-lingual transfer tasks. However, it remains unknown whether the optimization for different languages conditions the capacity of the models to generalize over syntactic structures, and how languages with syntactic phenomena of different complexity are affected. In this work, we explore the syntactic generalization capabilities of the monolingual and multilingual versions of BERT and RoBERTa. More specifically, we evaluate the syntactic generalization potential of the models on English and Spanish tests, comparing the syntactic abilities of monolingual and multilingual models on the same language (English), and of multilingual models on two different languages (English and Spanish). For English, we use the available SyntaxGym test suite; for Spanish, we introduce ...
|
|
Keyword:
Computational Linguistics; Condensed Matter Physics; Deep Learning; Electromagnetism; FOS Physical sciences; Information and Knowledge Engineering; Neural Network; Semantics
|
|
URL: https://underline.io/lecture/26424-assessing-the-syntactic-capabilities-of-transformer-based-multilingual-language-models https://dx.doi.org/10.48448/qse7-hb71
|
|
BASE
|
|
Hide details
|
|
5 |
Assessing the Syntactic Capabilities of Transformer-based Multilingual Language Models ...
|
|
|
|
BASE
|
|
Show details
|
|
6 |
Semantically-oriented text planning for automatic summarization
|
|
|
|
In: TDX (Tesis Doctorals en Xarxa) (2021)
|
|
BASE
|
|
Show details
|
|
7 |
The Third Multilingual Surface Realisation Shared Task (SR'20): Overview and Evaluation Results ...
|
|
|
|
BASE
|
|
Show details
|
|
8 |
The Third Multilingual Surface Realisation Shared Task (SR'20): Overview and Evaluation Results ...
|
|
|
|
BASE
|
|
Show details
|
|
10 |
CollFrEn: Rich Bilingual English--French Collocation Resource ...
|
|
|
|
BASE
|
|
Show details
|
|
11 |
The second multilingual surface realisation shared task (SR'19): Overview and evaluation results
|
|
|
|
In: Mille, Simon orcid:0000-0002-8852-2764 , Anja, Belz, Bohnet, Bernd, Graham, Yvette and Wanner, Leo orcid:0000-0002-9446-3748 (2019) The second multilingual surface realisation shared task (SR'19): Overview and evaluation results. In: 2nd Workshop on Multilingual Surface Realisation (MSR 2019), 3 Nov 2019, Hong Kong, China. (2019)
|
|
BASE
|
|
Show details
|
|
12 |
Collocation classification with unsupervised relation vectors
|
|
|
|
BASE
|
|
Show details
|
|
13 |
A Multimodal Analytics Platform for Journalists Analyzing Large-Scale, Heterogeneous Multilingual, and Multimedia Content
|
|
|
|
In: Front Robot AI (2018)
|
|
BASE
|
|
Show details
|
|
14 |
Towards Distributional Semantics-Based Classification of Collocations for Collocation Dictionaries
|
|
|
|
In: International Journal of Lexicography 30 (2017) 2, 167-186
|
|
IDS OBELEX meta
|
|
Show details
|
|
15 |
Multilingual Surface Realization Using Universal Dependency Trees
|
|
|
|
BASE
|
|
Show details
|
|
16 |
Feature engineering for author profiling and identification: on the relevance of syntax and discourse
|
|
|
|
In: TDX (Tesis Doctorals en Xarxa) (2017)
|
|
BASE
|
|
Show details
|
|
17 |
Processament automàtic de patents: un exercici de terminologia computacional
|
|
|
|
In: Terminàlia; Núm. 16 : desembre 2017; p. 54-56 ; 2013-6692 (2017)
|
|
BASE
|
|
Show details
|
|
18 |
Combining Acoustic and Linguistic Features in Phrase-Oriented Prosody Prediction ...
|
|
|
|
BASE
|
|
Show details
|
|
20 |
Classification of Grammatical Collocation Errors in the Writings of Learners of Spanish ; Clasificación de errores gramaticales colocacionales en textos de estudiantes de español
|
|
|
|
BASE
|
|
Show details
|
|
|
|