1 |
Multilingual Language Model Adaptive Fine-Tuning: A Study on African Languages ...
|
|
|
|
BASE
|
|
Show details
|
|
2 |
Do Acoustic Word Embeddings Capture Phonological Similarity? An Empirical Study ...
|
|
|
|
BASE
|
|
Show details
|
|
3 |
On the Correlation of Context-Aware Language Models With the Intelligibility of Polish Target Words to Czech Readers
|
|
|
|
In: Front Psychol (2021)
|
|
BASE
|
|
Show details
|
|
4 |
On the Interplay Between Fine-tuning and Sentence-level Probing for Linguistic Knowledge in Pre-trained Transformers ...
|
|
|
|
BASE
|
|
Show details
|
|
5 |
A Closer Look at Linguistic Knowledge in Masked Language Models: The Case of Relative Clauses in American English ...
|
|
|
|
Abstract:
Transformer-based language models achieve high performance on various tasks, but we still lack understanding of the kind of linguistic knowledge they learn and rely on. We evaluate three models (BERT, RoBERTa, and ALBERT), testing their grammatical and semantic knowledge by sentence-level probing, diagnostic cases, and masked prediction tasks. We focus on relative clauses (in American English) as a complex phenomenon needing contextual information and antecedent identification to be resolved. Based on a naturalistic dataset, probing shows that all three models indeed capture linguistic knowledge about grammaticality, achieving high performance. Evaluation on diagnostic cases and masked prediction tasks considering fine-grained linguistic knowledge, however, shows pronounced model-specific weaknesses especially on semantic knowledge, strongly impacting models' performance. Our results highlight the importance of (a)model comparison in evaluation task and (b) building up claims of model performance and the ... : Accepted to COLING 2020 ...
|
|
Keyword:
Computation and Language cs.CL; FOS Computer and information sciences
|
|
URL: https://dx.doi.org/10.48550/arxiv.2011.00960 https://arxiv.org/abs/2011.00960
|
|
BASE
|
|
Hide details
|
|
6 |
A Closer Look at Linguistic Knowledge in Masked Language Models: The Case of Relative Clauses in American English ...
|
|
|
|
BASE
|
|
Show details
|
|
|
|