• Refine your search:
  • 
    Keyword
  • 
    Creator / Publisher:
    
    • Elazar, Yanai (14)
    • Goldberg, Yoav (8)
    • Ravfogel, Shauli (7)
    • Jacovi, Alon (3)
    • Muller, Benjamin (3)
    • Sagot, Benoît (3)
    • Seddah, Djamé (3)
    • ANR-15-CE38-0011,SoSweet,Une sociolinguistique de Twitter : liens sociaux et variations linguistiques(2015) (2)
    • ANR-16-CE33-0021,PARSITI,Analyser l'impossible, Traduire l'improbable(2016) (2)
    • ANR-19-P3IA-0001,PRAIRIE,PaRis Artificial Intelligence Research InstitutE(2019) (2)
    •   more
  • 
    Year
  • 
    Medium
  • 
    Type
  • 
    BLLDB-Access

Search in the Catalogues and Directories

All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year Sort by creator [A → Z]' creator [Z → A]' publishing year ↑ (asc)' publishing year ↓ (desc)' title [A → Z]' title [Z → A]' Simple Search Hits 1 – 14 of 14 1 First Align, then Predict: Understanding the Cross-Lingual Ability of Multilingual BERT Muller, Benjamin; Elazar, Yanai; Sagot, Benoît; Seddah, Djamé In: https://hal.inria.fr/hal-03161685 ; 2021 (2021) Abstract: Accepted at EACL 2021 ; Multilingual pretrained language models have demonstrated remarkable zero-shot cross-lingual transfer capabilities. Such transfer emerges by fine-tuning on a task of interest in one language and evaluating on a distinct language, not seen during the fine-tuning. Despite promising results, we still lack a proper understanding of the source of this transfer. Using a novel layer ablation technique and analyses of the model's internal representations, we show that multilingual BERT, a popular multilingual language model, can be viewed as the stacking of two sub-networks: a multilingual encoder followed by a task-specific language-agnostic predictor. While the encoder is crucial for cross-lingual transfer and remains mostly unchanged during fine-tuning, the task predictor has little importance on the transfer and can be reinitialized during fine-tuning. We present extensive experiments with three distinct tasks, seventeen typologically diverse languages and multiple domains to support our hypothesis. Keyword: [INFO.INFO-TT]Computer Science [cs]/Document and Text Processing URL: https://hal.inria.fr/hal-03161685 BASE Hide details 2 First Align, then Predict: Understanding the Cross-Lingual Ability of Multilingual BERT Muller, Benjamin; Elazar, Yanai; Sagot, Benoît... In: EACL 2021 - The 16th Conference of the European Chapter of the Association for Computational Linguistics ; https://hal.inria.fr/hal-03239087 ; EACL 2021 - The 16th Conference of the European Chapter of the Association for Computational Linguistics, Apr 2021, Kyiv / Virtual, Ukraine ; https://2021.eacl.org/ (2021) BASE Show details 3 First Align, then Predict: Understanding the Cross-Lingual Ability of Multilingual BERT ... Muller, Benjamin; Elazar, Yanai; Sagot, Benoît. - : arXiv, 2021 BASE Show details 4 Contrastive Explanations for Model Interpretability ... The 2021 Conference on Empirical Methods in Natural Language Processing 2021; Choi, Yejin; Elazar, Yanai. - : Underline Science Inc., 2021 BASE Show details 5 Measuring and Improving Consistency in Pretrained Language Models ... The 2021 Conference on Empirical Methods in Natural Language Processing 2021; Elazar, Yanai; Goldberg, Yoav. - : Underline Science Inc., 2021 BASE Show details 6 Amnesic Probing: Behavioral Explanation With Amnesic Counterfactuals ... The Joint Conference of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing 2021; Elazar, Yanai; Goldberg, Yoav. - : Underline Science Inc., 2021 BASE Show details 7 It's not Greek to mBERT: Inducing Word-Level Translations from Multilingual BERT ... Gonen, Hila; Ravfogel, Shauli; Elazar, Yanai. - : arXiv, 2020 BASE Show details 8 The Extraordinary Failure of Complement Coercion Crowdsourcing ... Elazar, Yanai; Basmov, Victoria; Ravfogel, Shauli. - : arXiv, 2020 BASE Show details 9 Do Language Embeddings Capture Scales? ... Zhang, Xikun; Ramachandran, Deepak; Tenney, Ian. - : arXiv, 2020 BASE Show details 10 Amnesic Probing: Behavioral Explanation with Amnesic Counterfactuals ... Elazar, Yanai; Ravfogel, Shauli; Jacovi, Alon. - : arXiv, 2020 BASE Show details 11 Evaluating Models' Local Decision Boundaries via Contrast Sets ... Gardner, Matt; Artzi, Yoav; Basmova, Victoria. - : arXiv, 2020 BASE Show details 12 Unsupervised Distillation of Syntactic Information from Contextualized Word Representations ... Ravfogel, Shauli; Elazar, Yanai; Goldberger, Jacob. - : arXiv, 2020 BASE Show details 13 How Large Are Lions? Inducing Distributions over Quantitative Attributes ... Elazar, Yanai; Mahabal, Abhijit; Ramachandran, Deepak. - : arXiv, 2019 BASE Show details 14 Where’s My Head? Definition, Data Set, and Models for Numeric Fused-Head Identification and Resolution Elazar, Yanai; Goldberg, Yoav In: Transactions of the Association for Computational Linguistics, Vol 7, Pp 519-535 (2019) (2019) BASE Show details

Mobile view All Catalogues UB Frankfurt Linguistik 0 IDS Mannheim 0 OLC Linguistik 0 UB Frankfurt Retrokatalog 0 DNB Subject Category Language 0 Institut für Empirische Sprachwissenschaft 0 Leibniz-Centre General Linguistics (ZAS) 0 Bibliographies BLLDB 0 BDSL 0 IDS Bibliografie zur deutschen Grammatik 0 IDS Bibliografie zur Gesprächsforschung 0 IDS Konnektoren im Deutschen 0 IDS Präpositionen im Deutschen 0 IDS OBELEX meta 0 MPI-SHH Linguistics Collection 0 MPI for Psycholinguistics 0 Linked Open Data catalogues Annohub 0 Online resources Link directory 0 Journal directory 0 Database directory 0 Dictionary directory 0 Open access documents BASE 14 Linguistik-Repository 0 IDS Publikationsserver 0 Online dissertations 0 Language Description Heritage 0