• Refine your search:
  • 
    Keyword:
    
    • [INFO.INFO-CL]Computer Science [cs] / Computation and Language [cs.CL] (6)
    • [INFO.INFO-TT]Computer Science [cs] / Document and Text Processing (2)
    • [INFO.INFO-AI]Computer Science [cs] / Artificial Intelligence [cs.AI] (1)
  • 
    Creator / Publisher:
    
    • ANR-15-CE38-0011,SoSweet,Une sociolinguistique de Twitter : liens sociaux et variations linguistiques(2015) (8)
    • ANR-16-CE33-0021,PARSITI,Analyser l'impossible, Traduire l'improbable(2016) (8)
    • Automatic Language Modelling and ANAlysis & Computational Humanities (ALMAnaCH) (8)
    • Inria de Paris (8)
    • Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria) (8)
    • Muller, Benjamin (8)
    • Sagot, Benoît (8)
    • Seddah, Djamé (8)
    • ANR-19-P3IA-0001,PRAIRIE,PaRis Artificial Intelligence Research InstitutE(2019) (7)
    • Sorbonne Université (SU) (4)
    •   more
  • 
    Year:
    
    • 2021 (4)
    • 2020 (3)
    • 2019 (1)
  • 
    Medium
  • 
    Type:
    
    • Article (4)
    • Miscellaneous (4)
  • 
    BLLDB-Access:
    • free (8)
    • subject to license (0)

Search in the Catalogues and Directories

All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year Sort by creator [A → Z]' creator [Z → A]' publishing year ↑ (asc)' publishing year ↓ (desc)' title [A → Z]' title [Z → A]' Simple Search Hits 1 – 8 of 8 1 First Align, then Predict: Understanding the Cross-Lingual Ability of Multilingual BERT Muller, Benjamin; Elazar, Yanai; Sagot, Benoît; Seddah, Djamé In: https://hal.inria.fr/hal-03161685 ; 2021 (2021) Abstract: Accepted at EACL 2021 ; Multilingual pretrained language models have demonstrated remarkable zero-shot cross-lingual transfer capabilities. Such transfer emerges by fine-tuning on a task of interest in one language and evaluating on a distinct language, not seen during the fine-tuning. Despite promising results, we still lack a proper understanding of the source of this transfer. Using a novel layer ablation technique and analyses of the model's internal representations, we show that multilingual BERT, a popular multilingual language model, can be viewed as the stacking of two sub-networks: a multilingual encoder followed by a task-specific language-agnostic predictor. While the encoder is crucial for cross-lingual transfer and remains mostly unchanged during fine-tuning, the task predictor has little importance on the transfer and can be reinitialized during fine-tuning. We present extensive experiments with three distinct tasks, seventeen typologically diverse languages and multiple domains to support our hypothesis. Keyword: [INFO.INFO-TT]Computer Science [cs]/Document and Text Processing URL: https://hal.inria.fr/hal-03161685 BASE Hide details 2 Can Multilingual Language Models Transfer to an Unseen Dialect? A Case Study on North African Arabizi Muller, Benjamin; Sagot, Benoît; Seddah, Djamé In: https://hal.inria.fr/hal-03161677 ; 2021 (2021) BASE Show details 3 First Align, then Predict: Understanding the Cross-Lingual Ability of Multilingual BERT Muller, Benjamin; Elazar, Yanai; Sagot, Benoît... In: EACL 2021 - The 16th Conference of the European Chapter of the Association for Computational Linguistics ; https://hal.inria.fr/hal-03239087 ; EACL 2021 - The 16th Conference of the European Chapter of the Association for Computational Linguistics, Apr 2021, Kyiv / Virtual, Ukraine ; https://2021.eacl.org/ (2021) BASE Show details 4 When Being Unseen from mBERT is just the Beginning: Handling New Languages With Multilingual Language Models Muller, Benjamin; Anastasopoulos, Antonios; Sagot, Benoît... In: NAACL-HLT 2021 - 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies ; https://hal.inria.fr/hal-03251105 ; NAACL-HLT 2021 - 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Jun 2021, Mexico City, Mexico (2021) BASE Show details 5 Building a User-Generated Content North-African Arabizi Treebank: Tackling Hell Seddah, Djamé; Essaidi, Farah; Fethi, Amal... In: ACL 2020 - 58th Annual Meeting of the Association for Computational Linguistics ; https://hal.inria.fr/hal-02889804 ; ACL 2020 - 58th Annual Meeting of the Association for Computational Linguistics, Jul 2020, Seattle / Virtual, Canada. ⟨10.18653/v1/2020.acl-main.107⟩ (2020) BASE Show details 6 CamemBERT: a Tasty French Language Model Martin, Louis; Muller, Benjamin; Ortiz Suárez, Pedro Javier... In: ACL 2020 - 58th Annual Meeting of the Association for Computational Linguistics ; https://hal.inria.fr/hal-02889805 ; ACL 2020 - 58th Annual Meeting of the Association for Computational Linguistics, Jul 2020, Seattle / Virtual, United States. ⟨10.18653/v1/2020.acl-main.645⟩ (2020) BASE Show details 7 When Being Unseen from mBERT is just the Beginning: Handling New Languages With Multilingual Language Models Muller, Benjamin; Anastasopoulos, Antonis; Sagot, Benoît... In: https://hal.inria.fr/hal-03109106 ; 2020 (2020) BASE Show details 8 CamemBERT: a Tasty French Language Model Martin, Louis; Muller, Benjamin; Ortiz Suárez, Pedro Javier... In: https://hal.inria.fr/hal-02445946 ; 2019 (2019) BASE Show details

Mobile view All Catalogues UB Frankfurt Linguistik 0 IDS Mannheim 0 OLC Linguistik 0 UB Frankfurt Retrokatalog 0 DNB Subject Category Language 0 Institut für Empirische Sprachwissenschaft 0 Leibniz-Centre General Linguistics (ZAS) 0 Bibliographies BLLDB 0 BDSL 0 IDS Bibliografie zur deutschen Grammatik 0 IDS Bibliografie zur Gesprächsforschung 0 IDS Konnektoren im Deutschen 0 IDS Präpositionen im Deutschen 0 IDS OBELEX meta 0 MPI-SHH Linguistics Collection 0 MPI for Psycholinguistics 0 Linked Open Data catalogues Annohub 0 Online resources Link directory 0 Journal directory 0 Database directory 0 Dictionary directory 0 Open access documents BASE 8 Linguistik-Repository 0 IDS Publikationsserver 0 Online dissertations 0 Language Description Heritage 0