• Refine your search:
  • 
    Keyword
  • 
    Creator / Publisher:
    
    • Seddah, Djamé (17)
    • Sagot, Benoît (10)
    • ANR-16-CE33-0021,PARSITI,Analyser l'impossible, Traduire l'improbable(2016) (9)
    • Automatic Language Modelling and ANAlysis & Computational Humanities (ALMAnaCH) (9)
    • Inria de Paris (9)
    • Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria) (9)
    • ANR-19-P3IA-0001,PRAIRIE,PaRis Artificial Intelligence Research InstitutE(2019) (5)
    • Muller, Benjamin (5)
    • ANR-15-CE38-0011,SoSweet,Une sociolinguistique de Twitter : liens sociaux et variations linguistiques(2015) (4)
    • Bouma, Gosse (4)
    •   more
  • 
    Year:
    
    • 2021 (17)
  • 
    Medium
  • 
    Type
  • 
    BLLDB-Access

Search in the Catalogues and Directories

All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year Sort by creator [A → Z]' creator [Z → A]' publishing year ↑ (asc)' publishing year ↓ (desc)' title [A → Z]' title [Z → A]' Simple Search Hits 1 – 17 of 17 1 First Align, then Predict: Understanding the Cross-Lingual Ability of Multilingual BERT Muller, Benjamin; Elazar, Yanai; Sagot, Benoît... In: https://hal.inria.fr/hal-03161685 ; 2021 (2021) BASE Show details 2 Can Multilingual Language Models Transfer to an Unseen Dialect? A Case Study on North African Arabizi Muller, Benjamin; Sagot, Benoît; Seddah, Djamé In: https://hal.inria.fr/hal-03161677 ; 2021 (2021) BASE Show details 3 First Align, then Predict: Understanding the Cross-Lingual Ability of Multilingual BERT Muller, Benjamin; Elazar, Yanai; Sagot, Benoît... In: EACL 2021 - The 16th Conference of the European Chapter of the Association for Computational Linguistics ; https://hal.inria.fr/hal-03239087 ; EACL 2021 - The 16th Conference of the European Chapter of the Association for Computational Linguistics, Apr 2021, Kyiv / Virtual, Ukraine ; https://2021.eacl.org/ (2021) BASE Show details 4 When Being Unseen from mBERT is just the Beginning: Handling New Languages With Multilingual Language Models Muller, Benjamin; Anastasopoulos, Antonios; Sagot, Benoît... In: NAACL-HLT 2021 - 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies ; https://hal.inria.fr/hal-03251105 ; NAACL-HLT 2021 - 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Jun 2021, Mexico City, Mexico (2021) BASE Show details 5 PAGnol: An Extra-Large French Generative Model Launay, Julien; Tommasone, Giuseppe Luca; Pannier, Baptiste; Boniface, François; Chatelain, Amélie; Cappelli, Alessandro; Poli, Iacopo; Seddah, Djamé In: https://hal.inria.fr/hal-03540159 ; [Research Report] LightON. 2021 (2021) Abstract: Access to large pre-trained models of varied architectures, in many different languages, is central to the democratization of NLP. We introduce PAGnol, a collection of French GPT models. Using scaling laws, we efficiently train PAGnol-XL (1.5B parameters) with the same computational budget as CamemBERT, a model 13 times smaller. PAGnol-XL is the largest model trained to date for the French language. We plan to train increasingly large and performing versions of PAGnol, exploring the capabilities of French extreme-scale models. For this first release, we focus on the pre-training and scaling calculations underlining PAGnol. We fit a scaling law for compute for the French language, and compare it with its English counterpart. We find the pre-training dataset significantly conditions the quality of the outputs, with common datasets such as OSCAR leading to low-quality offensive text. We evaluate our models on discriminative and generative tasks in French, comparing to other state-of-the-art French and multilingual models, and reaching the state of the art in the abstract summarization task. Our research was conducted on the public GENCI Jean Zay supercomputer, and our models up to the Large are made publicly available. Keyword: [INFO.INFO-TT]Computer Science [cs]/Document and Text Processing URL: https://hal.inria.fr/hal-03540159 BASE Hide details 6 Synthetic Data Augmentation for Zero-Shot Cross-Lingual Question Answering Riabi, Arij; Scialom, Thomas; Keraron, Rachel... In: https://hal.inria.fr/hal-03109187 ; 2021 (2021) BASE Show details 7 Noisy UGC Translation at the Character Level: Revisiting Open-Vocabulary Capabilities and Robustness of Char-Based Models Núñez, José Carlos Rosales; Wisniewski, Guillaume; Seddah, Djamé In: W-NUT 2021 - 7th Workshop on Noisy User-generated Text (colocated with EMNLP 2021) ; https://hal.inria.fr/hal-03540174 ; W-NUT 2021 - 7th Workshop on Noisy User-generated Text (colocated with EMNLP 2021), Association for computational linguistics, Nov 2021, Punta Cana, Dominican Republic (2021) BASE Show details 8 Understanding the Impact of UGC Specificities on Translation Quality Rosales Nunez, José Carlos; Seddah, Djamé; Wisniewski, Guillaume In: W-NUT 2021 - Seventh Workshop on Noisy User-generated Text (colocated with EMNLP 2021) ; https://hal.inria.fr/hal-03540175 ; W-NUT 2021 - Seventh Workshop on Noisy User-generated Text (colocated with EMNLP 2021), association for computational linguistics, Nov 2021, Punta Cana, Dominican Republic (2021) BASE Show details 9 Challenging the Semi-Supervised VAE Framework for Text Classification Felhi, Ghazi; Roux, Joseph Le; Seddah, Djamé In: Second Workshop on Insights from Negative Results in NLP (colocated with EMNLP) ; https://hal.inria.fr/hal-03540081 ; Second Workshop on Insights from Negative Results in NLP (colocated with EMNLP), Nov 2021, Punta Cana, Dominican Republic ; https://insights-workshop.github.io/2021/ (2021) BASE Show details 10 Deep Sequoia corpus - PARSEME-FR corpus - FrSemCor Barque, Lucie; Candito, Marie; Constant, Matthieu. - : ANR, 2021 BASE Show details 11 IWPT 2021 Shared Task Data and System Outputs Zeman, Daniel; Bouma, Gosse; Seddah, Djamé. - : Universal Dependencies Consortium, 2021 BASE Show details 12 Universal Dependencies 2.9 Zeman, Daniel; Nivre, Joakim; Abrams, Mitchell. - : Universal Dependencies Consortium, 2021 BASE Show details 13 Universal Dependencies 2.8.1 Zeman, Daniel; Nivre, Joakim; Abrams, Mitchell. - : Universal Dependencies Consortium, 2021 BASE Show details 14 Universal Dependencies 2.8 Zeman, Daniel; Nivre, Joakim; Abrams, Mitchell. - : Universal Dependencies Consortium, 2021 BASE Show details 15 Can Character-based Language Models Improve Downstream Task Performance in Low-Resource and Noisy Language Scenarios? ... Riabi, Arij; Sagot, Benoît; Seddah, Djamé. - : arXiv, 2021 BASE Show details 16 First Align, then Predict: Understanding the Cross-Lingual Ability of Multilingual BERT ... Muller, Benjamin; Elazar, Yanai; Sagot, Benoît. - : arXiv, 2021 BASE Show details 17 Synthetic Data Augmentation for Zero-Shot Cross-Lingual Question Answering ... The 2021 Conference on Empirical Methods in Natural Language Processing 2021; ., Jacopo; Keraron, Rachel. - : Underline Science Inc., 2021 BASE Show details

Mobile view All Catalogues UB Frankfurt Linguistik 0 IDS Mannheim 0 OLC Linguistik 0 UB Frankfurt Retrokatalog 0 DNB Subject Category Language 0 Institut für Empirische Sprachwissenschaft 0 Leibniz-Centre General Linguistics (ZAS) 0 Bibliographies BLLDB 0 BDSL 0 IDS Bibliografie zur deutschen Grammatik 0 IDS Bibliografie zur Gesprächsforschung 0 IDS Konnektoren im Deutschen 0 IDS Präpositionen im Deutschen 0 IDS OBELEX meta 0 MPI-SHH Linguistics Collection 0 MPI for Psycholinguistics 0 Linked Open Data catalogues Annohub 0 Online resources Link directory 0 Journal directory 0 Database directory 0 Dictionary directory 0 Open access documents BASE 17 Linguistik-Repository 0 IDS Publikationsserver 0 Online dissertations 0 Language Description Heritage 0