• Refine your search:
  • 
    Keyword:
    
    • [INFO.INFO-CL]Computer Science [cs] / Computation and Language [cs.CL] (12)
    • [SHS.LANGUE]Humanities and Social Sciences / Linguistics (3)
    • 400 Sprache, Linguistik (2)
    • French (2)
    • Language Modeling (2)
    • Annotation stand-off (1)
    • BERT (1)
    • Balanced French Corpus (1)
    • Common Crawl (1)
    • Corpus creation (1)
    •   more
  • 
    Creator / Publisher:
    
    • Sagot, Benoît (15)
    • Automatic Language Modelling and ANAlysis & Computational Humanities (ALMAnaCH) (13)
    • Inria de Paris (13)
    • Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria) (13)
    • Ortiz Suárez, Pedro Javier (13)
    • ANR-18-CE38-0003,BASNUM,Numérisation et analyse du Dictionnaire universel de Basnage de Beauval: lexicographie et réseaux scientifiques(2018) (12)
    • Romary, Laurent (11)
    • Sorbonne Université (SU) (11)
    • ANR-19-P3IA-0001,PRAIRIE,PaRis Artificial Intelligence Research InstitutE(2019) (7)
    • Muller, Benjamin (4)
    •   more
  • 
    Year:
    
    • 2022 (2)
    • 2021 (4)
    • 2020 (5)
    • 2019 (4)
  • 
    Medium
  • 
    Type:
    
    • Article (12)
    • Miscellaneous (3)
  • 
    BLLDB-Access:
    • free (15)
    • subject to license (0)

Search in the Catalogues and Directories

All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year Sort by creator [A → Z]' creator [Z → A]' publishing year ↑ (asc)' publishing year ↓ (desc)' title [A → Z]' title [Z → A]' Simple Search Hits 1 – 15 of 15 1 From FreEM to D'AlemBERT ; From FreEM to D'AlemBERT: a Large Corpus and a Language Model for Early Modern French Gabay, Simon; Ortiz Suarez, Pedro; Bartz, Alexandre... In: Proceedings of the 13th Language Resources and Evaluation Conference ; https://hal.inria.fr/hal-03596653 ; Proceedings of the 13th Language Resources and Evaluation Conference, European Language Resources Association, Jun 2022, Marseille, France (2022) BASE Show details 2 Towards a Cleaner Document-Oriented Multilingual Crawled Corpus Abadji, Julien; Ortiz Suarez, Pedro; Romary, Laurent... In: https://hal.inria.fr/hal-03536361 ; 2022 (2022) BASE Show details 3 Ungoliant: An Optimized Pipeline for the Generation of a Very Large-Scale Multilingual Web Corpus Abadji, Julien; Ortiz Suárez, Pedro Javier; Romary, Laurent... In: CMLC 2021 - 9th Workshop on Challenges in the Management of Large Corpora ; https://hal.inria.fr/hal-03301590 ; CMLC 2021 - 9th Workshop on Challenges in the Management of Large Corpora, Jul 2021, Limerick / Virtual, Ireland. ⟨10.14618/ids-pub-10468⟩ ; https://www.cl2021.org/ (2021) BASE Show details 4 Quality at a Glance: An Audit of Web-Crawled Multilingual Datasets Caswell, Isaac; Kreutzer, Julia; Wang, Lisa... In: https://hal.inria.fr/hal-03177623 ; 2021 (2021) BASE Show details 5 Expanding the content model of annotationBlock Bartz, Alexandre; Janes, Juliette; Romary, Laurent... In: Next Gen TEI, 2021 - TEI Conference and Members’ Meeting ; https://hal.archives-ouvertes.fr/hal-03380805 ; Next Gen TEI, 2021 - TEI Conference and Members’ Meeting, Oct 2021, Virtual, United States (2021) BASE Show details 6 Ungoliant: An optimized pipeline for the generation of a very large-scale multilingual web corpus ... Abadji, Julien; Ortiz Suárez, Pedro Javier; Romary, Laurent. - : Leibniz-Institut für Deutsche Sprache, 2021 BASE Show details 7 Establishing a New State-of-the-Art for French Named Entity Recognition Ortiz Suárez, Pedro Javier; Dupont, Yoann; Muller, Benjamin... In: LREC 2020 - 12th Language Resources and Evaluation Conference ; https://hal.inria.fr/hal-02617950 ; LREC 2020 - 12th Language Resources and Evaluation Conference, May 2020, Marseille, France ; http://www.lrec-conf.org (2020) BASE Show details 8 Building a User-Generated Content North-African Arabizi Treebank: Tackling Hell Seddah, Djamé; Essaidi, Farah; Fethi, Amal... In: ACL 2020 - 58th Annual Meeting of the Association for Computational Linguistics ; https://hal.inria.fr/hal-02889804 ; ACL 2020 - 58th Annual Meeting of the Association for Computational Linguistics, Jul 2020, Seattle / Virtual, Canada. ⟨10.18653/v1/2020.acl-main.107⟩ (2020) BASE Show details 9 CamemBERT: a Tasty French Language Model Martin, Louis; Muller, Benjamin; Ortiz Suárez, Pedro Javier... In: ACL 2020 - 58th Annual Meeting of the Association for Computational Linguistics ; https://hal.inria.fr/hal-02889805 ; ACL 2020 - 58th Annual Meeting of the Association for Computational Linguistics, Jul 2020, Seattle / Virtual, United States. ⟨10.18653/v1/2020.acl-main.645⟩ (2020) BASE Show details 10 A Monolingual Approach to Contextualized Word Embeddings for Mid-Resource Languages Ortiz Suárez, Pedro Javier; Romary, Laurent; Sagot, Benoît In: ACL 2020 - 58th Annual Meeting of the Association for Computational Linguistics ; https://hal.inria.fr/hal-02863875 ; ACL 2020 - 58th Annual Meeting of the Association for Computational Linguistics, Jul 2020, Seattle / Virtual, United States. ⟨10.18653/v1/2020.acl-main.156⟩ ; https://acl2020.org (2020) BASE Show details 11 French Contextualized Word-Embeddings with a sip of CaBeRnet: a New French Balanced Reference Corpus Fabre, Murielle; Ortiz Suárez, Pedro Javier; Sagot, Benoît... In: CMLC-8 - 8th Workshop on the Challenges in the Management of Large Corpora ; https://hal.inria.fr/hal-02678358 ; CMLC-8 - 8th Workshop on the Challenges in the Management of Large Corpora, May 2020, Marseille, France ; https://lrec2020.lrec-conf.org/media/proceedings/Workshops/Books/CMLC-8book.pdf (2020) BASE Show details 12 Asynchronous Pipeline for Processing Huge Corpora on Medium to Low Resource Infrastructures Ortiz Suárez, Pedro Javier; Sagot, Benoît; Romary, Laurent In: 7th Workshop on the Challenges in the Management of Large Corpora (CMLC-7) ; https://hal.inria.fr/hal-02148693 ; 7th Workshop on the Challenges in the Management of Large Corpora (CMLC-7), Jul 2019, Cardiff, United Kingdom. ⟨10.14618/IDS-PUB-9021⟩ (2019) Abstract: International audience ; Common Crawl is a considerably large, heterogeneous multilingual corpus comprised of crawled documents from the internet, surpassing 20TB of data and distributed as a set of more than 50 thousand plain text files where each contains many documents written in a wide variety of languages. Even though each document has a metadata block associated to it, this data lacks any information about the language in which each document is written, making it extremely difficult to use Common Crawl for monolingual applications. We propose a general, highly parallel, multithreaded pipeline to clean and classify Common Crawl by language; we specifically design it so that it runs efficiently on medium to low resource infrastructures where I/O speeds are the main constraint. We develop the pipeline so that it can be easily reapplied to any kind of heterogeneous corpus and so that it can be parameterised to a wide range of infrastructures. We also distribute a 6.3TB version of Common Crawl, filtered, classified by language, shuffled at line level in order to avoid copyright issues, and ready to be used for NLP applications. Keyword: [INFO.INFO-CL]Computer Science [cs]/Computation and Language [cs.CL] URL: https://hal.inria.fr/hal-02148693/file/Asynchronous_Pipeline_for_Processing_Huge_Corpora_on_Medium_to_Low_Resource_Infrastructures.pdf https://doi.org/10.14618/IDS-PUB-9021 https://hal.inria.fr/hal-02148693 https://hal.inria.fr/hal-02148693/document BASE Hide details 13 CamemBERT: a Tasty French Language Model Martin, Louis; Muller, Benjamin; Ortiz Suárez, Pedro Javier... In: https://hal.inria.fr/hal-02445946 ; 2019 (2019) BASE Show details 14 Preparing the Dictionnaire Universel for Automatic Enrichment Ortiz Suárez, Pedro Javier; Romary, Laurent; Sagot, Benoît In: 10th International Conference on Historical Lexicography and Lexicology (ICHLL) ; https://hal.inria.fr/hal-02131598 ; 10th International Conference on Historical Lexicography and Lexicology (ICHLL), Jun 2019, Leeuwarden, Netherlands ; https://easychair.org/smart-program/ICHLL-10/ (2019) BASE Show details 15 Asynchronous pipelines for processing huge corpora on medium to low resource infrastructures ... Ortiz Suárez, Pedro Javier; Sagot, Benoît; Romary, Laurent. - : Leibniz-Institut für Deutsche Sprache, 2019 BASE Show details

Mobile view All Catalogues UB Frankfurt Linguistik 0 IDS Mannheim 0 OLC Linguistik 0 UB Frankfurt Retrokatalog 0 DNB Subject Category Language 0 Institut für Empirische Sprachwissenschaft 0 Leibniz-Centre General Linguistics (ZAS) 0 Bibliographies BLLDB 0 BDSL 0 IDS Bibliografie zur deutschen Grammatik 0 IDS Bibliografie zur Gesprächsforschung 0 IDS Konnektoren im Deutschen 0 IDS Präpositionen im Deutschen 0 IDS OBELEX meta 0 MPI-SHH Linguistics Collection 0 MPI for Psycholinguistics 0 Linked Open Data catalogues Annohub 0 Online resources Link directory 0 Journal directory 0 Database directory 0 Dictionary directory 0 Open access documents BASE 15 Linguistik-Repository 0 IDS Publikationsserver 0 Online dissertations 0 Language Description Heritage 0