• Refine your search:
  • 
    Keyword:
    
    • [INFO.INFO-CL]Computer Science [cs] / Computation and Language [cs.CL] (2)
    • 400 Sprache, Linguistik (1)
    • Common Crawl (1)
    • Computation and Language cs.CL (1)
    • FOS Computer and information sciences (1)
    • Language Modeling (1)
    • Web corpus (1)
  • 
    Creator / Publisher:
    
    • Abadji, Julien (5)
    • Romary, Laurent (5)
    • Sagot, Benoît (5)
    • ANR-18-CE38-0003,BASNUM,Numérisation et analyse du Dictionnaire universel de Basnage de Beauval: lexicographie et réseaux scientifiques(2018) (2)
    • ANR-19-P3IA-0001,PRAIRIE,PaRis Artificial Intelligence Research InstitutE(2019) (2)
    • Automatic Language Modelling and ANAlysis & Computational Humanities (ALMAnaCH) (2)
    • Inria de Paris (2)
    • Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria) (2)
    • Ortiz Suárez, Pedro Javier (2)
    • Sorbonne Université (SU) (2)
    •   more
  • 
    Year
  • 
    Medium
  • 
    Type
  • 
    BLLDB-Access:
    • free (5)
    • subject to license (0)

Search in the Catalogues and Directories

All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year Sort by creator [A → Z]' creator [Z → A]' publishing year ↑ (asc)' publishing year ↓ (desc)' title [A → Z]' title [Z → A]' Simple Search Hits 1 – 5 of 5 1 Towards a Cleaner Document-Oriented Multilingual Crawled Corpus Abadji, Julien; Ortiz Suarez, Pedro; Romary, Laurent; Sagot, Benoît In: https://hal.inria.fr/hal-03536361 ; 2022 (2022) Abstract: 12 pages, 6 figures, 2 tables ; The need for raw large raw corpora has dramatically increased in recent years with the introduction of transfer learning and semi-supervised learning methods to Natural Language Processing. And while there have been some recent attempts to manually curate the amount of data necessary to train large language models, the main way to obtain this data is still through automatic web crawling. In this paper we take the existing multilingual web corpus OSCAR and its pipeline Ungoliant that extracts and classifies data from Common Crawl at the line level, and propose a set of improvements and automatic annotations in order to produce a new document-oriented version of OSCAR that could prove more suitable to pre-train large generative language models as well as hopefully other applications in Natural Language Processing and Digital Humanities. Keyword: [INFO.INFO-CL]Computer Science [cs]/Computation and Language [cs.CL]; Common Crawl; Language Modeling; Web corpus URL: https://hal.inria.fr/hal-03536361 BASE Hide details 2 Towards a Cleaner Document-Oriented Multilingual Crawled Corpus ... Abadji, Julien; Suarez, Pedro Ortiz; Romary, Laurent. - : arXiv, 2022 BASE Show details 3 Ungoliant: An Optimized Pipeline for the Generation of a Very Large-Scale Multilingual Web Corpus Abadji, Julien; Ortiz Suárez, Pedro Javier; Romary, Laurent... In: CMLC 2021 - 9th Workshop on Challenges in the Management of Large Corpora ; https://hal.inria.fr/hal-03301590 ; CMLC 2021 - 9th Workshop on Challenges in the Management of Large Corpora, Jul 2021, Limerick / Virtual, Ireland. ⟨10.14618/ids-pub-10468⟩ ; https://www.cl2021.org/ (2021) BASE Show details 4 Ungoliant: An optimized pipeline for the generation of a very large-scale multilingual web corpus ... Abadji, Julien; Ortiz Suárez, Pedro Javier; Romary, Laurent. - : Leibniz-Institut für Deutsche Sprache, 2021 BASE Show details 5 Ungoliant: An optimized pipeline for the generation of a very large-scale multilingual web corpus [Online resource] Abadji, Julien; Ortiz, Pedro Javier Ortiz; Romary, Laurent. IDS-Repository Show details

Mobile view All Catalogues UB Frankfurt Linguistik 0 IDS Mannheim 0 OLC Linguistik 0 UB Frankfurt Retrokatalog 0 DNB Subject Category Language 0 Institut für Empirische Sprachwissenschaft 0 Leibniz-Centre General Linguistics (ZAS) 0 Bibliographies BLLDB 0 BDSL 0 IDS Bibliografie zur deutschen Grammatik 0 IDS Bibliografie zur Gesprächsforschung 0 IDS Konnektoren im Deutschen 0 IDS Präpositionen im Deutschen 0 IDS OBELEX meta 0 MPI-SHH Linguistics Collection 0 MPI for Psycholinguistics 0 Linked Open Data catalogues Annohub 0 Online resources Link directory 0 Journal directory 0 Database directory 0 Dictionary directory 0 Open access documents BASE 4 Linguistik-Repository 0 IDS Publikationsserver 1 Online dissertations 0 Language Description Heritage 0