| 1 |
Towards a Cleaner Document-Oriented Multilingual Crawled Corpus ...
|
|
|
|
BASE
|
|
Show details
|
|
|
| 2 |
MOR Digital: The Advent of a New Lexicographical Portuguese Project
|
|
|
|
In: eLex 2021 - Seventh biennial conference on electronic lexicography ; https://hal.inria.fr/hal-03195362 ; eLex 2021 - Seventh biennial conference on electronic lexicography, Jul 2021, Brno, Czech Republic ; https://elex.link/elex2021/ (2021)
|
|
BASE
|
|
Show details
|
|
|
| 3 |
MORDigital: The Advent of a New Lexicographical Portuguese Project
|
|
|
|
In: eLex 2021 - Seventh biennial conference on electronic lexicography ; https://hal.inria.fr/hal-03195362 ; eLex 2021 - Seventh biennial conference on electronic lexicography, Jul 2021, Brno, Czech Republic ; https://elex.link/elex2021/ (2021)
|
|
BASE
|
|
Show details
|
|
|
| 4 |
Ungoliant: An Optimized Pipeline for the Generation of a Very Large-Scale Multilingual Web Corpus
|
|
|
|
In: CMLC 2021 - 9th Workshop on Challenges in the Management of Large Corpora ; https://hal.inria.fr/hal-03301590 ; CMLC 2021 - 9th Workshop on Challenges in the Management of Large Corpora, Jul 2021, Limerick / Virtual, Ireland. ⟨10.14618/ids-pub-10468⟩ ; https://www.cl2021.org/ (2021)
|
|
Abstract:
International audience ; Since the introduction of large language models in Natural Language Processing, large raw corpora have played a crucial role in Computational Linguistics. However, most of these large raw corpora are either available only for English or not available to the general public due to copyright issues. Nevertheless, there are some examples of freely available multilingual corpora for training Deep Learning NLP models, such as the OSCAR and Paracrawl corpora. However, they have quality issues, especially for low-resource languages. Moreover, recreating or updating these corpora is very complex. In this work, we try to reproduce and improve the goclassy pipeline used to create the OSCAR corpus. We propose a new pipeline that is faster, modular, parameterizable, and well documented. We use it to create a corpus similar to OSCAR but larger and based on recent data.Also, unlike OSCAR, the metadata information is at the document level. We release our pipeline under an open source license and publish the corpus under a research-only license.
|
|
Keyword:
[INFO.INFO-CL]Computer Science [cs]/Computation and Language [cs.CL]
|
|
URL: https://hal.inria.fr/hal-03301590/file/Ungoliant___CMLC_9-2.pdf
https://doi.org/10.14618/ids-pub-10468
https://hal.inria.fr/hal-03301590/document
https://hal.inria.fr/hal-03301590
|
|
BASE
|
|
Hide details
|
|
|
| 5 |
Building, Encoding, and Annotating a Corpus of Parliamentary Debates in XML-TEI: A Cross-Linguistic Account
|
|
|
|
In: ISSN: 2162-5603 ; EISSN: 2162-5603 ; Journal of the Text Encoding Initiative ; https://halshs.archives-ouvertes.fr/halshs-03097333 ; Journal of the Text Encoding Initiative, TEI Consortium, 2021 (2021)
|
|
BASE
|
|
Show details
|
|
|
| 6 |
Expanding the content model of annotationBlock
|
|
|
|
In: Next Gen TEI, 2021 - TEI Conference and Members’ Meeting ; https://hal.archives-ouvertes.fr/hal-03380805 ; Next Gen TEI, 2021 - TEI Conference and Members’ Meeting, Oct 2021, Virtual, United States (2021)
|
|
BASE
|
|
Show details
|
|
|
| 7 |
From disparate disciplines to unity in diversity How the PARTHENOS project has brought European humanities Research Infrastructures together
|
|
|
|
In: ISSN: 1753-8548 ; EISSN: 1755-1706 ; International Journal of Humanities and Arts Computing ; https://hal.inria.fr/hal-03402145 ; International Journal of Humanities and Arts Computing, Edinburgh University Press, 2021, 15 (1-2), pp.101-116. ⟨10.3366/ijhac.2021.0264⟩ (2021)
|
|
BASE
|
|
Show details
|
|
|
| 8 |
MORDigital ; The advent of a new lexicographical portuguese project
|
|
|
|
BASE
|
|
Show details
|
|
|
| 9 |
Ungoliant: An optimized pipeline for the generation of a very large-scale multilingual web corpus ...
|
|
|
|
BASE
|
|
Show details
|
|
|
| 10 |
Modelling Etymology in LMF/TEI: The 'Grande Dicionário Houaiss da Língua Portuguesa' Dictionary as a Use Case. ...
|
|
|
|
BASE
|
|
Show details
|
|
|
| 11 |
Modelling Etymology in LMF/TEI: The 'Grande Dicionário Houaiss da Língua Portuguesa' Dictionary as a Use Case. ...
|
|
|
|
BASE
|
|
Show details
|
|
|
| 12 |
Establishing a New State-of-the-Art for French Named Entity Recognition
|
|
|
|
In: LREC 2020 - 12th Language Resources and Evaluation Conference ; https://hal.inria.fr/hal-02617950 ; LREC 2020 - 12th Language Resources and Evaluation Conference, May 2020, Marseille, France ; http://www.lrec-conf.org (2020)
|
|
BASE
|
|
Show details
|
|
|
| 13 |
Modelling Etymology in LMF/TEI: The Grande Dicionário Houaiss da Língua Portuguesa Dictionary as a Use Case
|
|
|
|
In: LREC 2020 - 12th Language Resources and Evaluation Conference ; https://hal.inria.fr/hal-02618067 ; LREC 2020 - 12th Language Resources and Evaluation Conference, May 2020, Marseille, France ; http://www.lrec-conf.org (2020)
|
|
BASE
|
|
Show details
|
|
|
| 14 |
CamemBERT: a Tasty French Language Model
|
|
|
|
In: ACL 2020 - 58th Annual Meeting of the Association for Computational Linguistics ; https://hal.inria.fr/hal-02889805 ; ACL 2020 - 58th Annual Meeting of the Association for Computational Linguistics, Jul 2020, Seattle / Virtual, United States. ⟨10.18653/v1/2020.acl-main.645⟩ (2020)
|
|
BASE
|
|
Show details
|
|
|
| 15 |
A Monolingual Approach to Contextualized Word Embeddings for Mid-Resource Languages
|
|
|
|
In: ACL 2020 - 58th Annual Meeting of the Association for Computational Linguistics ; https://hal.inria.fr/hal-02863875 ; ACL 2020 - 58th Annual Meeting of the Association for Computational Linguistics, Jul 2020, Seattle / Virtual, United States. ⟨10.18653/v1/2020.acl-main.156⟩ ; https://acl2020.org (2020)
|
|
BASE
|
|
Show details
|
|
|
| 16 |
Modelling Etymology in LMF/TEI ; The Grande Dicionário Houaiss da Língua Portuguesa Dictionary as a Use Case
|
|
|
|
BASE
|
|
Show details
|
|
|
| 17 |
A Monolingual Approach to Contextualized Word Embeddings for Mid-Resource Languages ...
|
|
|
|
BASE
|
|
Show details
|
|
|
| 18 |
How OCR Performance can Impact on the Automatic Extraction of Dictionary Content Structures
|
|
|
|
In: 19th annual Conference and Members’ Meeting of the Text Encoding Initiative Consortium (TEI) -What is text, really? TEI and beyond ; https://hal.archives-ouvertes.fr/hal-02263276 ; 19th annual Conference and Members’ Meeting of the Text Encoding Initiative Consortium (TEI) -What is text, really? TEI and beyond, Sep 2019, Graz, Austria (2019)
|
|
BASE
|
|
Show details
|
|
|
| 19 |
Asynchronous Pipeline for Processing Huge Corpora on Medium to Low Resource Infrastructures
|
|
|
|
In: 7th Workshop on the Challenges in the Management of Large Corpora (CMLC-7) ; https://hal.inria.fr/hal-02148693 ; 7th Workshop on the Challenges in the Management of Large Corpora (CMLC-7), Jul 2019, Cardiff, United Kingdom. ⟨10.14618/IDS-PUB-9021⟩ (2019)
|
|
BASE
|
|
Show details
|
|
|
| 20 |
Nénufar: Modelling a Diachronic Collection of Dictionary Editions as a Computational Lexical Resource
|
|
|
|
In: ELEX 2019: smart lexicography ; https://hal.inria.fr/hal-02272978 ; ELEX 2019: smart lexicography, Oct 2019, Sintra, Portugal (2019)
|
|
BASE
|
|
Show details
|
|
|
|
|
