4 |
Beyond the English Web: Zero-Shot Cross-Lingual and Lightweight Monolingual Classification of Registers ...
|
|
|
|
BASE
|
|
Show details
|
|
5 |
Deep learning for sentence clustering in essay grading support ...
|
|
|
|
BASE
|
|
Show details
|
|
9 |
The birth of Romanian BERT ...
|
|
|
|
Abstract:
Large-scale pretrained language models have become ubiquitous in Natural Language Processing. However, most of these models are available either in high-resource languages, in particular English, or as multilingual models that compromise performance on individual languages for coverage. This paper introduces Romanian BERT, the first purely Romanian transformer-based language model, pretrained on a large text corpus. We discuss corpus composition and cleaning, the model training process, as well as an extensive evaluation of the model on various Romanian datasets. We open source not only the model itself, but also a repository that contains information on how to obtain the corpus, fine-tune and use this model in production (with practical examples), and how to fully replicate the evaluation process. ... : 5 pages (4 + reference page), accepted in Findings of EMNLP 2020 ...
|
|
Keyword:
Computation and Language cs.CL; FOS Computer and information sciences
|
|
URL: https://arxiv.org/abs/2009.08712 https://dx.doi.org/10.48550/arxiv.2009.08712
|
|
BASE
|
|
Hide details
|
|
10 |
WikiBERT models: deep transfer learning for many languages ...
|
|
|
|
BASE
|
|
Show details
|
|
11 |
Exploring Cross-sentence Contexts for Named Entity Recognition with BERT ...
|
|
|
|
BASE
|
|
Show details
|
|
12 |
Universal Dependencies v2: An Evergrowing Multilingual Treebank Collection ...
|
|
|
|
BASE
|
|
Show details
|
|
13 |
Dependency parsing of biomedical text with BERT
|
|
|
|
In: BMC Bioinformatics (2020)
|
|
BASE
|
|
Show details
|
|
17 |
A neural classification method for supporting the creation of BioVerbNet ...
|
|
|
|
BASE
|
|
Show details
|
|
18 |
A neural classification method for supporting the creation of BioVerbNet ...
|
|
|
|
BASE
|
|
Show details
|
|
19 |
A neural classification method for supporting the creation of BioVerbNet ...
|
|
|
|
BASE
|
|
Show details
|
|
20 |
A Neural Classification Method for Supporting the Creation of BioVerbNet ...
|
|
|
|
BASE
|
|
Show details
|
|
|
|