DE eng

Search in the Catalogues and Directories

Page: 1 2
Hits 1 – 20 of 21

1
Constrained Density Matching and Modeling for Cross-lingual Alignment of Contextualized Representations ...
Zhao, Wei; Eger, Steffen. - : arXiv, 2022
BASE
Show details
2
Towards Explainable Evaluation Metrics for Natural Language Generation ...
BASE
Show details
3
Better than Average: Paired Evaluation of NLP systems ...
Abstract: Read paper: https://www.aclanthology.org/2021.acl-long.179 Abstract: Evaluation in NLP is usually done by comparing the scores of competing systems independently averaged over a common set of test instances. In this work, we question the use of averages for aggregating evaluation scores into a final number used to decide which system is best, since the average, as well as alternatives such as the median, ignores the pairing arising from the fact that systems are evaluated on the same test instances. We illustrate the importance of taking the instance\hyp level pairing of evaluation scores into account and demonstrate, both theoretically and empirically, the advantages of aggregation methods based on pairwise comparisons, such as the Bradley--Terry (BT) model, a mechanism based on the estimated probability that a given system scores better than another on the test set. By re-evaluating 296 real NLP evaluation setups across four tasks and 18 evaluation metrics, we show that the choice of aggregation mechanism ...
Keyword: Computational Linguistics; Condensed Matter Physics; Deep Learning; Electromagnetism; FOS Physical sciences; Information and Knowledge Engineering; Neural Network; Semantics
URL: https://dx.doi.org/10.48448/azt9-r152
https://underline.io/lecture/25501-better-than-average-paired-evaluation-of-nlp-systems
BASE
Hide details
4
Inducing Language-Agnostic Multilingual Representations ...
BASE
Show details
5
Global Explainability of BERT-Based Evaluation Metrics by Disentangling along Linguistic Factors ...
BASE
Show details
6
Global Explainability of BERT-Based Evaluation Metrics by Disentangling along Linguistic Factors ...
BASE
Show details
7
The Trans-Ancestral Genomic Architecture of Glycemic Traits
In: Nat Genet (2021)
BASE
Show details
8
Inducing Language-Agnostic Multilingual Representations ...
BASE
Show details
9
On the Limitations of Cross-lingual Encoders as Exposed by Reference-Free Machine Translation Evaluation ...
BASE
Show details
10
Regularized Attentive Capsule Network for Overlapped Relation Extraction ...
BASE
Show details
11
On the limitations of cross-lingual encoders as exposed by reference-free machine translation evaluation
Zhao, Wei; Glavaš, Goran; Peyrard, Maxime. - : Association for Computational Linguistics, 2020
BASE
Show details
12
On aligning OpenIE extractions with Knowledge Bases: A case study
Gashteovski, Kiril; Gemulla, Rainer; Kotnis, Bhushan. - : Association for Computational Linguistics (ACL), 2020
BASE
Show details
13
tRNA-mediated codon-biased translation in mycobacterial hypoxic persistence
In: Nature (2016)
BASE
Show details
14
Handbook of research on teaching methods in language translation and interpretation
Cui, Ying (Hrsg.); Zhao, Wei (Hrsg.). - 2015
BLLDB
UB Frankfurt Linguistik
Show details
15
An Analysis on how to Overcome the Cultural Barriers in Humor Translation - Application of the Dynamic Equivalence Principle to the Translation of Huang Xi's Jokes
Zhao, Wei. - : The University of Queensland, School of Languages and Cultures, 2013
BASE
Show details
16
Certificateless undeniable signatures from bilinear maps
In: Information sciences. - New York, NY : Elsevier Science Inc. 199 (2012), 204-215
OLC Linguistik
Show details
17
Understanding classifications : empirical evidence from the American and French wine industries
In: Poetics. - Amsterdam : Elsevier 33 (2005) 3, 179-200
BLLDB
Show details
18
From Natural Language Requirements to Executable Models of Software Components
In: DTIC AND NTIS (2003)
BASE
Show details
19
Computational aeroacoustics of phonation. Part II : effects of flow parameters and ventricular folds
In: Acoustical Society of America. The journal of the Acoustical Society of America. - Melville, NY : AIP 112 (2002) 5,1, 2147-2154
BLLDB
Show details
20
Computational aeroacoustics of phonation. Part I : computational methods and sound generation mechanisms
In: Acoustical Society of America. The journal of the Acoustical Society of America. - Melville, NY : AIP 112 (2002) 5,1, 2134-2146
BLLDB
Show details

Page: 1 2

Catalogues
1
0
1
0
0
0
0
Bibliographies
4
0
0
0
0
0
0
0
0
Linked Open Data catalogues
0
Online resources
0
0
0
0
Open access documents
16
0
0
0
0
© 2013 - 2024 Lin|gu|is|tik | Imprint | Privacy Policy | Datenschutzeinstellungen ändern