1 |
Constrained Density Matching and Modeling for Cross-lingual Alignment of Contextualized Representations ...
|
|
|
|
BASE
|
|
Show details
|
|
2 |
Towards Explainable Evaluation Metrics for Natural Language Generation ...
|
|
|
|
Abstract:
Unlike classical lexical overlap metrics such as BLEU, most current evaluation metrics (such as BERTScore or MoverScore) are based on black-box language models such as BERT or XLM-R. They often achieve strong correlations with human judgments, but recent research indicates that the lower-quality classical metrics remain dominant, one of the potential reasons being that their decision processes are transparent. To foster more widespread acceptance of the novel high-quality metrics, explainability thus becomes crucial. In this concept paper, we identify key properties and propose key goals of explainable machine translation evaluation metrics. We also provide a synthesizing overview over recent approaches for explainable machine translation metrics and discuss how they relate to those goals and properties. Further, we conduct own novel experiments, which (among others) find that current adversarial NLP techniques are unsuitable for automatically identifying limitations of high-quality black-box evaluation ...
|
|
Keyword:
Computation and Language cs.CL; FOS Computer and information sciences; Machine Learning cs.LG
|
|
URL: https://arxiv.org/abs/2203.11131 https://dx.doi.org/10.48550/arxiv.2203.11131
|
|
BASE
|
|
Hide details
|
|
5 |
Global Explainability of BERT-Based Evaluation Metrics by Disentangling along Linguistic Factors ...
|
|
|
|
BASE
|
|
Show details
|
|
6 |
Global Explainability of BERT-Based Evaluation Metrics by Disentangling along Linguistic Factors ...
|
|
|
|
BASE
|
|
Show details
|
|
7 |
The Trans-Ancestral Genomic Architecture of Glycemic Traits
|
|
|
|
In: Nat Genet (2021)
|
|
BASE
|
|
Show details
|
|
9 |
On the Limitations of Cross-lingual Encoders as Exposed by Reference-Free Machine Translation Evaluation ...
|
|
|
|
BASE
|
|
Show details
|
|
10 |
Regularized Attentive Capsule Network for Overlapped Relation Extraction ...
|
|
|
|
BASE
|
|
Show details
|
|
11 |
On the limitations of cross-lingual encoders as exposed by reference-free machine translation evaluation
|
|
|
|
BASE
|
|
Show details
|
|
12 |
On aligning OpenIE extractions with Knowledge Bases: A case study
|
|
|
|
BASE
|
|
Show details
|
|
14 |
tRNA-mediated codon-biased translation in mycobacterial hypoxic persistence
|
|
|
|
In: Nature (2016)
|
|
BASE
|
|
Show details
|
|
16 |
The Violation of the Cooperative Principles in Conan
|
|
|
|
In: Studies in Literature and Language; Vol 11, No 3 (2015): Studies in Literature and Language; 22-25 ; 1923-1563 ; 1923-1555 (2015)
|
|
BASE
|
|
Show details
|
|
17 |
Byronic Hero and the Comparison With Other Heroes
|
|
|
|
In: Studies in Literature and Language; Vol 10, No 6 (2015): Studies in Literature and Language; 29-32 ; 1923-1563 ; 1923-1555 (2015)
|
|
BASE
|
|
Show details
|
|
18 |
An Analysis on how to Overcome the Cultural Barriers in Humor Translation - Application of the Dynamic Equivalence Principle to the Translation of Huang Xi's Jokes
|
|
Zhao, Wei. - : The University of Queensland, School of Languages and Cultures, 2013
|
|
BASE
|
|
Show details
|
|
|
|