| 1 |
Pushing the right buttons: adversarial evaluation of quality estimation
|
|
|
|
In: Proceedings of the Sixth Conference on Machine Translation ; 625 ; 638 (2022)
|
|
BASE
|
|
Show details
|
|
|
| 2 |
Reverse racism: the construction of a slip narrative ; Racismo inverso: la construcción de una narrativa deslizante ; Racismo reverso: a construção de uma narrativa de esquiva
|
|
|
|
In: Signótica; Vol. 34 (2022) ; Signótica; v. 34 (2022) ; 2316-3690 ; 0103-7250 (2022)
|
|
BASE
|
|
Show details
|
|
|
| 6 |
When Does Translation Require Context? A Data-driven, Multilingual Exploration ...
|
|
|
|
Abstract:
Although proper handling of discourse phenomena significantly contributes to the quality of machine translation (MT), common translation quality metrics do not adequately capture them. Recent works in context-aware MT attempt to target a small set of these phenomena during evaluation. In this paper, we propose a new metric, P-CXMI, which allows us to identify translations that require context systematically and confirm the difficulty of previously studied phenomena as well as uncover new ones that have not been addressed in previous work. We then develop the Multilingual Discourse-Aware (MuDA) benchmark, a series of taggers for these phenomena in 14 different language pairs, which we use to evaluate context-aware MT. We find that state-of-the-art context-aware MT models find marginal improvements over context-agnostic models on our benchmark, which suggests current models do not handle these ambiguities effectively. We release code and data to invite the MT research community to increase efforts on ...
|
|
Keyword:
Computation and Language cs.CL; FOS Computer and information sciences; Machine Learning cs.LG
|
|
URL: https://dx.doi.org/10.48550/arxiv.2109.07446
https://arxiv.org/abs/2109.07446
|
|
BASE
|
|
Hide details
|
|
|
| 7 |
Measuring and Increasing Context Usage in Context-Aware Machine Translation ...
|
|
|
|
BASE
|
|
Show details
|
|
|
| 9 |
Do Context-Aware Translation Models Pay the Right Attention? ...
|
|
|
|
BASE
|
|
Show details
|
|
|
| 10 |
Findings of the WMT 2021 Shared Task on Quality Estimation ...
|
|
|
|
BASE
|
|
Show details
|
|
|
| 11 |
Do Context-Aware Translation Models Pay the Right Attention? ...
|
|
|
|
BASE
|
|
Show details
|
|
|
| 12 |
Findings of the WMT 2021 shared task on quality estimation
|
|
|
|
In: 689 ; 730 (2021)
|
|
BASE
|
|
Show details
|
|
|
| 15 |
MLQE-PE: A Multilingual Quality Estimation and Post-Editing Dataset ...
|
|
|
|
BASE
|
|
Show details
|
|
|
| 16 |
Understanding the Mechanics of SPIGOT: Surrogate Gradients for Latent Structure Learning ...
|
|
|
|
BASE
|
|
Show details
|
|
|
| 17 |
Findings of the WMT 2020 shared task on quality estimation
|
|
|
|
In: 743 ; 764 (2020)
|
|
BASE
|
|
Show details
|
|
|
| 18 |
MLQE-PE: A multilingual quality estimation and post-editing dataset
|
|
|
|
BASE
|
|
Show details
|
|
|
|
|
