3 |
Controllable Text Simplification with Explicit Paraphrasing ...
|
|
|
|
BASE
|
|
Show details
|
|
4 |
The (Un)Suitability of Automatic Evaluation Metrics for Text Simplification ...
|
|
|
|
Abstract:
In order to simplify sentences, several rewriting operations can be performed such as replacing complex words per simpler synonyms, deleting unnecessary information, and splitting long sentences. Despite this multi-operation nature, evaluation of automatic simplification systems relies on metrics that moderately correlate with human judgements on the simplicity achieved by executing specific operations (e.g.\ simplicity gain based on lexical replacements). In this article, we investigate how well existing metrics can assess sentence-level simplifications where multiple operations may have been applied and which, therefore, require more general simplicity judgements. For that, we first collect a new and more reliable dataset for evaluating the correlation of metrics and human judgements of overall simplicity. Second, we conduct the first meta-evaluation of automatic metrics in Text Simplification, using our new dataset (and other existing data) to analyse the variation of the correlation between metrics' ...
|
|
Keyword:
Computational Linguistics; Machine Learning; Machine Learning and Data Mining; Natural Language Processing
|
|
URL: https://underline.io/lecture/38205-the-(un)suitability-of-automatic-evaluation-metrics-for-text-simplification https://dx.doi.org/10.48448/76fg-r602
|
|
BASE
|
|
Hide details
|
|
6 |
deepQuest-py: large and distilled models for quality estimation
|
|
|
|
BASE
|
|
Show details
|
|
7 |
IAPUCP at SemEval-2021 task 1: Stacking fine-tuned transformers is almost all you need for lexical complexity prediction
|
|
|
|
BASE
|
|
Show details
|
|
8 |
The (un)suitability of automatic evaluation metrics for text simplification
|
|
|
|
BASE
|
|
Show details
|
|
10 |
deepQuest-py: large and distilled models for quality estimation
|
|
|
|
In: Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing: System Demonstrations ; 382 ; 389 (2021)
|
|
BASE
|
|
Show details
|
|
11 |
Knowledge distillation for quality estimation
|
|
|
|
In: 5091 ; 5099 (2021)
|
|
BASE
|
|
Show details
|
|
12 |
ASSET: A Dataset for Tuning and Evaluation of Sentence Simplification Models with Multiple Rewriting Transformations
|
|
|
|
In: ACL 2020 - 58th Annual Meeting of the Association for Computational Linguistics ; https://hal.inria.fr/hal-02889823 ; ACL 2020 - 58th Annual Meeting of the Association for Computational Linguistics, Jul 2020, Seattle / Virtual, United States (2020)
|
|
BASE
|
|
Show details
|
|
13 |
Controllable Text Simplification with Explicit Paraphrasing ...
|
|
|
|
BASE
|
|
Show details
|
|
14 |
ASSET: A Dataset for Tuning and Evaluation of Sentence Simplification Models with Multiple Rewriting Transformations ...
|
|
|
|
BASE
|
|
Show details
|
|
15 |
ASSET: A dataset for tuning and evaluation of sentence simplification models with multiple rewriting transformations
|
|
|
|
BASE
|
|
Show details
|
|
16 |
Data-Driven Sentence Simplification: Survey and Benchmark
|
|
|
|
In: Computational Linguistics, Vol 46, Iss 1, Pp 135-187 (2020) (2020)
|
|
BASE
|
|
Show details
|
|
17 |
Automatic Sentence Simplification with Multiple Rewriting Transformations
|
|
|
|
BASE
|
|
Show details
|
|
18 |
Distributed knowledge based clinical auto-coding system
|
|
Kaur, Rajvir (S33301). - : U.S., Association for Computational Linguistics, 2019
|
|
BASE
|
|
Show details
|
|
19 |
Towards semi-supervised Brazilian Portuguese semantic role labeling: Building a benchmark
|
|
|
|
BASE
|
|
Show details
|
|
|
|