1 |
AUTOLEX: An Automatic Framework for Linguistic Exploration ...
|
|
|
|
BASE
|
|
Show details
|
|
2 |
SD-QA: Spoken Dialectal Question Answering for the Real World ...
|
|
|
|
BASE
|
|
Show details
|
|
3 |
Phoneme Recognition through Fine Tuning of Phonetic Representations: a Case Study on Luhya Language Varieties ...
|
|
|
|
BASE
|
|
Show details
|
|
4 |
Machine Translation into Low-resource Language Varieties ...
|
|
|
|
BASE
|
|
Show details
|
|
5 |
Code to Comment Translation: A Comparative Study on Model Effectiveness & Errors ...
|
|
|
|
Abstract:
Automated source code summarization is a popular software engineering research topic wherein machine translation models are employed to "translate" code snippets into relevant natural language descriptions. Most evaluations of such models are conducted using automatic reference-based metrics. However, given the relatively large semantic gap between programming languages and natural language, we argue that this line of research would benefit from a qualitative investigation into the various error modes of current state-of-the-art models. Therefore, in this work, we perform both a quantitative and qualitative comparison of three recently proposed source code summarization models. In our quantitative evaluation, we compare the models based on the smoothed BLEU-4, METEOR, and ROUGE-L machine translation metrics, and in our qualitative evaluation, we perform a manual open-coding of the most common errors committed by the models when compared to ground truth captions. Our investigation reveals new insights into ... : Accepted to the 2021 NLP4Prog Workshop co-located with The Joint Conference of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (ACL-IJCNLP 2021) ...
|
|
Keyword:
Artificial Intelligence cs.AI; Computation and Language cs.CL; FOS Computer and information sciences; Machine Learning cs.LG; Software Engineering cs.SE
|
|
URL: https://dx.doi.org/10.48550/arxiv.2106.08415 https://arxiv.org/abs/2106.08415
|
|
BASE
|
|
Hide details
|
|
6 |
Systematic Inequalities in Language Technology Performance across the World's Languages ...
|
|
|
|
BASE
|
|
Show details
|
|
7 |
Multilingual Code-Switching for Zero-Shot Cross-Lingual Intent Prediction and Slot Filling ...
|
|
|
|
BASE
|
|
Show details
|
|
8 |
Investigating Post-pretraining Representation Alignment for Cross-Lingual Question Answering ...
|
|
|
|
BASE
|
|
Show details
|
|
9 |
Towards More Equitable Question Answering Systems: How Much More Data Do You Need? ...
|
|
|
|
BASE
|
|
Show details
|
|
10 |
Cross-Lingual Text Classification of Transliterated Hindi and Malayalam ...
|
|
|
|
BASE
|
|
Show details
|
|
11 |
Evaluating the Morphosyntactic Well-formedness of Generated Texts ...
|
|
|
|
BASE
|
|
Show details
|
|
12 |
Lexically Aware Semi-Supervised Learning for OCR Post-Correction ...
|
|
|
|
BASE
|
|
Show details
|
|
13 |
When is Wall a Pared and when a Muro? -- Extracting Rules Governing Lexical Selection ...
|
|
|
|
BASE
|
|
Show details
|
|
15 |
Towards Minimal Supervision BERT-based Grammar Error Correction ...
|
|
|
|
BASE
|
|
Show details
|
|
16 |
SIGMORPHON 2020 Shared Task 0: Typologically Diverse Morphological Inflection ...
|
|
|
|
BASE
|
|
Show details
|
|
17 |
It's not a Non-Issue: Negation as a Source of Error in Machine Translation ...
|
|
|
|
BASE
|
|
Show details
|
|
18 |
Automatic Extraction of Rules Governing Morphological Agreement ...
|
|
|
|
BASE
|
|
Show details
|
|
19 |
A Summary of the First Workshop on Language Technology for Language Documentation and Revitalization ...
|
|
|
|
BASE
|
|
Show details
|
|
20 |
Universal Phone Recognition with a Multilingual Allophone System ...
|
|
|
|
BASE
|
|
Show details
|
|
|
|