1 |
AutoNLU: Detecting, root-causing, and fixing NLU model errors ...
|
|
Sethi, Pooja; Savenkov, Denis; Arabshahi, Forough; Goetz, Jack; Tolliver, Micaela; Scheffer, Nicolas; Kabul, Ilknur; Liu, Yue; Aly, Ahmed. - : arXiv, 2021
|
|
Abstract:
Improving the quality of Natural Language Understanding (NLU) models, and more specifically, task-oriented semantic parsing models, in production is a cumbersome task. In this work, we present a system called AutoNLU, which we designed to scale the NLU quality improvement process. It adds automation to three key steps: detection, attribution, and correction of model errors, i.e., bugs. We detected four times more failed tasks than with random sampling, finding that even a simple active learning sampling method on an uncalibrated model is surprisingly effective for this purpose. The AutoNLU tool empowered linguists to fix ten times more semantic parsing bugs than with prior manual processes, auto-correcting 65% of all identified bugs. ... : 8 pages, 5 figures ...
|
|
Keyword:
Computation and Language cs.CL; FOS Computer and information sciences; I.2.7; Machine Learning cs.LG
|
|
URL: https://arxiv.org/abs/2110.06384 https://dx.doi.org/10.48550/arxiv.2110.06384
|
|
BASE
|
|
Hide details
|
|
2 |
Oral, Tongue-Coating Microbiota, and Metabolic Disorders: A Novel Area of Interactive Research
|
|
|
|
In: Front Cardiovasc Med (2021)
|
|
BASE
|
|
Show details
|
|
3 |
Short-time speaker verification with different speaking style utterances
|
|
|
|
In: PLoS One (2020)
|
|
BASE
|
|
Show details
|
|
4 |
Additional file 1: of Distribution pattern of the snail intermediate host of schistosomiasis japonica in the Poyang Lake region of China ...
|
|
|
|
BASE
|
|
Show details
|
|
5 |
Additional file 1: of Distribution pattern of the snail intermediate host of schistosomiasis japonica in the Poyang Lake region of China ...
|
|
|
|
BASE
|
|
Show details
|
|
6 |
Additional file 1: of Spatial and temporal clustering analysis of tuberculosis in the mainland of China at the prefecture level, 2005â 2015 ...
|
|
|
|
BASE
|
|
Show details
|
|
7 |
Additional file 1: of Spatial and temporal clustering analysis of tuberculosis in the mainland of China at the prefecture level, 2005â 2015 ...
|
|
|
|
BASE
|
|
Show details
|
|
8 |
Germanismen in der modernen chinesischen Sprache
|
|
|
|
In: Enthalten in: Deutsche Sprache (2017)
|
|
IDS Mannheim
|
|
10 |
The effects of globalization and poverty upon Philippine endangered languages
|
|
|
|
BASE
|
|
Show details
|
|
11 |
The effects of globalization and poverty upon Philippine endangered languages
|
|
|
|
BASE
|
|
Show details
|
|
12 |
Saving endangered Philippine languages via the K+12 Program
|
|
|
|
BASE
|
|
Show details
|
|
13 |
Sinismen im Gegenwartsdeutschen und ihre Entwicklungstendenzen
|
|
|
|
In: Deutsche Sprache (2014)
|
|
IDS Mannheim
|
|
15 |
Domestication and Foreignization: Culture Loss in Hong Lou Meng's Personal Name Translations - A Case Study of David Hawkes's The Story of the Stone
|
|
Liu, Yue. - : The University of Queensland, School of Languages and Cultures, 2014
|
|
BASE
|
|
Show details
|
|
16 |
Structural Abnormalities in Early Tourette Syndrome Children: A Combined Voxel-Based Morphometry and Tract-Based Spatial Statistics Study
|
|
|
|
BASE
|
|
Show details
|
|
17 |
"Kulturspezifisches" Kommunikationsverhalten? : eine empirische Untersuchung zu aktuellen Tendenzen in chinesisch-deutschen Begegnungen
|
|
|
|
IDS Mannheim
|
|
Show details
|
|
20 |
Gruppenorientierung: ein (noch) aktuelles Etikett für die chinesische Denkweise?
|
|
|
|
In: Deutsch als Fremdsprache aus internationaler Perspektive (2009)
|
|
IDS Mannheim
|
|
|
|