DE eng

Search in the Catalogues and Directories

Page: 1 2
Hits 1 – 20 of 24

1
What Models Know About Their Attackers: Deriving Attacker Information From Latent Representations ...
BASE
Show details
2
Benchmarking Scalable Methods for Streaming Cross Document Entity Coreference ...
BASE
Show details
3
Evaluating Entity Disambiguation and the Role of Popularity in Retrieval-Based NLP ...
BASE
Show details
4
Enforcing Consistency in Weakly Supervised Semantic Parsing ...
BASE
Show details
5
Competency Problems: On Finding and Removing Artifacts in Language Data ...
BASE
Show details
6
Beyond Accuracy: Behavioral Testing of NLP models with CheckList ...
BASE
Show details
7
Evaluating Models' Local Decision Boundaries via Contrast Sets ...
Abstract: Standard test sets for supervised learning evaluate in-distribution generalization. Unfortunately, when a dataset has systematic gaps (e.g., annotation artifacts), these evaluations are misleading: a model can learn simple decision rules that perform well on the test set but do not capture a dataset's intended capabilities. We propose a new annotation paradigm for NLP that helps to close systematic gaps in the test data. In particular, after a dataset is constructed, we recommend that the dataset authors manually perturb the test instances in small but meaningful ways that (typically) change the gold label, creating contrast sets. Contrast sets provide a local view of a model's decision boundary, which can be used to more accurately evaluate a model's true linguistic capabilities. We demonstrate the efficacy of contrast sets by creating them for 10 diverse NLP datasets (e.g., DROP reading comprehension, UD parsing, IMDb sentiment analysis). Although our contrast sets are not explicitly adversarial, model ...
Keyword: Computation and Language cs.CL; FOS Computer and information sciences
URL: https://arxiv.org/abs/2004.02709
https://dx.doi.org/10.48550/arxiv.2004.02709
BASE
Hide details
8
Model Performance as an Estimator of Language Complexity
Schaedler, Peter William. - : eScholarship, University of California, 2019
BASE
Show details
9
Distributed Non-Parametric Representations for Vital Filtering: UW at TREC KBA 2014
In: DTIC (2014)
BASE
Show details
10
Evaluation of an objective technique for analysing temporal variables in DAT spontaneous speech
In: Aphasiology. - London [u.a.] : Routledge, Taylor & Francis Group 15 (2001) 6, 571-584
OLC Linguistik
Show details
11
Evaluation of an objective technique for analysing temporal variables in DAT spontaneous speech
In: Aphasiology. - London [u.a.] : Routledge, Taylor & Francis Group 15 (2001) 6, 571-583
BLLDB
Show details
12
A pilot study on gender differences in conversational speech on lexical richness measures
In: Literary & linguistic computing. - Oxford : Oxford Univ. Press 16 (2001) 3, 251-264
BLLDB
Show details
13
A Pilot Study on Gender Differences in Conversational Speech on Lexical Richness Measures
In: Literary & linguistic computing. - Oxford : Oxford Univ. Press 16 (2001) 3, 251-264
OLC Linguistik
Show details
14
A Pilot Study on Gender Differences in Conversational Speech on Lexical Richness Measures
Singh, Sameer. - : Oxford University Press, 2001
BASE
Show details
15
Evaluation of an objective technique for anlaysing temporal variables in DAT spontaneous speech
BASE
Show details
16
Designing intelligent interfaces for users with memory and language limitations
In: Aphasiology. - London [u.a.] : Routledge, Taylor & Francis Group 14 (2000) 2, 157-177
BLLDB
Show details
17
Enhancing Comprehension of Web Information for Users with Special Linguistic Needs
In: Journal of communication. - Cary, NC : Oxford University Press 48 (1998) 2, 86-108
OLC Linguistik
Show details
18
Enhancing comprehension of Web information for users with special linguistic needs
In: Journal of communication. - Cary, NC : Oxford University Press 48 (1998) 2, 86-108
BLLDB
Show details
19
Language processing in ahpasia and dementia
Kelly, Louise (Mitarb.); Shillcock, Richard (Mitarb.); Monaghan, Padraic (Mitarb.)...
In: Clinical phonetics and linguistics. - London : Whurr Publ. (1998), 253-320
BLLDB
Show details
20
Quantitative classification of conversational language using artificial neural networks
In: Aphasiology. - London [u.a.] : Routledge, Taylor & Francis Group 11 (1997) 9, 829-844
BLLDB
Show details

Page: 1 2

Catalogues
0
0
4
0
0
0
0
Bibliographies
9
0
0
0
0
0
0
0
0
Linked Open Data catalogues
0
Online resources
0
0
0
0
Open access documents
11
0
0
0
0
© 2013 - 2024 Lin|gu|is|tik | Imprint | Privacy Policy | Datenschutzeinstellungen ändern