DE eng

Search in the Catalogues and Directories

Hits 1 – 17 of 17

1
Generalized Quantifiers as a Source of Error in Multilingual NLU Benchmarks ...
Abstract: Logical approaches to representing language have developed and evaluated computational models of quantifier words since the 19th century, but today's NLU models still struggle to capture their semantics. We rely on Generalized Quantifier Theory for language-independent representations of the semantics of quantifier words, to quantify their contribution to the errors of NLU models. We find that quantifiers are pervasive in NLU benchmarks, and their occurrence at test time is associated with performance drops. Multilingual models also exhibit unsatisfying quantifier reasoning abilities, but not necessarily worse for non-English languages. To facilitate directly-targeted probing, we present an adversarial generalized quantifier NLI task (GQNLI) and show that pre-trained language models have a clear lack of robustness in generalized quantifier reasoning. ... : To appear at NAACL 2022 ...
Keyword: Computation and Language cs.CL; FOS Computer and information sciences; Logic in Computer Science cs.LO
URL: https://dx.doi.org/10.48550/arxiv.2204.10615
https://arxiv.org/abs/2204.10615
BASE
Hide details
2
Challenges and Strategies in Cross-Cultural NLP ...
BASE
Show details
3
Meaning Representation of Numeric Fused-Heads in UCCA ...
BASE
Show details
4
Great Service! Fine-grained Parsing of Implicit Arguments ...
BASE
Show details
5
Multilingual Compositional Wikidata Questions ...
BASE
Show details
6
Can Language Models Encode Perceptual Structure Without Grounding? A Case Study in Color ...
BASE
Show details
7
A Multilingual Benchmark for Probing Negation-Awareness with Minimal Pairs ...
BASE
Show details
8
Does injecting linguistic structure into language models lead to better alignment with brain recordings? ...
BASE
Show details
9
Køpsala: Transition-Based Graph Parsing via Efficient Training and Effective Encoding ...
BASE
Show details
10
Refining Implicit Argument Annotation for UCCA ...
BASE
Show details
11
Lexical Semantic Recognition ...
BASE
Show details
12
Comparison by Conversion: Reverse-Engineering UCCA from Syntax and Lexical Semantics ...
BASE
Show details
13
SemEval-2019 Task 1: Cross-lingual Semantic Parsing with UCCA ...
BASE
Show details
14
CoNLL 2018 Shared Task System Outputs
Zeman, Daniel; Potthast, Martin; Duthoo, Elie. - : Charles University, Faculty of Mathematics and Physics, Institute of Formal and Applied Linguistics (UFAL), 2018
BASE
Show details
15
Universal Dependency Parsing with a General Transition-Based DAG Parser ...
BASE
Show details
16
SemEval 2019 Shared Task: Cross-lingual Semantic Parsing with UCCA - Call for Participation ...
BASE
Show details
17
A Transition-Based Directed Acyclic Graph Parser for UCCA ...
BASE
Show details

Catalogues
0
0
0
0
0
0
0
Bibliographies
0
0
0
0
0
0
0
0
0
Linked Open Data catalogues
0
Online resources
0
0
0
0
Open access documents
17
0
0
0
0
© 2013 - 2024 Lin|gu|is|tik | Imprint | Privacy Policy | Datenschutzeinstellungen ändern