DE eng

Search in the Catalogues and Directories

Hits 1 – 7 of 7

1
Challenges and Strategies in Cross-Cultural NLP ...
BASE
Show details
2
Can Language Models Encode Perceptual Structure Without Grounding? A Case Study in Color ...
BASE
Show details
3
Attention Can Reflect Syntactic Structure (If You Let It) ...
BASE
Show details
4
Does injecting linguistic structure into language models lead to better alignment with brain recordings? ...
Abstract: Neuroscientists evaluate deep neural networks for natural language processing as possible candidate models for how language is processed in the brain. These models are often trained without explicit linguistic supervision, but have been shown to learn some linguistic structure in the absence of such supervision (Manning et al., 2020), potentially questioning the relevance of symbolic linguistic theories in modeling such cognitive processes (Warstadt and Bowman, 2020). We evaluate across two fMRI datasets whether language models align better with brain recordings, if their attention is biased by annotations from syntactic or semantic formalisms. Using structure from dependency or minimal recursion semantic annotations, we find alignments improve significantly for one of the datasets. For another dataset, we see more mixed results. We present an extensive analysis of these results. Our proposed approach enables the evaluation of more targeted hypotheses about the composition of meaning in the brain, expanding ...
Keyword: Artificial Intelligence cs.AI; Computation and Language cs.CL; FOS Computer and information sciences
URL: https://dx.doi.org/10.48550/arxiv.2101.12608
https://arxiv.org/abs/2101.12608
BASE
Hide details
5
The Sensitivity of Language Models and Humans to Winograd Schema Perturbations ...
BASE
Show details
6
Do Neural Language Models Show Preferences for Syntactic Formalisms? ...
BASE
Show details
7
X-WikiRE: A Large, Multilingual Resource for Relation Extraction as Machine Comprehension ...
BASE
Show details

Catalogues
0
0
0
0
0
0
0
Bibliographies
0
0
0
0
0
0
0
0
0
Linked Open Data catalogues
0
Online resources
0
0
0
0
Open access documents
7
0
0
0
0
© 2013 - 2024 Lin|gu|is|tik | Imprint | Privacy Policy | Datenschutzeinstellungen ändern