1 |
Neural reality of argument structure constructions ...
|
|
|
|
Abstract:
In lexicalist linguistic theories, argument structure is assumed to be predictable from the meaning of verbs. As a result, the verb is the primary determinant of the meaning of a clause. In contrast, construction grammarians propose that argument structure is encoded in constructions (or form-meaning pairs) that are distinct from verbs. Decades of psycholinguistic research have produced substantial empirical evidence in favor of the construction view. Here we adapt several psycholinguistic studies to probe for the existence of argument structure constructions (ASCs) in Transformer-based language models (LMs). First, using a sentence sorting experiment, we find that sentences sharing the same construction are closer in embedding space than sentences sharing the same verb. Furthermore, LMs increasingly prefer grouping by construction with more input data, mirroring the behaviour of non-native language learners. Second, in a "Jabberwocky" priming-based experiment, we find that LMs associate ASCs with meaning, ... : ACL 2022 (Long Paper) ...
|
|
Keyword:
Computation and Language cs.CL; FOS Computer and information sciences
|
|
URL: https://dx.doi.org/10.48550/arxiv.2202.12246 https://arxiv.org/abs/2202.12246
|
|
BASE
|
|
Hide details
|
|
2 |
On the Use of Linguistic Features for the Evaluation of Generative Dialogue Systems ...
|
|
|
|
BASE
|
|
Show details
|
|
3 |
TorontoCL at CMCL 2021 Shared Task: RoBERTa with Multi-Stage Fine-Tuning for Eye-Tracking Prediction ...
|
|
|
|
BASE
|
|
Show details
|
|
4 |
Quantifying the Task-Specific Information in Text-Based Classifications ...
|
|
|
|
BASE
|
|
Show details
|
|
5 |
An {E}valuation of {D}isentangled {R}epresentation {L}earning for {T}exts ...
|
|
|
|
BASE
|
|
Show details
|
|
6 |
How is BERT surprised? Layerwise detection of linguistic anomalies ...
|
|
|
|
BASE
|
|
Show details
|
|
7 |
Comparing Pre-trained and Feature-Based Models for Prediction of Alzheimer's Disease Based on Speech
|
|
|
|
In: Front Aging Neurosci (2021)
|
|
BASE
|
|
Show details
|
|
8 |
Identification of primary and collateral tracks in stuttered speech
|
|
|
|
In: LREC 2020 - 12th Conference on Language Resources and Evaluation ; https://hal.archives-ouvertes.fr/hal-02959454 ; LREC 2020 - 12th Conference on Language Resources and Evaluation, May 2020, Marseille, France (2020)
|
|
BASE
|
|
Show details
|
|
9 |
Semantic coordinates analysis reveals language changes in the AI field ...
|
|
|
|
BASE
|
|
Show details
|
|
11 |
To BERT or Not To BERT: Comparing Speech and Language-based Approaches for Alzheimer's Disease Detection ...
|
|
|
|
BASE
|
|
Show details
|
|
12 |
An information theoretic view on selecting linguistic probes ...
|
|
|
|
BASE
|
|
Show details
|
|
13 |
Examining the rhetorical capacities of neural language models ...
|
|
|
|
BASE
|
|
Show details
|
|
14 |
A textual analysis of US corporate social responsibility reports
|
|
|
|
BASE
|
|
Show details
|
|
15 |
Lexical Features Are More Vulnerable, Syntactic Features Have More Predictive Power ...
|
|
|
|
BASE
|
|
Show details
|
|
16 |
Representation Learning for Discovering Phonemic Tone Contours ...
|
|
|
|
BASE
|
|
Show details
|
|
18 |
The Effect of Heterogeneous Data for Alzheimer's Disease Detection from Speech ...
|
|
|
|
BASE
|
|
Show details
|
|
19 |
Detecting cognitive impairments by agreeing on interpretations of linguistic features ...
|
|
|
|
BASE
|
|
Show details
|
|
20 |
Deconfounding age effects with fair representation learning when assessing dementia ...
|
|
|
|
BASE
|
|
Show details
|
|
|
|