DE eng

Search in the Catalogues and Directories

Hits 1 – 7 of 7

1
Contrastive Explanations for Model Interpretability ...
BASE
Show details
2
Provable Limitations of Acquiring Meaning from Ungrounded Form: What will Future Language Models Understand? ...
BASE
Show details
3
Measuring and Improving Consistency in Pretrained Language Models ...
BASE
Show details
4
Aligning Faithful Interpretations with their Social Attribution ...
BASE
Show details
5
Effects of Parameter Norm Growth During Transformer Training: Inductive Bias from Gradient Descent ...
BASE
Show details
6
Asking It All: Generating Contextualized Questions for any Semantic Role ...
BASE
Show details
7
Counterfactual Interventions Reveal the Causal Effect of Relative Clause Representations on Agreement Prediction ...
Abstract: When language models process syntactically complex sentences, do they use their representations of syntax in a manner that is consistent with the grammar of the language? We propose AlterRep, an intervention-based method to address this question. For any linguistic feature of a given sentence, AlterRep generates counterfactual representations by altering how the feature is encoded, while leaving intact all other aspects of the original representation. By measuring the change in a model's word prediction behavior when these counterfactual representations are substituted for the original ones, we can draw conclusions about the causal effect of the linguistic feature in question on the model's behavior. We apply this method to study how BERT models of different sizes process relative clauses (RCs). We find that BERT variants use RC boundary information during word prediction in a manner that is consistent with the rules of English grammar; this RC boundary information generalizes to a considerable extent across ...
Keyword: Computational Linguistics; Language Models; Machine Learning; Machine Learning and Data Mining; Natural Language Processing
URL: https://dx.doi.org/10.48448/jtvc-kx57
https://underline.io/lecture/39875-counterfactual-interventions-reveal-the-causal-effect-of-relative-clause-representations-on-agreement-prediction
BASE
Hide details

Catalogues
0
0
0
0
0
0
0
Bibliographies
0
0
0
0
0
0
0
0
0
Linked Open Data catalogues
0
Online resources
0
0
0
0
Open access documents
7
0
0
0
0
© 2013 - 2024 Lin|gu|is|tik | Imprint | Privacy Policy | Datenschutzeinstellungen ändern