DE eng

Search in the Catalogues and Directories

Hits 1 – 4 of 4

1
Bird’s Eye: Probing for Linguistic Graph Structures with a Simple Information-Theoretic Approach ...
BASE
Show details
2
Bird's Eye: Probing for Linguistic Graph Structures with a Simple Information-Theoretic Approach ...
Hou, Yifan; Sachan, Mrinmaya. - : arXiv, 2021
BASE
Show details
3
Bird’s Eye: Probing for Linguistic Graph Structures with a Simple Information-Theoretic Approach ...
Abstract: Read paper: https://www.aclanthology.org/2021.acl-long.145 Abstract: NLP has a rich history of representing our prior understanding of language in the form of graphs. Recent work on analyzing contextualized text representations has focused on hand-designed probe models to understand how and to what extent do these representations encode a particular linguistic phenomenon. However, due to the inter-dependence of various phenomena and randomness of training probe models, detecting how these representations encode the rich information in these linguistic graphs remains a challenging problem. In this paper, we propose a new information-theoretic probe, Bird's Eye, which is a fairly simple probe method for detecting if and how these representations encode the information in these linguistic graphs. Instead of using model performance, our probe takes an information-theoretic view of probing and estimates the mutual information between the linguistic graph embedded in a continuous space and the contextualized word ...
Keyword: Computational Linguistics; Condensed Matter Physics; Deep Learning; Electromagnetism; FOS Physical sciences; Information and Knowledge Engineering; Neural Network; Semantics
URL: https://dx.doi.org/10.48448/zqct-e976
https://underline.io/lecture/25458-birds-eye-probing-for-linguistic-graph-structures-with-a-simple-information-theoretic-approach
BASE
Hide details
4
Bird’s Eye: Probing for Linguistic Graph Structures with a Simple Information-Theoretic Approach ...
BASE
Show details

Catalogues
0
0
0
0
0
0
0
Bibliographies
0
0
0
0
0
0
0
0
0
Linked Open Data catalogues
0
Online resources
0
0
0
0
Open access documents
4
0
0
0
0
© 2013 - 2024 Lin|gu|is|tik | Imprint | Privacy Policy | Datenschutzeinstellungen ändern