DE eng

Search in the Catalogues and Directories

Page: 1 2 3
Hits 21 – 40 of 52

21
A Non-Linear Structural Probe
In: Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (2021)
BASE
Show details
22
Disambiguatory Signals are Stronger in Word-initial Positions
In: Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume (2021)
BASE
Show details
23
How (Non-)Optimal is the Lexicon?
In: Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (2021)
BASE
Show details
24
A Bayesian Framework for Information-Theoretic Probing
In: Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing (2021)
Abstract: Pimentel et al. (2020) recently analysed probing from an information-theoretic perspective. They argue that probing should be seen as approximating a mutual information. This led to the rather unintuitive conclusion that representations encode exactly the same information about a target task as the original sentences. The mutual information, however, assumes the true probability distribution of a pair of random variables is known, leading to unintuitive results in settings where it is not. This paper proposes a new framework to measure what we term Bayesian mutual information, which analyses information from the perspective of Bayesian agents—allowing for more intuitive findings in scenarios with finite data. For instance, under Bayesian MI we have that data can add information, processing can help, and information can hurt, which makes it more intuitive for machine learning applications. Finally, we apply our framework to probing where we believe Bayesian mutual information naturally operationalises ease of extraction by explicitly limiting the available background knowledge to solve a task.
URL: https://doi.org/10.3929/ethz-b-000518995
https://hdl.handle.net/20.500.11850/518995
BASE
Hide details
25
How (Non-)Optimal is the Lexicon? ...
NAACL 2021 2021; Blasi, Damián; Cotterell, Ryan. - : Underline Science Inc., 2021
BASE
Show details
26
A Non-Linear Structural Probe ...
BASE
Show details
27
How (Non-)Optimal is the Lexicon? ...
BASE
Show details
28
Disambiguatory Signals are Stronger in Word-initial Positions ...
Pimentel, Tiago; Cotterell, Ryan; Roark, Brian. - : ETH Zurich, 2021
BASE
Show details
29
Finding Concept-specific Biases in Form--Meaning Associations ...
NAACL 2021 2021; Blasi, Damián; Cotterell, Ryan. - : Underline Science Inc., 2021
BASE
Show details
30
SIGMORPHON 2020 Shared Task 0: Typologically Diverse Morphological Inflection ...
BASE
Show details
31
Information-Theoretic Probing for Linguistic Structure ...
BASE
Show details
32
Information-Theoretic Probing for Linguistic Structure ...
BASE
Show details
33
A Corpus for Large-Scale Phonetic Typology ...
BASE
Show details
34
Phonotactic Complexity and its Trade-offs ...
BASE
Show details
35
Phonotactic Complexity and Its Trade-offs ...
Pimentel, Tiago; Roark, Brian; Cotterell, Ryan. - : ETH Zurich, 2020
BASE
Show details
36
A Corpus for Large-Scale Phonetic Typology ...
BASE
Show details
37
Predicting Declension Class from Form and Meaning ...
BASE
Show details
38
A corpus for large-scale phonetic typology
BASE
Show details
39
Predicting declension class from form and meaning
BASE
Show details
40
Pareto Probing: Trading Off Accuracy for Complexity
In: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) (2020)
BASE
Show details

Page: 1 2 3

Catalogues
0
0
0
0
0
0
0
Bibliographies
0
0
0
0
0
0
0
0
0
Linked Open Data catalogues
0
Online resources
0
0
0
0
Open access documents
52
0
0
0
0
© 2013 - 2024 Lin|gu|is|tik | Imprint | Privacy Policy | Datenschutzeinstellungen ändern