DE eng

Search in the Catalogues and Directories

Hits 1 – 14 of 14

1
Revisiting the Uniform Information Density Hypothesis ...
BASE
Show details
2
Conditional Poisson Stochastic Beams ...
Abstract: Anthology paper link: https://aclanthology.org/2021.emnlp-main.52/ Abstract: Beam search is the default decoding strategy for many sequence generation tasks in NLP. The set of approximate K-best items returned by the algorithm is a useful summary of the distribution for many applications; however, the candidates typically exhibit high overlap and may give a highly biased estimate for ex- pectations under our model. These problems can be addressed by instead using stochastic decoding strategies. In this work, we propose a new method for turning beam search into a stochastic process: Conditional Poisson stochastic beam search. Rather than taking the maximizing set at each iteration, we sample K candidates without replacement according to the conditional Poisson sampling design. We view this as a more natural alternative to Kool et al. (2019)’s stochastic beam search (SBS). Furthermore, we show how samples generated under the CPSBS design can be used to build consistent estimators and sample diverse sets from ...
Keyword: Computational Linguistics; Machine Learning; Machine Learning and Data Mining; Natural Language Processing
URL: https://dx.doi.org/10.48448/n187-h976
https://underline.io/lecture/37840-conditional-poisson-stochastic-beams
BASE
Hide details
3
Language Model Evaluation Beyond Perplexity ...
BASE
Show details
4
Differentiable Subset Pruning of Transformer Heads ...
BASE
Show details
5
A Bayesian Framework for Information-Theoretic Probing ...
BASE
Show details
6
Classifying Dyads for Militarized Conflict Analysis ...
BASE
Show details
7
A surprisal--duration trade-off across and within the world's languages ...
BASE
Show details
8
Determinantal Beam Search ...
BASE
Show details
9
Is Sparse Attention more Interpretable? ...
BASE
Show details
10
On the Relationships Between the Grammatical Genders of Inanimate Nouns and Their Co-Occurring Adjectives and Verbs ...
BASE
Show details
11
A Cognitive Regularizer for Language Modeling ...
BASE
Show details
12
Are All Languages Equally Hard to Language-Model?
In: Proceedings of the Society for Computation in Linguistics (2019)
BASE
Show details
13
Rethinking Phonotactic Complexity
In: Proceedings of the Society for Computation in Linguistics (2019)
BASE
Show details
14
Quantifying the Trade-off Between Two Types of Morphological Complexity
In: Proceedings of the Society for Computation in Linguistics (2018)
BASE
Show details

Catalogues
0
0
0
0
0
0
0
Bibliographies
0
0
0
0
0
0
0
0
0
Linked Open Data catalogues
0
Online resources
0
0
0
0
Open access documents
14
0
0
0
0
© 2013 - 2024 Lin|gu|is|tik | Imprint | Privacy Policy | Datenschutzeinstellungen ändern