• Refine your search:
  • 
    Keyword
  • 
    Creator / Publisher
  • 
    Year
  • 
    Medium
  • 
    Type
  • 
    BLLDB-Access

Search in the Catalogues and Directories

All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year Sort by creator [A → Z]' creator [Z → A]' publishing year ↑ (asc)' publishing year ↓ (desc)' title [A → Z]' title [Z → A]' Simple Search Page: 1...48 49 50 51 52 Hits 1.021 – 1.029 of 1.029 1021 The Low-Dimensional Linear Geometry of Contextualized Word Representations ... The 2021 Conference on Empirical Methods in Natural Language Processing 2021; Andreas, Jacob; Hernandez, Evan. - : Underline Science Inc., 2021 Abstract: Black-box probing models can reliably extract linguistic features like tense, number, and syntactic role from pretrained word representations. However, the manner in which these features are encoded in representations remains poorly understood. We present a systematic study of the linear geometry of contextualized word representations in ELMO and BERT. We show that a variety of linguistic features (including structured dependency relationships) are encoded in low-dimensional subspaces. We then refine this geometric picture, showing that there are hierarchical relations between the subspaces encoding general linguistic categories and more specific ones, and that low-dimensional feature encodings are distributed rather than aligned to individual neurons. Finally, we demonstrate that these linear subspaces are causally related to model behavior, and can be used to perform fine-grained manipulation of BERT's output distribution. ... Keyword: Computational Linguistics; Language Models; Machine Learning; Machine Learning and Data Mining; Natural Language Processing URL: https://underline.io/lecture/39841-the-low-dimensional-linear-geometry-of-contextualized-word-representations https://dx.doi.org/10.48448/hsry-qs14 BASE Hide details 1022 Data Collection vs. Knowledge Graph Completion: What is Needed to Improve Coverage? ... The 2021 Conference on Empirical Methods in Natural Language Processing 2021; Bian, Yuchen; Church, Kenneth. - : Underline Science Inc., 2021 BASE Show details 1023 Coreference-aware Surprisal Predicts Brain Response ... The 2021 Conference on Empirical Methods in Natural Language Processing 2021; Jaffe, Evan; Oh, Byung-Doh. - : Underline Science Inc., 2021 BASE Show details 1024 Linguistic Dependencies and Statistical Dependence ... The 2021 Conference on Empirical Methods in Natural Language Processing 2021; Du, Wenyu; Hoover, Jacob. - : Underline Science Inc., 2021 BASE Show details 1025 Does referent predictability affect the choice of referential form? A computational approach using masked coreference resolution ... The 2021 Conference on Empirical Methods in Natural Language Processing 2021; Aina, Laura; Boleda, Gemma. - : Underline Science Inc., 2021 BASE Show details 1026 Live Session - 2E: Linguistic Theories, Cognitive Modeling and Psycholinguistics ... The 2021 Conference on Empirical Methods in Natural Language Processing 2021. - : Underline Science Inc., 2021 BASE Show details 1027 Coreference-aware Surprisal Predicts Brain Response ... The 2021 Conference on Empirical Methods in Natural Language Processing 2021; Jaffe, Evan; Oh, Byung-Doh. - : Underline Science Inc., 2021 BASE Show details 1028 Synthetic Textual Features for the Large-Scale Detection of Basic-level Categories in English and Mandarin ... The 2021 Conference on Empirical Methods in Natural Language Processing 2021; Chen, Yiwen; Teufel, Simone. - : Underline Science Inc., 2021 BASE Show details 1029 Pragmatic competence of pre-trained language models through the lens of discourse connectives ... The 2021 Conference on Empirical Methods in Natural Language Processing 2021; Cong, Yan; Ettinger, Allyson. - : Underline Science Inc., 2021 BASE Show details Page: 1...48 49 50 51 52

Mobile view All Catalogues UB Frankfurt Linguistik 0 IDS Mannheim 0 OLC Linguistik 0 UB Frankfurt Retrokatalog 0 DNB Subject Category Language 0 Institut für Empirische Sprachwissenschaft 0 Leibniz-Centre General Linguistics (ZAS) 0 Bibliographies BLLDB 0 BDSL 0 IDS Bibliografie zur deutschen Grammatik 0 IDS Bibliografie zur Gesprächsforschung 0 IDS Konnektoren im Deutschen 0 IDS Präpositionen im Deutschen 0 IDS OBELEX meta 0 MPI-SHH Linguistics Collection 0 MPI for Psycholinguistics 0 Linked Open Data catalogues Annohub 0 Online resources Link directory 0 Journal directory 0 Database directory 0 Dictionary directory 0 Open access documents BASE 1.029 Linguistik-Repository 0 IDS Publikationsserver 0 Online dissertations 0 Language Description Heritage 0