• Refine your search:
  • 
    Keyword
  • 
    Creator / Publisher:
    
    • Papadimitriou, Isabel (8)
    • Futrell, Richard (5)
    • Mahowald, Kyle (5)
    • Chi, Ethan A. (3)
    • Ahia, Oghenefego (2)
    • Ahia, Orevaoghene (2)
    • Ataman, Duygu (2)
    • Awokoya, Ayodele (2)
    • Azime, Israel Abebe (2)
    • Baljekar, Pallavi (2)
    •   more
  • 
    Year
  • 
    Medium
  • 
    Type
  • 
    BLLDB-Access

Search in the Catalogues and Directories

All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year Sort by creator [A → Z]' creator [Z → A]' publishing year ↑ (asc)' publishing year ↓ (desc)' title [A → Z]' title [Z → A]' Simple Search Hits 1 – 8 of 8 1 When classifying grammatical role, BERT doesn't care about word order... except when it matters ... Papadimitriou, Isabel; Futrell, Richard; Mahowald, Kyle. - : arXiv, 2022 BASE Show details 2 When Classifying Arguments, BERT Doesn't Care About Word Order. Except When It Matters Papadimitriou, Isabel; Futrell, Richard; Mahowald, Kyle In: Proceedings of the Society for Computation in Linguistics (2022) Abstract: We probe nouns in BERT contextual embedding space for grammatical role (subject vs. object of a clause), and examine how probing results vary between prototypical examples, where the role matches what we would expect from seeing that word in the context, and non-prototypical examples, where the role is mostly imparted by the context. In this way, engage with the contrast that has arisen in the literature, between studies that show contextual models as grammatically sensitive, and others that show that these models are robust to changes in word order. Our experiments yield three results: 1) Grammatical role is recovered in later layers for difficult non-prototypical cases, while prototypical cases are accurate without many layers of context 2) When we switch the subject and the object of a sentence around (eg, The chef cut the onion, The onion cut the chef), we see that the same word (eg, onion) can be fluently identified as both a subject and an object 3) Subjecthood probing breaks if we ablate local word order by shuffle words locally and break grammaticality. Keyword: BERT; Computational Linguistics; Contextual embeddings; grammatical role; prototype; subjecthood; verb arguments; word order URL: https://scholarworks.umass.edu/scil/vol5/iss1/18 https://scholarworks.umass.edu/cgi/viewcontent.cgi?article=1244&context=scil BASE Hide details 3 Quality at a Glance: An Audit of Web-Crawled Multilingual Datasets Caswell, Isaac; Kreutzer, Julia; Wang, Lisa... In: https://hal.inria.fr/hal-03177623 ; 2021 (2021) BASE Show details 4 Deep Subjecthood: Higher-Order Grammatical Features in Multilingual BERT ... Papadimitriou, Isabel; Chi, Ethan A.; Futrell, Richard. - : arXiv, 2021 BASE Show details 5 Quality at a Glance: An Audit of Web-Crawled Multilingual Datasets ... Kreutzer, Julia; Caswell, Isaac; Wang, Lisa. - : arXiv, 2021 BASE Show details 6 Multilingual BERT, Ergativity, and Grammatical Subjecthood ... Papadimitriou, Isabel; Chi, Ethan A.; Futrell, Richard. - : University of Massachusetts Amherst, 2021 BASE Show details 7 Multilingual BERT, Ergativity, and Grammatical Subjecthood Papadimitriou, Isabel; Chi, Ethan A.; Futrell, Richard... In: Proceedings of the Society for Computation in Linguistics (2021) BASE Show details 8 Learning Music Helps You Read: Using Transfer to Study Linguistic Structure in Language Models ... Papadimitriou, Isabel; Jurafsky, Dan. - : arXiv, 2020 BASE Show details

Mobile view All Catalogues UB Frankfurt Linguistik 0 IDS Mannheim 0 OLC Linguistik 0 UB Frankfurt Retrokatalog 0 DNB Subject Category Language 0 Institut für Empirische Sprachwissenschaft 0 Leibniz-Centre General Linguistics (ZAS) 0 Bibliographies BLLDB 0 BDSL 0 IDS Bibliografie zur deutschen Grammatik 0 IDS Bibliografie zur Gesprächsforschung 0 IDS Konnektoren im Deutschen 0 IDS Präpositionen im Deutschen 0 IDS OBELEX meta 0 MPI-SHH Linguistics Collection 0 MPI for Psycholinguistics 0 Linked Open Data catalogues Annohub 0 Online resources Link directory 0 Journal directory 0 Database directory 0 Dictionary directory 0 Open access documents BASE 8 Linguistik-Repository 0 IDS Publikationsserver 0 Online dissertations 0 Language Description Heritage 0