• Refine your search:
  • 
    Keyword
  • 
    Creator / Publisher:
    
    • Dufter, Philipp (31)
    • Schütze, Hinrich (29)
    • Sabet, Masoud Jalili (5)
    • Zhao, Mengjie (5)
    • Liang, Sheng (4)
    • Schmitt, Martin (4)
    • Yvon, François (4)
    • Fraser, Alexander (3)
    • Imani, Ayyoob (3)
    • Kassner, Nora (3)
    •   more
  • 
    Year
  • 
    Medium
  • 
    Type
  • 
    BLLDB-Access

Search in the Catalogues and Directories

All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year Sort by creator [A → Z]' creator [Z → A]' publishing year ↑ (asc)' publishing year ↓ (desc)' title [A → Z]' title [Z → A]' Simple Search Page: 1 2 Hits 1 – 20 of 31 1 Graph Algorithms for Multiparallel Word Alignment Imani, Ayyoob; Sabet, Masoud,; Keremşenel, Lütfi... In: Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing ; The 2021 Conference on Empirical Methods in Natural Language Processing ; https://hal.archives-ouvertes.fr/hal-03424044 ; The 2021 Conference on Empirical Methods in Natural Language Processing, Association for Computational Linguistics, Nov 2021, Punta Cana, Dominica ; https://2021.emnlp.org/ (2021) BASE Show details 2 Static Embeddings as Efficient Knowledge Bases? ... Dufter, Philipp; Kassner, Nora; Schütze, Hinrich. - : arXiv, 2021 BASE Show details 3 ParCourE: A Parallel Corpus Explorer for a Massively Multilingual Corpus ... Imani, Ayyoob; Sabet, Masoud Jalili; Dufter, Philipp. - : arXiv, 2021 BASE Show details 4 Multilingual LAMA: Investigating Knowledge in Multilingual Pretrained Language Models ... Kassner, Nora; Dufter, Philipp; Schütze, Hinrich. - : arXiv, 2021 BASE Show details 5 Wine is Not v i n. -- On the Compatibility of Tokenizations Across Languages ... Maronikolakis, Antonis; Dufter, Philipp; Schütze, Hinrich. - : arXiv, 2021 BASE Show details 6 Graph Algorithms for Multiparallel Word Alignment ... Imani, Ayyoob; Sabet, Masoud Jalili; Şenel, Lütfi Kerem. - : arXiv, 2021 BASE Show details 7 Locating Language-Specific Information in Contextualized Embeddings ... Liang, Sheng; Dufter, Philipp; Schütze, Hinrich. - : arXiv, 2021 BASE Show details 8 Static Embeddings as Efficient Knowledge Bases? ... NAACL 2021 2021; Dufter, Philipp; Kassner, Nora. - : Underline Science Inc., 2021 BASE Show details 9 ParCourE: A Parallel Corpus Explorer for a Massively Multilingual Corpus ... The Joint Conference of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing 2021; Cysouw, Michael; Dufter, Philipp. - : Underline Science Inc., 2021 BASE Show details 10 SimAlign: High Quality Word Alignments Without Parallel Training Data Using Static and Contextualized Embeddings Jalili Sabet, Masoud; Dufter, Philipp; Yvon, François... In: EMNLP 2020 ; https://hal.archives-ouvertes.fr/hal-03013194 ; EMNLP 2020, Association for Computational Linguistics, Nov 2020, Online, United States. pp.1627 - 1643 (2020) BASE Show details 11 Identifying Necessary Elements for BERT’s Multilinguality Dufter, Philipp; Schütze, Hinrich. - 2020 Abstract: It has been shown that multilingual BERT (mBERT) yields high quality multilingual rep- resentations and enables effective zero-shot transfer. This is suprising given that mBERT does not use any kind of crosslingual sig- nal during training. While recent literature has studied this effect, the exact reason for mBERT’s multilinguality is still unknown. We aim to identify architectural properties of BERT as well as linguistic properties of lan- guages that are necessary for BERT to become multilingual. To allow for fast experimenta- tion we propose an efficient setup with small BERT models and synthetic as well as natu- ral data. Overall, we identify six elements that are potentially necessary for BERT to be mul- tilingual. Architectural factors that contribute to multilinguality are underparameterization, shared special tokens (e.g., “[CLS]”), shared position embeddings and replacing masked to- kens with random tokens. Factors related to training data that are beneficial for multilin- guality are similar word order and comparabil- ity of corpora. Keyword: ddc:000; ddc:410 URL: https://epub.ub.uni-muenchen.de/72199/ https://epub.ub.uni-muenchen.de/72199/1/identify,dufter.pdf https://doi.org/10.5282/ubm/epub.72199 http://nbn-resolving.de/urn:nbn:de:bvb:19-epub-72199-8 BASE Hide details 12 Identifying Elements Essential for BERT’s Multilinguality Schütze, Hinrich; Dufter, Philipp. - 2020 BASE Show details 13 SimAlign: High Quality Word Alignments without Parallel Training Data using Static and Contextualized Embeddings Sabet, Masoud Jalili; Dufter, Philipp; Schütze, Hinrich In: Findings of ACL: EMNLP 2020 (2020) BASE Show details 14 Monolingual and Multilingual Reduction of Gender Bias in Contextualized Representations Liang, Sheng; Dufter, Philipp; Schütze, Hinrich. - 2020 BASE Show details 15 Increasing Learning Efficiency of Self-Attention Networks through Direct Position Interactions, Learnable Temperature, and Convoluted Attention Schütze, Hinrich; Dufter, Philipp; Schmitt, Martin. - 2020 BASE Show details 16 SimAlign: High Quality Word Alignments without Parallel Training Data using Static and Contextualized Embeddings ... Sabet, Masoud Jalili; Dufter, Philipp; Yvon, François. - : arXiv, 2020 BASE Show details 17 Identifying Necessary Elements for BERT's Multilinguality ... Dufter, Philipp; Schütze, Hinrich. - : arXiv, 2020 BASE Show details 18 Identifying Elements Essential for BERT’s Multilinguality ... Dufter, Philipp; Schütze, Hinrich. - : Universitätsbibliothek der Ludwig-Maximilians-Universität München, 2020 BASE Show details 19 Identifying Necessary Elements for BERT’s Multilinguality ... Dufter, Philipp; Schütze, Hinrich. - : Universitätsbibliothek der Ludwig-Maximilians-Universität München, 2020 BASE Show details 20 Monolingual and Multilingual Reduction of Gender Bias in Contextualized Representations ... Liang, Sheng; Dufter, Philipp; Schütze, Hinrich. - : Universitätsbibliothek der Ludwig-Maximilians-Universität München, 2020 BASE Show details Page: 1 2

Mobile view All Catalogues UB Frankfurt Linguistik 0 IDS Mannheim 0 OLC Linguistik 0 UB Frankfurt Retrokatalog 0 DNB Subject Category Language 0 Institut für Empirische Sprachwissenschaft 0 Leibniz-Centre General Linguistics (ZAS) 0 Bibliographies BLLDB 0 BDSL 0 IDS Bibliografie zur deutschen Grammatik 0 IDS Bibliografie zur Gesprächsforschung 0 IDS Konnektoren im Deutschen 0 IDS Präpositionen im Deutschen 0 IDS OBELEX meta 0 MPI-SHH Linguistics Collection 0 MPI for Psycholinguistics 0 Linked Open Data catalogues Annohub 0 Online resources Link directory 0 Journal directory 0 Database directory 0 Dictionary directory 0 Open access documents BASE 31 Linguistik-Repository 0 IDS Publikationsserver 0 Online dissertations 0 Language Description Heritage 0