• Refine your search:
  • 
    Keyword:
    
    • Natural Language Processing (12)
    • Computer and Information Science (5)
    • Neural Network (5)
    • Humans (3)
    • Language Models (3)
    • Semantics (3)
    • Computational Linguistics (2)
    • Data Mining (2)
    • Deep Learning (2)
    • Knowledge Bases (2)
    •   more
  • 
    Creator / Publisher
  • 
    Year
  • 
    Medium
  • 
    Type
  • 
    BLLDB-Access:
    • free (12)
    • subject to license (0)

Search in the Catalogues and Directories

All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year Sort by creator [A → Z]' creator [Z → A]' publishing year ↑ (asc)' publishing year ↓ (desc)' title [A → Z]' title [Z → A]' Simple Search Hits 1 – 12 of 12 1 UNKs Everywhere: Adapting Multilingual Language Models to New Scripts ... The 2021 Conference on Empirical Methods in Natural Language Processing 2021; ., Iryna; ., Sebastian. - : Underline Science Inc., 2021 BASE Show details 2 MirrorWiC: On Eliciting Word-in-Context Representations from Pretrained Language Models ... The 2021 Conference on Empirical Methods in Natural Language Processing 2021; ., Nigel; Korhonen, Anna; Liu, Fangyu; Liu, Qianchu; Vulić, Ivan. - : Underline Science Inc., 2021 Abstract: Recent work indicated that pretrained language models (PLMs) such as BERT and RoBERTa can be transformed into effective sentence and word encoders even via simple self-supervised techniques. Inspired by this line of work, in this paper we propose a fully unsupervised approach to improving word-in-context (WiC) representations in PLMs, achieved via a simple and efficient WiC-targeted fine-tuning procedure: MirrorWiC. The proposed method leverages only raw texts sampled from Wikipedia, assuming no sense-annotated data, and learns context-aware word representations within a standard contrastive learning setup. We experiment with a series of standard and comprehensive WiC benchmarks across multiple languages. Our proposed fully unsupervised MirrorWiC models obtain substantial gains over off-the-shelf PLMs across all monolingual, multilingual and cross-lingual setups. Moreover, on some standard WiC benchmarks, MirrorWiC is even on-par with supervised models fine-tuned with in-task data and sense labels. ... Keyword: Computational Linguistics; Language Models; Machine Learning; Machine Learning and Data Mining; Natural Language Processing URL: https://underline.io/lecture/39862-mirrorwic-on-eliciting-word-in-context-representations-from-pretrained-language-models https://dx.doi.org/10.48448/hs20-qq06 BASE Hide details 3 Fast, Effective, and Self-Supervised: Transforming Masked Language Models into Universal Lexical and Sentence Encoders ... The 2021 Conference on Empirical Methods in Natural Language Processing 2021; ., Nigel; Korhonen, Anna. - : Underline Science Inc., 2021 BASE Show details 4 SemEval-2020 Task 3: Graded Word Similarity in Context ... The 28th International Conference on Computational Linguistics 2020; Armendariz, Carlos; Ljubešić, Nikola. - : Underline Science Inc., 2020 BASE Show details 5 Emergent Communication Pretraining for Few-Shot Machine Translation ... The 28th International Conference on Computational Linguistics 2020; Korhonen, Anna; Li, Yaoyiran. - : Underline Science Inc., 2020 BASE Show details 6 Manual Clustering and Spatial Arrangement of Verbs for Multilingual Evaluation and Typology Analysis ... The 28th International Conference on Computational Linguistics 2020; Korhonen, Anna; Majewska, Olga. - : Underline Science Inc., 2020 BASE Show details 7 SemEval-2020 Task 2: Predicting Multilingual and Cross-Lingual (Graded) Lexical Entailment ... The 28th International Conference on Computational Linguistics 2020; Glavaš, Goran; Korhonen, Anna. - : Underline Science Inc., 2020 BASE Show details 8 Specializing Unsupervised Pretraining Models for Word-Level Semantic Similarity ... The 28th International Conference on Computational Linguistics 2020; Glavaš, Goran; Korhonen, Anna. - : Underline Science Inc., 2020 BASE Show details 9 Modeling Language Variation and Universals: A Survey on Typological Linguistics for Natural Language Processing Ponti, Edoardo,; O 'horan, Helen; Berzak, Yevgeni... In: https://hal.archives-ouvertes.fr/hal-01856176 ; 2018 (2018) BASE Show details 10 A deep learning approach to bilingual lexicon induction in the biomedical domain. ... Heyman, Geert; Vulić, Ivan; Moens, Marie-Francine. - : Apollo - University of Cambridge Repository, 2018 BASE Show details 11 A deep learning approach to bilingual lexicon induction in the biomedical domain. Heyman, Geert; Vulić, Ivan; Moens, Marie-Francine. - : Springer Science and Business Media LLC, 2018. : BMC Bioinformatics, 2018 BASE Show details 12 Bio-SimVerb and Bio-SimLex: wide-coverage evaluation sets of word similarity in biomedicine. Chiu, Billy; Pyysalo, Sampo; Vulić, Ivan. - : BioMed Central, 2018. : BMC bioinformatics, 2018 BASE Show details

Mobile view All Catalogues UB Frankfurt Linguistik 0 IDS Mannheim 0 OLC Linguistik 0 UB Frankfurt Retrokatalog 0 DNB Subject Category Language 0 Institut für Empirische Sprachwissenschaft 0 Leibniz-Centre General Linguistics (ZAS) 0 Bibliographies BLLDB 0 BDSL 0 IDS Bibliografie zur deutschen Grammatik 0 IDS Bibliografie zur Gesprächsforschung 0 IDS Konnektoren im Deutschen 0 IDS Präpositionen im Deutschen 0 IDS OBELEX meta 0 MPI-SHH Linguistics Collection 0 MPI for Psycholinguistics 0 Linked Open Data catalogues Annohub 0 Online resources Link directory 0 Journal directory 0 Database directory 0 Dictionary directory 0 Open access documents BASE 12 Linguistik-Repository 0 IDS Publikationsserver 0 Online dissertations 0 Language Description Heritage 0