Home
Catalogue search
Refine your search:
Keyword:
Computational Linguistics (22)
Artificial Intelligence and Robotics (16)
Computer Sciences (9)
Semantics and Pragmatics (8)
Cognition and Perception (7)
Psycholinguistics and Neurolinguistics (7)
Computation and Language cs.CL (6)
FOS Computer and information sciences (6)
Prepositions (6)
Situated Dialog (6)
more
Creator / Publisher:
Kelleher, John D. (42)
Mac Namee, Brian (10)
Dobnik, Simon (7)
Kelleher, John (6)
SFI Research Centres Programme (6)
Costello, Fintan (5)
Klubicka, Filip (5)
Schütte, Niels (5)
Maldonado, Alfredo (4)
van Genabith, Josef (4)
more
Year
Medium
Type
BLLDB-Access
Search in the Catalogues and Directories
All fields
Title
Creator / Publisher
Keyword
Year
AND
OR
AND NOT
All fields
Title
Creator / Publisher
Keyword
Year
AND
OR
AND NOT
All fields
Title
Creator / Publisher
Keyword
Year
AND
OR
AND NOT
All fields
Title
Creator / Publisher
Keyword
Year
AND
OR
AND NOT
All fields
Title
Creator / Publisher
Keyword
Year
Sort by
creator [A → Z]
'
creator [Z → A]
'
publishing year ↑ (asc)
'
publishing year ↓ (desc)
'
title [A → Z]
'
title [Z → A]
'
Simple Search
Page:
1
2
3
Hits 1 – 20 of 51
1
Shapley Idioms: Analysing BERT Sentence Embeddings for General Idiom Token Identification
Nedumpozhimana, Vasudevan
;
Klubička, Filip
;
Kelleher, John D.
In: Front Artif Intell (2022)
Abstract:
This article examines the basis of Natural Language Understanding of transformer based language models, such as BERT. It does this through a case study on idiom token classification. We use idiom token identification as a basis for our analysis because of the variety of information types that have previously been explored in the literature for this task, including: topic, lexical, and syntactic features. This variety of relevant information types means that the task of idiom token identification enables us to explore the forms of linguistic information that a BERT language model captures and encodes in its representations. The core of this article presents three experiments. The first experiment analyzes the effectiveness of BERT sentence embeddings for creating a general idiom token identification model and the results indicate that the BERT sentence embeddings outperform Skip-Thought. In the second and third experiment we use the game theory concept of Shapley Values to rank the usefulness of individual idiomatic expressions for model training and use this ranking to analyse the type of information that the model finds useful. We find that a combination of idiom-intrinsic and topic-based properties contribute to an expression's usefulness in idiom token identification. Overall our results indicate that BERT efficiently encodes a variety of information from topic, through lexical and syntactic information. Based on these results we argue that notwithstanding recent criticisms of language model based semantics, the ability of BERT to efficiently encode a variety of linguistic information types does represent a significant step forward in natural language understanding.
Keyword:
Artificial Intelligence
URL:
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC8964145/
https://doi.org/10.3389/frai.2022.813967
BASE
Hide details
2
Poisoning Knowledge Graph Embeddings via Relation Inference Patterns ...
Bhardwaj, Peru
;
Kelleher, John
;
Costabello, Luca
. - : arXiv, 2021
BASE
Show details
3
Poisoning Knowledge Graph Embeddings via Relation Inference Patterns ...
The Joint Conference of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing 2021
;
Bhardwaj, Peru
;
Costabello, Luca
. - : Underline Science Inc., 2021
BASE
Show details
4
Adversarial Attacks on Knowledge Graph Embeddings via Instance Attribution Methods ...
The 2021 Conference on Empirical Methods in Natural Language Processing 2021
;
Bhardwaj, Peru
;
Costabello, Luca
. - : Underline Science Inc., 2021
BASE
Show details
5
Style versus Content: A distinction without a (learnable) difference?
Jafaritazehjani, Somayeh
;
Lecorvé, Gwénolé
;
Lolive, Damien
...
In: International Conference on Computational Linguistics ; https://hal.archives-ouvertes.fr/hal-03112354 ; International Conference on Computational Linguistics, Dec 2020, Virtual, Spain (2020)
BASE
Show details
6
Language-Driven Region Pointer Advancement for Controllable Image Captioning ...
Lindh, Annika
;
Ross, Robert J.
;
Kelleher, John D.
. - : arXiv, 2020
BASE
Show details
7
Semantic Relatedness and Taxonomic Word Embeddings ...
Kacmajor, Magdalena
;
Kelleher, John D.
;
Klubicka, Filip
. - : arXiv, 2020
BASE
Show details
8
English WordNet Taxonomic Random Walk Pseudo-Corpora
Klubicka, Filip
;
Maldonado, Alfredo
;
Mahalunkar, Abhijit
...
In: Conference papers (2020)
BASE
Show details
9
Language-Driven Region Pointer Advancement for Controllable Image Captioning
Lindh, Annika
;
Ross, Robert
;
Kelleher, John D.
In: Conference papers (2020)
BASE
Show details
10
Local Alignment of Frame of Reference Assignment in English and Swedish Dialogue
Dobnik, Simon
;
Kelleher, John D.
;
Howes, Christine
In: Conference papers (2020)
BASE
Show details
11
Capturing and measuring thematic relatedness [<Journal>]
Kacmajor, Magdalena Verfasser]
DNB Subject Category Language
Show details
12
Synthetic, Yet Natural: Properties of WordNet Random Walk Corpora and the impact of rare words on embedding performance
Klubicka, Filip
;
Mahalunkar, Abhijit
;
Maldonado, Alfredo
...
In: Conference papers (2019)
BASE
Show details
13
Size Matters: The Impact of Training Size in Taxonomically-Enriched Word Embeddings
Maldonado, Alfredo
;
Klubicka, Filip
;
Kelleher, John D.
In: Articles (2019)
BASE
Show details
14
TEST: A terminology extraction system for technology related terms
Hossari, Murhaf
;
Dev, Soumyabrata
;
Kelleher, John
In: Conference papers (2019)
BASE
Show details
15
Modular Mechanistic Networks: On Bridging Mechanistic and Phenomenological Models with Deep Neural Networks in Natural Language Processing ...
Dobnik, Simon
;
Kelleher, John D.
. - : arXiv, 2018
BASE
Show details
16
What is not where: the challenge of integrating spatial representations into deep learning architectures ...
Kelleher, John D.
;
Dobnik, Simon
. - : arXiv, 2018
BASE
Show details
17
Is it worth it? Budget-related evaluation metrics for model selection ...
Klubička, Filip
;
Salton, Giancarlo D.
;
Kelleher, John D.
. - : arXiv, 2018
BASE
Show details
18
Is it worth it? Budget-related evaluation metrics for model selection
Klubicka, Filip
;
Salton, Giancarlo
;
Kelleher, John D.
In: Conference papers (2018)
BASE
Show details
19
Exploring the Functional and Geometric Bias of Spatial Relations Using Neural Language Models
Dobnik, Simon
;
Ghanimifard, Mehdi
;
Kelleher, John D.
In: Conference papers (2018)
BASE
Show details
20
Idiom Type Identification with Smoothed Lexical Features and a Maximum Margin Classifier ...
Kelleher, John; Ross, Robert J. And Salton, Giancarlo
. - : Dublin Institute of Technology, 2017
BASE
Show details
Page:
1
2
3
Mobile view
All
Catalogues
UB Frankfurt Linguistik
0
IDS Mannheim
0
OLC Linguistik
0
UB Frankfurt Retrokatalog
0
DNB Subject Category Language
1
Institut für Empirische Sprachwissenschaft
0
Leibniz-Centre General Linguistics (ZAS)
0
Bibliographies
BLLDB
0
BDSL
0
IDS Bibliografie zur deutschen Grammatik
0
IDS Bibliografie zur Gesprächsforschung
0
IDS Konnektoren im Deutschen
0
IDS Präpositionen im Deutschen
0
IDS OBELEX meta
0
MPI-SHH Linguistics Collection
0
MPI for Psycholinguistics
1
Linked Open Data catalogues
Annohub
0
Online resources
Link directory
0
Journal directory
0
Database directory
0
Dictionary directory
0
Open access documents
BASE
49
Linguistik-Repository
0
IDS Publikationsserver
0
Online dissertations
0
Language Description Heritage
0
© 2013 - 2024 Lin|gu|is|tik
|
Imprint
|
Privacy Policy
|
Datenschutzeinstellungen ändern