1 |
Multilingual Code-Switching for Zero-Shot Cross-Lingual Intent Prediction and Slot Filling ...
|
|
|
|
Abstract:
Predicting user intent and detecting the corresponding slots from text are two key problems in Natural Language Understanding (NLU). In the context of zero-shot learning, this task is typically approached by either using representations from pre-trained multilingual transformers such as mBERT, or by machine translating the source data into the known target language and then fine-tuning. Our work focuses on a particular scenario where the target language is unknown during training. To this goal, we propose a novel method to augment the monolingual source data using multilingual code-switching via random translations to enhance a transformer's language neutrality when fine-tuning it for a downstream task. This method also helps discover novel insights on how code-switching with different language families around the world impact the performance on the target language. Experiments on the benchmark dataset of MultiATIS++ yielded an average improvement of +4.2% in accuracy for intent task and +1.8% in F1 for slot ...
|
|
Keyword:
Computation and Language cs.CL; FOS Computer and information sciences; Machine Learning cs.LG
|
|
URL: https://arxiv.org/abs/2103.07792 https://dx.doi.org/10.48550/arxiv.2103.07792
|
|
BASE
|
|
Hide details
|
|
2 |
Cross-Lingual Text Classification of Transliterated Hindi and Malayalam ...
|
|
|
|
BASE
|
|
Show details
|
|
3 |
What Kind of #Communication is Twitter? A Psycholinguistic Perspective on Communication in Twitter for the Purpose of Emergency Coordination
|
|
|
|
In: Valerie Shalin (2017)
|
|
BASE
|
|
Show details
|
|
4 |
What Kind of #Conversation is Twitter? Mining #Psycholinguistic Cues for Emergency Coordination
|
|
|
|
In: Valerie Shalin (2017)
|
|
BASE
|
|
Show details
|
|
5 |
Intent Classification of Short-Text on Social Media
|
|
|
|
In: Valerie Shalin (2017)
|
|
BASE
|
|
Show details
|
|
6 |
Intent Classification of Short-Text on Social Media
|
|
|
|
In: Amit P. Sheth (2016)
|
|
BASE
|
|
Show details
|
|
7 |
Intent Classification of Short-Text on Social Media
|
|
|
|
In: Krishnaprasad Thirunarayan (2016)
|
|
BASE
|
|
Show details
|
|
8 |
Intent Classification of Short-Text on Social Media
|
|
|
|
In: Publications (2015)
|
|
BASE
|
|
Show details
|
|
9 |
Intent Classification of Short-Text on Social Media
|
|
|
|
In: Publications (2015)
|
|
BASE
|
|
Show details
|
|
10 |
Identifying Seekers and Suppliers in Social Media Communities to Support Crisis Coordination
|
|
|
|
In: John M. Flach (2015)
|
|
BASE
|
|
Show details
|
|
11 |
What Kind of #Conversation is Twitter? Mining #Psycholinguistic Cues for Emergency Coordination
|
|
|
|
In: John M. Flach (2015)
|
|
BASE
|
|
Show details
|
|
12 |
Intent Classification of Short-Text on Social Media
|
|
|
|
In: Kno.e.sis Publications (2015)
|
|
BASE
|
|
Show details
|
|
13 |
What Kind of #Communication is Twitter? A Psycholinguistic Perspective on Communication in Twitter for the Purpose of Emergency Coordination
|
|
|
|
In: John M. Flach (2015)
|
|
BASE
|
|
Show details
|
|
14 |
Identifying Seekers and Suppliers in Social Media Communities to Support Crisis Coordination
|
|
|
|
In: Publications (2014)
|
|
BASE
|
|
Show details
|
|
15 |
Identifying Seekers and Suppliers in Social Media Communities to Support Crisis Coordination
|
|
|
|
In: Amit P. Sheth (2014)
|
|
BASE
|
|
Show details
|
|
16 |
What Kind of #Conversation is Twitter? Mining #Psycholinguistic Cues for Emergency Coordination
|
|
|
|
In: Amit P. Sheth (2014)
|
|
BASE
|
|
Show details
|
|
17 |
Identifying Seekers and Suppliers in Social Media Communities to Support Crisis Coordination
|
|
|
|
In: Kno.e.sis Publications (2014)
|
|
BASE
|
|
Show details
|
|
18 |
What Kind of #Communication is Twitter? A Psycholinguistic Perspective on Communication in Twitter for the Purpose of Emergency Coordination
|
|
|
|
In: Amit P. Sheth (2014)
|
|
BASE
|
|
Show details
|
|
19 |
Twitris v3: From Citizen Sensing to Analysis, Coordination and Action
|
|
|
|
In: Amit P. Sheth (2014)
|
|
BASE
|
|
Show details
|
|
|
|