1 |
Enhancing Cross-lingual Prompting with Mask Token Augmentation ...
|
|
|
|
BASE
|
|
Show details
|
|
2 |
Cross-lingual Aspect-based Sentiment Analysis with Aspect Term Code-Switching ...
|
|
|
|
BASE
|
|
Show details
|
|
3 |
Towards Multi-Sense Cross-Lingual Alignment of Contextual Embeddings ...
|
|
|
|
Abstract:
Cross-lingual word embeddings (CLWE) have been proven useful in many cross-lingual tasks. However, most existing approaches to learn CLWE including the ones with contextual embeddings are sense agnostic. In this work, we propose a novel framework to align contextual embeddings at the sense level by leveraging cross-lingual signal from bilingual dictionaries only. We operationalize our framework by first proposing a novel sense-aware cross entropy loss to model word senses explicitly. The monolingual ELMo and BERT models pretrained with our sense-aware cross entropy loss demonstrate significant performance improvement for word sense disambiguation tasks. We then propose a sense alignment objective on top of the sense-aware cross entropy loss for cross-lingual model pretraining, and pretrain cross-lingual models for several language pairs (English to German/Spanish/Japanese/Chinese). Compared with the best baseline results, our cross-lingual models achieve 0.52%, 2.09% and 1.29% average performance ...
|
|
Keyword:
Artificial Intelligence cs.AI; Computation and Language cs.CL; FOS Computer and information sciences
|
|
URL: https://dx.doi.org/10.48550/arxiv.2103.06459 https://arxiv.org/abs/2103.06459
|
|
BASE
|
|
Hide details
|
|
5 |
MELM: Data Augmentation with Masked Entity Language Modeling for Low-Resource NER ...
|
|
|
|
BASE
|
|
Show details
|
|
6 |
Multilingual AMR Parsing with Noisy Knowledge Distillation ...
|
|
|
|
BASE
|
|
Show details
|
|
7 |
GlobalWoZ: Globalizing MultiWoZ to Develop Multilingual Task-Oriented Dialogue Systems ...
|
|
|
|
BASE
|
|
Show details
|
|
8 |
Multi-perspective Coherent Reasoning for Helpfulness Prediction of Multimodal Reviews ...
|
|
|
|
BASE
|
|
Show details
|
|
9 |
On the Effectiveness of Adapter-based Tuning for Pretrained Language Model Adaptation ...
|
|
|
|
BASE
|
|
Show details
|
|
11 |
Argument Pair Extraction via Attention-guided Multi-Layer Multi-Cross Encoding ...
|
|
|
|
BASE
|
|
Show details
|
|
12 |
Learning Span-Level Interactions for Aspect Sentiment Triplet Extraction ...
|
|
|
|
BASE
|
|
Show details
|
|
13 |
MulDA: A Multilingual Data Augmentation Framework for Low-Resource Cross-Lingual NER ...
|
|
|
|
BASE
|
|
Show details
|
|
14 |
Unsupervised Cross-lingual Adaptation for Sequence Tagging and Beyond ...
|
|
|
|
BASE
|
|
Show details
|
|
16 |
Transferable End-to-End Aspect-based Sentiment Analysis with Selective Adversarial Learning ...
|
|
|
|
BASE
|
|
Show details
|
|
17 |
A knowledge regularized hierarchical approach for emotion cause analysis
|
|
|
|
BASE
|
|
Show details
|
|
18 |
Neural Rating Regression with Abstractive Tips Generation for Recommendation ...
|
|
|
|
BASE
|
|
Show details
|
|
19 |
Reader-Aware Multi-Document Summarization via Sparse Coding ...
|
|
|
|
BASE
|
|
Show details
|
|
20 |
Abstractive Multi-Document Summarization via Phrase Selection and Merging ...
|
|
|
|
BASE
|
|
Show details
|
|
|
|