DE eng

Search in the Catalogues and Directories

Hits 1 – 7 of 7

1
Controllable Natural Language Generation with Contrastive Prefixes ...
Abstract: To guide the generation of large pretrained language models (LM), previous work has focused on directly fine-tuning the language model or utilizing an attribute discriminator. In this work, we propose a novel lightweight framework for controllable GPT2 generation, which utilizes a set of small attribute-specific vectors, called prefixes, to steer natural language generation. Different from prefix-tuning, where each prefix is trained independently, we take the relationship among prefixes into consideration and train multiple prefixes simultaneously. We propose a novel supervised method and also an unsupervised method to train the prefixes for single-aspect control while the combination of these two methods can achieve multi-aspect control. Experimental results on both single-aspect and multi-aspect control show that our methods can guide generation towards the desired attributes while keeping high linguistic quality. ...
Keyword: Computation and Language cs.CL; FOS Computer and information sciences
URL: https://arxiv.org/abs/2202.13257
https://dx.doi.org/10.48550/arxiv.2202.13257
BASE
Hide details
2
Poolingformer: Long Document Modeling with Pooling Attention ...
Zhang, Hang; Gong, Yeyun; Shen, Yelong. - : arXiv, 2021
BASE
Show details
3
Generation-Augmented Retrieval for Open-Domain Question Answering ...
BASE
Show details
4
UnitedQA: A Hybrid Approach for Open Domain Question Answering ...
BASE
Show details
5
Reader-Guided Passage Reranking for Open-Domain Question Answering ...
BASE
Show details
6
Unsupervised Deep Structured Semantic Models for Commonsense Reasoning ...
BASE
Show details
7
Multi-task Learning with Sample Re-weighting for Machine Reading Comprehension ...
BASE
Show details

Catalogues
0
0
0
0
0
0
0
Bibliographies
0
0
0
0
0
0
0
0
0
Linked Open Data catalogues
0
Online resources
0
0
0
0
Open access documents
7
0
0
0
0
© 2013 - 2024 Lin|gu|is|tik | Imprint | Privacy Policy | Datenschutzeinstellungen ändern