1 |
Which Linguist Invented the Lightbulb? Presupposition Verification for Question-Answering ...
|
|
|
|
Abstract:
Many Question-Answering (QA) datasets contain unanswerable questions, but their treatment in QA systems remains primitive. Our analysis of the Natural Questions (Kwiatkowski et al. 2019) dataset reveals that a substantial portion of unanswerable questions ($\sim$21%) can be explained based on the presence of unverifiable presuppositions. We discuss the shortcomings of current models in handling such questions, and describe how an improved system could handle them. Through a user preference study, we demonstrate that the oracle behavior of our proposed system that provides responses based on presupposition failure is preferred over the oracle behavior of existing QA systems. Then we discuss how our proposed system could be implemented, presenting a novel framework that breaks down the problem into three steps: presupposition generation, presupposition verification and explanation generation. We report our progress in tackling each subproblem, and present a preliminary approach to integrating these steps into ... : ACL 2021 Camera-ready ...
|
|
Keyword:
Computation and Language cs.CL; FOS Computer and information sciences
|
|
URL: https://dx.doi.org/10.48550/arxiv.2101.00391 https://arxiv.org/abs/2101.00391
|
|
BASE
|
|
Hide details
|
|
2 |
Which Linguist Invented the Lightbulb? Presupposition Verification for Question-Answering ...
|
|
|
|
BASE
|
|
Show details
|
|
3 |
Testing for Grammatical Category Abstraction in Neural Language Models
|
|
|
|
In: Proceedings of the Society for Computation in Linguistics (2021)
|
|
BASE
|
|
Show details
|
|
4 |
What do you learn from context? Probing for sentence structure in contextualized word representations ...
|
|
|
|
BASE
|
|
Show details
|
|
5 |
Predicting the Argumenthood of English Prepositional Phrases ...
|
|
|
|
BASE
|
|
Show details
|
|
|
|