2018 HotpotQAADatasetforDiverseExpla

(Yang et al., 2018) ⇒ Zhilin Yang, Peng Qi, Saizheng Zhang, Yoshua Bengio, William W. Cohen, Ruslan Salakhutdinov, and Christopher D. Manning. (2018). “HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answering.” In: Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing (EMNLP 2018).

Subject Headings: HotpotQA Dataset; Question-Answering Dataset.

Notes

Cited By

Google Scholar: ~ 326 Citations, Retrieved:2021-01-03.

Quotes

Abstract

Existing question answering (QA) datasets fail to train QA systems to perform complex reasoning and provide explanations for answers. We introduce HotpotQA, a new dataset with 113k Wikipedia-based question-answer pairs with four key features: (1) the questions require finding and reasoning over multiple supporting documents to answer; (2) the questions are diverse and not constrained to any pre-existing knowledge bases or knowledge schemas; (3) we provide sentence-level supporting facts required for reasoning, allowing QA systems to reason with strong supervision and explain the predictions; (4) we offer a new type of factoid comparison questions to test QA systems' ability to extract relevant facts and perform necessary comparison. We show that HotpotQA is challenging for the latest QA systems, and the supporting facts enable models to improve performance and make explainable predictions.

References

BibTeX

@inproceedings{2018_HotpotQAADatasetforDiverseExpla,
  author    = {Zhilin Yang and
               Peng Qi and
               Saizheng Zhang and
               Yoshua Bengio and
               William W. Cohen and
               Ruslan Salakhutdinov and
               Christopher D. Manning},
  editor    = {Ellen Riloff and
               David Chiang and
               Julia Hockenmaier and
               Junichi Tsujii},
  title     = {HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question
               Answering},
  booktitle = {Proceedings of the 2018 Conference on Empirical Methods in Natural
               Language Processing (EMNLP 2018)},
  pages     = {2369--2380},
  publisher = {Association for Computational Linguistics},
  year      = {2018},
  url       = {https://doi.org/10.18653/v1/d18-1259},
  doi       = {10.18653/v1/d18-1259},
}

	Author	volume	Date Value	title	type	journal	titleUrl	doi	note	year
2018 HotpotQAADatasetforDiverseExpla	William W. Cohen Christopher D. Manning Yoshua Bengio Ruslan Salakhutdinov Zhilin Yang Peng Qi Saizheng Zhang			HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answering						2018