2003 OverviewoftheTREC2003QuestionAn

• (Voorhees, 2003) ⇒ Ellen M. Voorhees. (2003). “Overview of the TREC 2003 Question Answering Track.” In: Proceedings of the TREC-12 Conference. NIST.

Subject Headings: Question Answering (QA) Task; Question Answering (QA) System.

Cited By

• http://scholar.google.com/scholar?q=%222003%22+Overview+of+the+TREC+2003+Question+Answering+Track

Quotes

Abstract

The TREC 2003 question answering track contained two tasks, the passages task and the main task. In the passages task, systems returned a single text snippet in response to factoid questions; the evaluation metric was the number of snippets that contained a correct answer. The main task contained three separate types of questions, factoid questions, list questions, and definition questions. Each of the questions was tagged as to its type and the different question types were evaluated separately. The final score for a main task run was a combination of the scores for the separate question types.

This paper defines the various tasks included in the track and reports the evaluation results. Since the TREC 2003 track was the first time for significant participation in the definition and list subtasks, the paper also examines the reliability of the evaluation for these tasks.

References

;

	Author	volume	Date Value	title	type	journal	titleUrl	doi	note	year
2003 OverviewoftheTREC2003QuestionAn	Ellen Voorhees			Overview of the TREC 2003 Question Answering Track						2003