2003 AutomaticEvalOfSummsUsingNgramCooccur
Jump to navigation
Jump to search
- (Lin & Hovy, 2003) ⇒ Chin-Yew Lin, and Eduard Hovy. (2003). “Automatic Evaluation of Summaries Using N-gram Co-occurrence Statistics.” In: Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology. doi:10.3115/1073445.1073465
Subject Headings: Evaluation Task, Document Summarization Task, N-gram Co-occurrence Statistic.
Notes
Cited By
~583 http://scholar.google.com/scholar?cites=5757500582993593533
Quotes
Abstract
Following the recent adoption by the machine translation community of automatic evaluation using the BLEU/NIST scoring process, we conduct an in-depth study of a similar idea for evaluating summaries. The results show that automatic evaluation using unigram co-occurrences between summary pairs correlates surprising well with human evaluations, based on various statistical metrics; while direct application of the BLEU evaluation procedure does not always give good results.
References
,
| Author | volume | Date Value | title | type | journal | titleUrl | doi | note | year | |
|---|---|---|---|---|---|---|---|---|---|---|
| 2003 AutomaticEvalOfSummsUsingNgramCooccur | Eduard Hovy Chin-Yew Lin | Automatic Evaluation of Summaries Using N-gram Co-occurrence Statistics | http://www.aclweb.org/anthology/N/N03/N03-1020.pdf | 10.3115/1073445.1073465 |