2013 AFrameworkforBenchmarkingEntity
- (Cornolti et al., 2013) ⇒ Marco Cornolti, Paolo Ferragina, and Massimiliano Ciaramita. (2013). “A Framework for Benchmarking Entity-annotation Systems.” In: Proceedings of the 22nd International Conference on World Wide Web. ISBN:978-1-4503-2035-1
Subject Headings: Entity-Annotation Task, Entity-Annotation System.
Notes
Cited By
- http://scholar.google.com/scholar?q=%222013%22+A+Framework+for+Benchmarking+Entity-annotation+Systems
- http://dl.acm.org/citation.cfm?id=2488388.2488411&preflayout=flat#citedby
Quotes
Abstract
In this paper we design and implement a benchmarking framework for fair and exhaustive comparison of entity-annotation systems. The framework is based upon the definition of a set of problems related to the entity-annotation task, a set of measures to evaluate systems performance, and a systematic comparative evaluation involving all publicly available datasets, containing texts of various types such as news, tweets and Web pages. Our framework is easily-extensible with novel entity annotators, datasets and evaluation measures for comparing systems, and it has been released to the public as open source. We use this framework to perform the first extensive comparison among all available entity annotators over all available datasets, and draw many interesting conclusions upon their efficiency and effectiveness. We also draw conclusions between academic versus commercial annotators.
References
;
| Author | volume | Date Value | title | type | journal | titleUrl | doi | note | year | |
|---|---|---|---|---|---|---|---|---|---|---|
| 2013 AFrameworkforBenchmarkingEntity | Paolo Ferragina Massimiliano Ciaramita Marco Cornolti | A Framework for Benchmarking Entity-annotation Systems | 2013 |