2006 MetricsForEvalOfOntBasedIE
- (Maynard et al., 2006) ⇒ Diana Maynard, Wim Peters, and Yaoyong Li. (2006). “Metrics for Evaluation of Ontology-based Information Extraction.” In: WWW 2006 Workshop on Evaluation of Ontologies for the Web (EON 2006).
Subject Headings: Ontology Population Task, Task Performance Measure, Partially Correct Prediction.
Notes
Cited By
2006
- (Dellschaft & Staab, 2006) ⇒ Klaas Dellschaft and Steffen Staab. (2006). “On How to Perform a Gold Standard Based Evaluation of Ontology Learning.” In: Proceedings of the 5th International Semantic Web Conference (ISWC 2006).
Quotes
Abstract
The evaluation of the quality of ontological classification is an important part of semantic web technology. Because this area is under constant development, it requires improvement and standardisation. This paper discusses existing evaluation metrics, and proposes a new method for evaluating the ontology population task, which is general enough to be used in a variety of situations, yet more precise than many current metrics. The paper further describes our first efforts in operationalising the evaluation procedure, including the creation of a semantically annotated corpus that will function as a test bed for the proposed evaluation mechanism, and comparison of different evaluation metrics. We conclude that for ontology-based evaluation, a more complex mechanism than is traditionally used is preferable. This mechanism aims to drive a benchmarking assessment tool for the current state-of-the-art of ontology population, and to set a standard for best practice for future evaluation of human language technology for the semantic web.,
| Author | volume | Date Value | title | type | journal | titleUrl | doi | note | year | |
|---|---|---|---|---|---|---|---|---|---|---|
| 2006 MetricsForEvalOfOntBasedIE | Diana Maynard Wim Peters Yaoyong Li | Metrics for Evaluation of Ontology-based Information Extraction | WWW 2006 Workshop on Evaluation of Ontologies for the Web | http://ftp.informatik.rwth-aachen.de/Publications/CEUR-WS/Vol-179/eon2006maynardetal.pdf | 2006 |