Evaluation Series
An Evaluation Series is a series of Benchmark Tasks for evaluating text mining and information extraction systems.
- AKA: Benchmark Evaluation Series.
- Example(s):
- MUC.
- BioCreAtIvE.
- SemEval / SensEval.
- See: Evaluation Assurance Level, Information Extraction Task.
References
2017
- (NCBI) ⇒ https://www.ncbi.nlm.nih.gov/research/bionlp/Research#BioCreative Retrieved:2017-07-16
- QUOTE: Critical Assessment of Information Extraction in Biology (BioCreative) is a community effort for evaluating text mining and information extraction systems applied to the biological domain. Since 2004, the BioCreative Evaluation series has included over ten different tasks such as ranking of relevant documents ("document triage"), extraction of genes and proteins ("gene mention") and their linkage to database identifiers ("gene normalization"), as well as creation of functional annotations in standard ontologies (e.g., GO) and extraction of entity-relations (e.g., protein-protein interaction). As part of the BioCreative executive committee, we have led the organization of multiple shared tasks in recent years such as:
- Chemical-Disease Relation Extraction - BioCreative 2015
- BioC: The BioCreative Interoperability Initiative - BioCreative 2015 & 2013
- Automatic Gene Ontology (GO) Annotation - BioCreative 2013
- Multi-species Gene Normalization (GN) - BioCreative 2010
- QUOTE: Critical Assessment of Information Extraction in Biology (BioCreative) is a community effort for evaluating text mining and information extraction systems applied to the biological domain. Since 2004, the BioCreative Evaluation series has included over ten different tasks such as ranking of relevant documents ("document triage"), extraction of genes and proteins ("gene mention") and their linkage to database identifiers ("gene normalization"), as well as creation of functional annotations in standard ontologies (e.g., GO) and extraction of entity-relations (e.g., protein-protein interaction). As part of the BioCreative executive committee, we have led the organization of multiple shared tasks in recent years such as: