2008 LearningToLinkWithWikipedia

Jump to navigation Jump to search

Subject Headings: Wikipedia-based Term Mention Linking Algorithm, Wikipedia-based Term Mention Recognition Algorithm, Supervised Concept Mention Linking Algorithm.


Cited By






This paper describes how to automatically cross-reference documents with Wikipedia: the largest knowledge base ever known. It explains how machine learning can be used to identify significant terms within unstructured text, and enrich it with links to the appropriate Wikipedia articles. The resulting link detector and disambiguator performs very well, with recall and precision of almost 75%. This performance is constant whether the system is evaluated on Wikipedia articles or “real worlddocuments.

This work has implications far beyond enriching documents with explanatory links. It can provide structured knowledge about any unstructured fragment of text. Any task that is currently addressed with bags of words - indexing, clustering, retrieval, and summarization to name a few - could use the techniques described here to draw on a vast network of concepts and semantics.


  • 4. C. David, L. Giroux, S. Bertrand-Gastaldy, and D. Lanteigne (1995) Indexing as problem solving: A cognitive approach to consistency. In: Proceedings of the ASIS Annual Meeting, Medford, NJ, pp. 49--55.
  • 5. S. Dolan. (2008) Six Degrees of Wikipedia. Retrieved June 2008 from www.netsoc.tcd.ie/~mu/wiki/.
  • 6. (Drenner et al., 2006) ⇒ Sara Drenner, Max Harper, Dan Frankowski, John Riedl, and Loren Terveen. (2006). “Insert Movie Reference Here: A system to bridge conversation and item-oriented web sites.” In: Proceedings of the SIGCHI conference on Human Factors in computing systems (SIGCHI 2006) doi:10.1145/1124772.1124914
  • 8. J. Howe. (2006) The Rise of Crowdsourcing. In Wired Magazine 14(6).
  • 9. A. Lih. (2004). Wikipedia as Participatory Journalism: Reliable Sources? Metrics for evaluating collaborative media as a news resource. In: Proceedings of the 5th International Symposium on Online Journalism, Austin, Texas.
  • 10. M. E. Maron. (1977) On indexing, retrieval and the meaning of about. In Journal of the American Society for Information Science 28(1), pp. 38--43
  • 14. David N. Milne, and Witten, I. H. (2008) An effective, low-cost measure of semantic relatedness obtained from Wikipedia links. In: Proceedings of the AAAI 2008 Workshop on Wikipedia and Artificial Intelligence (WIKIAI 2008), Chicago, IL.
  • 15. W. Mossberg. (2001) New Windows XP Feature Can Re-Edit Others' Sites. The Wall Street Journal, June 2001
  • 16. S. P. Ponzetto, and M. Strube. (2007) Deriving a Large Scale Taxonomy from Wikipedia. In: Proceedings of the 22st National Conference on Artificial Intelligence (AAAI'07), Vancouver, British Columbia, pp. 1440--1445.
  • 17. J. Ross Quinlan, C4.5: Programs for Machine Learning, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1993.
  • 18. Fabian M. Suchanek, Gjergji Kasneci, Gerhard Weikum, Yago: a core of semantic knowledge, Proceedings of the 16th International Conference on World Wide Web, May 08-12, 2007, Banff, Alberta, Canada doi:10.1145/1242572.1242667.
  • 19. Max Völkel, Markus Krötzsch, Denny Vrandecic, Heiko Haller, Rudi Studer, Semantic Wikipedia, Proceedings of the 15th International Conference on World Wide Web, May 23-26, 2006, Edinburgh, Scotland doi:10.1145/1135777.1135863,

 AuthorvolumeDate ValuetitletypejournaltitleUrldoinoteyear
2008 LearningToLinkWithWikipediaDavid N. Milne
Ian H. Witten
Learning to Link with WikipediaProceeding of the 17th ACM Conference on Information and Knowledge Managementhttp://www.cs.waikato.ac.nz/~ihw/papers/08-DNM-IHW-LearningToLinkWithWikipedia.pdf10.1145/1458082.14581502008