Text Item Classification Task

A text item classification ask is a classification task whose input is a text item and whose class set is a text category set.

• AKA: Text Classification, Document Categorization, Text Categorization, Document Classification.
• Context:
  • Input: a Text Item Set.
    • Optional Input: an Integer of the number of text categories to return.
    • Optional Input: a Text Item Classifier.
    • Optional Input: a Text Corpus (such as an Annotated Text Corpus)
  • Output: a Text Category Set.
    • Optional Output: a text classifier.
  • Task Performance Measures: (see: Classification Task Performance Measure).
  • It can be solved by a Text Categorization System that implements a Text Categorization Algorithm.
  • It can be, based on the availability of a labeled corpus, a Supervised Text Classification Task or an Unsupervised Text Classification Task.
  • It can be, based on the text category set cardinality.
    • a Binary Text Classification Task, such as {spam, no spam}
    • a Multiclass Text Classification Task, such as {sports, health, entertainment, local politics,...}.
    • a Large Multiclass Text Classification Task, such as the 18,000 MeSH headings.
• Example(s):
  • Webpage Type Classification: Classify a Webpage into categories such as a Product Review, "News Article", "Spam Webpage", or "Other" (a Multi-Valued Classification Task).
  • Spam Email Classification: Classify an Email Message as to whether it a Spam Email Message or not, a Binary Classification Task.
  • A Product Review Classification Task.
  • A Text Sentiment Classification Task.
  • A Newswire Topic Classification Task.
• Counter-Example(s):
  • a Text Segment Classification Task, such as POS Tagging.
  • a Text Segmentation Task, such as Text Chunking.
  • a Text Segment Classification Task, such as Named Entity Mention Recognition.
• See: Topic Modeling Task; NLP Task; Predictive Classifier; Classification; Document Clustering; Feature Selection; Perception; Semi-Supervised Text Processing; Support Vector Machine; Text Visualization.

---

---

References

2011

• (Mladeni; Brank; & Grobelnik, 2011) ⇒ Dunja Mladeni; Janez Brank; Marko Grobelnik. (2011). "Document Classification." In: (Sammut & Webb, 2011) p.289

2009

• (Wikipedia, 2009) ⇒ http://en.wikipedia.org/wiki/Document_classification
  • Document classification/categorization is a problem in information science. The task is to assign an electronic document to one or more categories, based on its contents. Document classification tasks can be divided into two sorts: supervised document classification where some external mechanism (such as human feedback) provides information on the correct classification for documents, and unsupervised document classification, where the classification must be done entirely without reference to external information. There is also a semi-supervised document classification, where parts of the documents are labeled by the external mechanism.

2008

• (Manning & al, 2008) ⇒ Christopher D. Manning, Prabhakar Raghavan, and Hinrich Schütze. (2008). "Introduction to Information Retrieval." Cambridge University Press. ISBN 0521865719.
  • The text classification problem http://nlp.stanford.edu/IR-book/html/htmledition/the-text-classification-problem-1.html ... In text classification, we are given a description \(d\) in X of a document, where X is the document space ; and a fixed set of classes C = {c₁,c₂,...,c_J}. Classes are also called categories or labels. Typically, the document space X is some type of high-dimensional space, and the classes are human defined for the needs of an application... We are given a training set D of labeled documents <d,c>, where <d,c> in X x C.

    Our goal in text classification is high accuracy on test data or new data ... When we use the training set to learn a classifier for test data, we make the assumption that training data and test data are similar or from the same distribution.

2007

• (Thet & al, 2007) ⇒ Tun Thura Thet, Jin-Cheon Na, and Christopher S. G. Khoo. (2007). "Filtering Product Reviews from Web Search Results." In: Proceedings of the 2007 ACM symposium on Document Engineering.
  • NOTES: It compares the performance of a Supervised Learning Algorithm and a Heuristic Approach to a Text Categorization Task that is based on Search Snippets.
  • NOTES: The Search Snippets are from Google queries using the format "[product name] review".

2006

• (Ruch, 2006) ⇒ Patrick Ruch. (2006). "Automatic Assignment of Biomedical Categories: toward a generic approach." In: Bioinformatics, 2006 Mar 15. doi:10.1093/bioinformatics/bti783.
  • QUOTE: To our knowledge the largest set of categories ever used by text classification systems has an order of magnitude of 10⁴. Thus, Yang and Chute (1992) work with the International Classification of Diseases (about 12,000 concepts), while Yang (1999) and Wilbur and Yang (1996) report on experiments conducted with a search space of less than 18,000 Medical Subject Headings (MeSH). To evaluate our system, it is tested using two different benchmarks: 1) the OHSUGEN (Hersh, 2005) collection for the MeSH terminology and 2) the BioCreative data for the Gene Ontology (GO).

2002

• (Sebastiani, 2002) ⇒ Fabrizio Sebastiani. (2002). "Machine Learning in Automated Text Categorization." In: Association of Computing Machinery Computing Surveys (CSUR), 34(1).
  • The automated categorization (or classification) of texts into predefined categories has witnessed a booming interest in the last 10 years, due to the increased availability of documents in digital form and the ensuing need to organize them. In the research community the dominant approach to this problem is based on machine learning techniques: a general inductive process automatically builds a classifier by learning, from a set of preclassified documents, the characteristics of the categories.

1999

• (Yang, 1999) ⇒ Y. Yang. (1999). "An Evaluation of Statistical Approaches to Text Categorization." In: Journal of Information Retrieval, 1.
  • NOTE: it experiments on a search space of ~18,000 Medical Subject Headings (MeSH).

• (McCallum, 1999) ⇒ Andrew McCallum. (1999). "Multi-label Text Classification with a Mixture Model Trained by EM." In: AAAI 99 Workshop on Text Learning.
  • QUOTE: In many important document classification tasks, documents may each be associated with multiple class labels. ... Text classification is the problem of assigning a text document into one or more topic categories or classes. In multiclass document classification, as distinguished from binary document classification, there are more than two classes. In multi-label classification each document may have more than one class label. For example, given classes N. America, S. America, Europe, Asia and Australia, a news article about U.S. troops in Bosnia may be labeled with both the N. America and Europe classes.

1998

• (Dumais & al, 1998) ⇒ Susan T. Dumais, John C. Platt, David Heckerman, and Mehran Sahami. (1998). "Inductive Learning Algorithms and Representations for Text Categorization." In: Proceedings of the Seventh International Conference on Information and Knowledge Management (CIKM 1998).
  • Text categorization – the assignment of natural language texts to one or more predefined categories based on their content – is an important component in many information organization and management tasks. Its most widespread application to date has been for assigning subject categories to documents to support text retrieval, routing and filtering.

1996

• (Wilbur & Yang, 1996) ⇒ J. Wilbur, and Y. Yang. (1996). "Analysis of Statistical Term Strength and its Use in the Indexing and Retrieval of Molecular Biology Texts." In: Comput. Biol. Med., 26(3), 209–222.
  • experiment on a search space of less than 18,000 Medical Subject Headings (MeSH).

1992

• (Yang & Chute, 1992) ⇒ Y. Yang, and C. Chute. (1992). "A Linear Least Squares Fit Mapping Method for Information Retrieval from Natural Language Texts." In: COLING 1992.
  • Work with the International Classification of Diseases (about 12,000 concepts)

1975

• (Field, 1975) ⇒ B. J. Field. (1975). "Towards Automatic Indexing: Automatic assignment of controlled-language indexing and classification from free indexing." In: : Journal of Documentation, 31(4). doi:10.1108/eb026605

1963

• (Borko & Bernick, 1963) ⇒ Harold Borko, and Myrna Bernick. (1963). "Automatic Document Classification." In: Journal of the ACM (JACM).
  • The problem of automatic document classification is a part of the larger problem of automatic content analysis. Classification means the determination of subject content. For a document to be classified under a given heading, it must be ascertained that its subject matter relates to that area of discourse. In most cases this is a relatively easy decision for a human being to make. The question being raised is whether a computer can be programmed to determine the subject content of a document and the category (categories) into which it should be classified.

---