2009 ExtractingDiscriminativeConcept

Jump to: navigation, search

Subject Headings: Domain Adaptation Algorithm, Feature Extraction Algorithm, Text Mining, Concept Space, Maximum Mean Discrepancy, 20 Newsgroups Dataset, Document Classification Task, Information Extraction Task.


Cited By


Author Keywords

Domain Adaptation, Text Mining, Feature Extraction


One common predictive modeling challenge occurs in text mining problems is that the training data and the operational (testing) data are drawn from different underlying distributions. This poses a great difficulty for many statistical learning methods. However, when the distribution in the source domain and the target domain are not identical but related, there may exist a shared concept space to preserve the relation. Consequently a good feature representation can encode this concept space and minimize the distribution gap. To formalize this intuition, we propose a domain adaptation method that parameterizes this concept space by linear transformation under which we explicitly minimize the distribution difference between the source domain with sufficient labeled data and target domains with only unlabeled data, while at the same time minimizing the empirical loss on the labeled data in the source domain. Another characteristic of our method is its capability for considering multiple classes and their interactions simultaneously. We have conducted extensive experiments on two common text mining problems, namely, information extraction and document classification to demonstrate the effectiveness of our proposed method.



 AuthorvolumeDate ValuetitletypejournaltitleUrldoinoteyear
2009 ExtractingDiscriminativeConceptBo Chen
Wai Lam
Ivor Tsang
Tak-Lam Wong
Extracting Discriminative Concepts for Domain Adaptation in Text MiningKDD-2009 Proceedings10.1145/1557019.15570452009