2009 ExtractingDiscriminativeConcept

Subject Headings: Domain Adaptation Algorithm, Feature Extraction Algorithm, Text Mining, Concept Space, Maximum Mean Discrepancy, 20 Newsgroups Dataset, Document Classification Task, Information Extraction Task.

Notes

Categories and Subject Descriptors: H.4 Information Systems Applications: Miscellaneous; I.5.2 Design Methodology: Feature evaluation and selection.
General Terms: Algorithms

One common predictive modeling challenge occurs in text mining problems is that the training data and the operational (testing) data are drawn from different underlying distributions. This poses a great difficulty for many statistical learning methods. However, when the distribution in the source domain and the target domain are not identical but related, there may exist a shared concept space to preserve the relation. Consequently a good feature representation can encode this concept space and minimize the distribution gap. To formalize this intuition, we propose a domain adaptation method that parameterizes this concept space by linear transformation under which we explicitly minimize the distribution difference between the source domain with sufficient labeled data and target domains with only unlabeled data, while at the same time minimizing the empirical loss on the labeled data in the source domain. Another characteristic of our method is its capability for considering multiple classes and their interactions simultaneously. We have conducted extensive experiments on two common text mining problems, namely, information extraction and document classification to demonstrate the effectiveness of our proposed method.

,

	Author	volume	Date Value	title	type	journal	titleUrl	doi	note	year
2009 ExtractingDiscriminativeConcept	Wai Lam Bo Chen Ivor Tsang Tak-Lam Wong			Extracting Discriminative Concepts for Domain Adaptation in Text Mining		KDD-2009 Proceedings		10.1145/1557019.1557045		2009