2010 EnsemblePruningviaIndividualCon

• (Lu et al., 2010) ⇒ Zhenyu Lu, Xindong Wu, Xingquan Zhu, and Josh Bongard. (2010). “Ensemble Pruning via Individual Contribution Ordering.” In: Proceedings of the 16th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD-2010). doi:10.1145/1835804.1835914

Subject Headings:

Cited By

• ~3 http://scholar.google.com/scholar?q=%22Ensemble+pruning+via+individual+contribution+ordering%22+2010
• http://portal.acm.org/citation.cfm?id=1835914&preflayout=flat#citedby

Quotes

Abstract

An ensemble is a set of learned models that make decisions collectively. Although an ensemble is usually more accurate than a single learner, existing ensemble methods often tend to construct unnecessarily large ensembles, which increases the memory consumption and computational cost. Ensemble pruning tackles this problem by selecting a subset of ensemble members to form subensembles that are subject to less resource consumption and response time with accuracy that is similar to or better than the original ensemble. In this paper, we analyze the accuracy/diversity trade-off and prove that classifiers that are more accurate and make more predictions in the minority group are more important for subensemble construction. Based on the gained insights, a heuristic metric that considers both accuracy and diversity is proposed to ly|explicitly evaluate each individual classifier's contribution to the whole ensemble. By incorporating ensemble members in decreasing order of their contributions, subensembles are formed such that users can select the top [math]\displaystyle{ p }[/math] percent of ensemble members, depending on their resource availability and tolerable waiting time, for predictions. Experimental results on 26 UCI data sets show that subensembles formed by the proposed EPIC (Ensemble Pruning via Individual Contribution ordering) algorithm outperform the original ensemble and a state-of-the-art ensemble pruning method, Orientation Ordering (OO).

References

,

	Author	volume	Date Value	title	type	journal	titleUrl	doi	note	year
2010 EnsemblePruningviaIndividualCon	Xindong Wu Xingquan Zhu Zhenyu Lu Josh Bongard			Ensemble Pruning via Individual Contribution Ordering		KDD-2010 Proceedings	http://www.cs.uvm.edu/~jbongard/papers/2010 KDD Lu.pdf	10.1145/1835804.1835914		2010