2015 TradingInterpretabilityforAccur

• (Wang et al., 2015) ⇒ Jialei Wang, Ryohei Fujimaki, and Yosuke Motohashi. (2015). “Trading Interpretability for Accuracy: Oblique Treed Sparse Additive Models.” In: Proceedings of the 21st ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD-2015). ISBN:978-1-4503-3664-2 doi:10.1145/2783258.2783407

Subject Headings:

Cited By

• http://scholar.google.com/scholar?q=%222015%22+Trading+Interpretability+for+Accuracy%3A+Oblique+Treed+Sparse+Additive+Models
• http://dl.acm.org/citation.cfm?id=2783258.2783407&preflayout=flat#citedby

Quotes

Author Keywords

• Interpretable model; learning; model selection; sparseness

Abstract

Model interpretability has been recognized to play a key role in practical data mining. Interpretable models provide significant insights on data and model behaviors and may convince end-users to employ certain models. In return for these advantages, however, there is generally a sacrifice in accuracy, i.e., flexibility of model representation (e.g., linear, rule-based, etc.) and model complexity needs to be restricted in order for users to be able to understand the results. This paper proposes oblique treed sparse additive models (OT-SpAMs). Our main focus is on developing a model which sacrifices a certain degree of interpretability for accuracy but achieves entirely sufficient accuracy with such fully non-linear models as kernel support vector machines (SVMs). OT-SpAMs are instances of region-specific predictive models. They divide feature spaces into regions with sparse oblique tree splitting and assign local sparse additive experts to individual regions. In order to maintain OT-SpAM interpretability, we have to keep the overall model structure simple, and this produces simultaneous model selection issues for sparse oblique region structures and sparse local experts. We address this problem by extending factorized asymptotic Bayesian inference. We demonstrate, on simulation, benchmark, and real world datasets that, in terms of accuracy, OT-SpAMs outperform state-of-the-art interpretable models and perform competitively with kernel SVMs, while still providing results that are highly understandable.

References

;

	Author	volume	Date Value	title	type	journal	titleUrl	doi	note	year
2015 TradingInterpretabilityforAccur	Ryohei Fujimaki Jialei Wang Yosuke Motohashi			Trading Interpretability for Accuracy: Oblique Treed Sparse Additive Models				10.1145/2783258.2783407		2015