2010 BoostingwithStructureInformatio

From GM-RKB
Jump to navigation Jump to search

Subject Headings:

Notes

Cited By

Quotes

Author Keywords

Abstract

Boosting is a very successful classification algorithm that produces a linear combination of "weak" classifiers (a.k.a. base learners) to obtain high quality classification models. this paper we propose a new boosting algorithm where base learners have structure relationships in the functional space. Though such relationships are generic, our work is particularly motivated by the emerging topic of pattern based classification for semi-structured data including graphs. Towards an efficient incorporation of the structure information, we have designed a general model where we use an undirected graph to capture the relationship of subgraph-based base learners. In our method, we combine both [math]\displaystyle{ L_1 }[/math] norm and Laplacian based [math]\displaystyle{ L_2 }[/math] penalty with Logit loss function of Logit Boost. In this approach, we enforce model sparsity and smoothness in the functional space spanned by the basis functions. We have derived efficient optimization algorithms based on coordinate decent for the new boosting formulation and theoretically prove that it exhibits a natural grouping effect for nearby spatial or overlapping features. Using comprehensive experimental study, we have demonstrated the effectiveness of proposed learning methods.

References

,

 AuthorvolumeDate ValuetitletypejournaltitleUrldoinoteyear
2010 BoostingwithStructureInformatioHongliang Fei
Jun Huan
Boosting with Structure Information in the Functional Space: An Application to Graph ClassificationKDD-2010 Proceedings10.1145/1835804.18358862010