2009 FeatureShapingforLinearSVMClass

Jump to: navigation, search

Subject Headings:


Cited By


Author Keywords

Text Classification Machine Learning, Feature Weighting, Feature Scaling, SVM


Linear classifiers have been shown to be effective for many discrimination tasks. Irrespective of the learning algorithm itself, the final classifier has a weight to multiply by each feature. This suggests that ideally each input feature should be linearly correlated with the target variable (or anti-correlated), whereas raw features may be highly non-linear. In this paper, we attempt to re-shape each input feature so that it is appropriate to use with a linear weight and to scale the different features in proportion to their predictive value. We demonstrate that this pre-processing is beneficial for linear SVM classifiers on a large benchmark of text classification tasks as well as UCI datasets.



 AuthorvolumeDate ValuetitletypejournaltitleUrldoinoteyear
2009 FeatureShapingforLinearSVMClassGeorge Forman
Martin Scholz
Shyamsundar Rajaram
Feature Shaping for Linear SVM ClassifiersKDD-2009 Proceedings10.1145/1557019.15570572009