2014 EfficientMultiTaskFeatureLearni

• (Gong et al., 2014) ⇒ Pinghua Gong, Jiayu Zhou, Wei Fan, and Jieping Ye. (2014). “Efficient Multi-task Feature Learning with Calibration.” In: Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD-2014) Journal. ISBN:978-1-4503-2956-9 doi:10.1145/2623330.2623641

Subject Headings:

Cited By

• http://scholar.google.com/scholar?q=%222014%22+Efficient+Multi-task+Feature+Learning+with+Calibration
• http://dl.acm.org/citation.cfm?id=2623330.2623641&preflayout=flat#citedby

Quotes

Author Keywords

• Accelerated gradient descent; calibration; data mining; dual problem; feature selection; multi-task learning

Abstract

Multi-task feature learning has been proposed to improve the generalization performance by learning the shared features among multiple related tasks and it has been successfully applied to many real-world problems in machine learning, data mining, computer vision and bioinformatics. Most existing multi-task feature learning models simply assume a common noise level for all tasks, which may not be the case in real applications. Recently, a Calibrated Multivariate Regression (CMR) model has been proposed, which calibrates different tasks with respect to their noise levels and achieves superior prediction performance over the non-calibrated one. A major challenge is how to solve the CMR model efficiently as it is formulated as a composite optimization problem consisting of two non-smooth terms. In this paper, we propose a variant of the calibrated multi-task feature learning formulation by including a squared norm regularizer. We show that the dual problem of the proposed formulation is a smooth optimization problem with a piecewise sphere constraint. The simplicity of the dual problem enables us to develop fast dual optimization algorithms with low per-iteration cost. We also provide a detailed convergence analysis for the proposed dual optimization algorithm. Empirical studies demonstrate that, the dual optimization algorithm quickly converges and it is much more efficient than the primal optimization algorithm. Moreover, the calibrated multi-task feature learning algorithms with and without the squared norm regularizer achieve similar prediction performance and both outperform the non-calibrated ones. Thus, the proposed variant not only enables us to develop fast optimization algorithms, but also keeps the superior prediction performance of the calibrated multi-task feature learning over the non-calibrated one.

References

;

	Author	volume	Date Value	title	type	journal	titleUrl	doi	note	year
2014 EfficientMultiTaskFeatureLearni	Wei Fan Jieping Ye Jiayu Zhou Pinghua Gong			Efficient Multi-task Feature Learning with Calibration				10.1145/2623330.2623641		2014