Second Order Cone Programming Formulations for Feature Selection

Bhattacharyya, Chiranjib (2004) Second Order Cone Programming Formulations for Feature Selection Journal of Machine Learning Research, 5 . pp. 1417-1433. ISSN 1532-4435

[img] PDF


This paper addresses the issue of feature selection for linear classifiers given the moments of the class conditional densities. The problem is posed as finding a minimal set of features such that the resulting classifier has a low misclassification error. Using a bound on the misclassification error involving the mean and covariance of class conditional densities and minimizing an L1 norm as an approximate criterion for feature selection, a second order programming formulation is derived. To handle errors in estimation of mean and covariances, a tractable robust formulation is also discussed. In a slightly different setting the Fisher discriminant is derived. Feature selection for Fisher discriminant is also discussed. Experimental results on synthetic data sets and on real life microarray data show that the proposed formulations are competitive with the state of the art linear programming formulation.

Item Type:Article
ID Code:127695
Deposited On:13 Oct 2022 11:00
Last Modified:13 Oct 2022 11:00

Repository Staff Only: item control page