On Guo and Nixon's criterion for feature subset selection by mutual information: assumptions, implications and alternative options

Balagani, K. S. ; Poha, V. V. ; Iyengar, S. S. ; Balakrishnan, N. (2010) On Guo and Nixon's criterion for feature subset selection by mutual information: assumptions, implications and alternative options IEEE Transactions on Systems, Man and Cybernetics, Part A: Systems and Humans, 40 (3). pp. 651-655. ISSN 1083-4427

Full text not available from this repository.

Official URL: http://ieeexplore.ieee.org/xpl/freeabs_all.jsp?arn...

Related URL: http://dx.doi.org/10.1109/TSMCA.2009.2036935

Abstract

Guo and Nixon proposed a feature selection method based on maximizing I( x;Y), the multidimensional mutual information between feature vector x and class variable Y. Because computing I(x;Y) can be difficult in practice, Guo and Nixon proposed an approximation of I(x;Y) as the criterion for feature selection. We show that Guo and Nixon's criterion originates from approximating the joint probability distributions in I(x;Y) by second-order product distributions. We remark on the limitations of the approximation and discuss computationally attractive alternatives to compute I(x;Y).

Item Type:Article
Source:Copyright of this article belongs to IEEE.
ID Code:64429
Deposited On:10 Oct 2011 07:38
Last Modified:10 Oct 2011 07:39

Repository Staff Only: item control page