A Comparison on Independent Component Analysis and Principal Component Analysis -for Classification Analysis-

  • Published : 2005.11.30

Abstract

We often extract a new feature from the original features for the purpose of reducing the dimensions of feature space and better classification. In this paper, we show feature extraction method based on independent component analysis can be used for classification. Entropy and mutual information are used for the selection of ordered features. Performance of classification based on independent component analysis is compared with principal component analysis for three real data sets.

Keywords

References

  1. Pattern Recognition and Image Analysis Gose, E.;Johnsonbaugh, R.;Jost, S.
  2. Neural Computation v.9 no.7 A Fast Fixed-Point Algorithm for Independent Component Analysis Hyvarinen, A.;Oja, E.
  3. Independent Component Analysis Hyvarinen, A.;Karhunen, J.;Oja, E.
  4. Signal processing v.24 Blind Separation of Sources, Part I : An Adaptive Algorithm based on Neuromimetic Architecture Jutten, C.;Herault, J.
  5. Multivariate analysis Mardia, K.V.;Kent, J.T.;Bibby, J.M.
  6. Journal of Machine Learning Research v.3 Feature Extraction by Non-Parametric Mutual Information Maximization Torkkola, K.