Advanced SearchSearch Tips
LMS and LTS-type Alternatives to Classical Principal Component Analysis
facebook(new window)  Pirnt(new window) E-mail(new window) Excel Download
 Title & Authors
LMS and LTS-type Alternatives to Classical Principal Component Analysis
Huh, Myung-Hoe; Lee, Yong-Goo;
  PDF(new window)
Classical principal component analysis (PCA) can be formulated as finding the linear subspace that best accommodates multidimensional data points in the sense that the sum of squared residual distances is minimized. As alternatives to such LS (least squares) fitting approach, we produce LMS (least median of squares) and LTS (least trimmed squares)-type PCA by minimizing the median of squared residual distances and the trimmed sum of squares, in a similar fashion to Rousseeuw (1984)'s alternative approaches to LS linear regression. Proposed methods adopt the data-driven optimization algorithm of Croux and Ruiz-Gazen (1996, 2005) that is conceptually simple and computationally practical. Numerical examples are given.
Principal component analysis (PCA);Projection pursuit;Least squares (LS);Least median of squares (LMS);Least trimmed squares (LTS);
 Cited by
Croux, C., and Ruiz-Gazen, A. (1996). A fast algorithm for robust principal components based on projection pursuit. COMPSTAT Proceedings in Computational Statistics. Physica-Verlag, Heidelberg. 211-216

Croux, C., and Ruiz-Gazen, A. (2005). High breakdown estimators for principal components: The projection-pursuit approach revisited. Journal of Multivariate Analysis, Vol. 95, 206-266 crossref(new window)

Hubert, M., Rousseeuw, P.J., and Verboven, S. (2002). A fast method for robust principal components with applications to chemometrics. Chemometrics and Intelligent Laboratory Systems, Vol. 60, 101-111 crossref(new window)

Huh, M.H. (1999). Quantification Methods for Multivariate Data. Freedom Academy, Seoul. (Written in Korean)

Johnson, R.A. and Wichern, D.W. (1992) Applied Multivariate Statistical Analysis (Third Edition). Prentice Hall, Englewood Cliffs

Lebart, L., Morineau, A., and Warwick, K. (1984). Multivariate Descriptive Statistical Analysis. Wiley, New York

Li, G. and Chen, Z. (1985). Projection-pursuit approach to robust dispersion matrices and principal components: primary theory and Monte Carlo. Journal of the American Statistical Association, Vol. 80, 759-766 crossref(new window)

Rousseeuw, P.J. (1984). Least median of squares regression. Journal of the American Statistical Association, Vol. 79, 871-880 crossref(new window)

Rousseeuw, P.J. and Leroy, AM. (1987). Robust Regression and Outlier Detection. Wiley, New York