Communications for Statistical Applications and Methods

The Korean Statistical Society (한국통계학회)
권호 표지
DOI QR코드

DOI QR Code

LMS and LTS-type Alternatives to Classical Principal Component Analysis

  • Published : 2006.08.31
Download PDF
⟨ Previous Next ⟩

Abstract

Classical principal component analysis (PCA) can be formulated as finding the linear subspace that best accommodates multidimensional data points in the sense that the sum of squared residual distances is minimized. As alternatives to such LS (least squares) fitting approach, we produce LMS (least median of squares) and LTS (least trimmed squares)-type PCA by minimizing the median of squared residual distances and the trimmed sum of squares, in a similar fashion to Rousseeuw (1984)'s alternative approaches to LS linear regression. Proposed methods adopt the data-driven optimization algorithm of Croux and Ruiz-Gazen (1996, 2005) that is conceptually simple and computationally practical. Numerical examples are given.

Keywords

References

  1. Croux, C., and Ruiz-Gazen, A. (1996). A fast algorithm for robust principal components based on projection pursuit. COMPSTAT Proceedings in Computational Statistics. Physica-Verlag, Heidelberg. 211-216
  2. Croux, C., and Ruiz-Gazen, A. (2005). High breakdown estimators for principal components: The projection-pursuit approach revisited. Journal of Multivariate Analysis, Vol. 95, 206-266 https://doi.org/10.1016/j.jmva.2004.08.002
  3. Hubert, M., Rousseeuw, P.J., and Verboven, S. (2002). A fast method for robust principal components with applications to chemometrics. Chemometrics and Intelligent Laboratory Systems, Vol. 60, 101-111 https://doi.org/10.1016/S0169-7439(01)00188-5
  4. Huh, M.H. (1999). Quantification Methods for Multivariate Data. Freedom Academy, Seoul. (Written in Korean)
  5. Johnson, R.A. and Wichern, D.W. (1992) Applied Multivariate Statistical Analysis (Third Edition). Prentice Hall, Englewood Cliffs
  6. Lebart, L., Morineau, A., and Warwick, K. (1984). Multivariate Descriptive Statistical Analysis. Wiley, New York
  7. Li, G. and Chen, Z. (1985). Projection-pursuit approach to robust dispersion matrices and principal components: primary theory and Monte Carlo. Journal of the American Statistical Association, Vol. 80, 759-766 https://doi.org/10.2307/2288497
  8. Rousseeuw, P.J. (1984). Least median of squares regression. Journal of the American Statistical Association, Vol. 79, 871-880 https://doi.org/10.2307/2288718
  9. Rousseeuw, P.J. and Leroy, AM. (1987). Robust Regression and Outlier Detection. Wiley, New York