Advanced SearchSearch Tips
Procedure for the Selection of Principal Components in Principal Components Regression
facebook(new window)  Pirnt(new window) E-mail(new window) Excel Download
 Title & Authors
Procedure for the Selection of Principal Components in Principal Components Regression
Kim, Bu-Yong; Shin, Myung-Hee;
  PDF(new window)
Since the least squares estimation is not appropriate when multicollinearity exists among the regressors of the linear regression model, the principal components regression is used to deal with the multicollinearity problem. This article suggests a new procedure for the selection of suitable principal components. The procedure is based on the condition index instead of the eigenvalue. The principal components corresponding to the indices are removed from the model if any condition indices are larger than the upper limit of the cutoff value. On the other hand, the corresponding principal components are included if any condition indices are smaller than the lower limit. The forward inclusion method is employed to select proper principal components if any condition indices are between the upper limit and the lower limit. The limits are obtained from the linear model which is constructed on the basis of the conjoint analysis. The procedure is evaluated by Monte Carlo simulation in terms of the mean square error of estimator. The simulation results indicate that the proposed procedure is superior to the existing methods.
Data mining;multicollinearity;principal components regression;condition index;selection of principal components;
 Cited by
로버스트주성분회귀에서 최적의 주성분선정을 위한 기준,김부용;

Communications for Statistical Applications and Methods, 2011. vol.18. 6, pp.761-770 crossref(new window)
A Criterion for the Selection of Principal Components in the Robust Principal Component Regression, Communications for Statistical Applications and Methods, 2011, 18, 6, 761  crossref(new windwow)
Belsley, D. A., Kuh, E. and Welsch, R. E. (1980). Regression Diagnostics, John Wiley.

Hadi, A. S. and Ling, R. F. (1998). Some cautionary notes on the use of principle components regression, The American Statistician, 52, 15-19. crossref(new window)

Jolliffe, I. T. (1972). Discarding variables in a principal component analysis. I: artificial data, Applied Statistics, 21, 160-1733. crossref(new window)

Jolliffe, I. T. (1982). A note on the use of principal component in regression, Applied Statistics, 31, 300-303. crossref(new window)

Mansfield, E. R., Webster, J. T. and Gunst, R. F. (1977). An analytic variable selection technique for principal component regression, Applied Statistics, 26, 34-40. crossref(new window)

Marquardt, D. W. (1970). Generalized inverse, ridge regression, biased linear estimation, and nonlinear estimation, Technometrics, 12, 591-612. crossref(new window)

Marquardt, D. W. and Snee, R. D. (1975). Ridge regression in practice, The American Statistician, 29, 3-20. crossref(new window)

Mason, R. L. and Gunst, R. F. (1985). Selecting principal components in regression, Statistics & Probability Letters, 3, 299-301. crossref(new window)

Montgomery, D. C., Peck, E. A. and Vining, G. G. (2006). Introduction to Linear Regression Analysis, John Wiley & Sons, Inc.

Pidot, Jr., G. B. (1969). A principal components of the determinants of local government fiscal patterns, The Review of Economics and Statistics, 51, 176-188. crossref(new window)