Smoothing Parameter Selection Using Multifold Cross-Validation in Smoothing Spline Regressions

  • Published : 1998.08.01

Abstract

The smoothing parameter $\lambda$ in smoothing spline regression is usually selected by minimizing cross-validation (CV) or generalized cross-validation (GCV). But, simple CV or GCV is poor candidate for estimating prediction error. We defined MGCV (Multifold Generalized Cross-validation) as a criterion for selecting smoothing parameter in smoothing spline regression. This is a version of cross-validation using $leave-\kappa-out$ method. Some numerical results comparing MGCV and GCV are done.

Keywords

References

  1. Biometrika v.71 An alternative method of cross-validation for the smoothing of density estimates Bowman, A.W.
  2. Journal of the American Statistical Association v.81 How biased is the apparent error rate of a prediction rule? Efron, B.
  3. Journal of SIAM v.14 Practical approximate solutions to linear operator equations when the data are noisy Wahba, G.
  4. Journal of the American Statistical Association v.70 The predictive sample reuse method with application Geisser, S.
  5. Biometrika v.76 A comparative study of ordinary cross-validation, u-fold cross-validation and the repeated learning-testing methods Burman, P.
  6. Journal of the American Statistical Association v.78 Splines in statistics Wegman, E.J.;Wright, I.W.
  7. The Annals of Statistics v.21 Model selection via multifold cross-validation Zhang, P.
  8. Biometrika v.68 On optimal selection of regression variables Shibata, R.
  9. The Annals of Statistics v.13 Optimal bandwidth selection in nonparametric regression function estimation Hardle, W.;Marron, J. S.
  10. Journal of the Royal Statistical Society, ser. B. v.47 Some aspects of the spline smoothing approach to nonparametric regression curve fitting (with discussion) Silverman, B.W.
  11. Some comment on $C_p$, {\em Technometrics} v.15 Mallows, C.L.
  12. Ph. D. Thesis, Department of Statistics Pusan National University A Study on model checking in nonparametric regression Jeong, M.
  13. Efficient nonparametric regression with cross-validated smoothing splines Speckman, P.
  14. Spline Models for Observational Data Wahba, G.
  15. Spline Smoothing and Nonparametric Regression Eubank, R.L.
  16. Journal of SIAM v.21 Multivariate smoothing spline functions Cox, D. D.
  17. Journal of the Royal Statistical Society, ser. B. v.36 Cross-validatory choice and assessment of statistical prediction (with discussion) Stone, M.
  18. Journal of the American Statistical Association v.88 Linear model selection by cross-validation Shao, J.
  19. IEEE Transactions on Automatic Control v.19 A new look at statistical model identification Akaike, H.
  20. Statistics and Probability Letters v.31 Cook's distance in spline smoothing Kim, C.
  21. The Annals of Statistics v.14 Asymptotic optimality of $C_L$ and generalized cross-validation in ridge regression with application to spline smoothing Li, K. C.
  22. Journal of the American Statistical Association v.78 Estimating the error rate of a prediction rule: Improvement on cross-validation Efron, B.
  23. Numerische Mathematik v.31 Smoothing noisy data with spline function : Estimating the correct degree of smoothing by the method of generalized cross-validation Craven, P.;Wahba, G.