Bootstrapping Regression Residuals

  • Published : 2005.08.31

Abstract

The sample reuse bootstrap technique has been successful to attract both applied and theoretical statisticians since its origination. In recent years a good deal of attention has been focused on the applications of bootstrap methods in regression analysis. It is easier but more accurate computation methods heavily depend on high-speed computers and warrant tough mathematical justification for their validity. It is now evident that the presence of multiple unusual observations could make a great deal of damage to the inferential procedure. We suspect that bootstrap methods may not be free from this problem. We at first present few examples in favour of our suspicion and propose a new method diagnostic-before-bootstrap method for regression purpose. The usefulness of our newly proposed method is investigated through few well-known examples and a Monte Carlo simulation under a variety of error and leverage structures.

Keywords

References

  1. Outliers in Statistical Data Barnett, V.;Lewis, T.
  2. Amer Statist. v.52 Monte Carlo approximation of bootstrap variances Booth, J.G.;Sarkar, S.
  3. J. Amer. Statist. Assoc. v.85 Comment on paper by Rousseeuw, P.J., and van Zomeren, B.C. Cook, R.D.;Hawkins, S.
  4. Bootstrap Methods and Their Applications Davison, A.C.;Hinkley, D.V.
  5. Ann. Statist. v.7 Bootstrap methods: Another look at the jackknife Efron, B.
  6. J. Amer. Statist. Assoc. v.82 Better bootstrap confidence intervals (with discussions) Efron, B.
  7. J. Roy. Statist., Soc., Ser - B v.54 Jackknife-after-bootstrap standard errors and influence functions (with discussions) Efron, B.
  8. An Introduction to the Bootstrap Efron, B.;Tibshirani, R.
  9. Regression Diagnostics Fox, J.
  10. Ann. Statist. v.9 Bootstrapping regression models Freedman, D.A.
  11. The Bootstrap and Edgeworth Expansion Hall, P.
  12. Robust Statistics: The Approach Based on Influence Function Hampel, F.R.;Ronchetti, E.M.;Rousseeuw, P.J.;Stahel, W.
  13. Technometrics v.26 Location of several outliers in multiple regression data using elemental sets Hawkins, D.M.;Bradu, D.;Kass, G.V.
  14. Commun. Statist. - Theory Meth. v.12 The regression dilemma Hocking, R.R.;Pendleton, O.J.
  15. J. App. Stat. v.30 Residuals from deletion in added variable plots Imon, A.H.M.R.
  16. Pak. J. Statist. v.21 A comparative study on the estimation of regression errors by bootstarp techniques Imon, A.H.M.R.;Das, K.K.
  17. J. Amer. Statist. Assoc. v.79 Least median of squares regression Rousseeuw, P.J.
  18. Robust Regression and Outlier Detection Rousseeuw, P.J.;Leroy, A.
  19. Modern Regression Methods Ryan, T.P.
  20. Linear Models: An Integrated Approach Sengupta, D.;Jammalamadaka, S.
  21. The Jackknife and Bootstrap Shao, J.;Tu, D.
  22. Modern Applied Statistics With S-Plus. Vol. II Venables, W.N.;Ripley, B.D.
  23. Ann. Statist. v.14 Jackknife, bootstrap and other resampling methods in regression analysis (with discussions) Wu, C.J.F.