Journal of the Korean Data and Information Science Society

The Korean Data and Information Science Society (한국데이터정보과학회)
권호 표지

A comparison on coefficient estimation methods in single index models

단일지표모형에서 계수 추정방법의 비교

  • Choi, Young-Woong (Department of Statistics, Hankuk University of Foreign Studies) ;
  • Kang, Kee-Hoon (Department of Statistics, Hankuk University of Foreign Studies)
  • 최영웅 (한국외국어대학교 통계학과) ;
  • 강기훈 (한국외국어대학교 통계학과)
  • Received : 2010.09.22
  • Accepted : 2010.11.15
  • Published : 2010.11.30
Download PDF
⟨ Previous Next ⟩

Abstract

It is well known that the asymptotic convergence rates of nonparametric regression estimator gets worse as the dimension of covariates gets larger. One possible way to overcome this problem is reducing the dimension of covariates by using single index models. Two coefficient estimation methods in single index models are introduced. One is semiparametric least square estimation method, which tries to find approximate solution by using iterative computation. The other one is weighted average derivative estimation method, which is non-iterative method. Both of these methods offer the parametric convergence rate to normal distribution. However, practical comparison of these two methods has not been done yet. In this article, we compare these methods by examining the variances of estimators in various models.

회귀함수의 비모수적 적합에서 공변량의 차원이 증가함에 따라 추정량의 극한성질이 좋지 않음이 잘 알려져 있다. 이러한 문제점을 극복하기 위한 방법중의 하나는 단일지표모형의 추정을 이용하여 공변량의 차원을 1차원으로 줄이는 것이다. 단일지표모형에서 계수 추정 방법으로는 반복적으로 해를 계산하여 근사치를 구하는 방법인 준모수적 최소제곱법과 비반복적으로 계산하여 구하는 도함수 가중평균법이 있다. 두 추정 방법 모두 모수적인 방법과 같은 수렴비율로 정규근사한다고 알려져 있지만 실질적인 성능에 관한 비교는 이루어지지 않았다. 본 논문에서는 모의실험을 통해 두 방법에 의한 추정치의 분산을 비교하여 어떠한 방법이 좋은지를 파악하고자 한다.

Keywords

References

  1. Carroll, R. J., Fan, J., Gijbels, I. and Wand, M. P. (1997). Generalized partially linear single-index models. Journal of the American Statistical Association, 92, 477-489. https://doi.org/10.2307/2965697
  2. Chu, C. K. and Cheng, K. F. (1995). Nonparametric regression estimates using misclassified binary responses. Biometrika, 82, 315-325 https://doi.org/10.1093/biomet/82.2.315
  3. Friedman, J. H. and Stuetzle, W. (1981). Projection pursuit regression. Journal of the American Statistical Association, 76, 817-823. https://doi.org/10.2307/2287576
  4. Hall, P. (1989). On projection pursuit regression. The Annals of Statistics, 17, 573-588. https://doi.org/10.1214/aos/1176347126
  5. Hardle, W. (1990). Applied nonparametric regression, Cambridge University Press.
  6. Hardle, W., Hall, P. and Ichimura, H. (1993). Optimal smoothing in single index models. The Annals of Statistics, 21, 157-178. https://doi.org/10.1214/aos/1176349020
  7. Hardle, W., Muller, M., Sperlich, S. and Werwatz, A. (2004). Nonparametric and semiparametric models, Springer.
  8. Hardle, W. and Stoker, T. (1989). Investigating smooth multiple regression by the method of average derivatives. Journal of the American Statistical Association, 84, 986-995. https://doi.org/10.2307/2290074
  9. Hastie, T. J. and Tibshirani, R. (1990). Generalized additive models, Chapman and Hall.
  10. Ichimura, H. (1993). Semiparametric least square (SLS) and weighted SLS estimation of single-index models. Journal of Econometrics, 58, 71-120. https://doi.org/10.1016/0304-4076(93)90114-K
  11. Newey, W. K. and Stoker, T. M. (1993). Efficiency of weighted average derivative estimators and index models. Econometrica, 61, 1199-1223. https://doi.org/10.2307/2951498
  12. Powell, J., Stock, J. and Stoker, T. (1989). Semiparametric estimation of index coefficients. Econometrica, 57, 1403-1430. https://doi.org/10.2307/1913713
  13. Silverman, B. W. (1986). Density estimation for statistics and data analysis, Chapman and Hall.