Journal of the Korean Data and Information Science Society

한국데이터정보과학회 (The Korean Data and Information Science Society)
권호 표지
DOI QR코드

DOI QR Code

모수적 엔트로피 추정량과 비모수적 엔트로피 추정량에 기초한 정규분포에 대한 적합도 검정

Goodness-of-fit test for normal distribution based on parametric and nonparametric entropy estimators

  • 최병진 (경기대학교 응용정보통계학과)
  • Choi, Byungjin (Department of Applied Information Statistics, Kyonggi University)
  • 투고 : 2013.06.20
  • 심사 : 2013.07.16
  • 발행 : 2013.07.31
PDF 다운로드
⟨ 이전 논문 다음 논문 ⟩

초록

본 논문에서는 모수적과 비모수적 엔트로피 추정량들에 기초한 정규분포에 대한 적합도 검정을 다룬다. 정규분포의 엔트로피에 대한 모수적 추정량으로 사용할 최소분산비편향추정량을 유도한다. 이 추정량과 대립가설 하에서의 자료생성분포에 대한 비모수적 엔트로피 추정량으로 표본엔트로피와 이것의 변형된 추정량들을 이용하여 검정통계량들을 구축했고 이 검정통계량들을 사용하는 새로운 엔트로피 기반 적합도 검정들을 제시한다. 제안한 검정들의 기각값들을 모의실험을 통해 추정해서 표의 형태로 제시한다. 성능의 조사를 위해 수행한 모의실험에서 제안한 검정들이 기존의 Vasicek (1976) 검정보다는 더 좋은 검정력을 가지는 것으로 나타난다. 응용에서 새로운 검정들이 정규성 검정을 위한 경쟁적인 도구로 시용될 수 있을 것으로 기대된다.

In this paper, we deal with testing goodness-of-fit for normal distribution based on parametric and nonparametric entropy estimators. The minimum variance unbiased estimator for the entropy of the normal distribution is derived as a parametric entropy estimator to be used for the construction of a test statistic. For a nonparametric entropy estimator of a data-generating distribution under the alternative hypothesis sample entropy and its modifications are used. The critical values of the proposed tests are estimated by Monte Carlo simulations and presented in a tabular form. The performance of the proposed tests under some selected alternatives are investigated by means of simulations. The results report that the proposed tests have better power than the previous entropy-based test by Vasicek (1976). In applications, the new tests are expected to be used as a competitive tool for testing normality.

키워드

참고문헌

  1. Choi, B. and Kim, K. (2006). Testing goodness-of-fit for Laplace distribution based on maximum entropy. Statistics. 40, 517-531. https://doi.org/10.1080/02331880600822473
  2. Correa, J. C. (1995). A new estimator of entropy. Communications in Statistics-Theory and Methods, 24, 2439-2449. https://doi.org/10.1080/03610929508831626
  3. Cressie, N. (1976). On the logarithms of high-order spacings. Biometrika, 63, 343-355. https://doi.org/10.1093/biomet/63.2.343
  4. D'Agostino, R.B. and Stephens, M. A. (1986). Goodness-of-fit techniques, Marcel Dekker, New York.
  5. Dudewicz, E. J. and van der Meulen, E. C. (1981). Entropy-based test for uniformity. Journal of the American Statistical Association, 76, 967-974. https://doi.org/10.1080/01621459.1981.10477750
  6. Dudewicz, E. J. and van der Meulen, E. C. (1987). New perspectives in theoretical and applied statistics, Wiley, New York.
  7. Ebrahimi, N., Pflughoeft, K. and Soofi, E. S. (1994). Two measures of sample entropy. Statistics and Probability Letters, 20, 225-234. https://doi.org/10.1016/0167-7152(94)90046-9
  8. Grzegorzewski. P. and Wieczorkowski, R. (1999). Entropy-based goodness-of-fit test for exponentiality. Communications in Statistics-Theory and Methods, 28, 1183-1202. https://doi.org/10.1080/03610929908832351
  9. Gyorfi, L. and van der Meulen, E. C. (1987). Density-free convergence properties of various estimators of entropy. Computational Statistics and Data Analysis, 5, 425-436. https://doi.org/10.1016/0167-9473(87)90065-X
  10. Lee, S., Lee, J. and Noh, J. (2013). Maximum entropy test for infinite order autoregressive models. Journal of the Korean Data & Information Science Society, 24, 637-642. https://doi.org/10.7465/jkdi.2013.24.3.637
  11. Mardia, K. V. (1980). Tests of univariate and multivariate normality. In Handbook of Statistics, Vol. 1., edited by P. K. Krishnaiah, North-Holland, Amsterdam, 279-320.
  12. Shannon, C. E. (1948). A mathematical theory of communications. Bell System Technical Journal, 27, 379-423, 623-656. https://doi.org/10.1002/j.1538-7305.1948.tb01338.x
  13. van Es, B. (1992). Estimating functionals related to a density by a class of statistics based on spacings. Scandinavian Journal of Statistics, 19, 61-72.
  14. Vasicek, O. (1976). A test for normality based on sample entropy. Journal of the Royal Statistical Society B, 38, 54-59.
  15. Wieczorkowski, R. and Grzegorzewski. P. (1999). Entropy estimators-improvements and comparisons. Communications in Statistics-Simulation and Computation, 28, 541-567. https://doi.org/10.1080/03610919908813564