DOI QR코드

DOI QR Code

A study on the difference and calibration of empirical influence function and sample influence function

경험적 영향함수와 표본영향함수의 차이 및 보정에 관한 연구

  • Received : 2020.05.20
  • Accepted : 2020.07.03
  • Published : 2020.10.31

Abstract

While analyzing data, researching outliers, which are out of the main tendency, is as important as researching data that follow the general tendency. In this study we discuss the influence function for outlier discrimination. We derive sample influence functions of sample mean, sample variance, and sample standard deviation, which were not directly derived in previous research. The results enable us to mathematically examine the relationship between the empirical influence function and sample influence function. We can also consider a method to approximate the sample influence function by the empirical influence function. Also, the validity of the relationship between the approximated sample influence function and the empirical influence function is also verified by the simulation of random sampled data in normal distribution. As the result of a simulation, both the relationship between the two influence functions, sample and empirical, and the method of approximating the sample influence function through the emperical influence function were verified. This research has significance in proposing a method that reduces errors in the approximation of the empirical influence function and in proposing an effective and practical method that proceeds from previous research that approximates the sample influence function directly through empirical influence function by constant revision.

이상치에 대한 적절한 선별과 배제없이 모든 데이터를 종합적으로 분석하게 되는 경우 데이터 분석을 통해 얻은 결과의 신뢰성과 해석의 일반성에 치명적인 위협을 받을 수 있다. 따라서 데이터의 분석 과정에서 이러한 이상치를 판별하고, 이상치가 통계량, 통계적 모형에 어떠한 영향을 주는 지에 대한 분석은 매우 중요한 일이라 할 수 있다. Hampel이 영향함수를 활용하여 이상치를 판별할 수 있는 방법을 소개한 이후, 이상치를 판별하기 위한 방법론으로 영향함수가 폭넓게 활용되어 왔다. 영향함수에는 경험적 영향함수와 표본영향함수가 있으며, 경험적 영향함수를 활용해 표본영향함수를 근사 추론하여 하나의 관측값이 제거되었을 때 통계량에 미치는 영향을 예측하는 방법론이 주로 활용되었다. 본 연구에서는 표본평균, 표본분산, 표본표준편차의 표본영향함수 유도를 통해 경험적 영향함수와 표본영향함수의 차이를 살펴 본다. 또한 경험적 영향함수로 표본영향함수를 근사하는 과정에서 발생하는 오차를 줄이기 위해 경험적 영향함수의 보정으로 표본영향함수를 근사 추론하는 방법을 제안하고, 모의실험을 통해 제안한 추론 방법의 타당성을 확인한다.

Keywords

References

  1. Campbell, N. A. (1978). The influence function as an aid outlier detection in discrimination analysis, Applied Statistics, 27, 251-258. https://doi.org/10.2307/2347160
  2. Cook, R. D. (1977). Detection of influential observation in linear regression, Technometrics, 19, 15-18. https://doi.org/10.2307/1268249
  3. Cook, R. D. and Weisberg, S. (1980). Characterization of and empirical influence function for detection influential cases in regression, Technometrics, 22, 495-508. https://doi.org/10.1080/00401706.1980.10486199
  4. Cook, R. D. and Weisberg, S. (1982). Residual and Influence in Regression, Chapman ad Hall, New York.
  5. Critchley, F. (1985). Influence in principal components analysis, Biometika, 72, 627-636. https://doi.org/10.1093/biomet/72.3.627
  6. Hampel, F. R. (1974). The influence curve and its role in robust estimation, Journal of the American Statistical Association, 69, 383-393. https://doi.org/10.1080/01621459.1974.10482962
  7. Kim, H. (1998). A study on cell influence to chi-square statistic in contingency tables, The Korean Communications in Statistics, 5, 35-42.
  8. Kim, H. and Lee, H. (1996). Influence Functions on ${\chi}^2$ statistic in contingency tables, The Korean Communications in Statistics, 3, 69-76.
  9. Kim, H. and Kim, K. (2005). Influence of an observation on the t-statistic, The Korean Communications in Statistics, 12, 453-462.
  10. Kim, S. and Kim, H. (2019). A study on the performance of the influence function on the t-statistic depending on population distributions, Journal of the Korean Data & Information Science Society, 30, 573-585. https://doi.org/10.7465/jkdi.2019.30.3.573
  11. Lee, H. and Kim, H. (2003). The changes in statistic when a row is deleted from a contingency table, The Korean Communications in Statistics, 10, 305-317.
  12. Lee, H. and Kim, H. (2008). Influence function on the coefficient of variation, Communications for Statistical Applications and Methods, 15, 509-516. https://doi.org/10.5351/CKSS.2008.15.4.509
  13. Park, S. and Kim, H. (2019). A study on the location of the observation which has the least effect on the t-statistic, Journal of the Korean Data & Information Science Society, 30, 1221-1232. https://doi.org/10.7465/jkdi.2019.30.6.1221
  14. Radhakrishnan, R. and Kshirsagar, A. M. (1981). Influence functions for certain parameters in multi-variate analysis, Communications in Statistics, 10, 515-529. https://doi.org/10.1080/03610928108828055