DOI QR코드

DOI QR Code

Comparative Study of Confidence Interval Estimators for Coverage Analysis

Coverage 분석을 위한 신뢰구간 추정량에 관한 비교 연구

  • Published : 2004.02.01

Abstract

Confidence interval estimators for proportions using normal approximation have been commonly used for coverage analysis of simulation output even though alternative approximate estimators of confidence intervals for proportions were proposed. This is -because the normal approximation was easier to use in practice than the other approximate estimators. Computing technology has no problem with dealing these alternative estimators. Recently, one of the approximation methods for coverage analysis which is based on arcsin transformation has been used for estimating proportion and for controlling the required precision in [12]. In this paper, we compare three approximate interval estimators, based on a normal distribution approximation, an arcsin transformation and an F-distribution approximation, of a single proportion. Three estimators were applied to sequential coverage analysis of steady-state means, in simulations of the M/M/1/$\infty$ and W/D/l/$\infty$ queueing systems on a single processor and multiple processors.

지금까지 비율(proportion)에 대한 신뢰구간의 근사적 추정량(approximate estimator)에 대한 여러 기법들이 제안되었으나, 시뮬레이션 결과에 대한 coverage 분석을 수행할 경우에는 정규분포에 기반 한 신뢰구간 추정량이 주로 이용되었다. 그 이유는 정규분포에 대한 근사법이 다른 근사법들 보다 실제 구현하는데 쉽게 여겨졌기 때문이다. 하지만, 최근에 arcsin 변환에 기반한 coverage 분석을 위한 근사법이 [12]에서 시뮬레이션 수행 시에 최종결과에 요구되는 정확도의 조절과 비율을 추정하기 위해서 사용되었다. 본 논문에서는 세 개의 신뢰구간 추정량 근사법(정규분포 기반 근사법, arcsin 변환 기반 근사법, 그리고 F-분포 기반 근사법)을 비교 분석하였다. 세 신뢰구간에 대한 추정량을 단일 프로세서와 다중 프로세서 상에서 참조모델(reference model)로 M/M/1/$\infty$와 W/D/l/$\infty$ 큐잉 시스템을 활용하여 정상상태(steady-state)에서의 평균치를 추정하는 시뮬레이션에 적용하였다.

Keywords

References

  1. G. C. Ewing, K. Pawlikowski and D. McNickle, 'Akaroa 2.5 User's Manual,' Department of Computer Science, University of Canterbury, New Zealand, Technical Report TR-COSC 07/98, 1998
  2. P. W. Glynn, 'Coverage Error for Confidence Intervals Arising in Simulation Output Analysis,' Proceedings of the 1982 Winter Simulation Conference, pp.369-375, 1982
  3. A. Hald, 'Statistical Theory with Engineering Applications,' John Wiley and Sons, Inc., 1952
  4. P. Heidelberger and P. D. Welch, 'A Spectral Method for Confidence Interval Generation and RunLength Control in Simulations,' Communications of the ACM, Vol.25, pp. 233-245, 1981 https://doi.org/10.1145/358598.358630
  5. J. Judge, H. W. P. Beadle and J. Chicharo, 'Correlation of HTTP Response Packet Size and Estimating Confidence intervals for for Mean Packet Size and WWW Traffic Volume,' Proceedings of APCC 1997, Sydney, Australia, pp.382-386, 1997
  6. A. M. Law and W. D. Kelton, 'Simulation Modeling and Analysis,' McGraw-Hill, Inc., 2nd Ed., 1991
  7. D. C. McNickle, K. Pawlikowski and G. Ewing, 'Experimental Evaluation of Confidence Interval Procedures in Sequential Steady-State Simulation,' Proceedings of the 1996 Winter Simulation Conference, pp.382-389, 1996 https://doi.org/10.1145/256562.256690
  8. K. Pawlikowski, 'Steady-State Simulation of Queueing Processes: A Survey of Problems and Solutions,' ACM Computing Surveys, Vol.22(2), pp.122-170, 1990 https://doi.org/10.1145/78919.78921
  9. K. Pawlikowski, D. C. McNickle and G. Ewing, 'Coverage of Confidence Intervals in Sequential Steady-State Simulation,' Simulation Practice and Theory, Vol.6, pp.255-267, 1998 https://doi.org/10.1016/S0928-4869(96)00030-4
  10. U. W. Pooch and J. A. Wall, 'Discrete Event Simulation: A Practical Approach,' CRC Press, 1993
  11. K. Pawlikowski, V. Yau and D. C. McNickle, 'Distributed and Stochastic Discrete-event Simulation in Parallel Time Streams,' Proceedings of the 1994 Winter Simulation Conference, Lake Buena Vista, Florida, pp.723-730, 1994 https://doi.org/10.1109/WSC.1994.717420
  12. K. E. E. Raatikainen, 'Simulation-Based Estimation of Proportions,' Management Science, Vol.41(7), pp.1202-1223, 1995 https://doi.org/10.1287/mnsc.41.7.1202
  13. C. H. Sauer, 'Confidence Intervals for Queueing Simulations of Computer Systems,' ACM Performance Evaluation Review, Vol.8(1-2), pp.46-55, 1979 https://doi.org/10.1145/1041853.1041856
  14. L. W. Schruben, 'A Coverage Function for Interval Estimators of Simulation Response,' Management Science, Vol.26, pp.18-27, 1980 https://doi.org/10.1287/mnsc.26.1.18