DOI QR코드

DOI QR Code

Kullback-Leibler Information of Consecutive Order Statistics

  • Kim, Ilmun (Department of Statistics, Carnegie Mellon University) ;
  • Park, Sangun (Department of Applied Statistics, Yonsei University)
  • Received : 2015.07.17
  • Accepted : 2015.08.20
  • Published : 2015.09.30

Abstract

A calculation of the Kullback-Leibler information of consecutive order statistics is complicated because it depends on a multi-dimensional integral. Park (2014) discussed a representation of the Kullback-Leibler information of the first r order statistics in terms of the hazard function and simplified the r-fold integral to a single integral. In this paper, we first express the Kullback-Leibler information in terms of the reversed hazard function. Then we establish a generalized result of Park (2014) to an arbitrary consecutive order statistics. We derive a single integral form of the Kullback-Leibler information of an arbitrary block of order statistics; in addition, its relation to the Fisher information of order statistics is discussed with numerical examples provided.

Keywords

References

  1. Balakrishnan, N., Rad, A. H. and Arghami, N. R. (2007). Testing exponentiality based on Kullback-Leibler information with progressively Type-II censored data, IEEE Transactions on Reliability, 56, 301-307. https://doi.org/10.1109/TR.2007.895308
  2. Ebrahimi, N., Soofi, E. S. and Zahedi, H. (2004). Information properties of order statistics and spacings, IEEE Transactions on Information Theory, 50, 177-183. https://doi.org/10.1109/TIT.2003.821973
  3. Gupta, R. D., Gupta, R. C. and Sankaran, P. G. (2004). Some characterization results based on factorization of the (reversed) hazard rate function, Communications in Statistics - Theory and Methods, 33, 3009-3031. https://doi.org/10.1081/STA-200038875
  4. Park, S. (1995). The entropy of consecutive order statistic, IEEE Transactions on Information Theory, 41, 2003-2007. https://doi.org/10.1109/18.476325
  5. Park, S. (2005). Testing exponentiality based on the Kullback-Leibler information with the type II censored data, IEEE Transactions on Reliability, 54, 22-26. https://doi.org/10.1109/TR.2004.837314
  6. Park, S. (2014). On Kullback-Leibler information of order statistics in terms of the relative risk, Metrika, 77, 609-616. https://doi.org/10.1007/s00184-013-0455-7
  7. Park, S. and Shin, M. (2014). Kullback-Leibler information of a censored variable and its applications, Statistics, 48, 756-765. https://doi.org/10.1080/02331888.2013.800070
  8. Rad, A. H., Yousefzadeh, F. and Balakrishnan, N. (2011). Goodness-of-fit test based on Kullback-Leibler information for progressively Type-II censored data, IEEE Transactions on Reliability, 60, 570-579. https://doi.org/10.1109/TR.2011.2162470
  9. Teitler, S., Rajagopal, A. K. and Ngai, K. L. (1986). Maximum entropy and reliability distributions, IEEE Transactions on Reliability, 35, 391-395. https://doi.org/10.1109/TR.1986.4335479
  10. Wong, K. M. and Chen, S. (1990). The entropy of ordered sequences and order statistics, IEEE Transactions on Information Theory, 36, 276-284. https://doi.org/10.1109/18.52473