Advanced SearchSearch Tips
Improving Sample Entropy Based on Nonparametric Quantile Estimation
facebook(new window)  Pirnt(new window) E-mail(new window) Excel Download
 Title & Authors
Improving Sample Entropy Based on Nonparametric Quantile Estimation
Park, Sang-Un; Park, Dong-Ryeon;
  PDF(new window)
Sample entropy (Vasicek, 1976) has poor performance, and several nonparametric entropy estimators have been proposed as alternatives. In this paper, we consider a piecewise uniform density function based on quantiles, which enables us to evaluate entropy in each interval, and study the poor performance of the sample entropy in terms of the poor estimation of lower and upper quantiles. Then we propose some improved entropy estimators by simply modifying the quantile estimators, and compare their performances with some existing estimators.
Kernel density estimator;maximum entropy;order statistics;sample entropy;
 Cited by
Ahmad, I. A. and Lin, P. E. (1976). A nonparametric estimation of the entropy for absolutely continuous distributions, IEEE Transactions on Information Theory, 22, 372-375. crossref(new window)

Bowman, A. W. (1992). Density based tests for goodness-of-fit, Journal of Statistical Computation and Simulation, 40, 1-13. crossref(new window)

Choi, B. and Kim, K. (2006). Testing goodness of fit for Laplace distribution based on maximum entropy, Statistics, 40, 517-531. crossref(new window)

Correa, J. C. (1995). A new estimator of entropy, Communications in Statistics: Theory and Method, 24, 2439-2449 crossref(new window)

Dmitriev, Y. G. and Tarasenko, F. P. (1973). On the estimation of functionals of the probability density and its derivatives, Theory of Probability and its Applications, 18, 628-633.

Dudewicz, E. and van der Meulen, E. (1987). The empiric entropy, a new approach to nonparametric entropy estimation, New Prospectives in Theoretical and Applied Statistics, 207-227.

Ebrahimi, N., Pflughoeft, K. and Soofi, E. S. (1994). Two measures of sample entropy, Statistics and Probability Letters, 20, 225-234. crossref(new window)

Park, S. and Park, D. (2003). Correcting moments for goodness of fit tests based on two entropy estimates, Journal of Statistical Computation and Simulation, 73, 685-694. crossref(new window)

Reiss, R. D. (1981). Nonparametric estimation of smooth distribution functions, Scandinavian Journal of Statistics, 8, 116-119.

Shannon, C. E. (1948). A mathematical theory of communications, Bell System Technical Journal, 27, 379-423, 623-656. crossref(new window)

Theil, H. (1980). The entropy of the maximum entropy distribution, Economics Letters, 5, 145-148. crossref(new window)

Vasicek, O. (1976). A test for normality based on sample entropy, Journal of the Royal Statistical Society, Series B, 38, 54-59.

Yang, S. S. (1985). A smooth nonparametric estimator of a quantile function, Journal of American Statistical Association, 80, 1004-1011. crossref(new window)