JOURNAL BROWSE
Search
Advanced SearchSearch Tips
k-Nearest Neighbor-Based Approach for the Estimation of Mutual Information
facebook(new window)  Pirnt(new window) E-mail(new window) Excel Download
 Title & Authors
k-Nearest Neighbor-Based Approach for the Estimation of Mutual Information
Cha, Woon-Ock; Huh, Moon-Yul;
  PDF(new window)
 Abstract
This study is about the k-nearest neighbor-based approach for the estimation of mutual information when the type of target variable is categorical and continuous. The results of Monte-Carlo simulation and experiments with real-world data show that k
 Keywords
Mutual information;k-nearest neighbor;jittering;bootstrap;
 Language
Korean
 Cited by
1.
세계 각국의 자원에 대한 통계적 고찰,허문열;최병수;이승천;

응용통계연구, 2009. vol.22. 1, pp.41-57 crossref(new window)
 References
1.
허문열, 차운옥 (2008). Sample-spacing 방법에 의한 상호정보의 추정, <응용통계연구>, 21, 301-312

2.
Beirlant, J., Dudewicz, E. J., Gyor-, L. and Meulen, E. (1997). Nonparametric entropy estimation: An overview, International Journal of Mathematical and Statistical Sciences, 6, 17-39

3.
Blake, C. and Merz, C. J. (1998). UCI machine learning repository, http://www.ics.uci.edu/mlearn/MLRepository

4.
Brillinger, D. R. (2004). Some data analyses using mutual information, Brazilian Journal of Probability and Satistics, 18, 163-183

5.
Cha, W. O. and Huh, M. Y. (2005). Discretization method based on quantiles for variable selection using mutual information, Communications of the Korean Statistical Society, 12, 659-672 crossref(new window)

6.
Cover, T. M. and Thomas, J. A. (1991). Elements of Information Theory, John Wiley & Sons, New York

7.
Huh, M. Y. (2005). DAVIS(Data visualization system), http://stat.skku.ac.kr/myhuh/DAVIS.html

8.
Kononenko, I. (1994). Estimating attributes: Analysis and extensions of RELIEF, In Proceedings of European Conference on Machine Learning, 171-182

9.
Kraskov, A., Staugbauer, H. and Grassberger, P. (2004). Estimating Mutual Information, Physical Review E 69, 066138

10.
Lazo, A. V. and Rathie, P. (1978). On the entropy of continuous probability distributions, IEEE Transactions on Information Theory, 24, 120-122 crossref(new window)

11.
Miller, E. G. L. and Fisher III, J. W. (2003). ICA using spacings estimation of entropy, The Journal of Machine Learning Research, 4, 1271-1295 crossref(new window)

12.
Staugbauer, H., Kraskov, A., Astakhov, S. A. and Grassberger, P. (2004). Least dependent component analysis based on mutual information, Physical Review E 70, 066123