Advanced SearchSearch Tips
An Effective Concept Drift Detection Method on Streaming Data Using Probability Estimates
facebook(new window)  Pirnt(new window) E-mail(new window) Excel Download
  • Journal title : Journal of KIISE
  • Volume 43, Issue 6,  2016, pp.718-723
  • Publisher : Korean Institute of Information Scientists and Engineers
  • DOI : 10.5626/JOK.2016.43.6.718
 Title & Authors
An Effective Concept Drift Detection Method on Streaming Data Using Probability Estimates
Kim, Young-In; Park, Cheong Hee;
In streaming data analysis, detecting concept drift accurately is important to maintain the performance of classification model. Error rates are usually used for concept drift detection. However, by describing prediction results with only binary values of 0 or 1, useful information about a behavior pattern of a classifier can be lost. In this paper, we propose an effective concept drift detection method which describes performance pattern of a classifier by utilizing probability estimates for class prediction and detects a significant change in a classifier behavior. Experimental results on synthetic and real streaming data show the efficiency of the proposed method for detecting the occurrence of concept drift.
concept drift detection;probability estimates;streaming data;adaptive incremental learning;
 Cited by
스트리밍 데이터에서의 기계학습,박정희;

한국멀티미디어학회지, 2016. vol.20. 3, pp.1-7
J. Gama, I. Zliobaite, A. Bifet, M. Pechenizkiy and A. Bouchachia, "A survey on concept drift adaptation," ACM computer surveys, Vol. 46 No. 4, pp. 1-37, 2014.

J. Gama. P. Medas, G. Castillo and P. Rpdrigues, "Learning with drift detection," Proc. of SBIA Brazilian Symposium on Artificial Intelligence, pp. 66-112, 2004.

M. Baena-Garcia, J. Campo-Avilla, R. Fidalgo, A. Bifet, R. Gavalda, and R. Moales-Bueno. "Early drift detection method," Proc. of ECML PKDD 2006 Workshop on Knowledge Discovery from Data Streams, 2006.

G. Ross, N. Adams, D. Tasoulis, and D. Hand, "Exponentially weighted moving average charts for detecting concept drift," Pattern recognition letters, 33(2012), pp. 191-198, 2012. crossref(new window)

D. Kifer, S. Ben-David, and J. Gehrke, "Detecting changes in data streams," Proc. of the 30th VLDB conference, pp. 180-191, 2004.

T. S. Sethi, M. Kantardzic, "Don't pay for validation : Detecting drifts from unlabeled data using margin density," Procedia Computer Science, 53(2015), pp. 103-112 2015. crossref(new window)

G. Hulton, L. Spencer and P. Domingos, "Mining timechanging data streams," Proc. of KDD, pp. 97-106, 2001.

J. Z. Kolter and M. A. Malloof, "Dynamic weighted majority : An ensemble method for drifting concepts," Journal of Machine Learning Research, 8 (2007), pp. 2755-2790, 2007.

H. Wang, W. Fan, P. Yu, and J. Han, "Mining concept-drifting data streams using ensemble classifiers," Proc. of KDD, 2003.

Y. Yeh and Y. F. Wang, "A rank-one update method for least squares linear discriminant anaylsis with concept drift," Pattern recognition, 46(2013), pp. 1267-1276, 2013. crossref(new window)

S. Bach and M. Maloof. "Paired learners for concept drift," Proc. of IEEE International Conference on Data Mining, 2008.

W. Navidi, Statistics for engineers and scientists, Magraw hill, New York. 2006.

I. H. Witten and E. Frank, Data mining : Practical machine learning tools and techniques, Morgan Kaufmann, San Francisco, 2005.

L. I. Kuncheva and C. O. Plumpton, "Adaptive learning rate for online linear discriminant classifiers," LNCS 5342 (2008), pp. 510-519. 2008.

P. Tan, M. Steinbach, and V. Kumar, Introduction to Data Mining, Addison Wesley, Boston, 2006.

A. Bifet, G. Holmes, R. Kirkby, B. Pfahringer, "MOA : Massive online analysis," Journal of Machine Learning Research, Vol. 11, pp. 1601-1604, 2010.

A. Bifet, J. Reed, B. Pfahringer, G. Holmes and I. Zliobaite, "CD-MOA: Change Detection Framework for Massive Online Analysis," LNCS 8207, pp. 92-103, 2013.

Massive Online Analysis(MOA) [Online]. Available:

Knowledge Discovery from Ubiquitous Streams (KDUS) [Online]. Available: