DOI QR코드

DOI QR Code

Naive Bayes Classifier based Anomalous Propagation Echo Identification using Class Imbalanced Data

클래스 불균형 데이터를 이용한 나이브 베이즈 분류기 기반의 이상전파에코 식별방법

  • Lee, Hansoo (Department of Electrical and Computer Engineering, Pusan National University) ;
  • Kim, Sungshin (Department of Electrical and Computer Engineering, Pusan National University)
  • Received : 2016.05.20
  • Accepted : 2016.06.08
  • Published : 2016.06.30

Abstract

Anomalous propagation echo is a kind of abnormal radar signal occurred by irregularly refracted radar beam caused by temperature or humidity. The echo frequently appears in ground-based weather radar due to its observation principle and disturb weather forecasting process. In order to improve accuracy of weather forecasting, it is important to analyze radar data precisely. Therefore, there are several ongoing researches about identifying the anomalous propagation echo with data mining techniques. This paper conducts researches about implementation of classification method which can separate the anomalous propagation echo in the raw radar data using naive Bayes classifier with various kinds of observation results. Considering that collected data has a class imbalanced problem, this paper includes SMOTE method. It is confirmed that the fine classification results are derived by the suggested classifier with balanced dataset using actual appearance cases of the echo.

이상전파에코는 대기 관측을 위해서 사용되는 레이더 전파가 온도나 습도에 의해서 발생하는 이상굴절에 의해서 발생하는 신호로, 지상에 설치된 기상레이더에 자주 발생하는 비기상에코이다. 기상예보의 정확도를 높이기 위해서는 레이더 데이터의 정확한 분석이 필수적이기 때문에 이상전파에코의 제거에 대한 연구가 수행되어 오고 있다. 본 논문에서는 다양한 레이더 관측변수를 나이브 베이지안 분류기에 적용하여 이상전파에코를 식별하는 방법에 대한 연구를 수행하였다. 수집된 데이터가 클래스 불균형 문제를 내포하고 있는 점을 고려하여, SMOTE 기법을 이용하였다. 실제 이상전파에코 발생 사례를 통해, 제안한 방법이 성능을 표출하는 것을 확인하였다.

Keywords

References

  1. M. Grecu and W. F. Krajewski, "An efficient methodology for detection of anomalous propagation echoes in radar reflectivity data using neural networks," Journal of atmospheric and oceanic technology, vol. 17, no. 2, pp. 121-129, Feb. 2000. https://doi.org/10.1175/1520-0426(2000)017<0121:AEMFDO>2.0.CO;2
  2. Y. Sun, A. K. Wong, and M. S. Kamel, "Classification of imbalanced data: a review," International journal of pattern recognition and artificial intelligence, vol. 23, no. 04, pp. 687-719, Jun. 2009. https://doi.org/10.1142/S0218001409007326
  3. K. P. Murphy, Machine learning: a probabilistic perspective, Cambridge, MIT press, 2012.
  4. N. V. Chawla, K. W. Bowyer, L. O. Hall, and W. P. Kegelmeyer, "SMOTE: synthetic minority over-sampling technique," Journal of artificial intelligence research, vol. 16, pp. 321-357, Jun. 2002.
  5. R. J. Doviak and D. S. Zrnic, Doppler Radar & Weather Observations, Cambridge, Academic press, 2014.
  6. G. Brussaard and P. A. Watson, Atmospheric modelling and millimetre wave propagation, New York, Springer Science & Business Media, 1995.
  7. S. Moszkowicz, G. J. Ciach and W. F. Krajewski, "Statistical detection of anomalous propagation in radar reflectivity patterns," Journal of atmospheric and oceanic technology, vol. 11, no. 4, pp. 1026-1034, Aug. 1994. https://doi.org/10.1175/1520-0426(1994)011<1026:SDOAPI>2.0.CO;2
  8. D. Heckerman, "Bayesian networks for data mining," Data mining and knowledge discovery, vol. 1, no. 1, pp. 79-119, Mar. 1997. https://doi.org/10.1023/A:1009730122752
  9. R. E. Neapolitan, Learning bayesian networks, New Jersey, Pearson Prentice Hall, 2004.
  10. A. McCallum and K. Nigam, "A comparison of event models for naive bayes text classification," in AAAI-98 workshop on learning for text categorization, vol. 752, Jul. 1998.
  11. R. S. Michalski, J. G. Carbonell, and T. M. Mitchell, Machine learning: an artificial intelligence approach, New York, Springer Science & Business Media, 2013.