DOI QR코드

DOI QR Code

Anomaly Detection via Pattern Dictionary Method and Atypicality in Application

패턴사전과 비정형성을 통한 이상치 탐지방법 적용

  • Sehong Oh (Department of AI and Data Science, Korea Military Academy) ;
  • Jongsung Park (Department of Precision Mechanical Engineering, Kyungpook National University) ;
  • Youngsam Yoon (Department of Electrical Engineering, Korea Military Academy)
  • 오세홍 (육군사관학교 AI.데이터과학과) ;
  • 박종성 (경북대학교 정밀기계공학과) ;
  • 윤영삼 (육군사관학교 전자공학과)
  • Received : 2023.11.09
  • Accepted : 2023.11.28
  • Published : 2023.11.30

Abstract

Anomaly detection holds paramount significance across diverse fields, encompassing fraud detection, risk mitigation, and sensor evaluation tests. Its pertinence extends notably to the military, particularly within the Warrior Platform, a comprehensive combat equipment system with wearable sensors. Hence, we propose a data-compression-based anomaly detection approach tailored to unlabeled time series and sequence data. This method entailed the construction of two distinctive features, typicality and atypicality, to discern anomalies effectively. The typicality of a test sequence was determined by evaluating the compression efficacy achieved through the pattern dictionary. This dictionary was established based on the frequency of all patterns identified in a training sequence generated for each sensor within Warrior Platform. The resulting typicality served as an anomaly score, facilitating the identification of anomalous data using a predetermined threshold. To improve the performance of the pattern dictionary method, we leveraged atypicality to discern sequences that could undergo compression independently without relying on the pattern dictionary. Consequently, our refined approach integrated both typicality and atypicality, augmenting the effectiveness of the pattern dictionary method. Our proposed method exhibited heightened capability in detecting a spectrum of unpredictable anomalies, fortifying the stability of wearable sensors prevalent in military equipment, including the Army TIGER 4.0 system.

Keywords

Acknowledgement

본 연구는 2023년 미래전략기술연구소 AI연구개발센터의 지원을 받아 수행되었습니다(23-AI-07).

References

  1. V. Chandola, A. Banerjee, and V. Kumar, "Anomaly detection: A survey", ACM Comput. Surv., Vol. 41, No. 3, pp. 1-58, 2009. https://doi.org/10.1145/1541880.1541882
  2. I. Steinwart, D. Hush, and C. Scovel, "A Classification Framework for Anomaly Detection", J. Mach. Learn. Res., Vol. 6, pp. 221-232, 2005.
  3. N. Elmrabit, F. Zhou, F. Li, and H. Zhou, "Evaluation of machine learning algorithms for anomaly detection", prof. of 2020 international conference on cyber security and protection of digital services (cyber security), pp. 1-8, Dublin, Ireland, 2020.
  4. M. E. Celebi and K. Aydin, Eds., Unsupervised learning algorithms, Springer Cham, Switzerland, p. 103, 2016.
  5. V. Chandola, A. Banerjee, and V. Kumar, "Anomaly detection for discrete sequences: A survey", IEEE Trans Knowl. Data Eng., Vol. 24, No. 5, pp. 823-839, 2010. https://doi.org/10.1109/TKDE.2010.235
  6. E. Sabeti, S. Oh, P. X. K. Song, and A. O. Hero, "A pattern dictionary method for anomaly detection", Entropy, Vol. 24, No. 8, pp. 1095(1)-1095(26), 2022.
  7. V. Chandola, A. Banerjee, and V. Kumar, "Anomaly detection for discrete sequences: A survey", IEEE Trans. Knowl. Data Eng., Vol. 24, No. 5, pp. 823-839, 2010. https://doi.org/10.1109/TKDE.2010.235
  8. J. Ziv and A. Lempel, "Compression of individual sequences via variable-rate coding", IEEE Trans. Inf. Theory, Vol. 24, No. 5, pp. 530-536, 1978. https://doi.org/10.1109/TIT.1978.1055934
  9. A. Host-Madsen, E. Sabeti, and C. Walton, "Data discovery and anomaly detection using atypicality: Theory", IEEE Trans. Inf. Theory, Vol. 65, No. 9, pp. 5302-5322, 2019. https://doi.org/10.1109/TIT.2019.2917669
  10. R. Bousseljot, D. Kreiseler, and A. Schnabel, "Nutzung der EKG-Signald atenbank CARDIODAT d er PTB uber d as Internet", Biomed. Tech., Vol. 40, pp. 317-318, 1995. https://doi.org/10.1515/bmte.1995.40.s1.317
  11. M. Kachuee, S. Fazeli, and M. Sarrafzadeh, "Ecg heartbeat classification: A deep transferable representation", proc. of 2018 IEEE Int. Conf. Healthc. Inform., pp. 443-444, New York, USA, 2018.
  12. M. C. Mackey and L. Glass, "Oscillation and chaos in physiological control systems", Science, Vol. 197, No. 4300, pp. 287-289, 1977. https://doi.org/10.1126/science.267326