DOI QR코드

DOI QR Code

Foreground Extraction in Thermal Videos Based on Selective Histogram Bins

선택적 히스토그램 빈 기반 열화상 영상 전경 추출

  • Yu, Gwang-Hyun (Department of Electronics and Computer Engineering, Chonnam National University) ;
  • Zaheer, Muhammd Zaigham (Department of Computer Software from the University of Science and Technology (UST)) ;
  • Kim, Jin-Young (Department of Electronics and Computer Engineering, Chonnam National University) ;
  • Sin, Do-Seong (DefenseTech)
  • 유광현 (전남대학교 대학원 전자컴퓨터공학부) ;
  • 자히르 (과학기술연합대학원 컴퓨터 소프트웨어학과) ;
  • 김진영 (전남대학교 대학원 전자컴퓨터공학부) ;
  • 신도성 (디펜스텍 주식회사)
  • Received : 2018.09.23
  • Accepted : 2018.11.05
  • Published : 2018.04.30

Abstract

Foreground extraction is the most significant step in thermal imaging based surveillance systems. This step needs to be efficient in terms of time and memory consumption in order for the system to provide real time results but usually this efficiency reciprocates with the accurateness of the ROI detection. In this study, novel selective histogram bins based two background & foreground separation approaches for thermal videos processing have been proposed which exploit the temporal-consistency property of the thermal images in a given environment and can save over 80% memory than their simplest counterpart temporal median filtering.

열화상 영상기반 감시 시스템에서 전경추출은 매우 중요한 단계이다. 전경추출단계는 계산시간과 메모리 사용측면에서 시스템의 실시간 처리가 매우 효율적이어야 한다. 그러나 이러한 효율성은 ROI 탐지의 정확도와 매우 연관되어 있다. 본 논문에서 열화상 비디오 처리를 위하여 새로운 히스토그램 빈에 기반하여 배경과 전경을 분리하기 위한 두 가지 방법을 제시하는데, 이는 임의의 주어진 환경에서 열화상영상의 시간상에서 일관성을 갖는 다는 점과, 이러한 성질이, 간단한 시간축 메디안 필터링에 비하여 80%이상의 메모리를 절감할 수 있다.

Keywords

References

  1. Wong, Wai Kit, Poi Ngee Tan, Chu Kiong Loo, and Way Soong Lim, "An effective surveillance system using thermal camera." in Proceeding of International Conference on Signal Acquisition and Processing, Malaysia, pp. 13-17, Apr 2009.
  2. Teutsch, Michael, Thomas Mueller, Marco Huber, and Juergen Beyerer, "Low resolution person detection with a moving thermal infrared camera by hot spot classification." in Proceeding of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 209-216, Jun 2014.
  3. Donoser, Michael, and Horst Bischof, "Efficient maximally stable extremal region (MSER) tracking." in proceeding of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, New York: NY, Vol. 1, pp. 553-560, Jun 2006.
  4. Kumar, K. Senthil, G. Kavitha, R. Subramanian, and G. Ramesh, "Visual and thermal image fusion for UAV based target tracking." MATLAB-A Ubiquitous Tool for the Practical Engineer. InTech, pp. 307-327, 2011.
  5. Torabi, Atousa, G. Masse, and G. A. Bilodeau, "Feedback scheme for thermal-visible video registration, sensor fusion, and people tracking." in Proceeding of IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, pp. 15-22, Jun 2010.
  6. Markov, Stefan, and Andreas Birk, "Detecting humans in 2d thermal images by generating 3d models." The Journal of Springer, pp. 293-307, Sep 2007.
  7. Wang, Weihong, Jian Zhang, and Chunhua Shen, "Improved human detection and classification in thermal images." in Proceeding of 17th IEEE International Conference on Image Processing, pp. 2313-2316, Sep 2010.
  8. Li, Jianfu, and Weiguo Gong, "Real Time Pedestrian Tracking using Thermal Infrared Imagery." The Journal of JCP, Vol. 5, no. 10, pp. 1606-1613, Oct 2010.
  9. Leira, Frederik S., Tor Arne Johansen, and Thor I. Fossen, "Automatic detection, classification and tracking of objects in the ocean surface from uavs using a thermal camera." in Proceeding of IEEE on Aerospace Conference,Big Sky: MT, pp. 1-10, Mar 2015.
  10. Hu, Ming-Kuei, "Visual pattern recognition by moment invariants." The Journal of IRE Transactions on Information Theory, Vol. 8, No. 2, pp. 179-187, Feb 1962.
  11. Gupta, Umesh, Maitreyee Dutta, and Mahesh Vadhavaniya, "Analysis of Target Tracking Algorithm in Thermal Imagery." The Journal of Computer Applications, Vol. 71, No. 16, pp. 1-71, Jan 2013.
  12. Zhan, Chaohui, Xiaohui Duan, Shuoyu Xu, Zheng Song, and Min Luo, "An improved moving object detection algorithm based on frame difference and edge detection." in Proceeding of Fourth International Conference on Image and Graphics, Sichuan: CH, pp. 519-523, Aug 2007.
  13. Hung, Mao-Hsiung, Jeng-Shyang Pan, and Chaur-Heh Hsieh, "Speed up temporal median filter for background subtraction." in Proceeding of First International Conference on Pervasive Computing Signal Processing and Applications, Harbin: CH, pp. 297-300, Sep 2010.
  14. Han, Ju, and Bir Bhanu, "Human activity recognition in thermal infrared imagery." in Proceeding of IEEE Computer Socity Conference on Computer Vision and Pattern Recognition-Workshops, San Diego: CA, pp. 17-17, Sep 2005.
  15. Jeon, Eun Som, Jong-Suk Choi, Ji Hoon Lee, Kwang Yong Shin, Yeong Gon Kim, Toan Thanh Le, and Kang Ryoung Park, "Human detection based on the generation of a background image by using a far-infrared light camera." The Journal of Sensors, Vol. 15, No. 3, pp. 6763-6788. Mar 2015.
  16. Beiping, Hou, and Zhu Wen, "Fast Human Detection Using Motion Detection and Histogram of Oriented Gradients." The Journal of JCP, Vol. 6, No. 8, pp. 1597-1604, Aug 2011.
  17. Han, Guang, Xi Cai, and Jinkuan Wang, "Object Detection based on Combination of Visible and Thermal Videos using A Joint Sample Consensus Background Model." The Journal of JSW, Vol. 8, No. 4, pp. 987-994, Apr 2013.
  18. Goubet, Emmanuel, Joseph Katz, and Fatih Porikli. "Pedestrian tracking using thermal infrared imaging." The Journal of International Society for Optics and Photonics, Vol. 6206, pp. 62062C, May 2006.
  19. Davis, James W., and Vinay Sharma, "Robust Background-Subtraction for Person Detection in Thermal Imagery." in Proceeding of CVPR Workshops, pp. 128, Jun 2004.
  20. Davis, James W., and Vinay Sharma, "Robust detection of people in thermal imagery." in Proceeding of International Conference on Pattern Recognition, 2004, Vol. 4, pp. 713-716, Aug 2004.
  21. Lenac, Kruno, Ivan Maurovic, and Ivan Petrovic, "Moving objects detection using a thermal Camera and IMU on a vehicle." in Proceeding of International Conference on Electrical Drives and Power Electronics, pp. 212-219, Sep 2015.
  22. Qi, Bin, Vijay John, Zheng Liu, and Seiichi Mita, "Use of sparse representation for pedestrian detection in thermal images." in Proceeding of IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 274-280, Jun 2014.
  23. Miezianko, Roland, IEEE OTCBVS WS Series Bench, "Terravic research infrared database.", 2005.
  24. Wu, Zheng, Nathan Fuller, Diane Theriault, and Margrit Betke, "A thermal infrared video benchmark for visual analysis." in Proceeding of IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 201-208, Jnu 2014.
  25. Bilodeau, Guillaume-Alexandre, Atousa Torabi, Pierre-Luc St-Charles, and Dorra Riahi, "Thermal-visible registration of human silhouettes: A similarity measure performance evaluation." The Journal of Infrared Physics & Technology, Vol. 64, pp. 79-86, May 2014. https://doi.org/10.1016/j.infrared.2014.02.005
  26. Davis, James W., and Mark A. Keck, "A two-stage template approach to person detection in thermal imagery." in Proceeding of Seventh IEEE Workshops on Application of Computer Vision, Vol. 1, pp. 364-369, Jan 2005.