DOI QR코드

DOI QR Code

Improve Stability of Military Infrared Image and Implement Zynq SoC

군사용 적외선 영상의 안정화 성능 개선 및 Zynq SoC 구현

  • Received : 2017.11.07
  • Accepted : 2017.11.23
  • Published : 2018.02.28

Abstract

Military camera equipment has a problem that observability is inferior due to various shaking factors. In this paper, we propose an image stabilization algorithm considering performance and execution time to solve this problem and implemented it in Zynq SoC. We stabilized both the simple shaking in the fixed observation position and the sudden shaking in the moving observation position. The feature of the input image is extracted by the Sobel edge algorithm, the subblock with the large edge data is selected, and the motion vector, which is the compensation reference, is calculated through template matching using the 3-step search algorithm of the region of interest. In addition, the proposed algorithm can distinguish the shaking caused by the simple shaking and the movement by using the Kalman filter, and the stabilized image can be obtained by minimizing the loss of image information. To demonstrate the effectiveness of the proposed algorithm, experiments on various images were performed. In comparison, PSNR is improved in the range of 2.6725~3.1629 (dB) and image loss is reduced from 41% to 15%. On the other hand, we implemented the hardware-software integrated design using HLS of Xilinx SDSoC tool and confirmed that it operates at 32 fps on the Zynq board, and realized SoC that operates with real-time processing.

Keywords

References

  1. S. Lew, W.J. Lee, H.C., Kang "A Study on an Image Stabilization for Car Vision System," Journal of the Korea Institute of Information And Communication Engineering, Vol. 15, No. 4, pp. 957-964, 2011 (in Korean). https://doi.org/10.6109/jkiice.2011.15.4.957
  2. W. Yang, Z. Zhang, Y. Zhang, X. Lu, J. Li, Z. Shi, "A Real-time Gray Projection Algorithm for Electronic Image Stabilization," Proceedings of SPIE International Symposium on Photoelectronic Detection and Imaging, Vol, 8193, pp. 81932G, 2011.
  3. J. Kim, "Electronic Image Stabilization for Portable Thermal Image Camera," Journal of the Korea Institute of Military Science and Technology, Vol. 19, No. 3, pp. 288-293, 2016 (in Korean). https://doi.org/10.9766/KIMST.2016.19.3.288
  4. C.H. Park, "Using Motion Estimation Video Stabilization for Thermal Imaginary Video," Incheon National University Graduate School, 2015 (in Korean).
  5. J.N. Kim, T.S. Choi, "A Fast Three-step Search Algorithm With Minimum Checking Points Using Unimodal Error Surface Assumption," IEEE Transactions on consumer Electronics, Vol. 44, No. 3, pp. 638-648, 1998. https://doi.org/10.1109/30.713175
  6. P. Coussy, A. Morawiec, High-level Synthesis, Springer, 2010.