DOI QR코드

DOI QR Code

Conversion Method of 3D Point Cloud to Depth Image and Its Hardware Implementation

3차원 점군데이터의 깊이 영상 변환 방법 및 하드웨어 구현

  • Jang, Kyounghoon (Department of Electronic Engineering, Dong-A University) ;
  • Jo, Gippeum (Department of Electronic Engineering, Dong-A University) ;
  • Kim, Geun-Jun (Department of Electronic Engineering, Dong-A University) ;
  • Kang, Bongsoon (Department of Electronic Engineering, Dong-A University)
  • Received : 2014.07.18
  • Accepted : 2014.09.01
  • Published : 2014.10.31

Abstract

In the motion recognition system using depth image, the depth image is converted to the real world formed 3D point cloud data for efficient algorithm apply. And then, output depth image is converted by the projective world after algorithm apply. However, when coordinate conversion, rounding error and data loss by applied algorithm are occurred. In this paper, when convert 3D point cloud data to depth image, we proposed efficient conversion method and its hardware implementation without rounding error and data loss according image size change. The proposed system make progress using the OpenCV and the window program, and we test a system using the Kinect in real time. In addition, designed using Verilog-HDL and verified through the Zynq-7000 FPGA Board of Xilinx.

깊이 영상을 이용한 동작 인식 시스템에서는 효율적인 알고리즘 적용을 위하여 깊이 영상을 3차원 점군 데이터로 구성되는 실제 공간으로 변환하여 알고리즘을 적용한 후 투영공간으로 변환하여 출력한다. 하지만 변환 과정 중 반올림 오차와 적용되는 알고리즘에 의한 데이터 손실이 발생하게 된다. 본 논문에서는 3차원 점군 데이터에서 깊이 영상으로의 변환 시 반올림 오차와 영상의 크기 변화에 따른 데이터 손실이 발생하지 않는 효율적인 방법과 이를 하드웨어로 구현 하는 방법을 제안 하였다. 최종적으로 제안된 알고리즘은 OpenCV와 Window 프로그램을 사용하여 소프트웨어적으로 알고리즘을 검증하였고, Kinect를 사용하여 실시간으로 성능을 테스트하였다. 또한, Verilog-HDL을 사용하여 하드웨어 시스템을 설계하고, Xilinx Zynq-7000 FPGA 보드에 탑재하여 검증하였다.

Keywords

References

  1. I. Benbasat, "HCI Research: Future Challenges and Directions," AIS Transactions on Human-Computer Interaction, vol. 2, no. 2, pp. 16-21, Jun. 2010. https://doi.org/10.17705/1thci.00011
  2. M.A. Garcia and A. Solanas, "3D Simultaneous Localization and Modeling from Stereo Vision," IEEE International Conference on Robotics and Automation, vol. 1, pp. 847-853, May. 2004.
  3. K.H Jang, H.S. Cho, G.J. Kim, and B.S. Kang, "Depth Image Distortion Correction Method according to the Position and Angle of Depth Sensor and Its hardware implementation," Journal of the Korea Institute of Information and Communication Engineering, vol. 18, no. 5, pp.1103-1109, May, 2014. https://doi.org/10.6109/jkiice.2014.18.5.1103
  4. R. Zhou, J. Wu, Q. He, C. Hu, and Z. Yu, "Approach of Human Face Recognition Based on SIFT Feature Extraction and 3D Rotation Model," IEEE International Conference on Information and Automation, pp. 476-479, Jun. 2011.
  5. I.S. Seo, G.P. Jo, K.H. Jang, and B.S. Kang, "Angle Correction Method of Depth Camera form Prevention of Hole Generation," The Korea Institute of Signal processing and Systems Summer Conference Proceedings , pp. 70-72, Jul. 2013.
  6. J. Biswas and M. Veloso, "Depth Camera Based Indoor Mobile Robot Localization and Navigation," IEEE International Conference on Robotics and Automation, pp.1697-1702, May. 2012.
  7. H.W. Kim, G.P. Jo, K.H. Jang, and B.S. Kang, "Resizing Image Algorithm for Real time processing and Hardware design," The Korea Institute of Signal processing and Systems Winter Conference Proceedings, pp. 212-214, Dec. 2013.
  8. Xilinx, Zynq-7000 All Programmable SoC Technical Reference Manual [Online] Available: http://www.xilinx.com, Apr, 2013.