DOI QR코드

DOI QR Code

A Study on High Speed Face Tracking using the GPGPU-based Depth Information

GPGPU 기반의 깊이 정보를 이용한 고속 얼굴 추적에 대한 연구

  • Received : 2013.01.17
  • Accepted : 2013.03.14
  • Published : 2013.05.31

Abstract

In this paper, we propose an algorithm to detect and track the human face with a GPU-based high speed. Basically the detection algorithm uses the existing Adaboost algorithm but the search area is dramatically reduced by detecting movement and skin color region. Differently from detection process, tracking algorithm uses only depth information. Basically it uses a template matching method such that it searches a matched block to the template. Also, In order to fast track the face, it was computed in parallel using GPU about the template matching. Experimental results show that the GPU speed when compared with the CPU has been increased to up to 49 times.

본 논문에서는 얼굴을 검출하고 GPU 기반으로 얼굴을 고속으로 추적하는 알고리즘을 제안하였다. 얼굴 검출에서는 깊이영상과 RGB영상을 사용하고, 기존의 방법인 Adaboost을 이용하지만 움직임 영역과 피부색 영역을 이용하여 Adaboost의 입력영상을 제한하여 얼굴을 검출하였다. 얼굴 검출과는 다르게 얼굴 추적은 깊이 정보만을 사용하였다. 기본적으로 얼굴 추적에서는 템플릿과 매칭 된 블록을 찾는 템플릿 매칭 방법을 사용하였다. 또한 고속으로 얼굴을 추적하기 위해서 GPU를 이용하여 템플릿 매칭을 병렬하여 연산하였다. 실험결과 CPU와 GPU을 비교 하였을 때 GPU 수행속도가 최대 49배까지 향상되는 것을 확인하였다.

Keywords

References

  1. G, Q, Zhao, et al., "A Simple 3D face Tracking Method based on Depth Information," Int'l Conf. on Machine Learning and Cybernetics, pp. 5022-5027, Aug. 2005.
  2. C. X. Wang and Z. Y. Li, "A New Face Tracking Algorithm Based on Local Binary Pattern and Skin Color Information," ISCSCT, Vol. 2, pp. 20-22, Dec. 2008.
  3. M. H. Yang, et al., "Detecting Faces in Images; A Survey," IEEE Trans. on Pattern Analysis and Machine Intelligence, Vol. 24, No. 1, pp. 34-58, Jan. 2002. https://doi.org/10.1109/34.982883
  4. G. Z. Yang and T. S. Huang, "Human Face Detection in Complex Background," Pattern Recognition, Vol. 27, No. 1, pp. 53-63, Jan. 1994. https://doi.org/10.1016/0031-3203(94)90017-5
  5. L. Craw, D. Tock, and A. Bennett, "Finding Face Features," Proc. Second European Conf. Computer Vision, pp. 92-96, 1992.
  6. MESA SR4000 MESA Imaging, 2011 [Online]. Available:http://www.mesa-imaging.ch/prodview4k.php
  7. Kinect Website, http://www.microsoft.com/en-us/kinectforwindows/
  8. R. Cabido, "High-performance template tracking", J. Vis. Commun. Image, pp 271-286, 2012.
  9. Oscar Mateo Lozano, Kazuhiro Otsuka, "SIMULTANEOUS AND FAST 3D TRACKING OF MULTIPLE FACES IN VIDEO BY GPU-BASED STREAM PROCESSING", ICASSP, 2008.
  10. Claus Lenz, Giorgio Panin, Alois Knoll, "A GPU-accelerated particle filter with pixel-level likelihood", 2008.
  11. GPGPU Website, http://gpgpu.org
  12. Douglas Chai, et al., "Locating Facial Region of a Head-and -Shoulders Color Image," Int'l Conf. Automatic Face and Gesture Recognition, pp. 124-129, April 1998.
  13. David B. Kirk and Wen-mei W. Hwu, "Programming Massively Parallel Processors: A Hands-on Approach 1st Ed", ELSEVIER
  14. NVidia Website, http://www.nvidia.co.kr/
  15. Mark Harris, "Optimizing Parallel Reduction in CUDA," NVIDIA Developer Technology, 2007.
  16. X. Suau, J. Ruiz-Hidalgo and J. Casas, "Real-Time Head and Hand Tracking Based on 2.5D Data", IEEE Trans. Multimedia, Vol. 14, No. 3, pp. 575-585, June 2012. https://doi.org/10.1109/TMM.2012.2189853
  17. S.-K. Kwon and S.-W. Kim, "Motion Estimation Method by Using Depth Camera," J. Broadcast Engineering, Vol. 17, No. 4, pp. 676-683, Jul. 2012. https://doi.org/10.5909/JBE.2012.17.4.676
  18. S.-K. Kwon, Y.-H. Park and K.-R. Kwon, "Zoom Motion Estimation Method by Using Depth Information," J. Korea Multimedia Society, Vol. 16, No. 2, pp. 131-137, Feb. 2013. https://doi.org/10.9717/kmms.2013.16.2.131
  19. P. Viola and M. J. Jones, "Robust Real-Time Face Detection," Computer Vision, Vol. 52, No. 2, pp. 137-154, 2004.