Real-time Hand Gesture Recognition System based on Vision for Intelligent Robot Control

지능로봇 제어를 위한 비전기반 실시간 수신호 인식 시스템

  • 양태규 (목원대학교 지능로봇공학과) ;
  • 서용호 (남서울대학교 컴퓨터학과)
  • Published : 2009.10.31


This paper is study on real-time hand gesture recognition system based on vision for intelligent robot control. We are proposed a recognition system using PCA and BP algorithm. Recognition of hand gestures consists of two steps which are preprocessing step using PCA algorithm and classification step using BP algorithm. The PCA algorithm is a technique used to reduce multidimensional data sets to lower dimensions for effective analysis. In our simulation, the PCA is applied to calculate feature projection vectors for the image of a given hand. The BP algorithm is capable of doing parallel distributed processing and expedite processing since it take parallel structure. The BP algorithm recognized in real time hand gestures by self learning of trained eigen hand gesture. The proposed PCA and BP algorithm show improvement on the recognition compared to PCA algorithm.


  1. Q. Chen, N. D. Georganas and E. M. Petriu, "Real-time Vision-based Hand Gesture Recognition Using Haar-like Features", Instrumentation and Measurement Technology Conference Proceedings, 2007 IEEE, pp.1-6, 2007
  2. J. Davis and M. Shah "Visual Gesture Recognition", IEEE Vision. Image and Signal Processing, Vol. 141, No. 2,pp.101-106, 1994
  3. Y. Aoki, S. Tanahashi and J. Xu, "Sign language image processing for intelligent communication by a communications satellite", IEEE mternational Conference on Acoustics, Speech, and Signal Processing, Vol. 5, pp. 197-200, 1994
  4. A. Utsumi, T. Miyasato and F. Kishino, "Multi-camera hand pose recognition system using skeleton image", IEEE mternational Workshop on Robot and Human Communication, pp. 219-224, 1995
  5. C. C. Chang, I. Y. Chen and Y. S. Huang, "Hand Pose Recognition Using Curvature Scale Space", IEEE mternational Conference on Pattern Recognition, Vol. 2, pp. 386-389, 2002
  6. M. Turk and A. Pentland, "Eigenfaces for Recognition", Journal of Cognitive Neuroscience, Vol. 3, pp. 71-86, 1991
  7. P. N. Beihumeur, J. P. Hespanha and D. J. Kriegman, "Eigenfaces vs. Fisherfaces: recognition using class specific linear projection", IEEE Transactions on Pattern Analysis and Machine mtelligence, Vol. 19, No. 7, pp. 711-720, 1997
  8. Yang, Ming-Hsuan, Kernel Eigenfaces vs. Kernel Fisherfaces : Face Recognition Using Kernel Methods, Automatic Face and Gesture Recognition, 2002 Proceedings. Fourth IEEE mternational Conference, pp. 208-213, 2002
  9. Rowley, H. and Baluja, S. and Kanade, T., Neural network-based face detection, IEEE Trans. Pattern Analysis and Maching mtelligence, Vol. 20, No.1, pp. 23-38, 1998