한국정보통신학회논문지 (Journal of the Korea Institute of Information and Communication Engineering)

  • 제25권10호
  • /
  • Pages.1323-1329
  • /
  • 2021
  • /
  • 2234-4772(pISSN)
  • /
  • 2288-4165(eISSN)
한국정보통신학회 (The Korea Institute of Information and Commucation Engineering)
권호 표지
DOI QR코드

DOI QR Code

손 표현 인식을 위한 계층적 손 자세 모델

Hierarchical Hand Pose Model for Hand Expression Recognition

  • Heo, Gyeongyong (Department of Electronic Engineering, Dong-eui University) ;
  • Song, Bok Deuk (Intelligent Convergence Research Laboratory, ETRI) ;
  • Kim, Ji-Hong (Department of Electronic Engineering, Dong-eui University)
  • 투고 : 2021.07.19
  • 심사 : 2021.08.25
  • 발행 : 2021.10.31
PDF 다운로드
⟨ 이전 논문 다음 논문 ⟩

초록

손 표현 인식을 위해서는 손의 정적인 형태를 기반으로 하는 손 자세 인식과 손의 동적인 움직임을 기반으로 하는 손 동작 인식이 함께 사용된다. 이 논문에서는 손 표현 인식을 위해 손가락의 위치와 형태를 기반으로 하는 계층적 손 자세 모델을 제안한다. 손 자세 인식을 위해서는 오픈소스인 미디어파이프를 기반으로 하고, 손가락 상태를 나타내는 모델과 이를 통해 손 자세를 나타내는 모델을 계층적으로 구성하였다. 손가락 모델 역시 손가락 하나의 굽힘과 손가락 두 개의 닿음을 사용하여 계층적으로 구성하였다. 제안하는 모델은 손을 통해 정보를 전달하는 다양한 응용에 사용할 수 있으며, 수화에서의 숫자 인식에 적용하여 그 유용성을 검증하였다. 제안하는 모델은 수화 인식 이외에 컴퓨터의 사용자 인터페이스에서 다양한 응용이 가능할 것으로 기대한다.

For hand expression recognition, hand pose recognition based on the static shape of the hand and hand gesture recognition based on the dynamic hand movement are used together. In this paper, we propose a hierarchical hand pose model based on finger position and shape for hand expression recognition. For hand pose recognition, a finger model representing the finger state and a hand pose model using the finger state are hierarchically constructed, which is based on the open source MediaPipe. The finger model is also hierarchically constructed using the bending of one finger and the touch of two fingers. The proposed model can be used for various applications of transmitting information through hands, and its usefulness was verified by applying it to number recognition in sign language. The proposed model is expected to have various applications in the user interface of computers other than sign language recognition.

키워드

참고문헌

  1. M. Patel and N. Kalani, "A Survey on Pose Estimation using Deep Convolutional Neural Networks," in Proceedings of 2nd International Conference on Machine Learning, Security and Cloud Computing, Hyderabad, India, pp. 1-9, 2020.
  2. M. M. Rahman, Y. Tan, J. Xue, and K. Lu, "Recent Advances in 3D Object Detection in the Era of Deep Neural Networks: A Survey," IEEE Transactions on Image Processing, vol. 29, pp. 2947-2962, 2020. https://doi.org/10.1109/tip.2019.2955239
  3. A. Singh, S. Agarwal, P. Nagrath, A. Saxena, and N. Thakur, "Human Pose Estimation Using Convolutional Neural Networks," in Proceedings of 2019 Amity International Conference on Artificial Intelligence, Dubai, United Arab Emirates, pp. 946-952, 2019.
  4. R. Berral-Soler, F. J. Madrid-Cuevas, R. Munoz-Salinas, and M. J. Marin-Jimwnez, "RealHePoNet: a robust single-stage ConvNet for head pose estimation in the wild," Neural Computing and Applications, vol. 33, no. 13, pp. 7673-7689, July. 2021. https://doi.org/10.1007/s00521-020-05511-4
  5. X. Ji, Q. Fang, J. Dong, Q Shuai, W. Jiang, and X. Zhou, "A survey on monocular 3D human pose estimation," Virtual Reality & Intelligent Hardware, vol. 2, no. 6, pp. 471-500, Dec. 2020. https://doi.org/10.1016/j.vrih.2020.04.005
  6. T. Chatzis, A. Stergioulas, D. Konstantinidis, K. Dimitropoulos, and P. Daras, "A Comprehensive Study on Deep Learning-Based 3D Hand Pose Estimation Methods," Applied Sciences, vol. 10, no. 19, pp. 1-27, Sep. 2020
  7. MediaPipe [Internet]. Available: https://mediapipe.dev.
  8. M. Pandiya, S. Dassani, and P. Mangalraj, "Analysis of Deep Learning Architectures for Object Detection - A Critical Review," in Proceedings of 2020 IEEE-HYDCON International Conference on Engineering in the 4th Industrial Revolution, Hyderabad, India, pp. 1-6, 2020.
  9. W. Liu, D. Anguelov, D. Erhan, C. Szegedy, S. Reed, C. Y. Fu, and A. C. Berg, "SSD: Single Shot MultiBox Detector," in Proceedings of 2016 European Conference on Computer Vision, Amsterdam, Netherlands, pp. 21-37, 2016.
  10. T. Y. Lin, P. Dollar, R. Girshick, K. He, B. Hariharan, and S. Belongie, "Feature Pyramid Networks for Object Detection," in Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, USA, pp. 936-944, 2017.