The Journal of the Convergence on Culture Technology (문화기술의 융합)

The International Promotion Agency of Culture Technology (국제문화기술진흥원)
권호 표지
DOI QR코드

DOI QR Code

Hand Motion Recognition Algorithm Using Skin Color and Center of Gravity Profile

피부색과 무게중심 프로필을 이용한 손동작 인식 알고리즘

  • Received : 2021.04.13
  • Accepted : 2021.05.06
  • Published : 2021.05.31
Download PDF
⟨ Previous Next ⟩

Abstract

The field that studies human-computer interaction is called HCI (Human-computer interaction). This field is an academic field that studies how humans and computers communicate with each other and recognize information. This study is a study on hand gesture recognition for human interaction. This study examines the problems of existing recognition methods and proposes an algorithm to improve the recognition rate. The hand region is extracted based on skin color information for the image containing the shape of the human hand, and the center of gravity profile is calculated using principal component analysis. I proposed a method to increase the recognition rate of hand gestures by comparing the obtained information with predefined shapes. We proposed a method to increase the recognition rate of hand gestures by comparing the obtained information with predefined shapes. The existing center of gravity profile has shown the result of incorrect hand gesture recognition for the deformation of the hand due to rotation, but in this study, the center of gravity profile is used and the point where the distance between the points of all contours and the center of gravity is the longest is the starting point. Thus, a robust algorithm was proposed by re-improving the center of gravity profile. No gloves or special markers attached to the sensor are used for hand gesture recognition, and a separate blue screen is not installed. For this result, find the feature vector at the nearest distance to solve the misrecognition, and obtain an appropriate threshold to distinguish between success and failure.

인간과 컴퓨터의 상호작용을 연구하는 분야를 HCI(Human-computer interaction)라고 한다. 이 분야는 인간과 컴퓨터 간에 서로 소통하면서 정보를 인식하는 방법에 대해 연구하는 학문 분야이다. 본 연구는 사람과의 상호작용을 위한 손동작 인식에 대한 연구로써 기존 인식방법의 문제점을 살펴보고 인식률을 개선하기 위한 알고리즘을 제시한다. 사람의 손 모양이 포함된 영상을 대상으로 피부색 정보를 바탕으로 손 영역을 추출하고, 주성분 분석을 이용하여 무게중심 프로필을 계산한다. 이렇게 얻은 정보를 미리 정의된 형상들과 비교하여 손동작을 인식률을 높이는 방법을 제안하였다. 기존의 무게중심 프로필은 회전으로 인한 손의 변형에 대해 잘못된 손동작 인식을 결과를 보여주었으나, 본 연구에서는 무게중심 프로필을 이용하고 모든 윤곽선의 점들과 무게중심 사이의 거리가 가장 긴 점을 시작점으로 하여 무게중심 프로필을 다시 개선함으로써 강건한 알고리즘을 제시하였다. 손동작 인식을 위하여 센서가 부착된 장갑이나 특별한 마커를 사용하지 않으며, 별도의 청색 스크린을 설치하지도 않는다. 이 결과에 대해 가장 가까운 거리의 특징벡터를 찾아 잘못된 인식을 해결하고, 적당한 경계치를 구하여 성공과 실패를 구분한다.

Keywords

References

  1. A. Mulder, "Hand Gestures for HCI," Technical Report 96-1, http://fas.sfu.ca/cs/people/ResearchStaff/amulder/pe../HCI-gestres.ht, 1996.
  2. D.J. Sturrmam. D. Zeltaer, "A Survey of glove-based input," IEEE Computer Graphics and Applications, Vol.14, pp.30-39, Jan. 1994. https://doi.org/10.1109/38.250916
  3. Ji Ho So, Young-Ju Jeon, "Using 3D image-based body shape Measurement to increase the accuracy of body shape Measurement" The Journal of the Convergence on Culture Technology(JCCT), Vol. 6, No. 4, pp803-806, 2020. DOI: https://doi.org/10.17703/JCCT.2020.6.4.803
  4. J. Lee, T. L. Knuii, "Model-based analysis of hand posture," IEEE Computer Graphics and Applications, pp. 77-86, 1995.
  5. C. C. Lien, C. L. Huang, "Model-based articulated hand motion tracking for gesture recognition," Image and Vision Computer 16 pp.121-134, 1998. https://doi.org/10.1016/S0262-8856(97)00041-3
  6. S. Tamura, S. Kawasaki, "Recognition of sign language motion image," pattern recognition 21(4) pp.343-353, 1998. https://doi.org/10.1016/0031-3203(88)90048-9
  7. YIN, Yong, "Video objects segmentation based on change detection, Computer engineering and application v.44 no.13, 2008.
  8. Youngmin Park, Youngwoo Yoon, "A Histogram Matching Scheme for Color Pattern Classification", KIPS Transactions on Software and Data Engineering, 13(7), pp.689-698 Dec, 2006
  9. Chan Wah Ng, Surendra Ranganath, "Real-Time Gesture Recognition," pp. 993-1007, 2002.
  10. Kim Jang-Woon, Hong Sec-Joo, Lee Chil-Woo, "Vision-Based hand shape recognition for a pictorial puzzle", Proceedings of the 2006 Fall General Conference of the Korea Contents Association, pp.801-805, 2006.
  11. D Chi, King N. Ngan "Face Segmentation Using Skin-Color Reference map in Videophone Applications," IEEE Transactions on Circuits and Systems for Vidoe Technology, vol.9, June 1999.
  12. Richard J. and M. Ibrahim Sezan, "Video Background Replacement without A Blue Screen," ICIP99. 28A03.
  13. Christopher Eveland, Kurt Konolige and Robert C. Bolles, "Background Modeling for Segmentation of Video-Rate Stereo Sequences," CVPR 1998, pp.266-271.