DOI QR코드

DOI QR Code

Vision based 3D Hand Interface Using Virtual Two-View Method

가상 양시점화 방법을 이용한 비전기반 3차원 손 인터페이스

  • Bae, Dong-Hee (Dept. of Multimedia, Dongguk Univ.) ;
  • Kim, Jin-Mo (Research Institute for Image & Cultural Content, Dongguk Univ.)
  • 배동희 (동국대학교 멀티미디어학과) ;
  • 김진모 (동국대학교 영상문화콘텐츠연구원)
  • Received : 2013.09.10
  • Accepted : 2013.10.04
  • Published : 2013.10.20

Abstract

With the consistent development of the 3D application technique, visuals are available at more realistic quality and are utilized in many applications like game. In particular, interacting with 3D objects in virtual environments, 3D graphics have led to a substantial development in the augmented reality. This study proposes a 3D user interface to control objects in 3D space through virtual two-view method using only one camera. To do so, homography matrix including transformation information between arbitrary two positions of camera is calculated and 3D coordinates are reconstructed by employing the 2D hand coordinates derived from the single camera, homography matrix and projection matrix of camera. This method will result in more accurate and quick 3D information. This approach may be advantageous with respect to the reduced amount of calculation needed for using one camera rather than two and may be effective at the same time for real-time processes while it is economically efficient.

최근 3차원 분야의 지속적인 발전으로 인해 보다 사실적이고 실감나는 영상을 경험할 수 있게 되었고 게임과 같은 다양한 응용분야에서 활용가능하게 되었다. 특히 가상환경에서의 객체들과 상호작용하며 이를 제어하는 증강현실 분야에 많은 발전을 가져왔다. 본 연구는 한 대의 카메라를 활용한 가상 양시점화 방법을 통해 3차원 공간의 객체를 제어하는 3차원 사용자 인터페이스를 제안한다. 이를 위해 임의의 두 카메라 위치 사이의 변환 정보를 담고 있는 호모그래피(homography) 행렬을 계산하고, 한 대의 카메라에서 얻은 2차원 손 좌표, 호모그래피 행렬 그리고 카메라의 투영행렬을 이용하여 3차원 좌표의 복원을 수행한다. 이러한 방법을 통해 보다 정확하고 빠른 3차원 정보를 얻을 수 있게 된다. 이는 두 대의 카메라를 동시에 구동할 때보다 연산량이 감소하여 실시간 처리에 효과적일 수 있으며 경제적인 부담도 줄일 수 있는 장점을 가지고 있다.

Keywords

References

  1. Dong-Ha Lee and Mun-Hee Lee, "Current status of human-computer interaction (HCI) technology policy", The Magazine of the IEEK, Vol. 34, No.6, pp. 628-637, 2007.
  2. Woon-Tack Woo, Namgyu Kim, Karen Wong and Makoto Tadenuma, "Sketch on dynamic gesture tracking and analysis exploiting vision-based 3D interface", Proceeding of SPIE, Vol. 4310, pp. 656-666, 2001.
  3. Boo-Nyon Kim, Jongho Kim and Tae-Young Kim, "A method of hand recognition for virtual hand control of virtual reality game environment", Journal of Korea Game Society, Vol. 10, No. 2, pp. 49-56, 2010.
  4. T. Maung, "Real-time hand tracking and gesture recognition system using neural networks", Proc. of World Academy of Science: Engineering & Technology, Vol. 50, pp. 466-470, 2009.
  5. C. J. Lim, Hun Lee, and Yun-Guen Jeong, "Validation test of vision-based eye controlled user interface", Journal of Korean Society for Computer Game, Vol. 24, No. 2, pp. 141-151, 2011.
  6. Hyun-Cheol Yoon and Jong-Seung Park, "Gesture-based game character animation using motion data captured from the kinect sensor", Journal of Korean Society for Computer Game, Vol. 26, No. 2, pp. 147-153, 2013.
  7. Guan-Feng He, Jin-Woong Park, Sun-Kyung Kang and Sung-Tae Jung, "Development of gesture recognition-based 3D serious games", Journal of Korea Game Society, Vol. 11, No. 6, pp. 103-114, 2011.
  8. D. Goldin, S. Smolka, P. Wegner and D. Eds, "Interated dynamic programming and quadtree subregioning for fast stereo matching", Image and Vision Computing, Vol. 26, Issue 10, pp. 1371-1383, 2008. https://doi.org/10.1016/j.imavis.2007.11.013
  9. J. Lee, Hyung-Gi Kim, and Won-Hyung Lee, "A multimedia implementation using tangible game interface", Journal of Korean Society for Computer Game, Vol. 7, pp. 16-22, 2005.
  10. R. Hartley and A. Zisserman, "Multiple view geometry in computer vision", Cambridge University Press, 2004.
  11. Ae-Kyung Kang,"Image processing- based hand interface to control 3D graphic objects", Master thesis, Dongguk University, 2008.
  12. J. R. Parker, "Algorithms for image processing and computer vision", John Wiley and Sons, 1996.
  13. David B. Kirk, Wen-mei W. Hwu, "Programming massively parallel processors", Elsevier Inc., 2010.