Proceedings of the Korea Information Processing Society Conference (한국정보처리학회:학술대회논문집)

  • 2018.10a
  • /
  • Pages.920-922
  • /
  • 2018
  • /
  • 2005-0011(pISSN)
  • /
  • 2671-7298(eISSN)
Korea Information Processing Society (한국정보처리학회)
권호 표지
DOI QR코드

DOI QR Code

Marker Classification by Sensor Fusion for Hand Pose Tracking in HMD Environments using MLP

HMD 환경에서 사용자 손의 자세 추정을 위한 MLP 기반 마커 분류

  • Vu, Luc Cong (Dept. of HCI & Robotics Engineering, Univ. of Science and Technology(UST)) ;
  • Choi, Eun-Seok (Dept. of HCI & Robotics Engineering, Univ. of Science and Technology(UST)) ;
  • You, Bum-Jae (Dept. of HCI & Robotics Engineering, Univ. of Science and Technology(UST))
  • 록콩부 (HCI 및 로봇공학과, 과학기술연합대학원대학교) ;
  • 최은석 (HCI 및 로봇공학과, 과학기술연합대학원대학교) ;
  • 유범재 (HCI 및 로봇공학과, 과학기술연합대학원대학교)
  • Published : 2018.10.31
Download PDF
⟨ Previous Next ⟩

Abstract

This paper describes a method to classify simple circular artificial markers on surfaces of a box on the back of hand to detect the pose of user's hand for VR/AR applications by using a Leap Motion camera and two IMU sensors. One IMU sensor is located in the box and the other IMU sensor is fixed with the camera. Multi-layer Perceptron (MLP) algorithm is adopted to classify artificial markers on each surface tracked by the camera using IMU sensor data. It is experimented successfully in real-time, 70Hz, under PC environments.

Keywords