Advanced SearchSearch Tips
3D Object Location Identification Using Finger Pointing and a Robot System for Tracking an Identified Object
facebook(new window)  Pirnt(new window) E-mail(new window) Excel Download
 Title & Authors
3D Object Location Identification Using Finger Pointing and a Robot System for Tracking an Identified Object
Gwak, Dong-Gi; Hwang, Soon-Chul; Ok, Seo-Won; Yim, Jung-Sae; Kim, Dong Hwan;
  PDF(new window)
In this work, a robot aimed at grapping and delivering an object by using a simple finger-pointing command from a hand- or arm-handicapped person is introduced. In this robot system, a Leap Motion sensor is utilized to obtain the finger-motion data of the user. In addition, a Kinect sensor is also used to measure the 3D (Three Dimensional)-position information of the desired object. Once the object is pointed at through the finger pointing of the handicapped user, the exact 3D information of the object is determined using an image processing technique and a coordinate transformation between the Leap Motion and Kinect sensors. It was found that the information obtained is transmitted to the robot controller, and that the robot eventually grabs the target and delivers it to the handicapped person successfully.
3D location identification;Object identification and tracking;Kinect and Leap Motion sensor fusion;Finger-pointing;
 Cited by
Leap Motion Inc., viewed 13 Sep. 2014, .

Spiegelmock, M., 2013, Leap Motion Development Essentials, Packt Publishing, UK.

Microsoft Inc., viewed 13 Jun. 2014, <>.

Webb, J., Ashley J., 2012, Beginning Kinect Programming with the Microsoft Kinect SDK, Apress : Springer-Verlag, New York.

Kim, S., Woo, W., 2006, 3D Reconstruction of an Indoor Scene Using Depth and Color Images, J. of the HCI Soc. of Korea, 1:1 53-61. crossref(new window)

Weichert, F., Bachmann, D., Rudak B., Fisseler, D., 2013, Analysis of the Accuracy and Robustness of the Leap Motion Controller, Sensors, 13 6380-6393. crossref(new window)

Cheung, K. M., 2003, Visual Hull Construction, Alignment and Refinement for Human Kinematic Modeling Motion Tracking and Rendering, A Thesis for a Doctorate, Carnegie Mellon University, United States.

Wikipedia, viewd 11 Mar. 2014, Dynamic Positioning System, .

Park, J., Shin, Y., Jang, G., Baeg, M., 2011, A Study on Mapping of 3D Spatial Information for Modeling of Indoor Space, The Korean Soc. Geo-Spatial Info. Sys., 2011:10, 84-89.