Advanced SearchSearch Tips
Human-Object Interaction Framework Using RGB-D Camera
facebook(new window)  Pirnt(new window) E-mail(new window) Excel Download
  • Journal title : Journal of Broadcast Engineering
  • Volume 21, Issue 1,  2016, pp.11-23
  • Publisher : The Korean Institute of Broadcast and Media Engineers
  • DOI : 10.5909/JBE.2016.21.1.11
 Title & Authors
Human-Object Interaction Framework Using RGB-D Camera
Baeka, Yong-Hwan; Lim, Changmin; Park, Jong-Il;
  PDF(new window)
Recent days, touch interaction interface is the most widely used interaction interface to communicate with digital devices. Because of its usability, touch technology is applied almost everywhere from watch to advertising boards and it is growing much bigger. However, this technology has a critical weakness. Normally, touch input device needs a contact surface with touch sensors embedded in it. Thus, touch interaction through general objects like books or documents are still unavailable. In this paper, a human-object interaction framework based on RGB-D camera is proposed to overcome those limitation. The proposed framework can deal with occluded situations like hovering the hand on top of the object and also moving objects by hand. In such situations object recognition algorithm and hand gesture algorithm may fail to recognize. However, our framework makes it possible to handle complicated circumstances without performance loss. The framework calculates the status of the object with fast and robust object recognition algorithm to determine whether it is an object or a human hand. Then, the hand gesture recognition algorithm controls the context of each object by gestures almost simultaneously.
human-object interaction;hand gesture interface;RGB-D camera;object recognition;
 Cited by
Andrew D. Wilson, "Depth-sensing video cameras for 3d tangible tabletop interaction," Proceedings of Second Annual IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP'07), pp. 201-204, 2007.

Matt Adcock, Stuart Anderson, and Bruce Thomas, "RemoteFusion: real time depth camera fusion for remote collaboration on physical tasks," Proceedings of the 12th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and Its Application in Industry (VRCAI'13), pp. 235-242, 2013.

Zoran Zivkovic, "Improved adaptive Gaussian mixture model for background subtraction," Proceedings of the 17th International Conference on Pattern Recognition (ICPR'04), Vol. 2, pp. 28-31, 2004.

Michael J. Swain, and Dana H. Ballard, “Color indexing,“ International Journal of Computer Vision, Vol. 7(1), pp. 11-32, 1991. crossref(new window)

Berrnt Schile, and James L. Crowley, “Recognition without Correspondence using Multidimensional Receptive Field Histograms,“ International Journal of Computer Vision, Vol. 36(1), pp. 31-50, 2000. crossref(new window)

Oskar Linde, and Tony Lindeberg, "Object recognition using composed receptive field histograms of higher dimensionality," Proceedings of the 17th International Conference on Pattern Recognition (ICPR'04), Vol. 2, pp. 1-6, 2004.

Oskar Linde, and Tony Lindeberg, “Composed complex-cue histograms: An investigation of the information content in receptive field based image descriptors for object recognition,“ Computer Vision and Image Understanding, Vol. 116(4), pp. 538-560, 2012. crossref(new window)

David G. Lowe, "Object recognition from local scale-invariant features," Proceedings of the 7th IEEE International Conference on Computer Vision (ICCV'99), Vol. 2, pp. 1150-1157, 1999.

David G. Lowe, “Distinctive image features from scale-invariant keypoints,“ International Journal of Computer Vision, Vol. 60(2), pp. 91-110, 2004. crossref(new window)

Herbert Bay, Tinne Tuytelaars, and Luc Van Gool, "Surf: Speeded up robust features," Computer Vision-ECCV 2006, pp. 404-417, 2006.

Herbert Freeman, and Ruth Shapira, “Determining the minimum-area encasing rectangle for an arbitrary closed curve,“ Communications of the ACM, Vol. 18(7), pp. 409-413, 1975. crossref(new window)

Junyeong Choi, Byung-Kuk Seo, Daeseon Lee, Hanhoon Park, and Jong-Il Park, "RGB-D camera-based hand shape recognition for human-robot interaction," 44th International Symposium on Robotics (ISR'13), pp. 1-2, 2013.