ETRI Journal

Electronics and Telecommunications Research Institute (한국전자통신연구원)
권호 표지
DOI QR코드

DOI QR Code

Fine-Motion Estimation Using Ego/Exo-Cameras

  • Uhm, Taeyoung (Department of Computer Science and Engineering, Hanyang University) ;
  • Ryu, Minsoo (Department of Computer Science and Engineering, Hanyang University) ;
  • Park, Jong-Il (Department of Computer Science and Engineering, Hanyang University)
  • Received : 2014.05.07
  • Accepted : 2015.04.01
  • Published : 2015.08.01
Download PDF
⟨ Previous Next ⟩

Abstract

Robust motion estimation for human-computer interactions played an important role in a novel method of interaction with electronic devices. Existing pose estimation using a monocular camera employs either ego-motion or exo-motion, both of which are not sufficiently accurate for estimating fine motion due to the motion ambiguity of rotation and translation. This paper presents a hybrid vision-based pose estimation method for fine-motion estimation that is specifically capable of extracting human body motion accurately. The method uses an ego-camera attached to a point of interest and exo-cameras located in the immediate surroundings of the point of interest. The exo-cameras can easily track the exact position of the point of interest by triangulation. Once the position is given, the ego-camera can accurately obtain the point of interest's orientation. In this way, any ambiguity between rotation and translation is eliminated and the exact motion of a target point (that is, ego-camera) can then be obtained. The proposed method is expected to provide a practical solution for robustly estimating fine motion in a non-contact manner, such as in interactive games that are designed for special purposes (for example, remote rehabilitation care systems).

Keywords

References

  1. S. Wang, H. Yu, and R. Hu, "3D Video Based Segmentation and Motion Estimation with Active Surface Evolution," J. Signal Process. Syst., vol. 71, no. 1, Apr. 2013, pp. 21-34. https://doi.org/10.1007/s11265-012-0675-5
  2. K. Khoshelham and S.O. Elberink, "Accuracy and Resolution of Kinect Depth Data for Indoor Mapping Applications," Sensors, vol. 12, no. 2, Feb. 2012, pp. 1437-1454. https://doi.org/10.3390/s120201437
  3. C. Lundquist and T.B. Schon, "Joint Ego-Motion and Road Geometry Estimation," Inf. Fusion, vol. 12, no. 4, Oct. 2011, pp. 253-263. https://doi.org/10.1016/j.inffus.2010.06.007
  4. J. Weng, Y. Cui, and N. Ahuja, "Transitory Image Sequences, Asymptotic Properties, and Estimation of Motion and Structure," IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 5, May 1997, pp. 451-464. https://doi.org/10.1109/34.589205
  5. A. Seki and M. Okutomi, "Ego-Motion Estimation by Matching Dewarped Road Regions Using Stereo Images," IEEE Int. Conf. Robot. Autom., Orlando, FL, USA, May 15-19, 2006, pp. 901-907.
  6. G. Adiv, "Inherent Ambiguities in Recovering 3D Motion and Structure from a Noisy Flow Field," IEEE Trans. Pattern Anal. Mach. Intell., vol. 11, no. 5, May 1989, pp. 477-489. https://doi.org/10.1109/34.24780
  7. R. Poppe, "Vision-Based Human Motion Analysis: An Overview," Comput. Vis. Image Understanding, vol. 108, no. 1, Oct. 2007, pp. 4-18. https://doi.org/10.1016/j.cviu.2006.10.016
  8. J. Weng, T.S Huang, and N. Ahuja, "Motion and Structure from Two Perspective Views: Algorithms, Error Analysis, and Error Estimation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 11, no. 5, May 1989, pp. 451-476. https://doi.org/10.1109/34.24779
  9. J. Weng, N. Ahuja, and T.H. Huang, "Optimal Motion and Structure Estimation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 15, no. 9, Sept. 1993, pp. 864-884. https://doi.org/10.1109/34.232074
  10. G. Schweighofer and A. Pinz, "Robust Pose Estimation from a Planar Target," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 12, Dec. 2006, pp. 2024-2030. https://doi.org/10.1109/TPAMI.2006.252
  11. J. Weng, T.S. Huang, and N. Ahuja, "Motion and Structure from Image Sequences," New York, NY, USA: Springer Publishing Company, 1993, pp. 1-444.
  12. A. Fossati et al., "Consumer Depth Cameras for Computing Vision: Research Topics and Applications," Google eBook, 2012.
  13. C.V. Nguyen, S. Izadi, and D. Lovell, "Modeling Kinect Sensor Noise for Improved 3D Reconstruction and Tracking," Int. Conf. 3D Imag., Modeling, Process., Vis. Transmission, Zurich, Switzerland, Oct. 13-15, 2012, pp. 524-530.