Implementation of Disparity Information-based 3D Object Tracking

  • Published : 2005.12.21

Abstract

In this paper, a new 3D object tracking system using the disparity motion vector (DMV) is presented. In the proposed method, the time-sequential disparity maps are extracted from the sequence of the stereo input image pairs and these disparity maps are used to sequentially estimate the DMV defined as a disparity difference between two consecutive disparity maps Similarly to motion vectors in the conventional video signals, the DMV provides us with motion information of a moving target by showing a relatively large change in the disparity values in the target areas. Accordingly, this DMV helps detect the target area and its location coordinates. Based on these location data of a moving target, the pan/tilt embedded in the stereo camera system can be controlled and consequently achieve real-time stereo tracking of a moving target. From the results of experiments with 9 frames of the stereo image pairs having 256x256 pixels, it is shown that the proposed DMV-based stereo object tracking system can track the moving target with a relatively low error ratio of about 3.05 % on average.

Keywords

References

  1. S. Mandelbaum, R. Hansen, M. Burt, and P. Baten, CIRA (1998), p. 671
  2. T. Darrell, G. Gordon, M. Harville, and J. Woodfill, Proc. of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (1998), p. 601
  3. T. Joshi, N. Ahuja, and J. Ponce, Int. Journal of Computer Vision, 31, 31 (1999)
  4. M. Han and T. Kanade, IEEE Conference on Computer Vision (2001), p. 163
  5. J. S. Lee, J. H. Ko, and E. S. Kim, Optics Communications, 191, 191 (2001) https://doi.org/10.1016/S0030-4018(01)01087-2
  6. J. S. Lee, C. W. Seo, and E. S. Kim, Optics Communications, 200, 73 (2001) https://doi.org/10.1016/S0030-4018(01)01558-9
  7. D. J. Coombs and C. M. Brown, IEEE Control Systems Magazine, 11, 24 (1991)
  8. D. Coombs and C. Brown, Int. Journal of Computer Vision, 11, 147 (1993)
  9. V. S. Grinberg, G. Podnar, and M. W. Siegel, Proc. of SPIE (1994), p. 56
  10. M. G. Perkins, IEEE Trans. on Communications, 40, p. 684 (1992) https://doi.org/10.1109/26.142788
  11. C. H. Yang, Rapport technique de l'INRS-T'elecommunications, 95, p.12 (1995)
  12. Z. L. He and M. L. Liou, IEEE Transactions on Circuits and Systems on Video Technology, 7, 819 (1997)
  13. K. H. Bae and E. S. Kim, Optical Engineering, 42, 6 (2003)
  14. D. Murray and A. Basu, IEEE Transaction on Pattern Analysis and Machine Intelligence, 16, 449 (1994)