Journal of the Korea Institute of Information and Communication Engineering (한국정보통신학회논문지)

The Korea Institute of Information and Commucation Engineering (한국정보통신학회)
권호 표지
DOI QR코드

DOI QR Code

Improve Stereo Matching by considering the Characteristic Points of the Image and the Cost Function

영상의 특징점과 비용함수를 고려한 스테레오 정합개선

  • 백영민 (광운대학교 실감미디어 연구소) ;
  • 최현준 (안양대학교 정보통신공학과) ;
  • 서영호 (광운대학교 실감미디어 연구소) ;
  • 김동욱 (광운대학교 실감미디어 연구소)
  • Received : 2010.03.01
  • Accepted : 2010.03.31
  • Published : 2010.07.30
Download PDF
⟨ Previous Next ⟩

Abstract

This thesis proposes an adaptive variable-sized matching window method using the characteristic points of the image and a method to increase the reliability of the cross-consistency check to raise the correctness of the final disparity image. The proposed adaptive variable-sized window method segments the image with the color information, finds the characteristic points in each segmented image, and varies the size of the matching window according to the existence of the characteristic points inside the window. Also the proposed cross-consistency check method processes the two cases with the cost values corresponding to the best disparity and the second-best disparity: when the cost values themselves are too large and when the difference between the two cost values are too small. The two proposed methods were experimented with the four test images provided by the Middleburry site. As the results from the experiments, the proposed adaptive variable-sized matching window method decreased up to 18.2% of error ratio and the proposed cross-consistency check method increased up to 7.4% of reliability.

본 논문에서는 최종 변이영상의 정확도를 높이기 위해 영상의 특징점을 이용한 적응적 가변 정합창 방법과 교차 일치성 검사의 신뢰도를 높이는 방법을 제안한다. 제안한 적응적 가변 정합창 방법은 색상정보를 이용하여 영상을 분할하고 분할된 각 영상의 특징점을 찾아 그 특징점들의 유무에 따라 정합창의 크기를 적응적으로 가변시키는 방법이다. 또한 제안한 교차 일치성 검사 방법은 최적의 변이와 차상위 최적의 변이에 대한 비용함수 값들을 비교하여 비용하수 값 자체가 너무 크거나 두 비용함수의 차이가 너무 적은 경우를 찾아내어 처리하는 방법이다. 제안한 두 방법에 대한 Middleburry에서 제공한 네 가지 실험영상을 대상으로 실험한 결과 적응적 가변 정합창 방법은 최대 18.2%의 오차율을 감소시켰다. 또한 제안한 교차 일치성 검사는 최대 7.4%의 신뢰도를 향상시킨 것으로 나타났다.

Keywords

References

  1. H. Saito, S. Baba, and T. Kanade, "Appearance-based Virtual View Generation of Temporally-Varying Events from Multi-Camera Images in the 3D Room," IEEE Trans. on Multimedia, Vol. 5, No. 3, pp. 303-316, Sep. 2003. https://doi.org/10.1109/TMM.2003.813283
  2. J. Schimidt, H. Niemann, and S. Vogt, "Dense Disparity Maps in Real-Time with an Application to Augmented Reality," Proceedings of IEEE Workshop on Applications of Computer Vision(WACV 2002), Orlando, FL USA, pp. 225-230, Dec. 2002.
  3. N. Kim, W. Woo, and M. Tadenuma, "Photo-realistic Interactive 3D Virtual Environment Generation Using Multiview Video," Proceedings of SPIE VCIP2001, Vol. 4310, pp. 245-254, Jan. 2001.
  4. ISO/IEC MPEG & ITU-T VCEG, "Multiview video plus depth (MVD) format for advanced 3D video systems," JVT-W100, April. 2007.
  5. T. Kanade, M. Okutomi, "A stereo matching algorithm with an adaptive window: theory and experiment," IEEE Trans. on Pattern Analysis and Machine Intelligence, Vol. 16, pp. 920-932, 1994. https://doi.org/10.1109/34.310690
  6. A. Fusiello, V. Roberto, E. Trucco, "Experiments with a new area-based stereo algorithm," International Conference on Image Analysis and Processing, 1997.
  7. I. J. Cox, S. L. Hingorani, S. B. Rao, "A maximum likelihood stereo algorithm," Computer Vision and Image Understanding, 63:3. pp. 542-567, May. 1996. https://doi.org/10.1006/cviu.1996.0040
  8. Jian Sun, Nan-Ning Zheng, Heung-Yeung Shum, "Stereo matching using belief propagation," IEEE Trans. on Pattern Analysis and Machine Intelligence, Vol. 27, Issue 25, pp. 787-800, July. 2003.
  9. Peter N. Belhumeur, "A Bayesian approach to binocular stereopsis," International Journal of Computer Vision, Vol. 19, Issue 3, pp.237-260, Aug. 1996. https://doi.org/10.1007/BF00055146
  10. I. Gallo, E. Binaghi, M. Raspanti, "Neural disparity computation for dense two-frame stereo correspondence," Pattern Recognition Letters, Vol. 29, Issue 5, pp. 673-687, April 2008. https://doi.org/10.1016/j.patrec.2007.12.003
  11. P. Seitz, "Using local orientation information as image primitive for robust object recognition," SPIE Visual Com. and Image Processing IV, Vol. 1199, pp. 1630-1639, 1989. https://doi.org/10.1117/12.970173
  12. T. Kanade and M. Okutomi, "A Stereo Matching Algorithm with an Adaptive Window: Theory and Experiments," IEEE Trans. on Pattern Analysis and Machine Intelligence, Vol. 16, pp. 920-932. 1994. https://doi.org/10.1109/34.310690
  13. O. Veksler, "Stereo Correspondence with Compact Windows via Minimum Ratio Cycle," IEEE Trans. on Pattern Analysis and Machine Intelligence, Vol. 24, pp 1654-1660, 2002. https://doi.org/10.1109/TPAMI.2002.1114859
  14. Kuk-Jin Yoon, In so Kweon, "Adaptive Support-Weight Approach for Correspondence Search," IEEE Trans. on Pattern Analysis and Machine Intelligence, Apr. 2006.
  15. Z. Gu, S. Xianyu, L. Yuankun, Z. Qican, "Local stereo matching with adaptive support-weight, rank transform and disparity calibration," Pattern Recognition Letters, Vol. 29, pp. 1230-1235. 2008. https://doi.org/10.1016/j.patrec.2008.01.032
  16. V. Kolmogorov and R. Zabih, "Computing visual correspondence with occlusions via graph cuts," ICCV 2001, Computer Vision, Vol. 2, pp.508-515, 2001.
  17. http://vision.middlebury.edu/stereo

Cited by

  1. Time Series Image Stereo Matching Experiment Using the Overlap Method vol.23, pp.1, 2015, https://doi.org/10.7319/kogsis.2015.23.1.123
  2. GPU를 이용한 스테레오 정합 알고리즘의 구현 vol.15, pp.3, 2011, https://doi.org/10.6109/jkiice.2011.15.3.583