JOURNAL BROWSE
Search
Advanced SearchSearch Tips
Depth Video Post-processing for Immersive Teleconference
facebook(new window)  Pirnt(new window) E-mail(new window) Excel Download
 Title & Authors
Depth Video Post-processing for Immersive Teleconference
Lee, Sang-Beom; Yang, Seung-Jun; Ho, Yo-Sung;
  PDF(new window)
 Abstract
In this paper, we present an immersive videoconferencing system that enables gaze correction between users in the internet protocol TV (IPTV) environment. The proposed system synthesizes the gaze corrected images using the depth estimation and the virtual view synthesis algorithms as one of the most important techniques of 3D video system. The conventional processes, however, causes several problems, especially temporal inconsistency of a depth video. This problem leads to flickering artifacts discomforting viewers. Therefore, in order to reduce the temporal inconsistency problem, we exploit the joint bilateral filter which is extended to the temporal domain. In addition, we apply an outlier reduction operation in the temporal domain. From experimental results, we have verified that the proposed system is sufficient to generate the natural gaze-corrected image and realize immersive videoconferencing.
 Keywords
Gaze correction;telepresence;joint bilateral filter;IPTV;three-dimensional video;
 Language
Korean
 Cited by
 References
1.
P. Kauff and O. Schreer, "An immersive 3D video-conferencing system using shared virtual team user environments," Proc. of international conference on Collaborative virtual environments, pp. 105-112, Sep. 2002.

2.
S. Huang and J. Wang, "A low-cost desktop videoconferencing codec: an adaptive Motion-JPEG design," IEEE Transactions on Consumer Electronics, vol. 40, no. 4, pp. 944-950, Nov. 1994. crossref(new window)

3.
S. M. Kuo, Y. C. Huang, and Z. Pan, "Acoustic noise and echo cancellation microphone system for videoconferencing," IEEE Transactions on Consumer Electronics, vol. 41, no. 4, pp. 1150-1158, Nov. 1995. crossref(new window)

4.
H. Kwon, H. Han, S. Lee, W. Choi, and B. Kang, "New video enhancement preprocessor using the region-of-interest for the videoconferencing," IEEE Transactions on Consumer Electronics, vol. 56, no. 4, pp. 2644-2651, Nov. 2010. crossref(new window)

5.
O. Schreer, N. Atzapadin, and I. Feldmann, "Multi-baseline disparity fusion for immersive videoconferencing," In Proceedings of International Conference on Immersive Telecommunications, pp. 27-29, May 2009.

6.
P. Kauff and O. Schreer, "An immersive 3D video-conferencing system using shared virtual team user environments," In Proceedings of International Conference on Collaborative Virtual Environments, pp. 105-112, Oct. 2002.

7.
S. Lee, I. Shin, and Y. Ho, "Gaze-corrected View Generation using Stereo Camera System for Immersive Videoconferencing," IEEE Transactions on Consumer Electronics, vol. 57, no. 3, pp. 1033-1040, 2011. crossref(new window)

8.
Q. Yang, L. Wang, and N. Ahuja, "A constant-space belief propagation algorithm for stereo matching," in Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition, pp. 1458-1465, 2010.

9.
P. Lai, D. Tian, and P. Lopez, "Depth map processing with iterative joint multilateral filtering," in Proceedings of Picture Coding Symposium, pp. 9-12, 2010.

10.
ISO/IEC JTCl/SC29/WG11, "Reference Software of Depth Estimation and View Synthesis for FTV/3DV," M15836, Oct. 2008.

11.
M. Sugawara, K. Mitani, M. Kanazawa, F. Okano, and Y. Nishida, "Future prospects of HDTV - technical trends toward 1080p," SMPTE Journal, vol. 115, pp. 10-15, 2006. crossref(new window)