JOURNAL BROWSE
Search
Advanced SearchSearch Tips
Real-Time 2D-to-3D Conversion for 3DTV using Time-Coherent Depth-Map Generation Method
facebook(new window)  Pirnt(new window) E-mail(new window) Excel Download
 Title & Authors
Real-Time 2D-to-3D Conversion for 3DTV using Time-Coherent Depth-Map Generation Method
Nam, Seung-Woo; Kim, Hye-Sun; Ban, Yun-Ji; Chien, Sung-Il;
  PDF(new window)
 Abstract
Depth-image-based rendering is generally used in real-time 2D-to-3D conversion for 3DTV. However, inaccurate depth maps cause flickering issues between image frames in a video sequence, resulting in eye fatigue while viewing 3DTV. To resolve this flickering issue, we propose a new 2D-to-3D conversion scheme based on fast and robust depth-map generation from a 2D video sequence. The proposed depth-map generation algorithm divides an input video sequence into several cuts using a color histogram. The initial depth of each cut is assigned based on a hypothesized depth-gradient model. The initial depth map of the current frame is refined using color and motion information. Thereafter, the depth map of the next frame is updated using the difference image to reduce depth flickering. The experimental results confirm that the proposed scheme performs real-time 2D-to-3D conversions effectively and reduces human eye fatigue.
 Keywords
2D-to-3D Conversion;Depth-map Generation;Image Segmentation and 3DTV;Stereoscopic Video;
 Language
English
 Cited by
 References
1.
J-I. Park, G. M. Lee, C-H. Ahn, and C. Ahn, "Virtual Control of Optical Axis of the 3DTV Camera for Reducing Visual Fatigue in Stereoscopic 3DTV," ETRI Journal, vol. 26, no. 6, Dec. 2004, pp. 597-604. crossref(new window)

2.
S-Y. Kim, S-B. Lee, and Y-S. Ho, "Three Dimensional Natural Video System Based on Layered Representation of Depth Maps," IEEE Trans. Consumer Electronics, vol. 52, no. 3, Aug. 2006, pp. 1035-1042. crossref(new window)

3.
L. Zhang and W. J. Tam, "Stereoscopic Image Generation Based on Depth Images for 3D TV," IEEE Trans. Broadcasting, vol. 51, no. 2, Jun. 2005, pp. 191-199. crossref(new window)

4.
P. Harman, J. Flack, S. Fox, and M. Dowley, "Rapid 2D to 3D conversion," Proc. SPIE, vol. 4660, 2002, pp. 78-86.

5.
X. Ashutosh, S. Min, and N. Andrew Y. "Make 3D: Learning 3D Scene Structure from A Single Still Image," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 31, no. 5, May. 2009, pp. 824-840. crossref(new window)

6.
C.-C. Cheng, C.-T. Li, P.-S. Huang, T.-K. Li, Y.-M. Tsai, and L.-G. Chen, "A Novel 2D-to-3D Conversion System Using Edge Information," IEEE Trans. Consumer Electronics, vol. 56, no. 3, Aug. 2010, pp. 1739-1745. crossref(new window)

7.
F. Yu, J. Liu, Y. Ren, J. Sun, Y. Gao, and W. Liu, "Depth generation method for 2D to 3D conversion," Proc. IEEE 3DTV Conference, 2011, pp. 1-4.

8.
D. Kim, D. Min, and K. Sohn, "Stereoscopic Video Generation Method Using Stereoscopic Display Characterization and Motion Analysis," IEEE Trans. Broadcasting, vol. 54, no. 2, June 2008, pp. 188-197. crossref(new window)

9.
C.-C. Cheng, C.-T. Li, P.-S. Huang, T.-K. Lin, Y.-M. Tsai, and L.-G. Chen, "A Block-based 2D to 3D conversion system with bilateral filter," Proc. IEEE International Conference on Consumer Electronics, 2009, pp. 1-2.

10.
S. H. Lai, C. W. Fu, and S. Chang, "A Generalized Depth Estimation Algorithm with A Single Image," IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 14, no. 4, Apr. 1992, pp. 405-411. crossref(new window)

11.
G. Gau, N. Zhang, L. Huo, and W. Gao, "2D to 3D conversion based on edge defocus and segmentation," Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing, 2008, pp. 2181-2184.

12.
S.-F. Tsai, C.-C. Cheng, C.T. Li, and L.-G. Chen, "A Real-time 1080p 2D-to-3D Video Conversion System," IEEE Trans. Consumer Electronics, vol. 57, no. 2, May. 2011, pp. 915-922. crossref(new window)

13.
Z. Zhang, Y. Wang, T. Jiang, and W. Gao, "Visual pertinent 2D-to-3D video conversion," Proc. IEEE International Conference on Image Processing, 2011, pp. 909-912.

14.
L.-M. Po, X. Xu, Y. Zhu, S. Zhang, K.-W. Cheung, and C.-W. Ting, "Automatic 2D-to-3D video conversion technique based on depth-from-motion and color segmentation," Proc. IEEE International Conference on Signal Processing, 2010, pp. 1000-1003.

15.
Y.-L. Chang, W.-Y. Chen, J.-Y. Chang, Y.-M. Tsai, C.-L. Lee, and L.-G. Chen, "Priority depth fusion for the 2D-to-3D conversion system," Proc. SPIE, vol. 6805, 2008.

16.
S.-W. Nam, H.-S. Kim, Y.-J. Ban, and S.-I. Chien, "Realtime 2D to 3D conversion for 3DTV using time coherent depth map generation method," Proc. IEEE International Conference on Consumer Electronics, 2013, pp. 187-188.

17.
I. Ideses, L. P. Yaroslavsky, and B. Fishbain, "Real-time 2D to 3D Video Conversion," Journal of Real-time Image Processing, vol. 2, no. 1, Oct. 2007, pp. 3-9. crossref(new window)

18.
C. Tomasi and R. Manduchi, "Bilateral filtering for gray and color images," Proc. IEEE International Conference on Computer Vision, 1998, pp. 839-846.

19.
J. Mas and G. Fernandez, "Video shot boundary detection based on color histogram," Proc. TREC Video Retrieval Evaluation Conference, Nov. 2003.

20.
R. Adams and L. Bischof, "Seeded Region Growing," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 16, no. 6, Jun. 1994, pp. 641-647. crossref(new window)

21.
T. Shibata, J. Kim, D. M. Hoffman, and M. S. Banks, "The Zone of Comfort: Predicting Visual Discomfort With Stereo Displays," Journal of Vision, vol. 11, no. 8, Jul. 2011, pp. 1-29.