Journal of the Korea Institute of Information and Communication Engineering (한국정보통신학회논문지)

The Korea Institute of Information and Commucation Engineering (한국정보통신학회)
권호 표지
DOI QR코드

DOI QR Code

Image Synthesis and Multiview Image Generation using Control of Layer-based Depth Image

레이어 기반의 깊이영상 조절을 이용한 영상 합성 및 다시점 영상 생성

  • Received : 2011.03.07
  • Accepted : 2011.04.13
  • Published : 2011.08.31
Download PDF
⟨ Previous Next ⟩

Abstract

This paper proposes a method to generate multiview images which use a synthesized image consisting of layered objects. The camera system which consists of a depth camera and a RGB camera is used in capturing objects and extracts 3-dimensional information. Considering the position and distance of the synthesizing image, the objects are synthesized into a layered image. The synthesized image is spaned to multiview images by using multiview generation tools. In this paper, we synthesized two images which consist of objects and human and the multiview images which have 37 view points were generated by using the synthesized images.

본 논문에서는 깊이영상 기반의 영상합성과 다시점 영상 생성 기술을 이용하여 3차원 입체 콘텐츠를 제작하는 방법을 제안하였다. 이를 위해 깊이영상을 촬영한 후에 깊이정보를 조절하고, 레이어 기반의 영상으로 합성한 후에 이를 이용하여 다시점 영상을 생성하였다. 깊이카메라와 RGB 카메라로 구성된 카메라 시스템을 이용하여 객체들을 촬영함으로써 객체에 대한 3차원 정보를 획득하고 이를 데이터베이스화하여 3차원 영상을 합성하고 생성하는데 이용한다. 3차원 영상의 위치 및 거리를 고려하여 객체의 3차원 정보를 조절하고, 레이어 기반으로 하나의 영상으로 합성한다. 합성된 영상은 다시점 영상 생성 도구를 이용하여 원하는 시점만큼의 다시점 영상들로 생성된다. 본 논문에서는 객체와 사람의 영상을 합성하였고, 이들을 이용하여 각각 37시점의 다시점 영상을 생성하였다.

Keywords

Acknowledgement

Supported by : 중소기업청

References

  1. R. Franich, R. Lagendijk and R. Horst, Reference model for hardware demonstrator implementation, RACE DISTIMA deliverable 45/TUD/IT/DS/ B/003/bl, October, 1992
  2. A. Redert, et al., "ATTEST : Advanced Three-Dimensional Television System Technologies", 3D Data Processing Visualization and Transmission, 2002. First International Symposium, pp.313-319, Jun, 2002
  3. C. Fehn, "Depth-Image-Based Rendering (DIBR), Compression and Transmission for a New Approach on 3D-TV", In Proceedings of SPIE Stereoscopic Displays and Virtual Reality Systems XI, pages 93-104, San Jose, CA, USA, January 2004
  4. Müller, K.; Merkle, P.; Wiegand, T.; , "3-D Video Representation Using Depth Maps," Proceedings of the IEEE , vol.99, no.4, pp.643-656, April 2011 https://doi.org/10.1109/JPROC.2010.2091090
  5. Eun-Kyung Lee; Yo-Sung Ho; , "Generation of multi-view video using a fusion camera system for 3D displays," Consumer Electronics, IEEE Transactions on, vol.56, no.4, pp.2797-2805, November 2010
  6. P. Dias, V. Sequeira, F. Vaz, and J.G.M. Gonçalves, "Registration and Fusion of Intensity and Range Data for 3D modeling of Real World Scenes," Proceedings of 3DIM'03, Oct., 2003, pp. 418-426
  7. M.D. Wheeler, Y. Sato, and K. Ikeuchi, "Consensus surfaces for modeling 3D objects from multiple range images," Proceedings of DARPA Image Understanding Workshop, 1997, pp.1229-1236.
  8. L. Zhang, B. Curless, and S. M. Seitz, "Rapid Shape Acquisition Using Color Structured Light and Multi-pass Dynamic Programming," Proceedings of 3DPVT'02, June, 2002, pp.24 -36.
  9. http://www.3dvsystems.com/products/zcam.html#spec
  10. R. Koch, "Dynamic 3D Scene Analysis through Synthesis Feedback Control," IEEE Trans. Pattern Analysis Machine Intelligence, Special issue on analysis and synthesis, Vol.15, No.6, June, 1993, pp.556-568. https://doi.org/10.1109/34.216725
  11. W. Matusik, C. Buehler, R. Raskar, S. Gortler, and L. McMillan, "Image-based visual hulls," Proceedings of SIGRAPH 2000, 2000, pp.369-374.
  12. S. Seitz, C. Dyer, "Photorealistic scene reconstruction by voxel coloring," International Journal of Computer Vision, Vol.35, No.2, 1999, pp.151-173. https://doi.org/10.1023/A:1008176507526
  13. M. Pollefeys, and R. Koch, "Visual Modeling with a Hand-Held Camera," International Journal of Computer Vision, Apr, 2004, pp.207-232.
  14. Y. Xiong, and S. A. Shafer, "Depth from Focusing and Defocusing," Tech. Report, CMU-RI-TR-93-07, Robotics Institute, Carnegie Mellon University, Mar, 1993.
  15. R. Zhang, P. Tsai, J.E. Cryer and Mubarak Shah, "Shape from Shading: A Survey," IEEE Trans. on Pattern Anal.ysis and Machine Intelligence, Vol.PAMI-21, No.8, Aug., 1999, pp.690-706. https://doi.org/10.1109/34.784284
  16. P. Dias, V. Sequeira, F. Vaz, J.G.M. Goncalves, "Combining intensity and range images for 3D modeling," Proceedings of Image Processing 2003, Vol.1, Sept., 2003, pp.417-20.
  17. H.Y. Lin, M. Subbarao, and S. Y. Park, "Complete 3D Model Reconstruction from Multiple Views," Proceedings of SPIE Machine Vision and Three- Dimensional Imaging Systems for Inspection and Metrology II, Vol.4657, Oct., 2001, pp.29-38.
  18. V. Sequeira, J.G.M. Gonçalves, and M. I. Ribeiro, "3D scene modeling from multiple range views," Proc. IEEE Workshop on Physics-Based Modeling in Computer Vision, Vol.2598, Philadelphia, USA, Oct, 1995, pp.114-127.
  19. P. Dias, V. Sequeira, J.G.M. Gonçalves, F. Vaz, "Automatic registration of laser and color intensity images for 3D reconstruction," Robotics and Autonomous Systems, Vol.39, 2002, pp.157-168.
  20. http://www.mesa-imaging.ch/
  21. http://www.xbox.com/ko-KR/Kinect/Home
  22. V. Popescu, E. Sacks, and G. Bahmutov, "The Model Camera: a Hand-Held Device for Interactive Modeling," Proceedings of 3DIM'03, Oct., 2003, pp.285- 292.
  23. A.V. Strat and M. M. Oliveira, "A Point-and-Shoot Color 3D Camera," Proceedings of 3DIM'03, Oct., 2003, pp.483- 490.