Journal of the Korea Institute of Information and Communication Engineering (한국정보통신학회논문지)

The Korea Institute of Information and Commucation Engineering (한국정보통신학회)
권호 표지
DOI QR코드

DOI QR Code

Computational generation method of elemental images using a Kinect sensor in 3D depth-priority integral imaging

3D 깊이우선 집적영상 디스플레이에서의 키넥트 센서를 이용한 컴퓨터적인 요소영상 생성방법

  • Received : 2015.09.17
  • Accepted : 2015.10.26
  • Published : 2016.01.31
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, we propose a generation of 2D elemental images for 3D objects using Kinect in 3D depth-priority integral imaging (DPII) display. First, we analyze a principle to pickup elemental images based on ray optics. Based on our analysis, elemental images are generated with both RGB image and depth image recorded from Kinect. We reconstruct 3D images from the elemental images with the computational integral imaging reconstruction technique and then compare various perspective images. To show the usefulness of the proposed method, we carried out the preliminary experiments. The experimental results reveal that our method can provide correct 3D images with full parallax.

본 논문에서는 3D 깊이우선 집적영상(DPII) 디스플레이에서 키넥트(Kinect)를 이용하여 3D 물체에 대한 2D 요소영상들을 생성하는 방법을 제안한다. 먼저, 깊이우선 집적영상에서의 요소영상 생성원리를 기하광학적으로 분석하고 이 분석에 기초하여 키넥트의 RGB영상과 깊이영상으로부터 요소영상들을 생성한다. 3D 영상 복원을 위해서 집적영상에 기반한 컴퓨터적 시점재생 실험을 수행하고, 복원된 3D 영상에 대한 많은 시점영상들을 서로 비교한다. 제안하는 방식의 유용함을 보이기 위해서 기초적인 광학적 실험을 수행하였다. 그 결과, 제안하는 방식은 완전시차를 가지는 올바른 3D 영상을 제공함을 확인하였다.

Keywords

References

  1. B. Javidi and F. Okano, Three-Dimensional Television, Video, and Display Technologies, Springer-verlag publishing, Berlin, 2002.
  2. G. Lippmann, "La photographie integrale," Comptes- Rendus, Academie des Sciences, vol. 146, pp. 446-451, 1908.
  3. J.-S. Jang and B. Javidi, "Improved viewing resolution of three-dimensional integral imaging by use of nonstationary micro-optics," Optics Letter, vol. 27, no. 5, pp. 324-326, May 2002. https://doi.org/10.1364/OL.27.000324
  4. X. Xiao, B. Javidi, M. Martinez-Corral, and A. Stern, "Advances in three-dimensional integral imaging: sensing, display, and applications ," Applied Optics, vol. 52, no. 4, pp. 546-560, Feb. 2013. https://doi.org/10.1364/AO.52.000546
  5. J. Kim, J. -H. Jung, Y. Jeong, K. Hong, and B. Lee, "Real-time integral imaging system for light field microscopy," Optics Express, vol. 22, no. 9, pp. 10210-10220, May 2014. https://doi.org/10.1364/OE.22.010210
  6. J.-H. Park, Y. Kim, J. Kim, S.-W. Min, and B. Lee, "Three-dimensional display scheme based on integral imaging with three-dimensional information processing," Optics Express, vol. 12, no. 24, pp. 6020-6032, Dec. 2004. https://doi.org/10.1364/OPEX.12.006020
  7. T. Ryu, B. Lee, and S. Lee, "Mutual constraint using partial occlusion artifact removal for computational integral imaging reconstruction," Applied Optics, vol. 54, no. 13, pp. 4147-4153, Jul. 2015. https://doi.org/10.1364/AO.54.004147
  8. D.-H. Shin, S.-H. Lee and E.-S. Kim, "Optical display of true 3D objects in depth-priority integral imaging using an active sensor," Optics Communications, vol. 275, no. 2, pp. 330-334, Feb. 2007. https://doi.org/10.1016/j.optcom.2007.03.072
  9. K. Konolige and P. Mihelich, "Technical description of Kinect calibration," http://www.ros.org/wiki/kinect_calibr ation/technical, 2011.
  10. S.-B. Lee and Y.-S. Ho, "Real-time Stereo View Generation using Kinect Depth Camera," Asia-Pacific Signal and Information Processing Association Annual Summit and Conference 2011, pp. PM.PS3.12, 2011.
  11. D.-H. Shin, B. Lee and E.-S. Kim, "Improved viewing quality of 3-D images in computational integral imaging reconstruction based on lenslet array model," ETRI Journal, vol. 28, no. 4, pp. 521-524, Apr. 2006. https://doi.org/10.4218/etrij.06.0206.0014

Cited by

  1. Kinect 센서를 활용하는 노인 하체 근력 강화 시스템 연구 vol.21, pp.11, 2016, https://doi.org/10.6109/jkiice.2017.21.11.2095