Journal of the Optical Society of Korea

Optical Society of Korea (한국광학회)
권호 표지
DOI QR코드

DOI QR Code

3D Image Correlator using Computational Integral Imaging Reconstruction Based on Modified Convolution Property of Periodic Functions

  • Jang, Jae-Young (iReal co., Dongseo University) ;
  • Shin, Donghak (Institute of Ambient Intelligence, Dongseo University) ;
  • Lee, Byung-Gook (Institute of Ambient Intelligence, Dongseo University) ;
  • Hong, Suk-Pyo (HoloDigilog Human Media Research Center (HoloDigilog), Kwangwoon University) ;
  • Kim, Eun-Soo (HoloDigilog Human Media Research Center (HoloDigilog), Kwangwoon University)
  • Received : 2014.02.03
  • Accepted : 2014.06.11
  • Published : 2014.08.25
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, we propose a three-dimensional (3D) image correlator by use of computational integral imaging reconstruction based on the modified convolution property of periodic functions (CPPF) for recognition of partially occluded objects. In the proposed correlator, elemental images of the reference and target objects are picked up by a lenslet array, and subsequently are transformed to a sub-image array which contains different perspectives according to the viewing direction. The modified version of the CPPF is applied to the sub-images. This enables us to produce the plane sub-image arrays without the magnification and superimposition processes used in the conventional methods. With the modified CPPF and the sub-image arrays, we reconstruct the reference and target plane sub-image arrays according to the reconstruction plane. 3D object recognition is performed through cross-correlations between the reference and the target plane sub-image arrays. To show the feasibility of the proposed method, some preliminary experiments on the target objects are carried out and the results are presented. Experimental results reveal that the use of plane sub-image arrays enables us to improve the correlation performance, compared to the conventional method using the computational integral imaging reconstruction algorithm.

Keywords

References

  1. A. Stern and B. Javidi, "Three-dimensional image sensing, visualization, and processing using integral imaging," Proc. IEEE 94, 591-607 (2006). https://doi.org/10.1109/JPROC.2006.870696
  2. B. Javidi, R. Ponce-Diaz, and S.-H. Hong, "Three-dimensional recognition of occluded objects by using computational integral imaging," Opt. Lett. 31, 1106-1108 (2006). https://doi.org/10.1364/OL.31.001106
  3. M. DaneshPanah, B. Javidi, and E. A. Watson, "Three dimensional imaging with randomly distributed sensors," Opt. Express 16, 6368-6377 (2008). https://doi.org/10.1364/OE.16.006368
  4. D.-H. Shin, B.-G. Lee, and J.-J. Lee, "Occlusion removal method of partially occluded 3D object using sub-image block matching in computational integral imaging," Opt. Express 16, 16294-16304 (2008). https://doi.org/10.1364/OE.16.016294
  5. J.-H. Park, J. Kim, and B. Lee, "Three-dimensional optical correlator using a sub-image array," Opt. Express 13, 5116- 5126 (2005). https://doi.org/10.1364/OPEX.13.005116
  6. J.-S. Park, D.-C. Hwang, D.-H. Shin, and E.-S. Kim, "Resolution-enhanced 3D image correlator using computationally reconstructed integral images," Opt. Commun. 276, 72-79 (2007). https://doi.org/10.1016/j.optcom.2007.04.007
  7. M. Zhang, Y. Piao, and E.-S. Kim, "Occlusion-removed scheme using depth-reversed method in computational integral imaging," Appl. Opt. 49, 2571-2580 (2010). https://doi.org/10.1364/AO.49.002571
  8. G. Li, K.-C. Kwon, G.-H. Shin, J.-S. Jeong, K.-H. Yoo, and N. Kim, "Simplified integral imaging pickup method for real objects using a depth camera," J. Opt. Soc. Korea 16, 381-385 (2012) https://doi.org/10.3807/JOSK.2012.16.4.381
  9. D. Shin and B. Javidi, "Three-dimensional imaging and visualization of partially occluded objects using axially distributed stereo image sensing," Opt. Lett. 37, 1394-1396 (2012). https://doi.org/10.1364/OL.37.001394
  10. G. Lippmann, "La photographic intergrale," C. R. Acad. Sci. 146, 446-451 (1908).
  11. F. Okano, H. Hoshino, J. Arai, and I. Yuyama, "Real-time pick-up method for a three-dimensional image based on integral photography," Appl. Opt. 36, 1598-1603 (1997). https://doi.org/10.1364/AO.36.001598
  12. B. Lee, S. Jung, and J.-H. Park, "Viewing-angle-enhanced integral imaging by lens switching," Opt. Lett. 27, 818-820 (2002). https://doi.org/10.1364/OL.27.000818
  13. D.-H. Shin, S.-H. Lee, and E.-S. Kim, "Optical display of true 3D objects in depth-priority integral imaging using an active sensor," Opt. Commun. 275, 330-334 (2007). https://doi.org/10.1016/j.optcom.2007.03.072
  14. R. Martinez-Cuenca, G. Saavedra, M. Martinez-Corral, and B. Javidi, "Progress in 3-D multiperspective display by integral imaging," Proc. IEEE 97, 1067-1077 (2009). https://doi.org/10.1109/JPROC.2009.2016816
  15. M. Cho and D. Shin, "3D integral imaging display using axially recorded multiple images," J. Opt. Soc. Korea 17, 410-414 (2013). https://doi.org/10.3807/JOSK.2013.17.5.410
  16. J.-H. Park, K. Hong, and B. Lee, "Recent progress in three-dimensional information processing based on integral imaging," Appl. Opt. 48, H77-H94 (2009). https://doi.org/10.1364/AO.48.000H77
  17. G. Li, S.-C. Kim, and E.-S. Kim, "Viewing quality-enhanced reconstruction of 3-D object images by using a modified computational integral imaging reconstruction technique," 3D Research 3, Article 4, 1-9 (2011).
  18. J.-Y. Jang, J.-I. Ser, S. Cha, and S.-H. Shin, "Depth extraction by using the correlation of the periodic function with an elemental image in integral imaging," Appl. Opt. 51, 3279-3286 (2012). https://doi.org/10.1364/AO.51.003279
  19. J.-Y. Jang, D. Shin, and E.-S. Kim, "Improved 3D image reconstruction using convolution property between periodic functions in curved integral imaging," Opt. Lasers Eng. 54, 14-20 (2014). https://doi.org/10.1016/j.optlaseng.2013.09.011
  20. J.-Y. Jang, D. Shin, and E.-S. Kim, "Optical threedimensional refocusing from elemental images based on a sifting property of the periodic $\delta$-function array in integral-imaging," Opt. Express 22, 1533-1550 (2014). https://doi.org/10.1364/OE.22.001533

Cited by

  1. Neighboring Elemental Image Exemplar Based Inpainting for Computational Integral Imaging Reconstruction with Partial Occlusion vol.19, pp.4, 2015, https://doi.org/10.3807/JOSK.2015.19.4.390
  2. Resolution improvements in integral microscopy with Fourier plane recording vol.24, pp.18, 2016, https://doi.org/10.1364/OE.24.020792
  3. Free-depths reconstruction with synthetic impulse response in integral imaging vol.23, pp.23, 2015, https://doi.org/10.1364/OE.23.030127
  4. Computational Integral Imaging Reconstruction of a Partially Occluded Three-Dimensional Object Using an Image Inpainting Technique vol.19, pp.3, 2015, https://doi.org/10.3807/JOSK.2015.19.3.248