Journal of the Korea Institute of Information and Communication Engineering (한국정보통신학회논문지)

The Korea Institute of Information and Commucation Engineering (한국정보통신학회)
권호 표지
DOI QR코드

DOI QR Code

Nonlinear 3D Correlator Based on Pixel Restoration for Enhanced Objects Recognition

향상된 물체 인식을 위한 픽셀 복원 기반의 비선형 3D 상관기

  • 신동학 (동서대학교 IAI연구소) ;
  • 이준재 (계명대학교 게임모바일콘텐츠학과)
  • Received : 2012.09.18
  • Accepted : 2012.10.08
  • Published : 2013.03.31
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, we propose a performance-enhanced object recognition by using nonlinear 3D correlator based on pixel restoration. In the proposed method, elemental images of the 3D target that are partially occluded by a foreground object are picked up and transformed into sub-images. By using the block-matching algorithm, the occluded target regions of each sub-image are estimated and removed. After that, the missing pixels in each sub-image are reestablished by using the pixel-restoration method. Finally, through the nonlinear cross-correlations between the reconstructed reference and the target plane images, the improved object recognition can be performed. To show the feasibility of the proposed method, some preliminary experiments are carried out and results are presented by comparing the conventional method.

본 논문에서는 향상된 물체 인식을 위한 픽셀 복원 기반의 비선형 3D 상관기를 제안한다. 제안한 방법은 부분적으로 가려진 물체로부터 요소영상을 픽업하고 서브영상으로 변환하고 영역 매칭 알고리즘 방법을 이용하여 서브영상으로부터 장애물로 가려진 영역을 검출하고 제거한다. 그 다음 픽셀 복원 방법으로 각 서브영상에서 제거된 물체의 픽셀을 복원한다. 마지막으로, 재생된 참조영상과 재생된 영상 사이의 비선형 상호상관을 통하여 3D 물체의 인식 성능을 향상 시킨다. 제안된 방법의 유용함을 보이기 위해 기존 방법과 비교하여 기초적인 상관관계 실험을 수행하고 그 결과를 보고한다.

Keywords

References

  1. M. G. Lippmann, "Epreuves reversibles donnant la sensation du relief," J. Phys. vol. 7, pp. 821-825, 1908.
  2. R. Martinez-Cuenca, G. Saavedra, M. Martinez-Corral and B. Javidi, "Enhanced depth of field integral imaging with sensor resolution constraints," Opt. Express, vol. 12, pp. 5237-5242, 2004. https://doi.org/10.1364/OPEX.12.005237
  3. J.-S. Jang and B. Javidi, "Improved viewing resolution of three-dimensional integral imaging by use of nonstationary micro-optics," Opt. Lett. vol. 27, pp. 324- 26, 2002. https://doi.org/10.1364/OL.27.000324
  4. S. Hong, J. Jang, and B. Javidi, "Three-dimensional volumetric object reconstruction using computational integral imaging," Opt. Express, vol. 12, pp. 483-491, 2004. https://doi.org/10.1364/OPEX.12.000483
  5. D.-H. Shin, S.-H. Lee, and E.-S. Kim, "Optical display of true 3D objects in depth-priority integral imaging using an active sensor," Opt. Commun. vol. 275, pp. 330-334, 2007. https://doi.org/10.1016/j.optcom.2007.03.072
  6. 홍석표, 신동학, 김은수 "완전시차 집적 영상 배경을 가지는 2D-3D 겸용 디스플레이 시스템" 한국해양정보통신학회 논문지, 13권 2호, pp. 369-375, 2009.
  7. S. Kishk and B. Javidi, "Improved resolution 3D object sensing and recognition using time multiplexed computational integral imaging," Opt. Express, vol. 11, pp. 3528-3541, 2003. https://doi.org/10.1364/OE.11.003528
  8. J.-S. Park, D.-C. Hwang, D.-H. Shin, and E.-S. Kim, "Resolution-enhanced three-dimensional image correlator using computationally reconstructed integral images," Opt. Commun. vol. 276, pp. 72-79, 2007. https://doi.org/10.1016/j.optcom.2007.04.007
  9. W. Tan, D. Shin and B.-K. Lee "Resolution-enhanced reconstruction of 3D object using depth-reversed elemental images for partially occluded object recognition," J. Opt. Soc. Korea, vol. 13, pp. 139-145, 2009. https://doi.org/10.3807/JOSK.2009.13.1.139
  10. B.-G. Lee, Liliana and D. Shin, "Enhanced computational integral imaging system for partially occluded 3D objects using occlusion removal technique and recursive PCA reconstruction," Opt. Commun. vol. 283, pp. 2084-2091, 2010. https://doi.org/10.1016/j.optcom.2010.01.044
  11. D.-H. Shin, B.-G. Lee, and J.-J. Lee, "Occlusion removal method of partially occluded 3D object using sub-image block matching in computational integral imaging," Opt. Express, vol. 16, pp. 16294-16304, 2008. https://doi.org/10.1364/OE.16.016294
  12. J.-H. Jung, K. Hong, G. Park, I. Chung, J.-H. Park, and B. Lee, "Reconstruction of three-dimensional occluded object using optical flow and triangular mesh reconstruction in integral imaging," Opt. Express, vol. 18, pp. 26373-26387, 2010. https://doi.org/10.1364/OE.18.026373
  13. J.-J. Lee, B.-G. Lee, and H. Yoo, "Image quality enhancement of computational integral imaging reconstruction for partially occluded objects using binary weighting mask on occlusion areas," Appl. Opt. vol. 50, pp. 1889-1893, 2011. https://doi.org/10.1364/AO.50.001889
  14. M. Zhang, Y. Piao, and E.-S. Kim, "Visibility-enhanced reconstruction of three-dimensional objects under a heavily scattering medium through combined use of intermediate view reconstruction, multipixel extraction, and histogram equalization methods in the conventional integral imaging system," Appl. Opt. vol. 50, pp. 5369-5381, 2011. https://doi.org/10.1364/AO.50.005369
  15. Y. Piao, M. Zhang, E.-S. Kim, "Effective reconstruction of a partially occluded 3-D target by using a pixel restoration scheme in computational integral-imaging," Opt. Lasers Eng., vol. 50, pp. 1602-1610, 2012. https://doi.org/10.1016/j.optlaseng.2012.05.013
  16. B. Javidi, "Nonlinear joint power spectrum based optical correlation," Appl. Opt. vol. 28, pp. 2358-2367, 1989. https://doi.org/10.1364/AO.28.002358

Cited by

  1. Three-Dimensional Visualization and Recognition of Micro-objects using Photon Counting Integral Imaging Microscopy vol.19, pp.5, 2015, https://doi.org/10.6109/jkiice.2015.19.5.1207