DOI QR코드

DOI QR Code

Improved recognition of 3D objects using nonlinear correlator based on direct pixel mapping in curving-effective integral imaging

커브형 집적 영상에서 DPM 기반의 비선형 상관기를 이용한 3D 물체 인식 향상

  • 이준재 (계명대학교 게임모바일콘텐츠학과) ;
  • 신동학 (동서대학교 IAI연구소) ;
  • 이병국 (동서대학교 컴퓨터정보공학부)
  • Received : 2012.07.25
  • Accepted : 2012.08.10
  • Published : 2013.01.31

Abstract

Curved integral imaging is a simple method to display 3D images in space using lens array and provides wide viewing angle. In this paper, we propose a nonlinear 3D correlator based on the direct pixel-mapping (DPM) method in order to improve the recognition performance of 3D target object in curving-effective integral imaging. With this scheme, the elemental image array (EIA) originally picked up from a partially occluded 3-D target object can be converted into a resolution enhanced new EIA by using DPM method. Then, through nonlinear cross-correlations between the reconstructed reference and the target plane images, the improved pattern recognition can be performed from the correlation outputs. To show the feasibility of the proposed method, some preliminary experiments are carried out and results are presented by comparing the conventional method.

커브형 집적 영상 기술은 렌즈 배열을 이용하여 3D 영상을 공간에 쉽게 표현할 수 있는 기술이며, 넓은 관측각을 제공한다. 본 논문에서는 커브형 집적 영상에서 물체의 인식 향상을 위하여 다이렉트 픽셀 매핑 (DPM) 방법 기반의 비선형 상관기를 제안한다. 제안하는 비선형 상관기는 커브형 집적 영상 시스템에서 장애물에 가려진 물체로부터 픽업된 요소 영상을 DPM 방법을 통하여 해상도가 향상된 새로운 요소 영상을 생성한다. 새로운 생성된 요소 영상을 사용하여 복원한 3D 영상들과 참조 영상간의 비선형 상호상관을 이용하여 3D 물체의 인식 성능 향상시킨다. 제안된 방법의 유용함을 보이기 위하여 기초적인 상관 관계 실험을 수행하고 기존의 방법과의 비교 결과를 보고한다.

Keywords

References

  1. G. Lippmann, "La photographie integrale," Comptes- Rendus Academie des Sciences, vol. 146, 446-451, 1908.
  2. F. Okano, H. Hoshino, J. Arai, and I. Yuyama, "Real-time pickup method for a three-dimensional image based on integral photography,"Appl. Opt., vol. 36, pp. 1598-1603, 1997. https://doi.org/10.1364/AO.36.001598
  3. J.-S. Jang, and B. Javidi, "Improved viewing resolution of three-dimensional integral imaging by use of nonstationary micro-optics," Opt. Lett. vol. 27, pp. 324-326, 2002. https://doi.org/10.1364/OL.27.000324
  4. S.-W. Min, B. Javidi, and B. Lee, "Enhanced three-dimensional integral imaging system by use of double display devices," Appl. Opt. vol. 42, pp. 4186-4195, 2003. https://doi.org/10.1364/AO.42.004186
  5. D.-H. Shin, S.-H. Lee, and E.-S. Kim, "Optical display of true 3D objects in depth-priority integral imaging using an active sensor," Opt. Commun. vol. 275, pp. 330-334, 2007. https://doi.org/10.1016/j.optcom.2007.03.072
  6. R. Martinez-Cuenca, A. Pons, G. Saavedra, M. Martinez-Corral, and B. Javidi, "Optically-corrected elemental images for undistorted Integral image display,"Opt. Express vol. 14, pp. 9657-9663, 2006. https://doi.org/10.1364/OE.14.009657
  7. D. -H. Shin, B. Lee, and E. -S. Kim, "Multidirectional curved integral imaging with large depth by additional use of a large-aperture lens," Appl. Opt., vol. 45, pp. 7375-7381, 2006. https://doi.org/10.1364/AO.45.007375
  8. 신동학, 유훈, "크기가변 확대 기법 기반의 컴퓨터 적집적 영상 방법을 이용한 3D 영상의 해상도 개선," 한국정보통신학회논문지, 제12권, 제12호, pp. 2271-2276, 2008.
  9. 유훈, "컴퓨터 집적영상 기술에서 픽업 모델개선에 의한 복원 화질 개선 방법," 한국정보통신학회 논문지,제15권,제7권, pp.1598-1603, 2011.
  10. Y. Frauel and B. Javidi, "Digital three-dimensional image correlation by use of computer reconstructed integral imaging," Appl. Opt. vol. 41, pp. 5488-5496, 2002. https://doi.org/10.1364/AO.41.005488
  11. J. Park, J. Kim, and B. Lee, "Three-dimensional optical correlator using a sub-image array," Opt. Express vol. 13, pp. 5116-5126, 2005. https://doi.org/10.1364/OPEX.13.005116
  12. J.-B. Hyun, D.-C. Hwang, D.-H. Shin, and E.-S. Kim, "Curved Computational integral imaging reconstruction technique for resolution-enhanced display of three- dimensional object images," Appl. Opt., vol. 46, pp. 7697-7708, 2007. https://doi.org/10.1364/AO.46.007697
  13. Y. Piao, D.-H. Shin, and E.-S. Kim, "Computational depth conversion of reconstructed three-dimensional object images in curving-effective integral imaging system," Jpn. J. Appl. Phys., vol. 49, pp. 022501, 2010. https://doi.org/10.1143/JJAP.49.022501
  14. Y. Piao and E.-S. Kim, "Resolution-enhanced reconstruction of far 3-D objects by using a direct pixel mapping method in computational curving-effective integral imaging," Appl. Opt. vol. 48, pp. H222-230, 2009. https://doi.org/10.1364/AO.48.00H222
  15. Y. Piao and E.-S. Kim, "Performance-enhanced recognition of a far and partially occluded 3-D object by use of direct pixel-mapping in computational curving-effective integral imaging," Opt. Commun. vol. 284, pp. 747-755, 2011. https://doi.org/10.1016/j.optcom.2010.10.002
  16. B. Javidi, "Nonlinear joint power spectrum based optical correlation,"Appl. Opt. vol. 28, pp. 2358-2367, 1989. https://doi.org/10.1364/AO.28.002358