3D Shape Recovery Using Image Focus through Nonlinear Total Variation

비선형 전변동을 이용한 초점거리 변화 기반의 3 차원 깊이 측정 방법

  • Mahmood, Muhammad Tariq (Korea University of Technology and Education, School of Computer Science and Engineering) ;
  • Choi, Young Kyu (Korea University of Technology and Education, School of Computer Science and Engineering)
  • Received : 2013.05.22
  • Accepted : 2013.06.17
  • Published : 2013.06.30

Abstract

Shape From Focus (SFF) is a passive optical technique to recover 3D structure of an object that utilizes focus information from 2D images of the object taken at different focus levels. Mostly, SFF methods use a single focus measure to compute image focus quality of each pixel in the image sequence. However, it is difficult to recover accurate 3D shape using a single focus measure, as different focus measures perform differently in diverse conditions. In this paper, a nonlinear Total Variation (TV) based approach is proposed for 3D shape recovery. To improve the result of surface reconstruction, several initial depth maps are obtained using different focus measures and the resultant 3D shape is obtained by diffusing them through TV. The proposed method is tested and evaluated by using image sequences of synthetic and real objects. The results and comparative analysis demonstrate the effectiveness of our method.

Keywords

References

  1. M. T. Mahmood and T. S. Choi, "Nonlinear Approach for Enhancement of Image Focus Volume in Shape From Focus," IEEE Transactions on Image Processing, vol. 21, pp. 2866-2873, 2012. https://doi.org/10.1109/TIP.2012.2186144
  2. S. K. Nayar and Y. Nakagawa, "Shape from focus," in IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 16, pp. 824-831, 1994. https://doi.org/10.1109/34.308479
  3. M. T. Mahmood and Y. K. Choi, "3D Shape Recovery from Image Focus using Gaussian Process Regression," Journal of the Semiconductor & Display Technonogy, vol. 11, no. 3, pp. 19-25, 2012.
  4. M. Asif and T. S. Choi, "Shape from focus using multilayer feedforward neural networks," in Image Processing, IEEE Transactions on Image Processing, vol. 10, pp. 1670-1675, 2001.
  5. A. Thelen, S. Frey, S. Hirsch, and P. Hering, "Improvements in Shape-From-Focus for Holographic Reconstructions With Regard to Focus Operators, Neighborhood-Size, and Height Value Interpolation," in IEEE Transactions on Image Processing, vol. 18, pp. 151-157, 2009. https://doi.org/10.1109/TIP.2008.2007049
  6. R. Hariharan and A. N. Rajagopalan, "Shape-From- Focus by Tensor Voting," IEEE Transactions on Image Processing, vol. 21, pp. 3323-3328, 2012. https://doi.org/10.1109/TIP.2012.2190612
  7. M. T. Mahmood, A. Majid, and T. S. Choi, "Optimal depth estimation by combining focus measures using genetic programming," Information Sciences, vol. 181, pp. 1249-1263, 2011. https://doi.org/10.1016/j.ins.2010.11.039
  8. E. Krotkov, "Focusing," International Journal of Computer Vision, vol. 1, pp. 223 - 237, 1988. https://doi.org/10.1007/BF00127822
  9. M. Kumar and S. Dass, "A Total Variation-Based Algorithm for Pixel-Level Image Fusion," Image Processing, IEEE Transactions on Image Processing, vol. 18, pp. 2137-2143, 2009. https://doi.org/10.1109/TIP.2009.2025006
  10. L. I. Rudin, S. Osher, and E. Fatemi, "Nonlinear total variation based noise removal algorithms," Physica D: Nonlinear Phenomena, vol. 60, pp. 259-268, 1992. https://doi.org/10.1016/0167-2789(92)90242-F