Journal of information and communication convergence engineering

The Korea Institute of Information and Commucation Engineering (한국정보통신학회)
권호 표지
DOI QR코드

DOI QR Code

Edge Adaptive Color Interpolation for Ultra-Small HD-Grade CMOS Video Sensor in Camera Phones

  • Received : 2010.01.07
  • Accepted : 2010.01.26
  • Published : 2010.02.28
Download PDF
⟨ Previous Next ⟩

Abstract

This paper proposes an edge adaptive color interpolation for an ultra-small HD-grade complementary metal-oxide semiconductor (CMOS) video sensor in camera phones that can process 720-p/30-fps videos. Recently, proposed methods with great image quality perceptually reconstruct the green component and then estimate the red/blue component using the reconstructed green and neighbor red and blue pixels. However, these methods require the bulky memory line buffers in order to temporally store the reconstructed green components. The edge adaptive color interpolation method uses seven or nine patterns to calculate the six edge directions. At the same time, the threshold values are adaptively adjusted by the sum of the color values of the selected pixels. This method selects the suitable one among the patterns using two flowcharts proposed in this paper, and then interpolates the missing color values. For verification, we calculated the peak-signal-to-noise-ratio (PSNR) in the test images, which were processed by the proposed algorithm, and compared the calculated PSNR of the existing methods. The proposed color interpolation is also fabricated with the 0.18-${\mu}m$ CMOS flash memory process.

Keywords

References

  1. D. Doswald, J. Hafliger, P. Blessing, N. Felber, P. Niederer, and W. Fichtner, "A 30-frames/s megapixel real-time CMOS image processor," IEEE Journal of Solid-State Circuits, vol. 34, no. 11, Nov. 2000.
  2. G. C. Holst and T. S. Lomheim, CMOS/CCD Sensors and Camera Systems, SPIE Press: Washington, 2007, pp. 118-121.
  3. S. C. Hsia, M. H. Chen, and P. S. Tsai, "VLSI Implementation of low-power high-quality color interpolation processor for CCD camera," IEEE Trans. VLSI Syst., vol. 14, no. 4, Apr. 2006.
  4. A. C. Popescu and H. Farid, "Exposing Digital Forgeries in Color Filter Array Interpolated Images," IEEE Trans. Signal Processing, vol. 53, no. 10, Oct. 2005.
  5. http://en.wikipedia.org/wiki/Color_filter_array
  6. B. E. Bayer, "Color imaging array," U.S. Patent 3,971,065, Jul. 1976.
  7. Y. Jung, H. Kim, B. Hur and M. Kang, "Design of real-time image enhancement preprocessor for cmos image sensor," IEEE Trans. Consumer Electron., vol. 46, no. 1, Feb. 2000.
  8. M. Unse, "Spline: A perfect fit for signal and image processing," IEEE Signal Processing Magazine, vol. 16, no. 6, pp. 22-38, Nov. 1999. https://doi.org/10.1109/79.799930
  9. R. H. Hibbard, "Apparatus and method for adaptively interpolating a full color image utilizing luminance gradients," U. S. Patent 5,382,976, 1995.
  10. C. A. Laroche and M. A. Prescott, "Apparatus and method for adaptively interpolating a full color image utilizing chrominance gradients," U.S. Patent 5,373,322, Dec. 1994.
  11. J. E. Adams Jr., "Design of practical color filter array interpolation algorithms for digital camera," Proc. SPIE, vol. 3028, pp. 117-125, Feb. 1997.
  12. J. F. Hamilton Jr. and J. E Adams, "Adaptive color plane interpolation in single sensor color electronic camera," U. S. Patent 5,629,734, May 1997
  13. R. Kimmel, "Demosaicing: image reconstruction from CCD samples," IEEE Trans. Image Processing, vol. 8, pp. 1221-1228, 1999. https://doi.org/10.1109/83.784434
  14. T. H. Chen and S. Y. Chien, "Cost Effective Color Filter Array Demosaicking with Chrominance Variance Weighted Interpolation," IEEE Int. Sym. Circuits and Syst., pp. 1277-1280, May 2007.
  15. S. Yun, J. Kim, and S. Kim, "Color interpolation by expanding a gradient method," IEEE Trans. Consumer Electron., vol. 54, no. 4, Nov. 2008.
  16. L. Chang and Y. P. Tan, "Hybrid color filter array demosaicking for effective artifact suppression," SPIE Journal of Electronic Imaging, vol. 15, Mar. 2006.
  17. H. Kim, J. Kim, W. Choi, and B. Kang, "Real-Time Edge Adaptive Color Interpolation for an Ultra Small HD-Grade Video Sensor in Mobile Devices," IEEE Int. Conf. Signal Processing and Communication Syst., Dec. 2008.
  18. H. Kim, W. Jang, J. Kim, and B. Kang, "Design of improve Color Interpolation Filter for High-speed Operation and Lower Hardware-complexity," lEEK SoC Design Tech. Society, pp. 243-246, May 2008.
  19. W. Jang, B. Kwak, J. Kim, and B. Kang, "An Image Signal Processor for Ultra Small HD Video Sensor with 3A in Camera Phones," IEEE Int. Conf. Consumer Electron., pp. 3.3-3, Jan. 2009.