Real-time Color Recognition Based on Graphic Hardware Acceleration

그래픽 하드웨어 가속을 이용한 실시간 색상 인식

  • 김구진 (경북대학교 컴퓨터공학과) ;
  • 윤지영 (경북대학교 컴퓨터공학과) ;
  • 최유주 (서울벤처정보대학원대학교 컴퓨터응용기술학과)
  • Published : 2008.02.15

Abstract

In this paper, we present a real-time algorithm for recognizing the vehicle color from the indoor and outdoor vehicle images based on GPU (Graphics Processing Unit) acceleration. In the preprocessing step, we construct feature victors from the sample vehicle images with different colors. Then, we combine the feature vectors for each color and store them as a reference texture that would be used in the GPU. Given an input vehicle image, the CPU constructs its feature Hector, and then the GPU compares it with the sample feature vectors in the reference texture. The similarities between the input feature vector and the sample feature vectors for each color are measured, and then the result is transferred to the CPU to recognize the vehicle color. The output colors are categorized into seven colors that include three achromatic colors: black, silver, and white and four chromatic colors: red, yellow, blue, and green. We construct feature vectors by using the histograms which consist of hue-saturation pairs and hue-intensity pairs. The weight factor is given to the saturation values. Our algorithm shows 94.67% of successful color recognition rate, by using a large number of sample images captured in various environments, by generating feature vectors that distinguish different colors, and by utilizing an appropriate likelihood function. We also accelerate the speed of color recognition by utilizing the parallel computation functionality in the GPU. In the experiments, we constructed a reference texture from 7,168 sample images, where 1,024 images were used for each color. The average time for generating a feature vector is 0.509ms for the $150{\times}113$ resolution image. After the feature vector is constructed, the execution time for GPU-based color recognition is 2.316ms in average, and this is 5.47 times faster than the case when the algorithm is executed in the CPU. Our experiments were limited to the vehicle images only, but our algorithm can be extended to the input images of the general objects.

References

  1. Chapelle, O., Haffner, P., Vapnik, V. N., "Support vector machines for histogram-based image classification," IEEE Transactions on Neural Networks, Vol.10, No.5, pp. 1055-1064, 1999 https://doi.org/10.1109/72.788646
  2. Smith, J. R., Chang, S. -F., "Tools and techniques for color image retrieval," In: Sethi, I. K., Jain, R. C., eds., Storage & Retrieval for Image and Video Databases IV, vol. 2670 of IS&T/SPIE Proceedings. San Jose, CA, USA, pp. 426-437, 1996
  3. Rui, Y., Huang, T. S., and Chang, S. -F., "Image retrieval: current techniques, promising directions and open issues," Journal of Visual Communication and Image Representation, Vol.10, No.4, pp. 39-62, April 1999 https://doi.org/10.1006/jvci.1999.0413
  4. Jeong, S., Won, C. S., Gray, R. M., "Image retrieval using color histograms generated by Gauss mixture vector quantization," Computer Vision and Image Understanding, Vol.94, No.1-3, pp. 1077-3142, 2004
  5. Park, J. B., Kak, A. C., "A New Color Representation for Non-White Illumination Conditions," Technical Report, TR-ECE-05-06, Purdue University, 2005
  6. Quinlan, M. J., Chalup, S. K., Middleton, R. H., "Application of SVMs for colour classification and collision detection with AIBO robots," Proceedings of Neural Information Processing Systems (NIPS), 2003
  7. Browning, B., Veloso, M., "Real-Time, Adaptive Color-based Robot Vision," Proceedings of IROS '05, Edmonton, Canada, August 2005
  8. Alvarez, R., Milan, E., Swain-Oropeza, R., Aceves- Lopez, A., "Color image classification through fitting of implicit surfaces," Proceedings of IBERAMIA 2004, LNAI 3315, pp. 677-686, 2004
  9. Buluswar, S. D., Draper, B. A., "Color recognition in outdoor images," Proceedings of Sixth International Conference on Computer Vision, pp. 171- 177, 1998
  10. Vandenbroucke, N., Macaire, L., Postaire, J. -G., "Color image segmentation by pixel classification in an adapted hybrid color space: Application to soccer image analysis," Computer Vision and Image Understanding, Vol.90, pp. 190-216, 2003 https://doi.org/10.1016/S1077-3142(03)00025-0
  11. Owens, J. D., Luebke, D., Govindaraju, N., Harris, M., Kruger, J., Lefohn, A. E., Purcell, T. J., "A survey of general-purpose computation on graphics hardware," Computer Graphics Forum, Vol.26, No.1, pp. 80-113, 2007 https://doi.org/10.1111/j.1467-8659.2007.01012.x
  12. Fernando, R., Kilgard, M. J., The Cg Tutorial: The Definitive Guide to Programmable Real-Time Graphics, Addison-Wesley, 2003
  13. Fernando, R., GPU Gems: Programming Techniques, Tips, and Tricks for Real-Time Graphics, Addison-Wesley, 2004
  14. Pharr, M., GPU Gems 2: Programming Techniques for High-Performance Graphics and General-Purpose Computation, Addison-Wesley, 2005