영상분할과 다중 특징을 이용한 영역기반 영상검색 알고리즘

Region-based Image Retrieval Algorithm Using Image Segmentation and Multi-Feature

  • 노진수 (조선대학교 전자정보공과대학 전자공학과) ;
  • 이강현 (조선대학교 전자정보공과대학 전자공학과)
  • Noh, Jin-Soo (Chosun University, Electronics & Information Engineering College, Dept. of Electronics Eng.) ;
  • Rhee, Kang-Hyeon (Chosun University, Electronics & Information Engineering College, Dept. of Electronics Eng.)
  • 발행 : 2009.05.25

초록

컴퓨터 기반의 영상 데이터베이스의 급격한 증가에 따라 영상 정보를 관리할 수 있는 시스템의 필요성이 증가하고 있다. 본 논문에서는 영상분할 알고리즘에 Active Contour, 칼라 특징으로 칼라 오토코렐로그램(Color Autocorrelogram), 질감 특징으로 CWT(Complex Wavelet Transform), 그리고 형태 특징으로 Hu 불변모멘트를 선택하여 이들을 효율적으로 추출하고 결합한 영역기반 다중 특징 영상검색 알고리즘을 제안한다. 칼라 오토코렐로 그램은 영상의 H(Hue), S(Saturation) 성분으로부터 추출 하였고, 질감 특징과 형태 및 위치 특징은 V(Value) 성분으로부터 추출하였다. 효율적인 유사도 측정을 위해 추출된 특징(오토코렐로그램, Hu 불변 모멘트, CWT 모멘트)을 결합하여 정확도와 재현율을 측정하였다. Corel DB 및 VisTex DB에 대한 실험 결과, 제안된 영상검색 알고리즘은 94.8%의 정확도와 90.7%의 재현율을 가지며 성공적으로 영상검색 시스템에 응용할 수 있다.

The rapid growth of computer-based image database, necessity of a system that can manage an image information is increasing. This paper presents a region-based image retrieval method using the combination of color(autocorrelogram), texture(CWT moments) and shape(Hu invariant moments) features. As a color feature, a color autocorrelogram is chosen by extracting from the hue and saturation components of a color image(HSV). As a texture, shape and position feature are extracted from the value component. For efficient similarity confutation, the extracted features(color autocorrelogram, Hu invariant moments, and CWT moments) are combined and then precision and recall are measured. Experiment results for Corel and VisTex DBs show that the proposed image retrieval algorithm has 94.8% Precision, 90.7% recall and can successfully apply to image retrieval system.

키워드

참고문헌

  1. 'Special issue on digital libraries,' IEEE Trans. Pattern Anal. Mach. Intel., vol. 18, no. 8, Aug. 1996
  2. A. W. M. Smeulders, M. Worring, S. Santini, A. Gupta, and R. Jain, 'Content-based image retrieval at the end of early years,' IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 12, pp. 1340-1380, Dec. 2000 https://doi.org/10.1109/34.888720
  3. V. N. Gudivada and V. Raghavan, 'Content based image retrieval systems,' IEEE Comput., vol. 28, no. 9, pp.18-22, Sep. 1995 https://doi.org/10.1145/259526.277426
  4. T. Gevers, and Smeulders, 'PicToseek: combining colour and shape invariant features for image retrieval,' IEEE Trans. Image Proess., 2000, 9, (1), pp. 102-119 https://doi.org/10.1109/83.817602
  5. J. Huang, R. Kumar, M. Mitra, W. J. Zhu, and R. Zahib, 'Image indexing using colour correlogram,' Proc. IEEE Conf. on Comput. Vis. Pattern Recognit., pp. 764-768, June 1997
  6. Kian-Lee Tan, Beng Chin Ooi, Chia Yeow Yee, 'An Evaluation of Color-Spatial Retrieval Techniques for large Databases,' Multimedia Tools and Applications, vol. 14, pp. 55-78, 2001 https://doi.org/10.1023/A:1011359607594
  7. R. M. Haralick, K. Shanmugam, and I. Dinstein, 'Texture features for image classification,' IEEE Trans. Syst. Man Cybern., vol. 8, pp. 610-621, Nov. 1973
  8. K. S. Thyagarajan, T. Nguyen, and C. Persons, 'A maximum likelihood approach to texture classification using wavelet transform,' in Proc. of IEEE Conf. on Image Processing, pp. 640-644, Austin, USA, Nov. 1994
  9. Jing Huang, S. Ravi Kumar, Mandar Mitra, Wei-Jing Zhu, and Ramin Zabih, 'Image indexing using color correlograms,' in Proc. of Recognition, pp. 762-768, Virginia, USA, July 1997
  10. A. K. Jain and A. Vailaya, 'Shape-based retrieval: A case study with trademark image database,' Pattern Recognit., vol. 31, no. 9, pp. 1369-1390, 1998 https://doi.org/10.1016/S0031-3203(97)00131-3
  11. S. Abbasi, F. Mokhtarian, and J. Kittler, 'Curvature scale space in shape similarity retrieval,' Multimedia Syst., vol. 7, no. 6, pp. 467-476, 1999 https://doi.org/10.1007/s005300050147
  12. R. L. Kashyap R. Chellappa, and A. Khotanzad, 'Texture classification using features derived from random field models,' Pattern Recognit. Lett., pp. 43-50, 1, 1982 https://doi.org/10.1016/0167-8655(82)90050-2
  13. Y. Rui and T. S. Huang, 'Image retrieval: Current techniques, promising directions, and open issues,' J. Visual Communication and Image Representation, vol. 10, no. 4, pp. 39-62, Oct. 1999 https://doi.org/10.1006/jvci.1999.0413
  14. Y. D. Chun, S. Y. Seo, and N. C. Kim, 'Image Retrieval Using BDIP and BVLC Moments,' IEEE Trans. on Circuits and Sys., vol. 13, no. 9, pp. 951-957, Sept. 2003
  15. A. K. Jain, and A. Vailaya, 'Image retrieval using colour and shape,' Proc. 2nd Asian Conf. on Computer Vision, Singapore, pp. 529-533, 1995
  16. T. Syeda-Mahmood, and D. Petkovic, 'On describing colour and shape information in images,' Signal Process. Image Commun., vol. 16, (1/2), pp. 15-31, 2000
  17. C. H. Yao, S. Y. Chen, 'Retrieval of translated rotated and scaled colour textures,' Pattern Recognition, vol. 36, pp. 913-929, 2002 https://doi.org/10.1016/S0031-3203(02)00124-3
  18. S. Liapis, and G. Tziritas, 'Image retrieval by colour and texture using chromaticity histograms and wavelet frames,' Int. Conf. on Visual Information and Information Systems, Lyon, France, 2000 https://doi.org/10.1007/3-540-40053-2_35
  19. J. Z. Wang, J. Li, and G. Wiederhold, 'SIMPLIcity: Semantics-sensitive integrated matching for picture libraries,' IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 9, pp. 947-963, Sep. 2001 https://doi.org/10.1109/34.955109
  20. C. Carson, S. Belongie, H. Greenspan, and J. Malik, 'Blobworld: image segmentation using expectation maximization and its application to image querying,' IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 8, pp. 1026-1038, 2002 https://doi.org/10.1109/TPAMI.2002.1023800
  21. M. Flickner, H. Sawhney, W. Niblack, and J. Ashley, 'Query by image and video content: The QBIC system,' IEEE Computer, vol. 28, no. 9, pp. 23-32, Sep. 1995 https://doi.org/10.1109/2.410146
  22. J. R. Smith and S. F. Chang, 'VisualSEEk: A fully automated contentbased image query system,' ACM Multimedia, pp. 87-98, 1996
  23. J. Li, J. Z.Wang, and G.Wiederhold, 'IRM: Integrated region matching for image retrieval,' ACM Multimedia, pp. 147-156, 2000
  24. Chunming Li, Chenyang Xu, Changfeng Gui, and Martin D. Fox, 'Level Set Evolution Without Re-initialization: A New Variational Formulation,' IEEE Computer Society Conf. on Computer Vision and Pattern Recognition Proc., CVPR'05, 2005 https://doi.org/10.1109/CVPR.2005.213
  25. Michael Kass, Andrew Witkin, and Demetri Terzopoulos, 'Snakes: Active contour models,' International Journal of Computer Vision, pp. 321-331, 1988 https://doi.org/10.1007/BF00133570
  26. M. K. Hu, 'Visual Pattern Recognition by Moment Invariants,' IRE Trans. Info. Theory, vol. IT-8, pp.179-187, 1962
  27. Ivan W. S., Richard G. B., and Nick G. K., 'The Dual-Tree Complex Wavelet Transform,' IEEE, SP, pp. 123-151, Nov. 2005
  28. 이강현, '영상 분할을 이용한 영역기반 내용 검색 알고리즘,' 대한전자공학회, CI, vol. 44, no. 5, pp. 361-371, Sep. 2007
  29. Corel DB [Online]. Available: http://dlp.cs.berkeley. edu/photos/corel/
  30. VisTex DB [Online]. Available: http://www-white.media.mit.edu./vismod/imagery/VisionTexture/VisTex.html