Journal of the Institute of Electronics Engineers of Korea SP (대한전자공학회논문지SP)

The Institute of Electronics and Information Engineers (대한전자공학회)
권호 표지

Image Retrieval Using Multiresoluton Color and Texture Features in Wavelet Transform Domain

웨이브릿 변환 영역의 칼라 및 질감 특징을 이용한 영상검색

  • Chun Young-Deok (Department of Electronic Engineering, KyungPook National University) ;
  • Sung Joong-Ki (LG.PHILIPS LCD) ;
  • Kim Nam-Chul (Department of Electronic Engineering, KyungPook National University)
  • Published : 2006.01.01
Download PDF
⟨ Previous Next ⟩

Abstract

We propose a progressive image retrieval method based on an efficient combination of multiresolution color and torture features in wavelet transform domain. As a color feature, color autocorrelogram of the hue and saturation components is chosen. As texture features, BDIP and BVLC moments of the value component are chosen. For the selected features, we obtain multiresolution feature vectors which are extracted from all decomposition levels in wavelet domain. The multiresolution feature vectors of the color and texture features are efficiently combined by the normalization depending on their dimensions and standard deviation vector, respectively, vector components of the features are efficiently quantized in consideration of their storage space, and computational complexity in similarity computation is reduced by using progressive retrieval strategy. Experimental results show that the proposed method yields average $15\%$ better performance in precision vs. recall and average 0.2 in ANMRR than the methods using color histogram color autocorrelogram SCD, CSD, wavelet moments, EHD, BDIP and BVLC moments, and combination of color histogram and wavelet moments, respectively. Specially, the proposed method shows an excellent performance over the other methods in image DBs contained images of various resolutions.

본 논문에서는 웨이브릿 변환된 영역에서 추출된 다해상도 칼라 및 질감 특징의 효율적인 결합을 이용한 점진적 영상검색 기법을 제안한다. 칼라 특징으로 칼라 영상의 H(Hue)와 S(Saturation) 성분의 칼라 오토코렐로그램을 선택하였고, 질감 특징으로는 V(value) 성분의 BDIP와 BVLC 모멘트를 선택하였다 선택된 특징들에 대하여 웨이브릿 변환 영역의 각 분해 레벨로부터 다해상도 특징벡터들을 얻었다. 칼라와 질감 특징의 다해상도 특징벡터들은 특징들의 차원들과 표준 편차 벡터들에 의해 정규화되어 효율적으로 결합되었고, 저장 공간을 고려하여 각 대상 영상들의 특징벡터들은 효율적으로 양자화 되었으며 점진적 검색 기법을 적용하여 유사도 계산시 계산량을 줄였다. 제안한 방법은 칼라 히스토그램, 칼라 오토코렐로그램, SCD, CSD, 웨이브릿 모멘트, EHD, BDIPBVLC, 칼라 히스토그램과 웨이브릿 모멘트의 결합을 이용한 방법들보다 정확도 대 재현율 평가에서는 평균 $15\%,$ ANMRR 평가에서는 평균 0.2 향상된 성능을 나타내었다. 특히, 제안한 방법은 다양한 해상도를 가지는 영상 DB에서 더욱 우수한 성능을 나타내었다

Keywords

References

  1. M. J. Swain and D. H. Ballard, 'Color indexing,' Int. J Computer Vision. vol. 7, pp. 11-32, 1991 https://doi.org/10.1007/BF00130487
  2. J. Huang, S. R. Kumar, M. Mitra, W. J. Zhu, and R. Zabih, 'Image indexing using color correlograms', IEEE Proceedings of Computer Vision and Pattern Recognition, pp. 762-768, 1997 https://doi.org/10.1109/CVPR.1997.609412
  3. 'ISO/IEC 15938-3/FDIS Information technology Multimedia content description interface-part 3 visual,' ISO/IEC/JTC1/SC29/WG11, Doc. N4358, July 2001
  4. R. M. Haralick, K Shanmugam, and I. Dinstein, 'Texture features for image classification,' IEEE Trans. Syst. Man Cybern., vol. 8, pp. 610-621, Nov. 1973
  5. D. Feng, W. C. Siu, and H. J. Zhang, Fundamentals of Content-based Image retrieval, in Multimedia Information Retrieval and Management-Technological Fundamentals and Applications, New York, NY, Springer, 2003
  6. Y. Rui and T. S. Huang, 'Image retrieval: current techniques, promising, directions, and open issues,' J. Visual Communication and Image Representation, vol. 10, pp. 39-62, Oct. 1999 https://doi.org/10.1006/jvci.1999.0413
  7. J. R. Smith and S.-F Chang, 'Transform features for texture classification and discrimination in large image databases,' in Proc. IEEE Int. Conf. Image Processing, vol. 3, pp. 407-411, Nov. 1994 https://doi.org/10.1109/ICIP.1994.413817
  8. Y. D. Chun, S. Y. Seo, and N. C. Kim, 'Image retrieval using BDIP and BVLC moments,' IEEE Trans. Circuits Syst. Video Technol., vol. 13, pp. 951-957, Sep, 2003 https://doi.org/10.1109/TCSVT.2003.816507
  9. S. Liapis and G. Tziritas, 'Color and texture image retrieval using chromaticity histograms and wavelet frames,' IEEE Trans. Multimedia, vol. 6, pp. 676-686, Oct. 2004 https://doi.org/10.1109/TMM.2004.834858
  10. A. Vadivel, A. K. Majumdar, and S. Sural, 'Characteristics of weighted feature vector in content-based image retrieval applications,' in Proc. IEEE Int. Conf. Intelligent Sensing and Information processing, Chennai, India, pp. 127-132, Jan. 2004 https://doi.org/10.1109/ICISIP.2004.1287638
  11. H. Permuter, J. Francos, and I. H. Jermyn, 'Gaussian mixture models of texture and colour for image database retrieval,' in Proc. IEEE Int. Conf. Acoustics, Speech, Signal processing, vol. 3, Hong Kong, pp. 569-572, Apr. 2003 https://doi.org/10.1109/ICASSP.2003.1199538
  12. 성중기, 칼라의 공간적 상관관계 및 국부 질감특성을 이용한 영상검색, 경북대학교 석사학위논문, 2004년 12월
  13. M. Ankerst, H. P. Kriegel, and T. Seidl, 'A multistep approach for shape similarity search in image databases,' IEEE Trans. Knowledge and Data Engineering, vol. 10, pp. 996-1004, Nov.-Dec. 1998 https://doi.org/10.1109/69.738362
  14. B. C. Song, M. J. Kim, and J. B. Ra, 'A fast multiresolution feature matching algorithm for exhaustive search in large image databases,' IEEE Trans. Circuits and Systems for Video Technology, vol. 11, pp. 673-678, May 2001 https://doi.org/10.1109/76.920197
  15. Jing Huang, S. R. Kumar, M. Mitra, and W. J. Zhu, 'Spatial color indexing and applications,' Computer Vision, Sixth International Conference, pp. 602-607, 1998 https://doi.org/10.1109/ICCV.1998.710779
  16. T.Ojala, M. Rautiainen, E. Matinmikko, and M. Aittola, 'Semantic image retrieval with HSV correlogram,' Proc. 12th Scandinavian Conf. On Image Analysis, Bergen, Norway, pp. 621-627, 2001
  17. D. E. Pearson and J. A. Robinson, 'Visual communication at very low data rates,' Proc. IEEE, vol. 73, pp. 795-812, Apr. 1985 https://doi.org/10.1109/PROC.1985.13202
  18. R. C. Gonzalez and R. E. Woods, Digital Image Processing 2nd Edition, Prentice Hall, Upper Saddle River, NJ, 2002
  19. E. J. Stollnitz, T. D. DeRose, and D. H. Salesin, Wavelets for Computer Graphics: Theory and Applications, Morgan Kaufmann, 1996
  20. A. Gersho and R. M. Gray, Vector Quantization and Signal Compression, Kluwer Academic Publishers, 1992
  21. S. F. Chang, W. C. Horace J. Meng, H. Sundaram, and D. Zhong, 'A fully automated content-based video search engine supporting spatiotemporal queries,' IEEE Trans. Circuits Sys. Video Technol., vol. 8, no. 5, pp. 602-615, Sep. 1998 https://doi.org/10.1109/76.718507
  22. P. Ndjiki-Nya, J. Restat, T. Meiers, J. R. Ohm, A. Seyferth, and R. Sniehotta, 'Subjective evaluation of the MPEG-7 retrieval accuracy measure (ANMRR),' ISO/WG11 MPEG Meeting, Geneva, Switzerland, May 2000, Doc. M6029