Journal of KIISE (정보과학회 논문지)

Korean Institute of Information Scientists and Engineers (한국정보과학회)
권호 표지
DOI QR코드

DOI QR Code

Web-based 3D Object Retrieval from User-drawn Sketch Query

스케치를 이용한 웹 환경에서의 3차원 모델 검색

  • 송종헌 (국민대학교 컴퓨터공학부) ;
  • 주재호 (국민대학교 컴퓨터공학부) ;
  • 윤상민 (국민대학교 컴퓨터공학부)
  • Received : 2014.05.13
  • Accepted : 2014.08.19
  • Published : 2014.10.15
⟨ Previous Next ⟩

Abstract

Three-dimensional (3D) object retrieval from user-drawn sketch queries is one of the important research issues in the areas of pattern recognition and computer graphics for simulation, visualization, and Computer Aided Design. The performance of content-based 3D object retrieval system depends on the availability of effective descriptors and similarity measures for this kind of data. In this paper, we present a sketch-based 3D object retrieval system by extracting a hybrid edge descriptor which is robust against rotation and translation. The experimental results which are based on HTML5 and WebGL show that proposed sketch-based 3D object retrieval method is very efficient to search and order the 3D objects according to user's intention.

터치기반 스마트 기기의 발달에 따라, 사용자가 펜/손가락을 이용하여 그린 스케치를 기반으로 다양한 멀티미디어 검색 기술은 컴퓨터 비전, 컴퓨터 그래픽스, 패턴인식, HCI 분야에서 많은 각광을 받고 있다. 하지만, 기존의 텍스트 정보를 기반으로 한 검색 시스템은 사용자가 원하는 멀티미디어 데이터를 정확히 검색하는데 한계가 있다. 따라서, 멀티미디어 자체가 가지고 있는 정보를 이용하여 검색할 수 있는 내용 기반 멀티미디어 검색에 관한 연구가 필요하게 되었다. 본 논문에서는 Hybrid Edge Descriptor(HED)를 사용한 웹 환경에서의 사용자가 스케치로부터 3차원 모델을 검색할 수 있는 시스템을 제안한다. 3차원 모델로부터 다양한 방향으로 투영된 suggestive contour 영상 및 사용자가 그린 스케치 영상으로부터 전역/지역 히스토그램 분석을 이용한 HED 검색자를 통해 회전 및 이동에 강인한 3차원 모델 검색 시스템을 제안한다.

Keywords

Acknowledgement

Supported by : 연구재단

References

  1. M. Eitz, K. Hildebrand, T. Boubekeur and M. Alexa, "Sketch-Based Image Retrieval:Benchmark and Bag-of-Features Descriptors," IEEE trans, Vis. Comut. Graph, Vol. 17, No. 11, pp. 1624-1636, 2011. https://doi.org/10.1109/TVCG.2010.266
  2. K. Bozas, and E. Izquierdo, "Large Scale Sketch Based Image Retrieval Using Patch Hashing," Lecture Notes in CS, Vol. 7431, pp. 210-219, 2012.
  3. R. Zhou, L. Chen, and L. Zhang, "Sketch-based image retrieval on a large scale database," ACM Multimedia, pp. 973-976, User-Drawn Sketch-based 3D Object Retrieval Using Sparse Coding 15, 2012.
  4. T. Funkhouser, P. Min, M. Kazhdan, J. Chen, A. Halderman, D. Dobkin, and D. Jacobs, "A search engine for 3D models," ACM Transactions on Graphics, Vol. 22, No. 1, pp. 83-105, 2003. https://doi.org/10.1145/588272.588279
  5. T. Funkhouser, M. Kazhdan, P. Shilane, P. Min, W. Kiefer, "A. Tal, S. Rusinkiewicz, and D. Dobkin, Modeling by example," ACM Transactions on Graphics (Proc. SIGGRAPH), 16 Sang Min Yoon et al., Aug. 2004.
  6. J. Lee and T. Funkhouser, "Sketch-based search and composition of 3D models," EUROGRAPHICS Workshop on Sketch-Based Interfaces and Modeling, Jun. 2008.
  7. S. Yoon, M. Scherer, T. Schreck, and A. Kuijper, "Sketch-based 3D model retrieval using diffusion tensor fields of suggestive contours," Proc. ACM Multimedia. ACM, pp. 193-200, 2010.
  8. M. Eitz, K. Hildebrand, T. Boubekeur, and M. Alexa, "A descriptor for large scale image retrieval based on sketched feature lines," Eurographics Symposium on Sketch-Based Interfaces and Modeling, pp. 29-36, 2009.
  9. J. Saavedra, B. Bustos, M. Scherer, and T. Schreck, "STELA: Sketch-Based 3D Model Retrieval using a Structure-Based Local Approach," Proc. of the ACM International Conference on Multimedia Retrieval, pp. 26:1-26:8, peer-reviewed poster paper, 2011.
  10. D. DeCarlo, A. Finkelstein, S. Rusinkiewicz, and A. Santella, "Suggestive contours for conveying shape," ACM Transactions on Graphics (Proc. SIGGRAPH), Vol. 22, No. 3, pp. 848-855, Jul. 2003.
  11. S.M. Yoon and A. Kuijper, "Sketch-based 3D model retrieval using compressive sensing classification," IET Electronics Letter, Vol. 47, No. 21, pp. 1181-1183, 2011. https://doi.org/10.1049/el.2011.2158
  12. M. Eitz and J. Hays, Learning to classify human object sketches," Proc. of the SIGGRAPH 2011: Talks, 2011.
  13. P. Shilane, P. Min, M.M. Kazhdan, and T.A. Funkhauser, "The princeton shape benchmark," Proc. of the SMI, pp. 167-178, 2004.
  14. Chee Sun Won, Dong Kwon Park, Soo-Jun Park, "Efficient Use of MPEG-7 Edge-Histogram Descriptor," ETRI journal, 2002.
  15. N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection," Proc. of IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Vol. 1, Washington, DC, USA: IEEE Computer Society, pp. 886-893, 2005.
  16. M. Aono, H. Iwabuchi, "3D shape retrieval from a 2D image as query," Proc. of the Signal & Information Processing Association Annual Summit and Conference, pp. 1-10, 2012.
  17. D. Zhang, and G. Lu, "A comparative study of Fourier descriptors for shape representation and retrieval," Proc. of the 5th Asian Conference on Computer Vision, pp. 646-651, 2002.
  18. J. Saavedra, and B. Bustos, "An improved histogram of edge local orientations for sketch-based image retrieval," Proc. of the 32nd Annual Symposium of the German Association for Pattern Recognition, pp. 424-441, 2010.
  19. M. Eitz, R. Richter, T. Boubekeur, K. Hildebrand, and M. Alexa, Sketch-Based Shape Retrieval," ACM Trans. Graph. (Proc. of the SIGGRAPH), Vol. 31, No. 4, 2012.
  20. B. Li, T. Schreck, A. Godil, M. Alexa, T. Boubekeur, B. Bustos, J. Chen, M. Eitz, T. Furuya, K. Hildebrand, S. Huang, H. Johan, A. Kuijper R. Ohbuchi, R. Richter, J. Saavedra, M. Scherer, T. Yanagimachi, G. Yoon, and S. Yoon, "SHREC12 Track: Sketch based 3D shape retrieval," Proc. of the Eurographics Workshop on 3D Object Retrieval, pp. 109-118, 2012.
  21. B. Li, Y. Lu, A. Godil, T. Schreck, M. Aono, H. Johan, J. Saavedra, and S. Tashiro, SHREC13 track: Large scale sketch-based 3d shape retrieval, Proc. of the Eurographics Workshop on 3D Object Retrieval, pp. 89-96, 2013.
  22. B. Li, Y. Lu and H. Johan, "Sketch-Based 3D Model Retrieval by Viewpoint Entropy Based Adaptive View Clustering" Proc. of the Eurographics Workshop on 3D Object Retrieval, pp. 49-56, 2013.
  23. Swapnalini pattanaik, D.G. Bhalke, "Efficient content based Image Retrieval System using Mpeg-7 Features," International Journal of Computer Applications, Vol. 53, No. 5, 2012.
  24. X. Chen and A. Golovinskiy and T. Funkhouser, "A Benchmark for 3D Mesh Segmentation," ACM Transactions on Graphics (Proc. of the SIGGRAPH), Vol. 28, No. 3, 2009.
  25. B. Li, Y. Lu, Afzal Godil, Tobias Schreck, Masaki Aono, Henry Johan, Jose M. Saavedra, S. Tashiro, In: S. Biasotti, I. Pratikakis, U. Castellani, T. Schreck, A. Godil, and R. Veltkamp (eds.), SHREC'13 Track: Large Scale Sketch-Based 3D Shape Retrieval, Proc. of the Eurographics Workshop on 3D Object Retrieval 2013 (3DOR 2013), 89-96, 2013.