Journal of Korea Multimedia Society (한국멀티미디어학회논문지)

Korea Multimedia Society (한국멀티미디어학회)
권호 표지
DOI QR코드

DOI QR Code

Extending Semantic Image Annotation using User- Defined Rules and Inference in Mobile Environments

모바일 환경에서 사용자 정의 규칙과 추론을 이용한 의미 기반 이미지 어노테이션의 확장

  • Received : 2018.01.11
  • Accepted : 2018.01.29
  • Published : 2018.02.28
Download PDF
⟨ Previous Next ⟩

Abstract

Since a large amount of multimedia image has dramatically increased, it is important to search semantically relevant image. Thus, several semantic image annotation methods using RDF(Resource Description Framework) model in mobile environment are introduced. Earlier studies on annotating image semantically focused on both the image tag and the context-aware information such as temporal and spatial data. However, in order to fully express their semantics of image, we need more annotations which are described in RDF model. In this paper, we propose an annotation method inferencing with RDFS entailment rules and user defined rules. Our approach implemented in Moment system shows that it can more fully represent the semantics of image with more annotation triples.

Keywords

References

  1. H. No, K. Seo, and D. Im, “Semantic Image Annotation and Retrieval in Mobile Environments,” Journal of Korea Multimedia Society, Vol. 19, No. 8, pp. 1498-1504, 2016. https://doi.org/10.9717/kmms.2016.19.8.1498
  2. D. Im and G. Park, “Linked Tag: Image Annotation Using Semantic Relationships Between Image Tags,” Multimedia Tools and Applications, Vol. 74, No. 7, pp. 2273-2287, 2015. https://doi.org/10.1007/s11042-014-1855-z
  3. D. Im and G. Park, "STAG: Semantic Image Annotation Using Relationships Between Tags," Proceeding of International Conference on Information Science and Applications, pp. 1-2, 2013.
  4. J. Jeong, H. Hong, and D. Lee, “i-TagRanker: an Efficient Tag Ranking System for Image Sharing and Retrieval Using the Semantic Relationships Between Tags,” Multimedia Tools and Applications, Vol. 62, No. 2, pp. 451-478, 2013. https://doi.org/10.1007/s11042-011-0903-1
  5. Resource Description Framework(RDF): Concepts and Abstract Syntax, http://www.w3. org/TR/2014/REC-rdf11-concepts-20140225, (accessed Jan., 14, 2016).
  6. SPARQL Query Language for RDF, http://w3c.org/TR/rdf-sparql-query/, (accessed Jan., 14, 2016).
  7. Patrick Hayes, "RDF Model Theory," https://www.w3.org/TR/2001/WD-rdf-mt-20010925/ W3C Working Draft, (accessed Sep., 25, 2001).
  8. L. Hollink, G. Schreiber, J. Wielemaker, and B. Wielinga, "Semantic Annotation of Image Collections," Proceeding of Knowledge Markup and Semantic Annotation Workshop, pp. 41-48, 2003.
  9. K. Park, J. Jeong, and D. Lee, "OLYBIA: Ontology-based Automatic Annotation System Using Semantic Inference Rules," Proceeding of International Conference on Database Systems for Advanced Applications, Vol. 4443, 2007.
  10. N. Chen, Q. Zhou, and V. Prasnna, "Understanding Web Images by Object Relation Network," Proceeding of the International Conference on World Wide Web, pp. 291-300, 2012.
  11. S. Xia, X. Gong, W. Wang, Y. Tian, X. Yang, and J. Ma, "Context-aware Image Annotation and Retrieval on Mobile Device," Proceeding of International Conference on Multimedia and Information Technology, pp. 111-114, 2010.
  12. W. Viana, J. Filho, J. Gensel, M. Oliver, and H. Martin, "PhotoMap: Automatic Spatiotemporal Annotation for Mobile Photos," Proceeding of International Symposium on Web and Wireless Geographical Information Systems, pp. 187-201, 2007.
  13. J. Broekstra and A. Kampman, "Inferencing and Truth Maintenance in RDF Schema : Exploring a Native Practical Approach," Proceeding of Practical and Scalable Semantic System Workshop, pp. 1-14, 2003.
  14. C. Forgy, “Rete: A Fast Algorithm for the Many Pattern/Many Object Pattern Match Problem,” Artificial Intelligence, Vol. 19, No. 1, pp. 17-37, 1982. https://doi.org/10.1016/0004-3702(82)90020-0