Evaluation Metrics for Ontology Modules Based on the Relationship Type

관계 유형에 기반한 온톨로지 모듈 평가 메트릭

  • 오선주 (서울대학교 컴퓨터공학과)
  • Received : 2009.11.25
  • Accepted : 2010.04.12
  • Published : 2010.05.31

Abstract

In response to an increased need, various methods for ontology modularization have been proposed. However, few studies have focused on evaluative methods for ontology modules. In this study, we devise novel metrics to measure ontology modularity. To evaluate the ontology modules, we introduce cohesion and coupling based on the theory of software metrics. A cohesion metric and two coupling metrics were used to measure cohesion and coupling for ontology modules. These metrics were also used to check consistency between the ontology modules and the original ontology. The new metrics support a more detailed relationship between classes in ontology modules. We validate the proposed metrics using the well known verification framework and perform the empirical experiments to complement previous investigations. This study offers ontology engineers valuable criteria with which to select and use ontology modules and modularization techniques.

온톨로지 모듈화에 대한 필요성이 증가하고 있으며 이에 따라 다양한 방법으로 온톨로지를 모듈화하려는 시도들이 이루어져 왔다. 그러나 모듈화 과정을 통하여 생성된 온톨로지 모듈의 품질과 모듈화 일치성을 평가할 수 있는 공통된 기준인 평가 메트릭에 대한 연구가 부족한 실정이다. 본 연구에서는 소프트웨어 메트릭 이론을 바탕으로 하여 온톨로지에 적합한 모듈 응집도와 결합도 메트릭을 제안한다. 새로이 제안하는 메트릭은 기존의 온톨로지 메트릭과 상이하게 온톨로지 모듈을 적용 대상으로 하며 모듈의 클래스가 다른 클래스와 형성하는 관계의 유형을 세분화시킴으로써 관계 유형에 따른 영향도를 각각 반영할 수 있도록 하였다. 또한 제안한 메트릭의 검증을 위하여 메트릭 검증 프레임워크를 이용하여 이론적으로 타당성을 검증하고 웹 상의 온톨로지를 모듈화하여 적용하는 실증적 실험을 하였다. 본 연구에서 제안하는 온톨로지 모듈 응집도와 결합도 메트릭은 온톨로지 엔지니어들이 온톨로지 모듈과 모듈화 기법을 선택하여 사용하는 기준으로 활용할 수 있을 것이다.

Keywords

References

  1. Burton-Jones, A., Storey, V., and Sugumaran, V., and Ahluwalia, P., "A semiotic metrics suite for assessing the quality of ontologies," Data Knowl. Eng.,Vol. 55, No. 1, 2005, pp. 84-102. https://doi.org/10.1016/j.datak.2004.11.010
  2. Chidamber, S. R. and Kemerer, C. F.,"A Metric Suite for Object Oriented Design," IEEE Transactions on Software Engineering, Vol. 17, No. 6, 1994, pp. 36-638.
  3. Constantine and Yourdon, Structured Design, Prentice-Hall, Englewood Cliffs, NJ, 1979.
  4. Cuenca Grau, B., Parsia, B., Sirin, E.,and Kalyanpur, A., Automatic Partitioning of OWL Ontologies Using E-Connections, In : Proc. of Description Logic Workshop, 2005.
  5. d'Aquin, M., Sabou, M., Motta, E., Modularization:a Key for the Dynamic Selection of Relevant Knowledge Components, In : Proc. of the ISWC 2006 Workshop on Modular Ontologies, 2006.
  6. d'Aquin, M., Doran, P., Motta, E., Tamma, V., Towards a Parametric Ontolo gy Modularization Framework Based on Graph Transformation, Workshop :International Workshop on Modular Ontologies, 2007.
  7. Doran, P., Tamma, V., and Iannone, L.,Ontology module extraction for ontology reuse : an ontology engineering perspective, CIKM 2007.
  8. Kitchenham, B., Pfleeger, S. and Fenton, N., "Towards a Framework for Software Measurement Validation," IEEE Trans. Software Eng., Vol. 21, No. 12, 1995.
  9. Ma, Y., Jin, B., and Feng, Y., "Semantic oriented ontology cohesion metrics for ontology-based systems," Journal of Systems and Software, Vol. 83, No. 1, 2010.
  10. McCabe, T. J., "A complexity measure," IEEE Transactions on software engineering, Vol. 2, No. 4, 1976, pp. 308-320.
  11. Noy, N. and Musen, M., Specifying Ontology Views by Traversal, In : Proc. of the International Semantic Web Conference (ISWC), 2004.
  12. Orme, A. M., Yao, H. and Etzkorn, L. H., "Coupling Metrics for Ontology-Based Systems," IEEE Software, Vol. 23, No. 2, 2006, pp. 102-108.
  13. Page-Jones, M., Practical Guide to Structured Systems Design, Yourdon, 1980.
  14. Seidenberg, J. and Rector, A., Web ontology segmentation : analysis, classification and use, Proceedings of the 15th international conference on World Wide Web, 2006.
  15. Stuckenschmidt, J. and Klein, M., Structure-Based Partitioning of Large Concept Hierarchies, In : Proc. of the International Semantic Web Conference (ISWC), 2004.
  16. Yang, Z., Zhang, D., and Ye, C., Evaluation Metrics for Ontology Complexity and Evolution Analysis, IEEE International Conference on E-Business Engineering, 2006.
  17. Yao, H., Orme, A. M., and Etzkorn, L.,"Cohesion Metrics for Ontology Design and Application," Journal of Computer science, Vol. 1, No. 1, 2005, pp. 107-113. https://doi.org/10.3844/jcssp.2005.107.113
  18. http://protege.stanford.edu/plugins/owl/owl-library/koala.owl.
  19. http://annotation.semanticweb.org/ontologies/iswc.owl.
  20. http://www.lehigh.edu/~zhp2/2004/0401/univ-bench.owl.