상이한 적합성 판정과 전문검색시스템의 평가에 관한 연구

Variations in relevance assessments and evaluation of the performance of full-text retrieval system

  • 문성빈 (연세대학교 문헌정보학과)
  • 발행 : 1997.12.01

초록

본 논문에서는 문헌의 전문을 대상으로 얻어진 4개의 상이한 적합성 판정 세트가 전문검색시스템의 검색효율성 평가에 미치는 영향을 살펴보았다. 각 적합성 판정 세트간의 검색효율성에는 주목할 만한 차이가 없는 것으로 밝혀졌다. 이는 적합성 개념에 대한 다양한 관점이 검색효율성의 평가에는 커다란 영향을 미치지 못하고 있음을 암시하는 것이다. 그러나, 적합성 정보를 효과적으로 이용하는 정교한 검색기법인 적합성 피이드백을 통합한 검색실험은 계속 연구되어야 할 과제로 제시하고 있다.

This study examined the extent to which variations in relevance assessments affect the evaluation of the performance of full-text retrieval system. Four sets of relevance judgments obtained by examining the full-text of documents were used to test the retrieval effectiveness. There was no noticeable difference in retrieval performance among the four relevance judgment sets. It implies that a variety of definitions of relevance has no effect on the evaluation of the performance of the full-text retrieval system. Furth r retrieval experiments on this topic incorporating relevance feedback, which is one of the sophisticated retrieval techniques using relevance information, are suggested.

키워드

참고문헌

  1. 정보관리학회지 v.10 no.2 적합성 피이드백을 이용한 전문검색시스템의 효율성 증진을 위한 연구 문성빈
  2. Information Processing & Management v.28 no.5 Variations in Relevance Judgements and the Evaluation of Retrieval Performance Burgin,R.
  3. Information Processing & Management v.24 no.4 Measuring Relevance Judgments Eisenberg,M.B.
  4. Journal of the American Society for Information Science v.39 no.5 Order Effect : A study of the Possible Influence of Presentation Order on User Judgments of Document Relevance Eisenberg,M.B.;Barry,C.
  5. Journal of the American Society for Information Science v.47 no.1 Variations in Relevance Assessments and the Measurement of Retrieval Effectiveness Harter, Stephen P.
  6. Journal of the American Society for Information Science v.43 no.10 Psychological Relevance and Information Science Harter, Stephen P.
  7. Journal of the American Society for Information Science v.45 no.3 Other People`s Judg 100ments : A Comparison of Users` and Others` Judgments of Document Relevance, Topicality and Utility Janes,J.W.
  8. Information Storage Retrieval v.4 Relevance Assessments and Retrieval System Evaluation Lesk,M.E.;Salton,G.
  9. Journal of the American Society for Information Science v.45 no.3 Toward a Theory of User-Based Relevance - A Call for a New Paradigm of Inquiry Park,T.K.
  10. Information Processing & Management v.28 no.4 The State of Retrieval System Evaluation Salton,G.
  11. Information Processing & Management v.24 no.5 Term-Weighting Approaches in Automatic Text Retrieval Salton,G.;Buckley,C.
  12. Science v.168 Automatic Text Analysis Salton,G.
  13. Journal of the American Society for Information Science v.26 no.5 Relevance : A Review of and a Framework for the Thinking on the Notion in Information Science Saracevic,T.
  14. Annual Review of Information Science and Technology v.29 no.3 Relevance and Information Behavior Schamber,L.
  15. Information Processing & Management v.26 no.6 A Re-examination of Relevance : Toward a Dynamic, Situational Definition Schamber,L.;Eisenberg,M.B.;Nilan,M.S.
  16. LISR v.13 The Cystic Fibrosis Database : Content and Research Opportunities Shaw,W.M.(et al.)
  17. Journal of Documentation v.30 Automatic Indexing Sparck Jones,K.
  18. Journal of the American Society for Information Science v.39 no.2 Historical Note : Information Retrieval and the Future of an Illusion Swanson, Don R.
  19. Library Quarterly v.56 no.3 Subjective versus Objective Relevance in Bibliographic Retrieval Systems Swanson, Don R.