Analysis of Error Source in Subjective Evaluation on Patient Dentist Interaction : Application of Generalizability Theory

환자-치과의사 관계(PDI Patient Dentist Interaction) 평가의 오차원 분석: 일반화가능도 이론 적용

  • Kim, Jooah (Yonsei University College of Dentistry) ;
  • Cho, Lee-Ra (Gangneung-Wonju National University College of Dentistry)
  • 김주아 (연세대학교 치과대학 치의학교육연구센터) ;
  • 조리라 (강릉원주대학교 치과대학 치과보철학교실)
  • Received : 2019.06.07
  • Accepted : 2019.07.12
  • Published : 2019.07.31

Abstract

This study aims to apply the Generalizability Theory (G-theory) for estimation of reliability of evaluation scores between raters on Patient Dentist Interaction. Selecting a number of raters as multiple error sources, this study was analyzed the error sources caused by relative magnitude of error variances of interaction between the factors and proceeded with D-study based on the results of G-study for optimal determination of measurement condition. The estimated outcomes of variance component for accuracy among the Patient Dentist Interaction evaluation with G-theory showed that impact of error was the biggest influence factor in students. The second influence was the item effect, and the rater effect was relatively small. The Generalizability coefficients for case1 and case2 which were estimated through the D- study were calculated relatively low.

Keywords

References

  1. Brennan, R. L. (2001). Generalizability Theory. New York: Springer.
  2. Kim, S. S., & Kim, Y. B. (2001). Generalizability Theory. Seoul: Kyoyookgwahaksa.
  3. Shavelson, R. J., Baxter, G. P., & Gao, X. (1993). Sampling variability of performance assessments. Journal of Educational Measurement, 30(3), 215-232. https://doi.org/10.1111/j.1745-3984.1993.tb00424.x
  4. Fyans, L. J. (1983). Generalizability theory: Inferences and practical applications. Jossey-Bass Inc Pub.
  5. Norcini, J. J. (1999). Measurement issues in the use of simulation for testing professionals: Test development, test scoring, standard setting. Innovative simulations for assessing professional competence. Chicago, IL: University of Illinois.