Journal of the Korean Data and Information Science Society

The Korean Data and Information Science Society (한국데이터정보과학회)
권호 표지

A Joint Agreement Measure Between Multiple Raters and One Standard

  • Published : 2005.08.31
Download PDF
⟨ Previous Next ⟩

Abstract

This article addresses the problem of measuring a joint agreement between multiple raters and a standard set of responses. A new agreement measure based on Um's approach is proposed. The proposed agreement measure is used for multivariate interval responses. Comparison is made between the proposed measure and other corresponding agreement measures using hypothetical data set.

Keywords

References

  1. Educational and Psychological Measurement v.48 A Generalization of Cohen's Kappa agreement Measure to Interval Measurement and Multiple Raters Berry, K.J.;Mielke, P.W. Jr.
  2. Educational and Psychological Measurement v.57 no.3 Measuring the Joint Agreement between Multiple Raters and a Standard Berry, K.J.;Mielke, P.W. Jr.
  3. Educational and Psychological Measurement v.20 A Coefficient of Agreement for Nominal Scales Cohen, J.
  4. Educational and Psychological Measurement v.61 no.2 A Measure of Agreement for Interval or Nominal Multivariate Observations Janson, H.;Olsson, U.
  5. Educational and Psychological Measurement v.6 A Coefficient of Agreement for Nominal Scales Guetzkow, H.
  6. Psychological Bulletin v.84 Kappa revisited Hubert, L.
  7. Psychological Bulletin v.76 Measures of Response Agreement for Qualitative Data: Some Generalizations and Alternatives Light, R.J.
  8. Biometrics v.33 The Measurement of Observer Agreement for Categorical Data Landis, J.R.;Koch, G.G.
  9. Journal of Korean Data & Information Science Society v.15 no.1 A New Agreement Measure for Interval Multivariate Observations Um, Y.