Advanced SearchSearch Tips
Criterion of Test Statistics for Validation in Credit Rating Model
facebook(new window)  Pirnt(new window) E-mail(new window) Excel Download
 Title & Authors
Criterion of Test Statistics for Validation in Credit Rating Model
Park, Yong-Seok; Hong, Chong-Sun; Lim, Han-Seung;
  PDF(new window)
This paper presents Kolmogorov-Smirnov, mean difference, AUROC and AR, four well known statistics that have been widely used for evaluating the discriminatory power of credit rating models. Criteria for these statistics are determined by the value of mean difference under the assumption of normality and equal standard deviation. Alternative criteria are proposed through the simulations according to various sample sizes, type II error rates, and the ratio of bads, also we suggest the meaning of statistic on the basis of discriminatory power. Finally we make a comparative study of the currently used guidelines and simulated results.
Accuracy ratio(AR);area under ROC(AUROC);discriminatory power;mean difference;type II error rates;
 Cited by
박용석, 홍종선 (2008). 신용평가모형에서 콜모고로프-스미르노프 검정기준의 문제점, <한국통계학회 논문집>, 15, 1013-1026

홍종선, 이창혁, 김지훈 (2008). 범주형 재무자료에 대한 신용평가모형 검증 비교, <한국통계학회 논문집>, 15, 615-631

Egan, J. P. (1975). Signal Detection Theory and ROC Analysis, Series in Cognitition and Perception, Academic Press, New York

Engelmann, B., Hayden, E. and Tasche, D. (2003). Measuring the Discriminative Power of Rating Systems, Discussion paper Series 2: Banking and Financial Supervision

Faraggi, D. and Reiser, B. (2002). Estimation of the area under the ROC curve, Statistics in Medicine, 21, 3093-3106 crossref(new window)

Hanley, J. A. and McNeil, B. J. (1982). The meaning and use of the area under a receiver operating characteristic (ROC) curve, Radiology, 143, 29-36 crossref(new window)

Joseph, M. P. (2005). A PD validation framework for Basel II internal ratings-based systems, Credit Scoring and Credit Control Ⅳ

Sobehart, J. R., Keenan, S. C. and Stein, R. M. (2000). Benchmarking quantitative default risk models: A validation methodology, Moody's Investors Service

Swets, J. A. (1988). Measuring the accuracy of diagnostic systems, Science, 240, 1285-1293 crossref(new window)

Swets, J. A., Dawes, R. M. and Manahan, J. (2000). Better decisions through science, Scientific American, 283, 82-87 crossref(new window)

Tasche, D. (2006). Validation of internal rating systems and PD estimates, eprint arXiv:physics/0606071

Wilkie, A. D. (2004). Measures for Comparing Scoring Systems, In Readings in Credit Scoring-Recent Developments, Advances, and Aims, Oxford Finance