JOURNAL BROWSE
Search
Advanced SearchSearch Tips
Criterion of Test Statistics for Validation in Credit Rating Model
facebook(new window)  Pirnt(new window) E-mail(new window) Excel Download
 Title & Authors
Criterion of Test Statistics for Validation in Credit Rating Model
Park, Yong-Seok; Hong, Chong-Sun; Lim, Han-Seung;
  PDF(new window)
 Abstract
This paper presents Kolmogorov-Smirnov, mean difference, AUROC and AR, four well known statistics that have been widely used for evaluating the discriminatory power of credit rating models. Criteria for these statistics are determined by the value of mean difference under the assumption of normality and equal standard deviation. Alternative criteria are proposed through the simulations according to various sample sizes, type II error rates, and the ratio of bads, also we suggest the meaning of statistic on the basis of discriminatory power. Finally we make a comparative study of the currently used guidelines and simulated results.
 Keywords
Accuracy ratio(AR);area under ROC(AUROC);discriminatory power;mean difference;type II error rates;
 Language
Korean
 Cited by
 References
1.
박용석, 홍종선 (2008). 신용평가모형에서 콜모고로프-스미르노프 검정기준의 문제점, <한국통계학회 논문집>, 15, 1013-1026

2.
홍종선, 이창혁, 김지훈 (2008). 범주형 재무자료에 대한 신용평가모형 검증 비교, <한국통계학회 논문집>, 15, 615-631

3.
Egan, J. P. (1975). Signal Detection Theory and ROC Analysis, Series in Cognitition and Perception, Academic Press, New York

4.
Engelmann, B., Hayden, E. and Tasche, D. (2003). Measuring the Discriminative Power of Rating Systems, Discussion paper Series 2: Banking and Financial Supervision

5.
Faraggi, D. and Reiser, B. (2002). Estimation of the area under the ROC curve, Statistics in Medicine, 21, 3093-3106 crossref(new window)

6.
Hanley, J. A. and McNeil, B. J. (1982). The meaning and use of the area under a receiver operating characteristic (ROC) curve, Radiology, 143, 29-36 crossref(new window)

7.
Joseph, M. P. (2005). A PD validation framework for Basel II internal ratings-based systems, Credit Scoring and Credit Control Ⅳ

8.
Sobehart, J. R., Keenan, S. C. and Stein, R. M. (2000). Benchmarking quantitative default risk models: A validation methodology, Moody's Investors Service

9.
Swets, J. A. (1988). Measuring the accuracy of diagnostic systems, Science, 240, 1285-1293 crossref(new window)

10.
Swets, J. A., Dawes, R. M. and Manahan, J. (2000). Better decisions through science, Scientific American, 283, 82-87 crossref(new window)

11.
Tasche, D. (2006). Validation of internal rating systems and PD estimates, eprint arXiv:physics/0606071

12.
Wilkie, A. D. (2004). Measures for Comparing Scoring Systems, In Readings in Credit Scoring-Recent Developments, Advances, and Aims, Oxford Finance