Advanced SearchSearch Tips
Information Theoretic Standardized Logistic Regression Coefficients with Various Coefficients of Determination
facebook(new window)  Pirnt(new window) E-mail(new window) Excel Download
 Title & Authors
Information Theoretic Standardized Logistic Regression Coefficients with Various Coefficients of Determination
Hong Chong-Sun; Ryu Hyeon-Sang;
  PDF(new window)
There are six approaches to constructing standardized coefficient for logistic regression. The standardized coefficient based on Kruskal's information theory is known to be the best from a conceptual standpoint. In order to calculate this standardized coefficient, the coefficient of determination based on entropy loss is used among many kinds of coefficients of determination for logistic regression. In this paper, this standardized coefficient is obtained by using four kinds of coefficients of determination which have the most intuitively reasonable interpretation as a proportional reduction in error measure for logistic regression. These four kinds of the sixth standardized coefficient are compared with other kinds of standardized coefficients.
Entropy loss;Information theory;Inherent prediction error;Proportional reduction;
 Cited by
Agresti, A. (1996). An Introduction to Categorical Data Analysis, Wiley, New York

Agresti, A. and Finlay, B. (1997). Statistical Methods for the Social Sciences (3rd ed.). Dellen/Macmillan, San Francisco

Bock, D.R (1975). Multivariate Statistical Methods in Behavioral Research. McGraw-Hill Series in Psychology

Freund, R.J, and Littell, R.C. (2000). SAS System for Regression (3rd ed.). Sas Institute: Wiley Inter-Science

Goodman, L.A. (1972). A Modified Multiple Regression Approach to the analysis of Dichotomous Variables. American Sociological Review, Vol. 37, 28-46 crossref(new window)

Kruskal, W. (1987). Relative Importance by Averaging Over Orderings. The American Statistician, Vol. 41, 6-10 crossref(new window)

Kvalseth, T, O. (1985). Cautionary Note About $R^2$. The American Statistician, Vol. 39, 279-285 crossref(new window)

Liao, J,G. and McGee, D. (2003). Adjusted Coefficients of Determination for Logistic Regression. The American Statistician, Vol. 57, 161-165 crossref(new window)

Long, J,S. (1997). Regression Models for Categorical and Limited Dependent Variables. Thousand Oaks, CA: Sage

Mayer, L.S. and Younger, M.S. (1976). Estimation of Standardized Regression Coefficients. Journal of the American Statistical Association, Vol. 71, 154-157 crossref(new window)

McFadden, D. (1974). The Measurement of Urban Travel Demand. Journal of Public Economics, Vol. 3, 303-328 crossref(new window)

Menard, S. (1995). Applied Logistic Regression Analysis. Thousand Oaks, CA: Sage

Menard, S. (2000). Coefficients of Determination for Multiple Logistic Regression Analysis. The American Statistician, Vol. 54, 17-24 crossref(new window)

Menard, S. (2004). Six Approaches to Calculating Standardized Logistic Regression Coefficients. The American Statistician, Vol. 58, 218-223 crossref(new window)

Mittlbock, M. and Schernper, M. (1996). Explained Variation for Logistic Regression. Statistics in Medicine, Vol. 15, 1987-1997 crossref(new window)

Tatsuoka, M.M. (1971). Multivariate analysis: Techniques for Educational and Psychological Research, Wiley, New York