JOURNAL BROWSE
Search
Advanced SearchSearch Tips
Information Theoretic Standardized Logistic Regression Coefficients with Various Coefficients of Determination
facebook(new window)  Pirnt(new window) E-mail(new window) Excel Download
 Title & Authors
Information Theoretic Standardized Logistic Regression Coefficients with Various Coefficients of Determination
Hong Chong-Sun; Ryu Hyeon-Sang;
  PDF(new window)
 Abstract
There are six approaches to constructing standardized coefficient for logistic regression. The standardized coefficient based on Kruskal's information theory is known to be the best from a conceptual standpoint. In order to calculate this standardized coefficient, the coefficient of determination based on entropy loss is used among many kinds of coefficients of determination for logistic regression. In this paper, this standardized coefficient is obtained by using four kinds of coefficients of determination which have the most intuitively reasonable interpretation as a proportional reduction in error measure for logistic regression. These four kinds of the sixth standardized coefficient are compared with other kinds of standardized coefficients.
 Keywords
Entropy loss;Information theory;Inherent prediction error;Proportional reduction;
 Language
English
 Cited by
 References
1.
Agresti, A. (1996). An Introduction to Categorical Data Analysis, Wiley, New York

2.
Agresti, A. and Finlay, B. (1997). Statistical Methods for the Social Sciences (3rd ed.). Dellen/Macmillan, San Francisco

3.
Bock, D.R (1975). Multivariate Statistical Methods in Behavioral Research. McGraw-Hill Series in Psychology

4.
Freund, R.J, and Littell, R.C. (2000). SAS System for Regression (3rd ed.). Sas Institute: Wiley Inter-Science

5.
Goodman, L.A. (1972). A Modified Multiple Regression Approach to the analysis of Dichotomous Variables. American Sociological Review, Vol. 37, 28-46 crossref(new window)

6.
Kruskal, W. (1987). Relative Importance by Averaging Over Orderings. The American Statistician, Vol. 41, 6-10 crossref(new window)

7.
Kvalseth, T, O. (1985). Cautionary Note About $R^2$. The American Statistician, Vol. 39, 279-285 crossref(new window)

8.
Liao, J,G. and McGee, D. (2003). Adjusted Coefficients of Determination for Logistic Regression. The American Statistician, Vol. 57, 161-165 crossref(new window)

9.
Long, J,S. (1997). Regression Models for Categorical and Limited Dependent Variables. Thousand Oaks, CA: Sage

10.
Mayer, L.S. and Younger, M.S. (1976). Estimation of Standardized Regression Coefficients. Journal of the American Statistical Association, Vol. 71, 154-157 crossref(new window)

11.
McFadden, D. (1974). The Measurement of Urban Travel Demand. Journal of Public Economics, Vol. 3, 303-328 crossref(new window)

12.
Menard, S. (1995). Applied Logistic Regression Analysis. Thousand Oaks, CA: Sage

13.
Menard, S. (2000). Coefficients of Determination for Multiple Logistic Regression Analysis. The American Statistician, Vol. 54, 17-24 crossref(new window)

14.
Menard, S. (2004). Six Approaches to Calculating Standardized Logistic Regression Coefficients. The American Statistician, Vol. 58, 218-223 crossref(new window)

15.
Mittlbock, M. and Schernper, M. (1996). Explained Variation for Logistic Regression. Statistics in Medicine, Vol. 15, 1987-1997 crossref(new window)

16.
Tatsuoka, M.M. (1971). Multivariate analysis: Techniques for Educational and Psychological Research, Wiley, New York