Publisher : Korean Data and Information Science Society
DOI : 10.7465/jkdi.2016.27.4.1059
Title & Authors
Robust varying coefficient model using L1 regularization Hwang, Changha; Bae, Jongsik; Shim, Jooyong;
In this paper we propose a robust version of varying coefficient models, which is based on the regularized regression with L1 regularization. We use the iteratively reweighted least squares procedure to solve L1 regularized objective function of varying coefficient model in locally weighted regression form. It provides the efficient computation of coefficient function estimates and the variable selection for given value of smoothing variable. We present the generalized cross validation function and Akaike information type criterion for the model selection. Applications of the proposed model are illustrated through the artificial examples and the real example of predicting the effect of the input variables and the smoothing variable on the output.
Akaike`s information criterion;generalized cross validation function;iteratively reweighted least squares procedure;L1-regularization;locally weighted regression;smoothing variable;variable selection;varying coefficient model;
Akaike, H. (1974). A new look at the statistical model identification. IEEE Transaction on Automatic Control, 19, 716-723.
Cho, D. H., Shim, J. and Seok, K. (2010). Doubly regularized kernel method for heteroscedastic autoregressive data. Journal of the Korean Data & Information Science Society, 21, 155-162.
Cleveland, W. S. and Devlin, S. J. (1988). Locally-weighted regression: An approach to regression analysis by local fitting. Journal of the American Statistical Associationl, 83, 596-610.
Fan, J. and I. Gijbels (1996). Local polynomial modelling and its applications, Chapman & Hall, Boca Raton.
Fan, J. and Zhang, W. (2008). Statistical methods with varying coefficient models. Statistics and its Inter-face, 1, 179-195.
Hastie, T. and Tibshirani, R. (1993). Varying-coefficient models. Journal of the Royal Statistical Society B, 55, 757-796.
Hoover, D. R., Rice, J. A., Wu, C. O. and Yang, L. P. (1998). Nonparametric smoothing estimates of time-varying coefficient models with longitudinal data. Biometrika, 85, 809-822.
Hu, S. and Rao, J. S. (2010). Sparse penalization with censoring constraints for estimating high dimensional AFT models with applications to microarray data analysis, Technical Report 07 of Division of Biostatistics, Case Western Reserve University, Ohio.
Huang, J., Ma, S. and Xie, H. (2005). Regularized estimation in the accelerated failure time model with high dimensional covariates, Technical Report No. 349, Department of Statistics and Actuarial Science, The University of Iowa, Iowa.
Hwang, C., Kim, M. and Shim, J. (2011). Variable selection in L1 penalized censored Regression. Journal of the Korean Data & Information Science Society, 22, 951-959.
Krishnapuram, B., Carlin, L., Figueiredo, M. A. T. and Hartermink, A. J. (2005). Sparse multinomial logistic regression: Fast algorithms and generalization bounds. IEEE Transactions on Pattern Analysis and Machine Intelligence, 27, 957-968.
Park, B. U., Mammen, E., Lee, Y. K. and Lee, E. R. (2015). Varying coefficient regression models: A review and new developments. International Statistical Review, 83, 36-64.
Sauerbrei, W. and Schumacher, M. (1992). A bootstrap resampling procedure for model building: Application to the Cox regression model. Statistical Medicine, 11, 2093-2099.
Shim, J. and Hwang, C. (2015). Varying coefficient modeling via least squares support vector regression. Neurocomputing, 161, 254-259.
Shim, J., Kim, M. and Seok, K. (2015). SVQR with asymmetric quadratic function. Journal of the Korean Data & Information Science Society, 26, 1537-1545.
Tibshirani, R. (1996). Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society B, 58, 267-288.
Wang, H. and Xia, Y. (2009). Shrinkage Estimation of the varying coefficient model. Journal of the American Statistical Association, 104, 747-757.
Williams, P. M. (1995). Bayesian regularization and pruning using a Laplace prior. Neural Computation, 7, 117-143.
Wooldridge, J. M. (2012).Introductory econometrics: A modern approach, South-Western Cengage Learning, Mason.
Wu, C., Shi, X., Cui, Y. and Ma, S. (2015). A penalized robust semiparametric approach for gene-environment interactions. Statistics in Medicine, doi:10.1002/sim.6609.