Two-Stage Penalized Composite Quantile Regression with Grouped Variables

  • Received : 2013.02.19
  • Accepted : 2013.06.12
  • Published : 2013.07.31


This paper considers a penalized composite quantile regression (CQR) that performs a variable selection in the linear model with grouped variables. An adaptive sup-norm penalized CQR (ASCQR) is proposed to select variables in a grouped manner; in addition, the consistency and oracle property of the resulting estimator are also derived under some regularity conditions. To improve the efficiency of estimation and variable selection, this paper suggests the two-stage penalized CQR (TSCQR), which uses the ASCQR to select relevant groups in the first stage and the adaptive lasso penalized CQR to select important variables in the second stage. Simulation studies are conducted to illustrate the finite sample performance of the proposed methods.


Supported by : Korea Military Academy, National Research Foundation of Korea (NRF)


  1. Bang, S. and Jhun, M. (2012). Simultaneous estimation and factor selection in quantile regression viaadaptive sup-norm regularization, Computational Statistics and Data Analysis, 56, 813-826.
  2. Bradic, J., Fan, J. and Wang, W. (2011). Penalized composite quasi-likelihood for ultrahigh dimen-sional variable selection, Journal of the Royal Statistical Society, Series B, 73, 325-349.
  3. Fan, J. and Li, R. (2001). Variable selection via nonconcave penalized likelihood and its oracle properties, Journal of the American Statistical Association, 96, 1348-1360.
  4. Knight, K. (1998). Limiting distributions for L1 regression estimators under general conditions, TheAnnals of Statistics, 26, 755-770.
  5. Koenker, R. (1984). A note on L-estimates for linear models, Statistics and Probability Letters, 2,323-325.
  6. Koenker, R. (2005). Quantile Regression, Cambridge University Press, New York.
  7. Koenker, R. and Bassett, G. (1978). Regression quantiles, Econometrica, 4, 33-50.
  8. Tibshirani, R. (1996). Regression shrinkage and selection via the lasso, Journal of the Royal Statistical Society, Series B, 58, 267-288.
  9. Wang, H. and Leng, C. (2008). A note on adaptive group lasso, Computational Statistics and Data Analysis, 52, 5277-5286.
  10. Wu, Y. and Liu, Y. (2009). Variable selection in quantile regression, Statistica Sinica, 19, 801-817.
  11. Yuan, M. and Lin, Y. (2006). Model selection and estimation in regression with grouped variables, Journal of the Royal Statistical Society, Series B, 68, 49-67.
  12. Zhao, P., Rocha, G. and Yu, B. (2009). The composite absolute penalties family for grouped and hierarchical variable selection, The Annals of Statistics, 37, 3468-3497.
  13. Zou, H. (2006). The adaptive lasso and its oracle properties, Journal of the American Statistical Association, 101, 1418-1429.
  14. Zou, H. and Yuan, M. (2008a). Composite quantile regression and the oracle model selection theory, The Annals of Statistics, 36, 1108-1126.
  15. Zou, H. and Yuan, M. (2008b). The $F_{\infty}$-norm support vector machine, Statisitca Sinica, 18, 379-398.