Understanding Complex Design Features via Design Effect Models

설계효과모형을 통한 설계요소의 유용성 이해

  • Received : 2015.10.29
  • Accepted : 2015.11.13
  • Published : 2015.12.31


Survey research, data is commonly collected through a sample design with complex design features that allow the relative efficiency on the precision of an estimator to be measured using the concept of the design effect compared to simple random sampling as a reference design. This concept is most useful when the design effect can be expressed as a function of various design features. We propose a design effect formula suitable under a stratified multistage sampling by generalizing Gabler et al. (1999, 2006)'s approaches for multistage sampling. Its use can either guide improvement in the design efficiency when in design stage or enable the evaluation of the adopted design features afterwards.


stratified multistage sampling;haphazard weighting;intracluster correlation coefficient;mixed effect model;effective sample size


  1. Cornfield, J. (1951). Modern methods in the sampling of human populations, American Journal of Public Health, 41, 654-661.
  2. Gabler, S., Ganninger, M. and Lahiri, P. (2014). A new approximation to the true randomization-based design effect, Submitted to a journal.
  3. Gabler, S., Hader, S. and Lahiri, P. (1999). A Model based justification of Kish's formula for design effects for weighting and clustering, Survey Methodology, 25, 105-106.
  4. Gabler, S., Hader, S. and Lynn, P. (2006). Design effects for multiple design samples, Survey Methodology, 32, 115-120.
  5. Henry, K. A. (2011). Weighting adjustment methods and their impact on sample-based inference (Ph.D. thesis), University of Maryland, College Park, MD.
  6. Holt, D. (1980). Discussion of the paper by Verma, Scott, and O'Muircheartaigh, Journal of Royal Statistical Society-A, 143, 468-469.
  7. Jabkowski, P. (2013). How (not) to estimate the design effect of a complex sampling scheme: a case study of the Polish section of the European social survey, round 5, Ask Research & Methods, 22, 55-77.
  8. Kalton, G., Brick, J. M. and Le, T. (2005). Estimating components of design effects for use in sample design. In Household sample surveys in developing and transition countries,(Sales No. E.05.XVII.6). Department of Economic and Social Affairs, New York, Statistics Division, United Nations.
  9. Kish, L. (1965). Survey Sampling, John Wiley & Sons, New York.
  10. Kish, L. (1987). Weighting in Deft2, Survey Statistician, 26-30.
  11. Kish, L. (1992). Weighting for unequal pi, Journal of Official Statistics, 8, 183-200.
  12. Korn, E. L. and Graubard, B. I. (1999). Analysis of Health Surveys, John Wiley & Sons, New York.
  13. Le, T., Brick, J. M. and Kalton, G. (2001). Decomposing design effects, In Proceedings of the Joint Statistical Meetings, Section on Survey Research Methods, American Statistician Association, CD-Rom.
  14. Lee, H. (2012). How should one find out the contributions to the design effect (variance) made by each of the design components (stratification, clustering, weighting) of a complex sample design?, Survey Statistician, 66, 16-20.
  15. Park, I. (2014). A study on design effect models for complex sample survey, Journal of the Korean Data & Science Society, 25, 523-531.
  16. Park, I. (2015). Assessing complex sample designs via design effect decompositions, Submitted to a journal.
  17. Park, I. and Lee, H. (2004). Design effects for the weighted mean and total estimators under complex survey sampling, Survey Methodology, 30, 183-193.
  18. Rao, J. N. K. and Scott, A. J. (1987). On simple adjustments to chi-square tests with sample survey data, Annals of Statistics, 15, 385-397.
  19. Rust, K. and Broene, P. (2010). Design effects for totals in multi-stage samples, Proceedings of the Joint Statistical Meetings, Section on Survey Research Methods, American Statistician Association, 2174-2181.
  20. Spencer, B. D. (2000). An approximate design effect for unequal weighting when measurements may correlate with selection probabilitie, Survey Methodology, 26, 137-138.
  21. Verma, V., Scott, C. and O'Muircheartaigh, C. (1980). Sample designs and sampling errors for the World Fertility Survey, Journal of Royal Statistical Society-A, 143, 431-473.