Is Simple Random Sampling Better than Quota Sampling? An Analysis Based on the Sampling Methods of Three Surveys in South Korea

  • Published : 2016.08.31


This paper considers whether random sampling always produces more accurate survey results in the case of South Korea. We compare information from the 2010 census to the demographic variables of three public opinion surveys from South Korea: Gallup Korea's Omnibus Survey (Survey A) is conducted every two months by Gallup Korea; the annual Social Survey (Survey B) is conducted by Statistics Korea (KOSTAT); the Korean General Social Survey (KGSS or Survey C) is conducted annually by the Survey Research Center (SRC) at Sungkyunkwan University (SKKU). Survey A uses quota sampling after randomly selecting the neighborhood and initial addresses; Survey B uses random sampling, but allows replacements in some situations; Survey C uses simple random sampling. Data from more than one year was used for each survey. Our analysis suggests that Survey B is the most representative in most respects, and, in some respects, Survey A may be more representative than Survey C. Data from Survey C was the least stable in terms of representativeness by geographical area and age. Single-person households were underrepresented in both Surveys A and C, but the problem was more severe in Survey A. Four-person households and married persons were both over-represented in Survey A. Less educated people were under-represented in both Survey A and Survey C. There were differences in income level between Survey A and Survey C, but income data was not available for Survey B or the census, so it is difficult to ascertain which survey was more representative in this case.


  1. Baruch, Y., & Holtom, B. C. (2008). Survey response rate levels and trends in organizational research. Human Relations 61(8), 1139-1160. doi: 10.1177/0018726708094863
  2. Brick, J. M. (2011). The future of survey sampling. Public Opinion Quarterly, 75 (5), 872-888. doi: 10.1093/poq/nfr045
  3. Gallup Korea. (2016). Gallup omnibus. Retrieved from
  4. Guignard, R., Wilquin, J.-L., Richard, J.-B., Beck, F. (2013). Tobacco smoking surveillance: Is quota sampling an effective tool for monitoring national trends? A comparison with random cross-sectional survey. PLOS ONE. DOI: 10.1371/journal.pone.0078372
  5. Korea Internet and Security Agency (KISA). (2015). Internet hwalyong josa [Internet usage survey]. Retrieved from
  6. Putnam, R. (2001). Bowling Alone. New York, NY: Simon and Schuster.
  7. Republic of Korea National Election Commission (NEC). (2016). Retrieved from
  8. Social Research Center, SungKyunKwan University (SRC). Korean General Social Survey (KGSS) (2014). Retrieved from
  9. Statistics Korea (KOSTAT). (2014). KOSIS. Retrieved from
  10. Statistics Korea (KOSTAT). (2010). Yundobyul josakyulkwa [Census Result by Year]. Retrieved from