Journal of Agricultural Extension & Community Development (농촌지도와개발)

Korean Society of Agricultural Extension (한국농촌지도학회)
권호 표지
DOI QR코드

DOI QR Code

Development and Application of the Questionnaire Improvement Model, Using Systematic Appraisal Tools - Improvement of the 2014 Korean Farmers' Occupational Disease and Injury Survey -

체계화된 측정도구를 이용한 조사표 개선 모델 개발 및 적용 - 2014년 농업인의 업무상 질병 조사표 개선을 중심으로 -

  • Chae, Hyeseon (National Institute of Agricultural Science, Rural Development Administration) ;
  • Lee, Kyungsuk (National Institute of Agricultural Science, Rural Development Administration) ;
  • Choi, Dongphil (National Institute of Agricultural Science, Rural Development Administration) ;
  • Son, Jeongkyu (National Institute of Agricultural Science, Rural Development Administration)
  • 채혜선 (농촌진흥청 국립농업과학원) ;
  • 이경숙 (농촌진흥청 국립농업과학원) ;
  • 최동필 (농촌진흥청 국립농업과학원) ;
  • 손정규 (농촌진흥청 국립농업과학원)
  • Received : 2016.01.11
  • Accepted : 2016.09.12
  • Published : 2016.09.30
Download PDF
⟨ Previous Next ⟩

Abstract

This study aims to improve the Korean Farmers' Occupational Disease and Injury Survey (KFODIS), using the questionnaire improvement model, and systematic appraisal tools. The questionnaire improvement model comprises three stages: pretesting, redesign, and field-testing. The survey was evaluated by 13 expert reviewers, using a modified version of the Questionnaire Appraisal System (QAS-99). Based on the results of pretesting, survey questions were modified at a group meeting of experts. To identify potential issues with the improved survey questions, data were collected from 20 interviews and 31 respondents before behavior coding analysis was conducted. The questionnaire improvement model and systematic appraisal tools were useful in identifying, evaluating, and correcting miscommunication and other similar issues in the KFODIS.

Keywords

References

  1. 고순철, 이재룡, & 최미용. (2006). 농촌 노인의 거주지 만족과 관련변인. 농촌지도와 개발 , 13(1), 29-47.
  2. 박공주, 윤순덕, & 강현정. (2007). 농촌건강장수마을 노인의 운동태도에 영향을 미치는 요인. 농촌지도와 개발, 14(2), 257-278.
  3. 박영실. (2014). 다양한 평가방법을 적용한 조사표 설계 사례 연구. 조사연구 , 15(1), 47-72.
  4. 박영실, 박현정, & 윤연옥. (2013). 조사표 평가 방법에 관한 최근 동향. 조사연구 , 14(2), 201-227.
  5. 이정원, 김경은, 김기남, 현태선, 현화진, & 박영숙 (2000). 우리 나라 노인의 영양부족위험 진단을 위해 개발된 간이조사표의 타당성 평가. 한국영양학회지, 33(8), 864-872.
  6. 이창범, 정남수, & 장우석. (2014). 현장포럼 적용을 위한 농촌주민생활만족도 조사표 개선 연구. 농촌계획, 20(2), 45-56. DOI: 10.7851/ksrp.2014.20.2.045
  7. 전경배. (2011) 자기기입식 조사표 디자인 개선 연구. 국민계정리뷰. Retrieved July 15, 2016, from http://dlps.nanet.go.kr/DlibViewer.do?cn=KINX2011124538&sysid=nhn
  8. 채혜선, 윤순덕, 이경숙, & 김효철. (2009). 농촌지역 노인돌봄 교육프로그램의 효과성 평가. 농촌지도와 개발, 16(1), 1-20.
  9. 통계개발원. (2012). 자료수집방법에 따른 조사표설계 가이드라인 작성 . 대전: 통계교육원.
  10. 통계교육원. (2014). 2014 국가통계품질의 이해. 대전: 통계교육원.
  11. 통계청. (2007) 국가통계 조사표 설계 품질관리 매뉴얼 개발 연구보고서. Retrieved May 15, 2016, from http:// www.dbpia.co.kr/SKnowledge/ArticleDetail/1186437
  12. Brancato. G., Macchina S., Murgia M., Signore M., Simeoni G., Blanke K., Korner T., Nimmergut A., Lima P., Paulino R., & Hoffmeyer-Zlotnik J.H.P. (2006). Handbook of recommended practices for questionnaire development and testing in the European Statistical System. Retrieved May 14, 2014, from http://www4.istat.it/en/files/2013/12/Handbook_questionnaire_development_ 2006.pdf
  13. Centers for Disease Control and Prevention(CDC). (2008). Checklist to evaluate the quality of questions, Retrieved May 14, 2014, from http://appliedresearch.cancer.gov/areas/cognitive/qas99.pdf
  14. Graesser, A. C., Cai, Z., Louwerse, M. M., & Daniel, F. (2006). Question understanding aid(QUAID): A web facility that tests question comprehensibility. Public Opinion Quarterly, 70(1), 3-22. https://doi.org/10.1093/poq/nfj012
  15. Graesser, A. C., Hastings, K. W., Kreuz, R., & Hastings, P. W. (2000). QUAID: A questionnaire evaluation aid for survey methodlogists. Behavior Research Methods, Instruments, & Computers, 32(2), 254-262. https://doi.org/10.3758/BF03207792
  16. Hess, J.C., Singer, E., & Bushery J. (1999). Predicting test-retest reliability from behavior coding. International Journal of Public Opinion Research, 11(4), 346-360. https://doi.org/10.1093/ijpor/11.4.346
  17. Kudela, M. S., Forsyth, B. H., Levin, K., Lawrence, D., & Willis, G. (2006). Cognitive interviewing versus behavior coding. ASA Section on Survey Research Methods, 4243-4249, Retrieved May 14, 2014, from https://www.amstat.org/sections/srms/Proceedings/y2006 /Files/JSM2006-000201.pdf
  18. Morton-williams, J. (1979). The use of "verbal interaction coding" for evaluation a questionnaire. Quality and Quantity, 13, 59-75.
  19. Oksenberg L., Cannell C., & Kalton G. (1991). New strategies for pre-testing survey question. Journal of Official Statistics, 7(3), 349-365.
  20. Presser. S., Blair. J., (1994). Survey pretesting: do different methods produce different results?. Sociological methodology, 24(24), 73-104. https://doi.org/10.2307/270979
  21. Presser, S., Couper, M. P., Lessler, J. T., Martin, E., Martin, J., Rothgeb, J. M., & Singer, E. (2004). Methods for testing and evaluating survey questions. Retrieved May 14, 2014, from http://poq.oxfordjournals.org/content/68/1/109.full.pdf+html
  22. Statistics Sweden. (2004). Design your questions right: how to develop, test, evaluate and improve questionnaires. Retrived July 00, 2016, from http://www.websm.org/uploadi/editor/1364219047Henningsson_2004_Design_Your_Questions_Right.pdf
  23. United States Census Bureau. (2003). Census bureau standard: pretesting questionnaires and related materials for surveys and censuses. Retrieved May 14, 2014, from http://www.census.gov/srd/pretest-standards.pdf
  24. United States Census Bureau. (2013). U.S. Census Bureau statistical quality standards. Retrieved May 14, 2014, from https://www.census.gov/quality/standards/Quality_Standards.pdf
  25. United States Census Bureau. (2007). Behavior coding analysis report; evaluation the English and Spanish versions of the non-response follow-up for the 2006 census test. Retrieved September 27, 2016, from https://www.census.gov/srd/papers/pdf/ssm2007-16.pdf
  26. Zukerberg A. L., Von Thurn D. R., & Moore J. C.(1995). Practical considerations in sample size selection for behavior coding pretests. Retrieved September 14, 2016, from http://citeseerx.ist.psu.edu/viewdoc/download;jsessionid=26BA7D6C29772228A085F4C30B61A541?doi=10.1.1.46.4 690&rep=rep1&type=pdf