DOI QR코드

DOI QR Code

Level of Agreement and Factors Associated With Discrepancies Between Nationwide Medical History Questionnaires and Hospital Claims Data

  • Kim, Yeon-Yong (Big Data Steering Department, National Health Insurance Service) ;
  • Park, Jong Heon (Big Data Steering Department, National Health Insurance Service) ;
  • Kang, Hee-Jin (Big Data Steering Department, National Health Insurance Service) ;
  • Lee, Eun Joo (Big Data Steering Department, National Health Insurance Service) ;
  • Ha, Seongjun (Big Data Steering Department, National Health Insurance Service) ;
  • Shin, Soon-Ae (Gwanak-Branch, National Health Insurance Service)
  • Received : 2017.02.11
  • Accepted : 2017.06.29
  • Published : 2017.09.30

Abstract

Objectives: The objectives of this study were to investigate the agreement between medical history questionnaire data and claims data and to identify the factors that were associated with discrepancies between these data types. Methods: Data from self-reported questionnaires that assessed an individual's history of hypertension, diabetes mellitus, dyslipidemia, stroke, heart disease, and pulmonary tuberculosis were collected from a general health screening database for 2014. Data for these diseases were collected from a healthcare utilization claims database between 2009 and 2014. Overall agreement, sensitivity, specificity, and kappa values were calculated. Multiple logistic regression analysis was performed to identify factors associated with discrepancies and was adjusted for age, gender, insurance type, insurance contribution, residential area, and comorbidities. Results: Agreement was highest between questionnaire data and claims data based on primary codes up to 1 year before the completion of self-reported questionnaires and was lowest for claims data based on primary and secondary codes up to 5 years before the completion of self-reported questionnaires. When comparing data based on primary codes up to 1 year before the completion of selfreported questionnaires, the overall agreement, sensitivity, specificity, and kappa values ranged from 93.2 to 98.8%, 26.2 to 84.3%, 95.7 to 99.6%, and 0.09 to 0.78, respectively. Agreement was excellent for hypertension and diabetes, fair to good for stroke and heart disease, and poor for pulmonary tuberculosis and dyslipidemia. Women, younger individuals, and employed individuals were most likely to under-report disease. Conclusions: Detailed patient characteristics that had an impact on information bias were identified through the differing levels of agreement.

Keywords

References

  1. Rich EC, Crowson TW, Harris IB. The diagnostic value of the medical history. Perceptions of internal medicine physicians. Arch Intern Med 1987;147(11):1957-1960. https://doi.org/10.1001/archinte.1987.00370110085013
  2. Coughlin SS. Recall bias in epidemiologic studies. J Clin Epidemiol 1990;43(1):87-91. https://doi.org/10.1016/0895-4356(90)90060-3
  3. Murray JK, Singer ER, Morgan KL, Proudman CJ, French NP. Memory decay and performance-related information bias in the reporting of scores by event riders. Prev Vet Med 2004;63(3-4):173-182. https://doi.org/10.1016/j.prevetmed.2004.02.005
  4. Raphael K. Recall bias: a proposal for assessment and control. Int J Epidemiol 1987;16(2):167-170. https://doi.org/10.1093/ije/16.2.167
  5. Simpson CF, Boyd CM, Carlson MC, Griswold ME, Guralnik JM, Fried LP. Agreement between self-report of disease diagnoses and medical record validation in disabled older women: factors that modify agreement. J Am Geriatr Soc 2004;52(1):123-127. https://doi.org/10.1111/j.1532-5415.2004.52021.x
  6. Okura Y, Urban LH, Mahoney DW, Jacobsen SJ, Rodeheffer RJ. Agreement between self-report questionnaires and medical record data was substantial for diabetes, hypertension, myocardial infarction and stroke but not for heart failure. J Clin Epidemiol 2004;57(10):1096-1103. https://doi.org/10.1016/j.jclinepi.2004.04.005
  7. Haapanen N, Miilunpalo S, Pasanen M, Oja P, Vuori I. Agreement between questionnaire data and medical records of chronic diseases in middle-aged and elderly Finnish men and women. Am J Epidemiol 1997;145(8):762-769. https://doi.org/10.1093/aje/145.8.762
  8. Chun H, Kim IH, Min KD. Accuracy of self-reported hypertension, diabetes, and hypercholesterolemia: analysis of a representative sample of Korean older adults. Osong Public Health Res Perspect 2016;7(2):108-115. https://doi.org/10.1016/j.phrp.2015.12.002
  9. Bergmann MM, Jacobs EJ, Hoffmann K, Boeing H. Agreement of self-reported medical history: comparison of an in-person interview with a self-administered questionnaire. Eur J Epidemiol 2004;19(5):411-416. https://doi.org/10.1023/B:EJEP.0000027350.85974.47
  10. National Health Insurance Service. Health insurance guide [cited 2016 Dec 26]. Available from: http://www.nhis.or.kr/static/html/wbd/g/a/wbdga0606.html.
  11. Cheol Seong S, Kim YY, Khang YH, Park JH, Kang HJ, Lee H, et al. Data resource profile: the national health information database of the National Health Insurance Service in South Korea. Int J Epidemiol 2016;pii:dyw253.
  12. National Health Insurance Service. 2014 National health screening statistical yearbook. Seoul: National Health Insurance Service; 2015, p. 5 (Korean).
  13. Fleiss JL. Statistical methods for rates and proportions. 2nd ed. New York: Wiley; 1981, p. 218.
  14. Stull DE, Leidy NK, Parasuraman B, Chassany O. Optimal recall periods for patient-reported outcomes: challenges and potential solutions. Curr Med Res Opin 2009;25(4):929-942. https://doi.org/10.1185/03007990902774765
  15. Muntner P, Coresh J, Klag MJ, Whelton PK, Perneger TV. History of myocardial infarction and stroke among incident end-stage renal disease cases and population-based controls: an analysis of shared risk factors. Am J Kidney Dis 2002;40(2): 323-330. https://doi.org/10.1053/ajkd.2002.34515
  16. Weiss MG, Ramakrishna J, Somma D. Health-related stigma: rethinking concepts and interventions. Psychol Health Med 2006;11(3):277-287. https://doi.org/10.1080/13548500600595053
  17. Brewer NT, Chapman GB, Brownlee S, Leventhal EA. Cholesterol control, medication adherence and illness cognition. Br J Health Psychol 2002;7(Part 4):433-447.
  18. Morris AB, Li J, Kroenke K, Bruner-England TE, Young JM, Murray MD. Factors associated with drug adherence and blood pressure control in patients with hypertension. Pharmacotherapy 2006;26(4):483-492. https://doi.org/10.1592/phco.26.4.483
  19. Khadr Z, Yount K. Differences in self-reported physical limitation among older women and men in Ismailia, Egypt. J Gerontol B Psychol Sci Soc Sci 2012;67(5):605-617. https://doi.org/10.1093/geronb/gbs066
  20. Merrill SS, Seeman TE, Kasl SV, Berkman LF. Gender differences in the comparison of self-reported disability and performance measures. J Gerontol A Biol Sci Med Sci 1997;52(1):M19-M26.
  21. Mokdad AH, Ford ES, Bowman BA, Nelson DE, Engelgau MM, Vinicor F, et al. Diabetes trends in the U.S.: 1990-1998. Diabetes Care 2000;23(9):1278-1283. https://doi.org/10.2337/diacare.23.9.1278
  22. Harris MI, Flegal KM, Cowie CC, Eberhardt MS, Goldstein DE, Little RR, et al. Prevalence of diabetes, impaired fasting glucose, and impaired glucose tolerance in U.S. adults. The Third National Health and Nutrition Examination Survey, 1988-1994. Diabetes Care 1998;21(4):518-524. https://doi.org/10.2337/diacare.21.4.518
  23. Egan BM, Zhao Y, Axon RN. US trends in prevalence, awareness, treatment, and control of hypertension, 1988-2008. JAMA 2010; 303(20):2043-2050. https://doi.org/10.1001/jama.2010.650
  24. O'Malley KJ, Cook KF, Price MD, Wildes KR, Hurdle JF, Ashton CM. Measuring diagnoses: ICD code accuracy. Health Serv Res 2005;40(5 Pt 2):1620-1639. https://doi.org/10.1111/j.1475-6773.2005.00444.x

Cited by

  1. Stroke at baseline of the Brazilian Longitudinal Study of Adult Health (ELSA-Brasil): a cross-sectional analysis vol.136, pp.5, 2017, https://doi.org/10.1590/1516-3180.2018.0129060818
  2. The agreement between chronic diseases reported by patients and derived from administrative data in patients undergoing joint arthroplasty vol.19, pp.1, 2017, https://doi.org/10.1186/s12874-019-0729-5
  3. Feasibility of continuous fever monitoring using wearable devices vol.10, pp.1, 2017, https://doi.org/10.1038/s41598-020-78355-6
  4. Clinical outcomes of COVID-19 following the use of angiotensin-converting enzyme inhibitors or angiotensin-receptor blockers among patients with hypertension in Korea: a nationwide study vol.43, pp.None, 2021, https://doi.org/10.4178/epih.e2021004
  5. New methodological approaches were able to effectively reduce immeasurable time bias in case-only designs vol.131, pp.None, 2017, https://doi.org/10.1016/j.jclinepi.2020.11.004