Physical Therapy Korea (한국전문물리치료학회지)

Korean Research Society of Physical Therapy (한국전문물리치료학회)
권호 표지
DOI QR코드

DOI QR Code

Verification of the Reliability and Validity of a Virtual Reality Cognitive Evaluation System Based on Motion Recognition Analysis Evaluation

  • Jeonghan Kwon (Rehabilitation Center, Catholic Kwandong University International St. Mary's Hospital) ;
  • Subeen Kim (Rehabilitation Department, Daejeon Public Children Rehabilitation Hospital) ;
  • Jongduk Choi (Department of Physical Therapy, College of Health and Medical Science, Daejeon University)
  • Received : 2023.11.09
  • Accepted : 2023.11.16
  • Published : 2023.11.20
Download PDF
⟨ Previous Next ⟩

Abstract

Background: As social problems due to the acceleration of the aging era and the increase in the elderly population are becoming serious, virtual reality (VR)-based healthcare is emerging as an approach for preventing and managing health issues. Objects: This study used validity and reliability analyses to examine the clinical efficacy that is, the clinical value and usability of a novel VR cognitive evaluation system index that we developed. Methods: We developed a VR cognitive evaluation system based on motion recognition analysis evaluation for individuals aged 65 to 85. After conducting the Korean version of the Mini-Mental State Exam (K-MMSE) cognitive evaluation, the evaluation score was verified through correlation analysis in the VR cognitive evaluation system. To verify the construct validity of the two groups, the Global Deterioration Scale (GDS) grades were categorized into a normal cognitive group (GDS grade 1) and a cognitive impairment group (GDS grades 2 and 3). The data were measured twice to determine the reliability between the two measurements and assess the stability and clinical value of the evaluation system. Results: Our evaluation system had a high correlation of 0.85 with the widely used K-MMSE cognitive evaluation. The system had strong criterion-related validity at the 95% confidence interval. Compared to the average score of GDS grade 1 in the VR cognitive evaluation system, the average score of GDS grades 2 and 3 in the VR cognitive evaluation system was statistically significantly lower while also having strong construct validity at the 95% confidence interval. To measure the reliability of the VR cognitive evaluation system, tests-retests were conducted using the intraclass correlation coefficient (3,1), which equaled 0.923 and was statistically significant. Conclusion: The VR cognitive evaluation system we developed is a valid and reliable clinical tool to distinguish between normal cognitive status and mild cognitive impairment.

Keywords

References

  1. Kaplan HI, Sadock BJ. Delirium, dementia, amnestic and other cognitive disorders. In: Kaplan HI, Sadock BJ editors. Kaplan and Sadock's synopsis of psychiatry: behavioral sciences/clinical psychiatry. 8th ed. Williams & Wilkins; 1998;318-64. 
  2. Kim JM, Shin IS, Yoon JS, Lee HY. Comparison of diagnostic validities between MMSE-K and K-MMSE for screening of dementia. J Korean Neuropsychiatr Assoc 2003;42(1):124-30. 
  3. Howett D, Castegnaro A, Krzywicka K, Hagman J, Marchment D, Henson R, et al. Differentiation of mild cognitive impairment using an entorhinal cortex-based test of virtual reality navigation. Brain 2019;142(6):1751-66.  https://doi.org/10.1093/brain/awz116
  4. Kim MY, Lee KS, Choi JS, Kim HB, Park CI. Effectiveness of cognitive training based on virtual reality for the elderly. J Korean Acad Rehabil Med 2005;29(4):424-33. 
  5. Ge S, Zhu Z, Wu B, McConnell ES. Technology-based cognitive training and rehabilitation interventions for individuals with mild cognitive impairment: a systematic review. BMC Geriatr 2018;18(1):213. 
  6. Ju Y. Systematic review of virtual reality based rehabilitation for dementia. J Korean Soc Cogn Rehabil 2020;9(1):61-80. 
  7. Cogne M, Auriacombe S, Vasa L, Tison F, Klinger E, Sauzeon H, et al. Are visual cues helpful for virtual spatial navigation and spatial memory in patients with mild cognitive impairment or Alzheimer's disease? Neuropsychology 2018;32(4):385-400.  https://doi.org/10.1037/neu0000435
  8. Kim DR, Kim GM, Song SH, Huh U, Chang JH, Tak YJ, et al. Effect of virtual reality-based cognition training on the cognitive function of the elderly adults in the community who use dementia care center. J Occup Ther Aged Dement 2020;14(2):1-10.  https://doi.org/10.34263/jsotad.2020.14.2.1
  9. Zajac-Lamparska L, Wilkosc-Debczynska M, Wojciechowski A, Podhorecka M, Polak-Szabela A, Warchol L, et al. Effects of virtual reality-based cognitive training in older adults living without and with mild dementia: a pretest-posttest design pilot study. BMC Res Notes 2019;12(1):776. 
  10. Marquardt G, Bueter K, Motzek T. Impact of the design of the built environment on people with dementia: an evidence-based review. HERD 2014;8(1):127-57.  https://doi.org/10.1177/193758671400800111
  11. Choi SH, Na DL, Lee BH, Hahm DS, Jeong JH, Jeong Y, et al. The validity of the Korean version of Global Deterioration Scale. J Korean Neurol Assoc 2002;20(6):612-7. 
  12. Hwang DY, Ryu SH, Kwon KH, Choi CR, Kim SA. Correlation between Cognitive Impairment Screening Test (CIST), Korean-Mini Mental State Examination, 2nd edition (K-MMSE~2) and Clinical Dementia Rating (CDR) of patients with stroke. Ther Sci Rehabil 2022;11(2):53-62. 
  13. Kim SY. Clinical features and treatment of mild cognitive impairment. Korean J Clin Geriatr Korea Soc Geriatr Dis Spring Acad Conf 2006;7(1);22-33. 
  14. Jeong JY. Memory failure patients old man, how will you do it? Korean Acad Clin Genet Fall Symp 2007;3(8):352-62. 
  15. Kim DY, Joo SY, Park CI, Park TH, Park KD, Jung KJ, et al. Assessment of post-stroke cognitive dysfunction using 3-dimensional virtual reality program. J Korean Acad Rehabil Med 2009;33(1):12-20.