DOI QR코드

DOI QR Code

User evaluation of the mobile application, CAMBRA-kids, for caries management in preschoolers

소아 치아우식관리 애플리케이션에 대한 사용자 평가

  • Kang, Yu-Min (Department of Dental Hygiene, The Graduate School of Namseoul University) ;
  • Lee, Su-Young (Department of Dental Hygiene, Namseoul University)
  • 강유민 (남서울대학교 일반대학원 치위생학과) ;
  • 이수영 (남서울대학교 치위생학과)
  • Received : 2019.08.03
  • Accepted : 2019.09.08
  • Published : 2019.10.30

Abstract

Objectives: The present study aimed to evaluate the usability, quality, and usefulness of the mobile application, CAMBRA-kids, for caries management in preschoolers. Methods: Ninety-one caregivers and preschoolers participated in the user evaluation of CAMBRA-kids. The evaluators assessed the usability, quality, and usefulness of CAMBRA-kids. The collected data were analyzed using R studio 1.2.1335 for Windows (RStudio Inc. 2018, Boston, MA, USA). The evaluations for usability, quality, and usefulness were analyzed with descriptive statistics, Kruskal-Wallis rank sum test, and Wilcoxon rank sum test. Results: On user evaluation, the quality and usefulness of the application scored >3 points, and majority of the users rated the quality and usefulness of the application as high. The quality of the application's system was the highest at 3.68 points, and the actual usage of the application was the lowest at 3.10 points. The application had the highest technological aspect score of 3.20, whereas the content related to oral health information had the lowest score of 3.10/5. Although the application showed no statistically significant differences in the quality and usefulness according to general characteristics, there was a statistically significant difference (p<0.05) between the two when compared between the caries risk group. For all items, the protector of the high-risk group evaluated the quality and usefulness of the application highly. The moderate risk group gave the lowest evaluation score for the application's quality and usefulness. The usability score of the application, according to the user version of the mobile application rating scale (uMARS), was 3.25, and the average engagement score was 2.82 (56.31%). The highest subscale score was 3.63. Conclusions: In this study, we found suitable quality, usability, and usefulness of the mobile application, CAMBRA-kids. In future, the use of this application will contribute to the prevention of dental caries among preschoolers.

Keywords

References

  1. Roh MS, Heo HN, Choi YJ, Lee HS. Korea Internet & Security Agency. 2018 Survey on the mobile internet usage. Seoul: Korea Internet & Security Agency; 2019: 14-20.
  2. Jin DH, Heo TH, Lee Y, Choung JT. Qualitative assessment of atopic dermatitis-related mobile applications in Korea. Allergy Asthma Respir Dis 2014;2(5):370-6. https://doi.org/10.4168/aard.2014.2.5.370
  3. Kim GH, Lee KH. Perception of smartphone applications for oral health care education in infants and toddlers. J Korean Soc Dent Hyg 2018;18(6):987-1001. https://doi.org/10.13065/jksdh.20180085
  4. Jeong SJ, Lim K, Ko YJ, Sim HA, Kim KY. The analysis of trends in smart phone applications for education and suggestions for improved educational use. J Dig Cont Soc 2010;11(2):203-16.
  5. Kang YM, Lee SY. Heuristics evaluation and development of the caries management by risk assessment(CAMBRA)-kids application for caries management of preschoolers. J Korean Soc Dent Hyg 2019[In press].
  6. Ramos-Gomez FJ, Crall J, Gansky SA, Slayton RL, Featherstone JD. Caries risk assessment appropriate for the age 1 visit(infants and toddlers). J Calif Dent Assoc 2007;35(10):687-702.
  7. Ramos-Gomez FJ, Crystal YO, Ng MW, Crall JJ, Featherstone JD. Pediatric dental care: prevention and management protocols based on caries risk assessment. J Calif Dent Assoc 2010;38(11):746-61.
  8. Ramos-Gomez FJ, Kim YJ, Ng MW, Stephanie Y. New visions in pediatric dentistry keeping healthy teeth caries free-pediatric CAMBRA protocol. J Korean Acad Pediatr Dent 2013;40(1):73-80.
  9. Cho YS. Clinical preventive dental and dental hygiene practice by caries management by risk assessment(CAMBRA). J Dent Hyg Sci 2012;12(6):545-57.
  10. Kim BI. Korean caries management by risk assessment(K-CAMBRA). Korean Dent Assoc 2014;52(8):456-63.
  11. Koo SY, Lee SY. Caries management of high-risk children by caries risk assessment. J Dent Hyg Sci 2018;18(2):97-104. https://doi.org/10.17135/jdhs.2018.18.2.97
  12. U.S. Food and Drug Administration. Medical devices[Internet]. U.S. Food and Drug Administration;2014.[cited 2019 Mar 24]. Available from: https://www.fda.gov/regulatory-information/search-fda-guidance-documents/mobile-medical-applications
  13. Kim ML, Kim JE. Usability test of serious game robot app for hospitalized children. J Korea Academia Industrial Cooperation Soc 2019;20(2):228-34. https://doi.org/10.5762/KAIS.2019.20.2.228.
  14. Jeon EJ. Development and effectiveness evaluation of diabetes self-management mobile application based on imb model[Doctoral dissertation]. Seoul:Univ. of Seoul National, 2017.
  15. Byun AJ. Development and evaluation of smartphone app "healthy kids" for children's weight control with their parents[Master's thesis]. Seoul:Univ. of Seoul National, 2018.
  16. Kim ML. Development and evaluation of health care smart phone application evaluation tool[Master's thesis]. Seoul:Univ. of Seoul National, 2014.
  17. Jo JG, Heo WH. Usability evaluation frameworks of mobile apps on smartphone. AJMAHS 2017;7(12):841-8. https://doi.org/10.14257/ajmahs.2017.12.24
  18. Virzi RA. Refining the test phase of usability evaluation-how many subjects is enough. Hum Factors 1992;34(4):457-68. https://doi.org/10.1177/001872089203400407
  19. Faulkner L. Beyond the five-user assumption-benefits of increased sample sizes in usability testing. Behav Res Methods Instrum Comput 2003;35(3):379-83. https://doi.org/10.3758/BF03195514
  20. Delone WH, McLean ER. The edelone and mclean model of information systems success: a ten-year update. J Manage Inform Syst 2003;19(4):9-30. https://doi.org/10.1080/07421222.2003.11045748
  21. Wang YS, Wang HY, Shee DY. Measuring e-learning systems success in an organizational context: scale development and validation. Comput Hum Behav 2007;23(4):1792-808. https://doi.org/10.1016/j.chb.2005.10.006
  22. Stoyanov SR, Hides L, Kavanagh DJ, Wilson H. Development and validation of the user version of the mobile application rating scale(uMARS). J Med Internet Res 2016;4(2):72. https://doi.org/10.2196/mhealth.5849
  23. Demidowich AP, Lu K, Tamler R, Bloomgarden Z. An evaluation of diabetes self-management applications for android smartphones. J Telemed Telecare 2012;18(4):235-8. https://doi.org/10.1258/jtt.2012.111002
  24. Kang H, Park HA. A mobile app for hypertension management based on clinical practice guidelines: development and deployment. J Med Internet Res 2016;4(1):12. https://doi.org/10.2196/mhealth.4966.
  25. Shim H, Kim YJ, Park MJ. Differences on satisfaction of healthcare applications by smartphone users' characteristics. J Korea Academia-Ind Coop Soc 2016;17(7):410-9. https://doi.org/10.5762/KAIS.2016.17.7.410
  26. Lee MH. Factors affecting oral health education needs on the policemen[Master's degree]. Gwangju:Univ. of Chonnam National, 2017.
  27. LeBeau K, Huey LG, Hart M. Assessing the quality of mobile apps used by occupational therapists: evaluation using the user version of the mobile application rating scale. J Med Internet Res 2019;7(5):13019. https://doi.org/10.2196/13019
  28. Zhang H, Gil TS, Kang EJ. A feasibility study of Korean mobile application rating scale(MARS) for evaluating the quality of blood pressure management apps. Korean J Health Educ Promot 2018;35(3):41-51. https://doi.org/10.14367/kjhep.2018.35.3.41
  29. Chinn CH, Levine J, Matos S, Findley S, Edelstein BL. An interprofessional collaborative approach in the development of a caries risk assessment mobile tablet application: my smile buddy. J Health Care Poor Underserved 2013;24(3):1010-20. https://doi.org/10.1353/hpu.2013.0114
  30. Li Y, Ding J, Wang Y, Tang C, Zhang P. Nutrition-related mobile apps in the China app store: assessment of functionality and quality. J Med Internet Res 2019;7(7):13261. https://doi.org/10.2196/13261