The korean journal of orthodontics (대한치과교정학회지)

The Korean Association Of Orthodontists (대한치과교정학회)
권호 표지
DOI QR코드

DOI QR Code

Artificial intelligence solutions for temporomandibular joint disorders: Contributions and future potential of ChatGPT

  • Betul Kula (Department of Orthodontics, Istanbul Galata University) ;
  • Ahmet Kula (Department of Prosthodontics, Uskudar University) ;
  • Fatih Bagcier (Physical Medicine and Rehabilitation Clinic, Basaksehir Cam and Sakura City Hospital) ;
  • Bulent Alyanak (Department of Physical Medicine and Rehabilitation, Golcuk Necati Celik State Hospital)
  • Received : 2024.06.12
  • Accepted : 2024.12.09
  • Published : 2025.03.25
Download PDF
⟨ Previous Next ⟩

Abstract

Objective: This study aimed to evaluate the reliability and usefulness of information generated by Chat Generative Pre-Trained Transformer (ChatGPT) on temporomandibular joint disorders (TMD). Methods: We asked ChatGPT about the diseases specified in the TMD classification and scored the responses using Likert reliability and usefulness scales, the modified DISCERN (mDISCERN) scale, and the Global Quality Scale (GQS). Results: The highest Likert scores for both reliability and usefulness were for masticatory muscle disorders (mean ± standard deviation [SD]: 6.0 ± 0), and the lowest scores were for inflammatory disorders of the temporomandibular joint (mean ± SD: 4.3 ± 0.6 for reliability, 4.0 ± 0 for usefulness). The median Likert reliability score indicates that the responses are highly reliable. The median Likert usefulness score was 5 (4-6), indicating that the responses were moderately useful. A comparative analysis was performed, and no statistically significant differences were found in any subject for either reliability or usefulness (P = 0.083-1.000). The median mDISCERN score was 4 (3-5) for the two raters. A statistically significant difference was observed in the mean mDISCERN scores between the two raters (P = 0.046). The GQS scores indicated a moderate to high quality (mean ± SD: 3.8 ± 0.8 for rater 1, 4.0 ± 0.5 for rater 2). No statistically significant correlation was found between mDISCERN and GQS scores (r = -0.006, P = 0.980). Conclusions: Although ChatGPT-4 has significant potential, it can be used as an additional source of information regarding TMD for patients and clinicians.

Keywords

References

  1. Andre A, Kang J, Dym H. Pharmacologic treatment for temporomandibular and temporomandibular joint disorders. Oral Maxillofac Surg Clin North Am 2022;34:49-59. https://doi.org/10.1016/j.coms.2021.08.001
  2. Shaffer SM, Brismée JM, Sizer PS, Courtney CA. Temporomandibular disorders. Part 1: anatomy and examination/diagnosis. J Man Manip Ther 2014;22:2-12. https://doi.org/10.1179/2042618613y.0000000060
  3. Thomas DC, Khan J, Manfredini D, Ailani J. Temporomandibular joint disorder comorbidities. Dent Clin North Am 2023;67:379-92. https://doi.org/10.1016/j.cden.2022.10.005
  4. Valesan LF, Da-Cas CD, Réus JC, Denardin ACS, Garanhani RR, Bonotto D, et al. Prevalence of temporomandibular joint disorders: a systematic review and meta-analysis. Clin Oral Investig 2021;25:441-53. https://doi.org/10.1007/s00784-020-03710-w
  5. AlGhamdi KM, Moussa NA. Internet use by the public to search for health-related information. Int J Med Inform 2012;81:363-73. https://doi.org/10.1016/j.ijmedinf.2011.12.004
  6. Mintz Y, Brodie R. Introduction to artificial intelligence in medicine. Minim Invasive Ther Allied Technol 2019;28:73-81. https://doi.org/10.1080/13645706.2019.1575882
  7. Kung JE, Marshall C, Gauthier C, Gonzalez TA, Jackson JB 3rd. Evaluating ChatGPT performance on the orthopaedic in-training examination. JB JS Open Access 2023;8:e23.00056. https://doi.org/10.2106/jbjs.oa.23.00056
  8. Sharma S, Pajai S, Prasad R, Wanjari MB, Munjewar PK, Sharma R, et al. A critical review of ChatGPT as a potential substitute for diabetes educators. Cureus 2023;15:e38380. https://doi.org/10.7759/cureus.38380
  9. Palanica A, Flaschner P, Thommandram A, Li M, Fossat Y. Physicians' perceptions of chatbots in health care: cross-sectional web-based survey. J Med Internet Res 2019;21:e12887. https://doi.org/10.2196/12887
  10. Acar AH. Can natural language processing serve as a consultant in oral surgery? J Stomatol Oral Maxillofac Surg 2024;125:101724. https://doi.org/10.1016/j.jormas.2023.101724
  11. Davenport T, Kalakota R. The potential for artificial intelligence in healthcare. Future Healthc J 2019;6:94-8. https://doi.org/10.7861/futurehosp.6-2-94
  12. Ahmed N, Abbasi MS, Zuberi F, Qamar W, Halim MSB, Maqsood A, et al. Artificial intelligence techniques: analysis, application, and outcome in dentistry-a systematic review. Biomed Res Int 2021;2021:9751564. https://doi.org/10.1155/2021/9751564
  13. Alhaidry HM, Fatani B, Alrayes JO, Almana AM, Alfhaed NK. ChatGPT in dentistry: a comprehensive review. Cureus 2023;15:e38317. https://doi.org/10.7759/cureus.38317
  14. Eggmann F, Weiger R, Zitzmann NU, Blatz MB. Implications of large language models such as ChatGPT for dental medicine. J Esthet Restor Dent 2023;35:1098-102. https://doi.org/10.1111/jerd.13046
  15. Strunga M, Urban R, Surovková J, Thurzo A. Artificial intelligence systems assisting in the assessment of the course and retention of orthodontic treatment. Healthcare (Basel) 2023;11:683. https://doi.org/10.3390/healthcare11050683
  16. Schwendicke F, Samek W, Krois J. Artificial intelligence in dentistry: chances and challenges. J Dent Res 2020;99:769-74. https://doi.org/10.1177/0022034520915714
  17. Cankurtaran RE, Polat YH, Aydemir NG, Umay E, Yurekli OT. Reliability and usefulness of ChatGPT for inflammatory bowel diseases: an analysis for patients and healthcare professionals. Cureus 2023;15:e46736. https://doi.org/10.7759/cureus.46736
  18. Uz C, Umay E. "Dr ChatGPT": is it a reliable and useful source for common rheumatic diseases? Int J Rheum Dis 2023;26:1343-9. https://doi.org/10.1111/1756-185x.14749
  19. Hasnain M, Hayat A, Hussain A. Revolutionizing chronic obstructive pulmonary disease care with the open AI application: ChatGPT. Ann Biomed Eng 2023;51:2100-2. https://doi.org/10.1007/s10439-023-03238-6
  20. Chelli M, Descamps J, Lavoué V, Trojani C, Azar M, Deckert M, et al. Hallucination rates and reference accuracy of ChatGPT and bard for systematic reviews: comparative analysis. J Med Internet Res 2024;26:e53164. https://doi.org/10.2196/53164
  21. Alkaissi H, McFarlane SI. Artificial hallucinations in ChatGPT: implications in scientific writing. Cureus 2023;15:e35179. https://doi.org/10.7759/cureus.35179
  22. Yaltırık M, Palancıoğlu A, Koray M, Turgut CT. Temporomandibular joint disorders and diagnosis. Yeditepe J Dent 2017;13:43-50. https://doi.org/10.5505/yeditepe.2017.07078
  23. Bernard A, Langille M, Hughes S, Rose C, Leddin D, Veldhuyzen van Zanten S. A systematic review of patient inflammatory bowel disease information resources on the World Wide Web. Am J Gastroenterol 2007;102:2070-7. https://doi.org/10.1111/j.1572-0241.2007.01325.x
  24. Agrawal P, Nikhade P. Artificial intelligence in dentistry: past, present, and future. Cureus 2022;14:e27405. https://doi.org/10.7759/cureus.27405
  25. Anil S, Sudeep K, Saratchandran S, Sweety VK. Revolutionizing dental caries diagnosis through artificial intelligence. In: Chibinski ACR, ed. Dental caries perspectives - a collection of thoughtful essays. London: IntechOpen; 2023. https://doi.org/10.5772/intechopen.112979
  26. Musleh D, Almossaeed H, Balhareth F, Alqahtani G, Alobaidan N, Altalag J, et al. Advancing dental diagnostics: a review of artificial intelligence applications and challenges in dentistry. Big Data Cogn Comput 2024;8:66. https://doi.org/10.3390/bdcc8060066
  27. Ghaffari M, Zhu Y, Shrestha A. A review of advancements of artificial intelligence in dentistry. Dent Rev 2024;4:100081. https://doi.org/10.1016/j.dentre.2024.100081
  28. Balaban C, Inam W, Kennedy R, Faiella R. The future of dentistry: how AI is transforming dental practices. Compend Contin Educ Dent 2021;42:14-7. https://pubmed.ncbi.nlm.nih.gov/33481621/
  29. Xie B, Xu D, Zou XQ, Lu MJ, Peng XL, Wen XJ. Artificial intelligence in dentistry: a bibliometric analysis from 2000 to 2023. J Dent Sci 2024;19:1722-33. https://doi.org/10.1016/j.jds.2023.10.025
  30. Kukalakunta Y, Thunki P, Yellu RR. Integrating artificial intelligence in dental healthcare: opportunities and challenges. J Deep Learn Genom Data Anal 2024;4:34-41. https://aithor.com/paper-summary/integrating-artificial-intelligence-in-dental-healthcare-opportunities-and-challenges
  31. Kessels RP. Patients' memory for medical information. J R Soc Med 2003;96:219-22. https://doi.org/10.1177/014107680309600504
  32. Vinufrancis A, Al Hussein H, Patel HV, Nizami A, Singh A, Nunez B, et al. Assessing the quality and reliability of AI-generated responses to common hypertension queries. Cureus 2024;16:e66041. https://doi.org/10.7759/cureus.66041
  33. Onder CE, Koc G, Gokbulut P, Taskaldiran I, Kuskonmaz SM. Evaluation of the reliability and readability of ChatGPT-4 responses regarding hypothyroidism during pregnancy. Sci Rep 2024;14:243. https://doi.org/10.1038/s41598-023-50884-w
  34. Xie Y, Seth I, Hunter-Smith DJ, Rozen WM, Seifman MA. Investigating the impact of innovative AI chatbot on post-pandemic medical education and clinical assistance: a comprehensive analysis. ANZ J Surg 2024;94:68-77. https://doi.org/10.1111/ans.18666
  35. Dursun D, Bilici Geçer R. Can artificial intelligence models serve as patient information consultants in orthodontics? BMC Med Inform Decis Mak 2024;24:211. https://doi.org/10.1186/s12911-024-02619-8
  36. Hatia A, Doldo T, Parrini S, Chisci E, Cipriani L, Montagna L, et al. Accuracy and completeness of ChatGPT-generated information on interceptive orthodontics: a multicenter collaborative study. J Clin Med 2024;13:735. https://doi.org/10.3390/jcm13030735
  37. Alan R, Alan BM. Utilizing ChatGPT-4 for providing information on periodontal disease to patients: a DISCERN quality analysis. Cureus 2023;15:e46213. https://doi.org/10.7759/cureus.46213
  38. Zengin O, Onder ME. Educational quality of YouTube videos on musculoskeletal ultrasound. Clin Rheumatol 2021;40:4243-51. https://doi.org/10.1007/s10067-021-05793-6
  39. Wadhwa S, Kapila S. TMJ disorders: future innovations in diagnostics and therapeutics. J Dent Educ 2008;72:930-47. https://pubmed.ncbi.nlm.nih.gov/18676802/ https://doi.org/10.1002/j.0022-0337.2008.72.8.tb04569.x
  40. Balel Y. Can ChatGPT be used in oral and maxillofacial surgery? J Stomatol Oral Maxillofac Surg 2023;124:101471. https://doi.org/10.1016/j.jormas.2023.101471
  41. Kılınç DD, Mansız D. Examination of the reliability and readability of Chatbot Generative Pretrained Transformer's (ChatGPT) responses to questions about orthodontics and the evolution of these responses in an updated version. Am J Orthod Dentofacial Orthop 2024;165:546-55. https://doi.org/10.1016/j.ajodo.2023.11.012
  42. Tanaka OM, Gasparello GG, Hartmann GC, Casagrande FA, Pithon MM. Assessing the reliability of ChatGPT: a content analysis of self-generated and self-answered questions on clear aligners, TADs and digital imaging. Dental Press J Orthod 2023;28:e2323183. https://doi.org/10.1590/2177-6709.28.5.e2323183.oar
  43. Khanagar SB, Al-Ehaideb A, Vishwanathaiah S, Maganur PC, Patil S, Naik S, et al. Scope and performance of artificial intelligence technology in orthodontic diagnosis, treatment planning, and clinical decision-making: a systematic review. J Dent Sci 2021;16:482-92. https://doi.org/10.1016/j.jds.2020.06.018
  44. Abu Arqub S, Al-Moghrabi D, Allareddy V, Upadhyay M, Vaid N, Yadav S. Content analysis of AI generated (ChatGPT) responses concerning orthodontic clear aligners. Angle Orthod 2024;94:263-72. https://doi.org/10.2319/062623-472.1
  45. Siontis KC, Attia ZI. ChatGPT hallucinating: can it get any more humanlike? Eur Heart J 2024;45:321-3. https://doi.org/10.1093/eurheartj/ehad548
  46. Sallam M. ChatGPT utility in healthcare education, research, and practice: systematic review on the promising perspectives and valid concerns. Healthcare (Basel) 2023;11:887. https://doi.org/10.3390/healthcare11060887
  47. Kung TH, Cheatham M, Medenilla A, Sillos C, De Leon L, Elepaño C. Performance of ChatGPT on USMLE: potential for AI-assisted medical education using large language models. PLOS Digit Health 2023;2:e0000198. https://doi.org/10.1371/journal.pdig.0000198
  48. Fatima A, Shafi I, Afzal H, Díez IT, Lourdes DRM, Breñosa J, et al. Advancements in dentistry with artificial intelligence: current clinical applications and future perspectives. Healthcare (Basel) 2022;10:2188. https://doi.org/10.3390/healthcare10112188
  49. Vaira LA, Sergnese S, Salzano G, Maglitto F, Arena A, Carraturo E, et al. Are YouTube videos a useful and reliable source of information for patients with temporomandibular joint disorders? J Clin Med 2023;12:817. https://doi.org/10.3390/jcm12030817
  50. Gilson A, Safranek CW, Huang T, Socrates V, Chi L, Taylor RA, et al. How does ChatGPT perform on the United States medical licensing examination (USMLE)? The implications of large language models for medical education and knowledge assessment. JMIR Med Educ 2023;9:e45312. https://doi.org/10.2196/45312