How Reliable Are The ChatGPT Responses To Frequently Asked Questions About Talus Osteochondritis Dissecans?

Year 2025, Volume: 32 Issue: 3, 198 - 205, 09.09.2025

Sefa Erdem Karapınar , Recep Dinçer

https://doi.org/10.17343/sdutfd.1648670

Abstract

Objective: Talus OCD (Osteochondritis Dissecans) is a painful ankle pathology that affects the subchondral bone and cartilage. This study aimed to determine whether artificial intelligence could provide accurate and sufficient responses to frequently asked questions about this pathology.
Material and Method: ChatGPT (Chat Generative Pre-Trained Transformer) version 4.0 was asked 10 questions selected from the frequently asked questions on the websites of various orthopaedic institutions. The responses were analyzed with the Mika and Discern accuracy scores. Readability was based on the Flesch-Kincaid Grade Level, Gunning-Fog Index, Coleman-Liau Index, Automatic Readability Index, Simple Measure of Gobbledygook Index, Gobbledygook Index, Fry Readability Graph, and the Raygor Readability Estimate. The Reading grade levels were stated as USA grade levels.
Results: According to the Mika scoring system, the mean score of the responses was 2.1. The general responses were satisfactory and required minimal explanation. The mean Discern score was 48, seen to be an average response given. In the index measurements for readability, the mean points were 15.14, which was equivalent to the reading level of a 3rd year university student.
Conclusion: Artificial intelligence is a promising technological development. The continuously developing world of medicine does not yet have the most up-to-date data, and the readability level was seen to be very high. It was seen that the responses were made without showing evidence, which was lacking in the literature.

Keywords

Talus OCD , foot , ankle , ChatGPT

Ethical Statement

This article does not contain any studies with human or animal subjects. Since this study was not a clinical study and patient data were not collected, it was conducted without ethical approval, like other similar studies.

Thanks

I would like to thank Dr. Umut Can Duvarci for his assistance in data collection.

References

• 1. Pelletier-Roy R, Tran Y, Merle G, Nault ML. Retroarticular drilling for osteochondritis dissecans of the talus: A systematic review. Orthop Traumatol Surg Res 2024;8;103834.
• 2. Chau MM, Klimstra MA, Wise KL, Ellermann JM, Tóth F, Carlson CS, et al. Osteochondritis dissecans: Current understanding of epidemiology, etiology, management, and outcomes. J Bone Joint Surg Am 2021;16;103(12):1132–51.
• 3. Yasui Y, Wollstein A, Murawski CD, Kennedy JG. Operative Treatment for osteochondral lesions of the talus: Biologics and scaffold-based therapy. Cartilage 2017;8(1):42–9.
• 4. Lopes R, Geffroy L, Padiolleau G, Ngbilo C, Baudrier N, Mainard D, et al. Proposal of a new CT arthrographic classification system of osteochondral lesions of the talus. Orthop Traumatol Surg Res 2021;107(6):102890. 5. Qulaghassi M, Cho YS, Khwaja M, Dhinsa B. Treatment strategies for osteochondral lesions of the talus: A review of the recent evidence. Foot (Edinb) 2021;47:101805.
• 6. Burrus MT, Werner BC, Starman JS, Kurkis GM, Pierre JM, Diduch DR, et al. Patient perceptions and current trends in ınternet use by orthopedic outpatients. HSS J 2017;13(3):271–5.
• 7. Brega AG, Freedman MAG, LeBlanc WG, Barnard J, Mabachi NM, Cifuentes M, et al. Using the health literacy universal precautions toolkit to ımprove the quality of patient materials. J Health Commun 2015;20(Suppl 2):69–76.
• 8. Sayah FA, Qiu W, Johnson JA. Health literacy and health-related quality of life in adults with type 2 diabetes: a longitudinal study. Qual Life Res 2016;25(6):1487–94.
• 9. Herzog I, Mendiratta D, Para A, Berg A, Kaushal N, Vives M. Assessing the potential role of ChatGPT in spine surgery research. J Exp Orthop 2024;11(3):e12057.
• 10. Mika AP, Martin JR, Engstrom SM, Polkowski GG, Wilson JM. Assessing ChatGPT Responses to common patient questions regarding total hip arthroplasty. J Bone Joint Surg Am 2023;4;105(19):1519–26.
• 11. Feucht MJ, Cotic M, Saier T, Minzlaff P, Plath JE, Imhoff AB, et al. Patient expectations of primary and revision anterior cruciate ligament reconstruction. Knee Surg Sports Traumatol Arthrosc 2016;24(1):201–7.
• 12. Hurley ET, Crook BS, Lorentz SG, Danilkowicz RM, Lau BC, Taylor DC, et al. Evaluation of High-quality ınformation from ChatGPT (Artificial Intelligence-Large Language Model) Artificial Intelligence on shoulder stabilization surgery. Arthroscopy 2024;40(3):726-731.e6.
• 13. Fahy S, Oehme S, Milinkovic D, Jung T, Bartek B. Assessment of quality and readability of ınformation provided by ChatGPT in relation to anterior cruciate ligament injury. J Pers Med 2024;18;14(1):104.
• 14. Lans A, Schwab JH. Health literacy in orthopaedics. J Am Acad Orthop Surg 2023;15;31(8):382–8.
• 15. Li LT, Sinkler MA, Adelstein JM, Voos JE, Calcei JG. ChatGPT Responses to common questions about anterior cruciate ligament reconstruction are frequently satisfactory. Arthroscopy 2024;40(7):2058–66.