EVALUATION OF THE CHATGPT-4 ARTIFICIAL INTELLIGENCE RESPONSE TO THE PROBLEMS OF HIP REPLACEMENT CHAT GPT-4 Yapay Zekanın Kalça Protezi Sorunlarına Cevabının Değerlendirilmesi

Year 2023, Volume: 13 Issue: 4, 118 - 122, 15.12.2023

Hacı Ali Olçar Gökçen Aydın Akbuğa Samet Ulutürk Şenay Aras Doğan Murat Korkmaz İrem Nisa Korkmaz

Abstract

Objective: This study aims to evaluate the CHAT GPT-4 artificial intelligence responses to common problems
experienced by patients after hip replacement surgery using expert opinion.
Material and Methods: The study used an 11-question form developed by the researcher from a literature
review of the information needs of patients after hip replacement surgery. Ten orthopaedic specialists rated
the accuracy of the responses generated by Chat GPT-4 using a 5-point Likert scale (5: strongly agree, 1:
strongly disagree).The maximum score that can be obtained from the rating scale is 55, and the minimum
score is 11. The scores are summarised using descriptive statistics.
Results: All of the experts agreed that the artificial intelligence (AI) correctly answered the signs of wound
infection (4.80±0.42), practices to prevent home accidents (4.50±0.52), and in which cases a doctor should
be consulted (4.50±0.52). Half of the experts report that the artificial intelligence answered the question
(Antithrombotic treatment time) portially true/false. For the question (Will my hip replacement dislocate?)
60 % of the experts report that the artificial intelligence answered partially true/false.
Conclusion: When Chat GPT-4 was evaluated by experts, it was found to provide mostly accurate information.
However, it is thought that it may be more limited in individualised treatment and care practices. More
research is needed to confirm the accuracy of the results.

Keywords

EVALUATION OF THE CHATGPT-4 ARTIFICIAL INTELLIGENCE RESPONSE TO THE PROBLEMS OF HIP REPLACEMENT, CHAT GPT-4 Yapay Zekanın Kalça Protezi Sorunlarına Cevabının, Değerlendirilmesi

References

• 1. Teubner, T., Flath, C. M., Weinhardt, C., van der Aalst, W., & Hinz, O. (2023). Welcome to the era of chatgpt et al. the prospects of large language models. Business & Information Systems Engineering, 65(2), 95-101.
• 2. Birer, G. C., “ChatGPT”, TÜBİTAK Bilim ve Teknik Dergisi, 2023;662:36-7
• 3. Cotton, D. R., Cotton, P. A., & Shipway, J. R. (2023). Chatting andcheating: Ensuring academic integrity in the era of ChatGPT. Innovations in Education and Teaching International, 1-12.
• 4. Daniel, G., Cabot, J., Deruelle, L., & Derras, M. Xatkit: a multimodal low-code chatbot development framework. IEEE Access, 8, 15332-46.
• 5. OECD. Hip and knee replacement. In Health Care Activities Health at a Glance 2015: OECD Indicators. OECD Publishing, Paris, 2015; 112-3.
• 6. Balkan A, Seki Z. Determination of Complications of Patients Undergoing Total Hip Replacement after Discharge. BSJ Health Sci, 2021; 4(2): 141-9.
• 7. Lucas B. Total hip and total knee replacement: postoperative nursing management. Br J Nurs. 2008 Dec 11-2009 Jan 7;17(22):1410-4
• 8. Yıldırım A, Şendir M. Postoperative Pain Assessment and Pain Management in Patients Undergoing Total Knee Replacement. University of Health Sciences Journal of Nursing. 2013; 1(3): 157-64.
• 9. Montin, L., Suominen, T., & Leino-Kilpi, H. The experiences of patients undergoing total hip replacement. Journal of Orthopaedic Nursing, 2002;6(1):23-9.
• 10. Kaya, Ç., & Bilik, Ö. Effect of Counseling on Quality of Life and Self-Care Agency for Patients Who are Scheduled for Total Knee Replacement. Clinical Nursing Research, 2022;31(3):519-29.