Large language models in emergency medicine: a bibliometric study

Year 2026, Volume: 9 Issue: 2 , 400 - 408 , 12.03.2026

Furkan Çağrı Oğuzlar

https://doi.org/10.32322/jhsm.1849694

https://izlik.org/JA99NX32XC

Abstract

Aims: The aim of this study was to bibliometrically map the research literature on large language model (LLM) applications in emergency medicine (EM), identify publication trends, thematic structures, and citation characteristics, and evaluate global research productivity and collaboration patterns.
Methods: A bibliometric analysis was performed using publications retrieved from the Web of Science Core Collection (WoSCC). Bibliographic data were systematically preprocessed through deduplication, harmonization, and standardization. Performance analysis was conducted to assess publication output, citation metrics, journal characteristics, and geographic distribution. Science-mapping methods, including keyword co-occurrence networks, citation-based overlay visualization, and international collaboration analysis, were applied to explore the thematic structure of the field.
Results: A total of 156 original research articles published were included. Annual publication output showed peaking in 2025. Nearly half of the articles were published in first-quartile journals. The United States (USA) was the leading contributor, followed by Turkiye and Israel. Keyword co-occurrence analysis identified artificial intelligence, emergency department, LLMs, and ChatGPT as the central thematic core. Citation-based overlay visualization demonstrated that LLM- and decision-support related keywords were associated with higher average citation impact. International collaboration analysis indicated that the USA served as the primary collaboration hub, with increasing cross-national co-authorship.
Conclusion: Research on LLMs in EM has increased rapidly since the emergence of generative LLMs, shifting from exploratory studies toward clinically oriented applications. The literature reflects increasing thematic diversity, international collaboration, and emphasis on diagnostic support and clinical decision-making. This bibliometric analysis summarizes the research landscape and highlights trends guiding the responsible integration of LLMs into EM.

Keywords

Large language models , emergency medicine , artificial intelligence , deep learning , bibliometric analysis

Ethical Statement

This study is a bibliometric analysis based exclusively on previously published articles indexed in international databases. No human participants, patient data, biological samples, or animal subjects were involved in the study. All data were obtained from publicly available sources and analyzed in an aggregated and anonymized manner. Therefore, ethical committee approval and informed consent were not required for this study. The study was conducted in accordance with the principles of research and publication ethics.

Supporting Institution

Suleyman Demirel University

Thanks

None

References

• Kumar P. Large language models (LLMs): survey, technical frameworks, and future challenges. Artif Intell Rev. 2024;57(10):260. doi:10.1007/s10462-024-10888-y
• Huang Y, Xu J, Lai J, et al. Advancing transformer architecture in long-context large language models: a comprehensive survey. arXiv. 2023; arXiv:2311.12351. doi:10.48550/arXiv.2311.12351
• Huang J, Xu Y, Wang Q, et al. Foundation models and intelligent decision-making: Progress, challenges, and perspectives. Innovation (Camb). 2025;6(6):100948. doi:10.1016/j.xinn.2025.100948
• Reddy NPK, Shweta C, Srinivas GPVN. Chatbots in the ICU: unveiling the accuracy and limitations of AI in critical care knowledge assessment. Indian J Crit Care Med. 2024;28(Suppl 1):S139-S142. doi:10.5005/jaypee-journals-10071-24667.49
• Saluja R, Rosenthal J, Windon A, et al. Cancer type, stage and prognosis assessment from pathology reports using LLMs. Sci Rep. 2025;15(1): 27300. doi:10.1038/s41598-025-10709-4
• Arslan B, Nuhoglu C, Satici MO, Altinbilek E. Evaluating LLM-based generative AI tools in emergency triage: a comparative study of ChatGPT Plus, Copilot Pro, and triage nurses. Am J Emerg Med. 2025;89:174-181. doi:10.1016/j.ajem.2024.12.024
• Ogdu CU, Gurbuz S, Karakose M, Hanoglu E. Medical implications of LLM-based clinical decision support systems in healthcare. In: Proc 29th Int Conf Information Technology (IT). IEEE; 2025. doi:10.1109/IT 64745.2025.10930252
• Williams CYK, Bains J, Tang T, et al. Evaluating large language models for drafting emergency department encounter summaries. PLOS Digit Health. 2025;4(6):e0000899. doi:10.1371/journal.pdig.0000899
• Shah-Mohammadi F, Finkelstein J. Accuracy evaluation of GPT-assisted differential diagnosis in emergency department. Diagnostics (Basel). 2024;14(16):1779. doi:10.3390/diagnostics14161779
• Williams CYK, Zack T, Miao BY, et al. Use of a large language model to assess clinical acuity of adults in the emergency department. JAMA Netw Open. 2024;7(5):e248895. doi:10.1001/jamanetworkopen.2024.8895
• Li ZQ, Xu R, Gong XR, Wang CL, Liu JP. The top 100 most-cited articles on large language models in medicine: a bibliometric analysis. Digit Health. 2025;11:20552076251365059. doi:10.1177/20552076251365059
• Preiksaitis C, Ashenburg N, Bunney G, et al. The role of large language models in transforming emergency medicine: a scoping review. JMIR Med Inform. 2024;12:e53787. doi:10.2196/53787
• Politi RE, Mills PD, Zubkoff L, Neily J. Delays in diagnosis, treatment, and surgery: root causes, actions taken, and recommendations for healthcare improvement. J Patient Saf. 2022;18(7):e1061-e1066. doi:10. 1097/PTS.0000000000001016
• Vrdoljak J, Boban Z, Vilović M, Kumrić M, Božić J. A review of large language models in medical education, clinical decision support, and healthcare administration. Healthcare (Basel). 2025;13(6):603. doi:10. 3390/healthcare13060603
• Powell KR, Peterson SR. Coverage and quality: a comparison of Web of Science and Scopus databases for reporting faculty nursing publication metrics. Nurs Outlook. 2017;65(5):572-578. doi:10.1016/j.outlook. 2017. 03.004
• Page MJ, McKenzie JE, Bossuyt PM, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ. 2021;372: n71. doi:10.1136/bmj.n71
• Lansiaux E, Azzouz R, Chazard E, Vromant A, Wiel E. Development and comparative evaluation of three artificial intelligence models for predicting triage in emergency departments. arXiv. 2025;arXiv:2507. 01080. doi:10.48550/arXiv.2507.01080
• Shool S, Adimi S, Saboori Amleshi R, Bitaraf E, Golpira R, Tara M. A systematic review of large language model evaluations in clinical medicine. BMC Med Inform Decis Mak. 2025;25(1):117. doi:10.1186/s12911-025-02954-4
• Zamanifar A, Faezipour M, Soleimanian Gharehchopogh F, Farhadi A, eds. Applications of large language models (LLM) in healthcare systems: opportunities, challenges, and ethical considerations. 1st ed. New York, NY: Chapman and Hall/CRC; 2025. doi:10.1201/9781003665083
• Zaidi SFA, Woo H, Lee CG. Toward an effective bug triage system using transformers to add new developers. J Sensors. 2022;2022:4347004. doi: 10.1155/2022/4347004
• Chen S, Chen Y, Liu Y, et al. LLM-empowered chatbots for psychiatrist and patient simulation: application and evaluation. arXiv. 2023;arXiv: 2305.13614. doi:10.48550/arXiv.2305.13614
• Porto BM. Improving triage performance in emergency departments using machine learning and natural language processing: a systematic review. BMC Emerg Med. 2024;24(1):219. doi:10.1186/s12873-024-01135-2
• Song JW, Park J, Kim JH, You SC. Large language model assistant for emergency department discharge documentation. JAMA Netw Open. 2025;8(10):e2538427. doi:10.1001/jamanetworkopen.2025.38427
• Savage N. The race to the top among the world’s leaders in artificial intelligence. Nature. 2020;588:S102-S104. doi:10.1038/d41586-020-03409-8
• Qu S, Liu L, Zhou M, Zhou C, Campy KS. Factors influencing Chinese doctors to use medical large language models. Digit Health. 2024;10: 20552076241297237. doi:10.1177/20552076241297237
• Lee JA, Friedman B, Alberts H, Kivlehan SM, DeVos EL, Patiño AM. Emergency medicine around the world: updates from the 2023 ACEP international ambassador country reports. JACEP Open. 2025;6(3): 100108. doi:10.1016/j.acepjo.2025.100108
• Fraser H, Crossland D, Bacher I, Ranney M, Madsen T, Hilliard R. Comparison of diagnostic and triage accuracy of symptom checkers, ChatGPT, and physicians in an emergency department. JMIR Mhealth Uhealth. 2023;11(1):e49995. doi:10.2196/49995
• Zaboli A, Brigo F, Sibilio S, Mian M, Turcato G. Human intelligence versus ChatGPT: who performs better in correctly classifying patients in triage? Am J Emerg Med. 2024;79:44-47. doi:10.1016/j.ajem.2024.02.008
• Günay S, Öztürk A, Özerol H, Yiğit Y, Erenler AK. Comparison of emergency medicine specialist, cardiologist, and ChatGPT in electrocardiography assessment. Am J Emerg Med. 2024;80:51-60. doi: 10.1016/j.ajem.2024.03.017
• Barash Y, Klang E, Konen E, Sorin V. ChatGPT-4 assistance in optimizing emergency department radiology referrals and imaging selection. J Am Coll Radiol. 2023;20(10):998-1003. doi:10.1016/j.jacr.2023.06.009
• Huang J, Neill L, Wittbrodt M, et al. Generative Artificial Intelligence for chest radiograph interpretation in the emergency department. JAMA Netw Open. 2023;6(10):e2336100. doi:10.1001/jamanetworkopen. 2023.36100
• Lyons RJ, Arepalli SR, Fromal O, Choi JD, Jain N. Artificial Intelligence chatbot performance in triage of ophthalmic conditions. Can J Ophthalmol. 2024;59(4):e301-e308. doi:10.1016/j.jcjo.2023.07.016
• Gebrael G, Sahu KK, Chigarira B, et al. Enhancing triage efficiency and accuracy using ChatGPT-4.0 in emergency rooms for metastatic prostate cancer. Cancers (Basel). 2023;15(14):3717. doi:10.3390/cancers15143717
• Naveed H, Khan AU, Qiu S, et al. A comprehensive overview of large language models. ACM Trans Intell Syst Technol. 2025;16(5):1-72.
• Zhou L, Schellaert W, Martínez-Plumed F, Moros-Daval Y, Ferri C, Hernández-Orallo J. Larger and more instructable language models become less reliable. Nature. 2024;634(8032):61-68. doi:10.1038/s41586-024-07930-y
• Hoffmann J, Borgeaud S, Mensch A, et al. Training compute-optimal large language models. arXiv. 2022;arXiv:2203.15556. doi:10.48550/arXiv.2203.15556
• Wang H, Drone E, Sandlin D, et al. Generative AI-enhanced nomogram predicts left without being seen among ambulance-transported emergency department patients. Am J Emerg Med. 2026;100:62-69. doi: 10.1016/j.ajem.2025.11.010
• Kunze KN, Varady NH, Mazzucco M, et al. ChatGPT-4 exhibits excellent triage capabilities for knee pain presentations. Arthroscopy. 2025;41(5):1438-1447. doi:10.1016/j.arthro.2024.06.021
• Levra AG, Gatti M, Mene R, et al. A large language model-based clinical decision support system for syncope recognition in the emergency department: a framework for clinical workflow integration. Eur J Intern Med. 2025;131:113-120. doi:10.1016/j.ejim.2024.09.017
• Pasli S, Yadigaroğlu M, Kirimli EN, et al. ChatGPT-supported patient triage with voice commands in the emergency department. Am J Emerg Med. 2025;94:63-70. doi:10.1016/j.ajem.2025.04.040