AI-driven nodule detection in chest X-rays: Validation with radiologist-confirmed CT and X-ray findings

Year 2025, Volume: 11 Issue: 5, 915 - 921, 04.09.2025

Yeliz Başar

https://doi.org/10.18621/eurj.1692575

Abstract

Objectives: This study evaluates the performance of a commercially available deep learning tool in detecting chest nodules on X-rays, with findings validated by radiologist and confirmatory Computed Tomography (CT) scans.

Methods: In this retrospective analysis, the data of 299 consecutive patients who underwent both chest X-rays and CT scans within two weeks from June 2024 to December 2024 were analyzed. The performance of the deep learning tool was compared against the radiologist reports and CT scan reports, which were considered the gold standard. Performance parameters such as accuracy, sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) were calculated and compared using McNemar's test.

Results: In 299 patients (43.8% female, mean age 58.78 years), CT scans showed nodules in 122 (40.8%) patients. Nodules were identified by the deep learning system in 53 patients, missing five cases identified by radiologist, but also identifying an additional 37 (30.3%) missed cases. The deep learning tool was 72% accurate (95% confidence interval: 0.66-0.77), higher than the 63% of the radiologist (P=0.02). Sensitivity was higher for artificial intelligence (37%) than for radiologist (10%; P<0.001) but lower in terms of specificity (95% vs. 100%; P=0.004).

Conclusions: The deep learning algorithm showed improved sensitivity and accuracy for the detection of pulmonary nodules but lower specificity, with reservations about false positives. The synergy of artificial intelligence and human experience has the potential to enhance the diagnosis of lung cancer. Further research is needed to validate these findings in diverse populations.

Keywords

Artificial intelligence , chest X-ray , chest nodüle , chest CT

Ethical Statement

All procedures conducted in studies involving human participants complied with the ethical standards of the institutional and/or national research committee, as well as the 1964 Helsinki Declaration and its subsequent amendments or equivalent ethical guidelines. The local ethics committee (Acıbadem Mehmet Ali Aydınlar University Medical Research Evaluation Board - ATADEK) approved this retrospective study and waived the requirement for informed consent for the retrospective analysis of anonymized medical data (Decision number: 2025-07/52 and date: 08.05.2025).

References

• 1. Siegel RL, Giaquinto AN, Jemal A. Cancer statistics, 2024. CA Cancer J Clin. 2024;74(1):12-49. doi: 10.3322/caac.21820.
• 2. Hendriks LEL, Remon J, Faivre-Finn C, et al. Non-small-cell lung cancer. Nat Rev Dis Primers. 2024;10(1):71. doi: 10.1038/s41572-024-00551-9.
• 3. Cheng PM, Montagnon E, Yamashita R, et al. Deep Learning: An Update for Radiologists. Radiographics. 2021;41(5):1427-1445. doi: 10.1148/rg.2021200210.
• 4. Huang S, Yang J, Shen N, Xu Q, Zhao Q. Artificial intelligence in lung cancer diagnosis and prognosis: Current application and future perspective. Semin Cancer Biol. 2023;89:30-37. doi: 10.1016/j.semcancer.2023.01.006.
• 5. Esteva A, Robicquet A, Ramsundar B, et al. A guide to deep learning in healthcare. Nat Med. 2019;25(1):24-29. doi: 10.1038/s41591-018-0316-z.
• 6. Lakhani P, Sundaram B. Deep Learning at Chest Radiography: Automated Classification of Pulmonary Tuberculosis by Using Convolutional Neural Networks. Radiology. 2017;284(2):574-582. doi: 10.1148/radiol.2017162326.
• 7. Bramley R, Broadhurst P, Sharman A, et al. Prevalence of AI findings on chest X-ray in patients with lung cancer: A cross-sectional cohort study. medRxiv.2024.12.20.24319410. [Preprint]. doi: 10.1101/2024.12.20.24319410.
• 8. Najjar R. Redefining Radiology: A Review of Artificial Intelligence Integration in Medical Imaging. Diagnostics (Basel). 2023;13(17):2760. doi: 10.3390/diagnostics13172760.
• 9. Anderson PG, Tarder-Stoll H, Alpaslan M, et al. Deep learning improves physician accuracy in the comprehensive detection of abnormalities on chest X-rays. Sci Rep. 2024;14(1):25151. doi: 10.1038/s41598-024-76608-2.
• 10. von Elm E, Altman DG, Egger M, Pocock SJ, Gøtzsche PC, Vandenbroucke JP; STROBE Initiative. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. J Clin Epidemiol. 2008;61(4):344-3449. doi: 10.1016/j.jclinepi.2007.11.008.
• 11. Megat Ramli PN, Aizuddin AN, Ahmad N, Abdul Hamid Z, Ismail KI. A Systematic Review: The Role of Artificial Intelligence in Lung Cancer Screening in Detecting Lung Nodules on Chest X-Rays. Diagnostics (Basel). 2025;15(3):246. doi: 10.3390/diagnostics15030246.
• 12. Peters AA, Decasper A, Munz J, et al. Performance of an AI based CAD system in solid lung nodule detection on chest phantom radiographs compared to radiology residents and fellow radiologists. J Thorac Dis. 2021;13(5):2728-2737. doi: 10.21037/jtd-20-3522.
• 13. Govindarajan A, Govindarajan A, Tanamala S, et al. Role of an Automated Deep Learning Algorithm for Reliable Screening of Abnormality in Chest Radiographs: A Prospective Multicenter Quality Improvement Study. Diagnostics (Basel). 2022;12(11):2724. doi: 10.3390/diagnostics12112724.
• 14. Ahn JS, Ebrahimian S, McDermott S, et al. Association of Artificial Intelligence-Aided Chest Radiograph Interpretation With Reader Performance and Efficiency. JAMA Netw Open. 2022;5(8):e2229289. doi: 10.1001/jamanetworkopen.2022.29289.
• 15. Koo YH, Shin KE, Park JS, Lee JW, Byun S, Lee H. Extravalidation and reproducibility results of a commercial deep learning-based automatic detection algorithm for pulmonary nodules on chest radiographs at tertiary hospital. J Med Imaging Radiat Oncol. 2021;65(1):15-22. doi: 10.1111/1754-9485.13105.
• 16. Ardila D, Kiraly AP, Bharadwaj S, et al. End-to-end lung cancer screening with three-dimensional deep learning on low-dose chest computed tomography. Nat Med. 2019;25(6):954-961. doi: 10.1038/s41591-019-0447-x.
• 17. Ahmad HK, Milne MR, Buchlak QD, et al. Machine Learning Augmented Interpretation of Chest X-rays: A Systematic Review. Diagnostics (Basel). 2023;13(4):743. doi: 10.3390/diagnostics13040743.
• 18. Delrue L, Gosselin R, Ilsen B, Van Landeghem A, de Mey J, Duyck P. Difficulties in the Interpretation of Chest Radiography. In: Coche E, Ghaye B, de Mey J, Duyck P. Editors. Comparative Interpretation of CT and Standard Radiography of the Chest. Springer, Berlin, Heidelberg. 2011: pp. 27-49.
• 19. Mazzone PJ, Lam L. Evaluating the Patient With a Pulmonary Nodule: A Review. JAMA. 2022;327(3):264-273. doi: 10.1001/jama.2021.24287.
• 20. Nam JG, Hwang EJ, Kim J, et al. AI Improves Nodule Detection on Chest Radiographs in a Health Screening Population: A Randomized Controlled Trial. Radiology. 2023;307(2):e221894. doi: 10.1148/radiol.221894.