Research Article

Improved Vision Transformer with Lion Optimizer for Lung Diseases Detection

Volume: 16 Number: 2 June 30, 2024
TR EN

Improved Vision Transformer with Lion Optimizer for Lung Diseases Detection

Abstract

Lung infections, such as pneumonia, bronchitis, tuberculosis, and notably COVID-19 caused by the SARS-CoV-2 virus, have caused widespread devastation globally, resulting in a significant loss of life. Timely and precise diagnosis of these respiratory diseases is crucial in controlling their spread and reducing their deadly impact. However, diagnostic errors can occur due to factors like physician workload and the need for a second opinion. To address these challenges, artificial intelligence-based diagnostic systems, utilizing deep learning algorithms, particularly in the radiology field, have been proposed. In this research, we introduced a novel model based on Multi-Axis Image Transformers, which boasts a reduced parameter count, decreased GPU computational load, real-time diagnostic capabilities, and improved accuracy. Furthermore, we conducted a detailed performance comparison of optimization algorithms, including SGD, Adam, and Lion, with higher results indicating that the Lion optimizer notably enhances the diagnostic capabilities of the proposed MaxViT model, especially in detecting lung infections. Our proposed approach underwent rigorous experimentation using the COVID-QU-Ex dataset, recognized as the most current, comprehensive, and balanced dataset for lung infections and COVID-19. Our method achieved diagnostic accuracy of 97.14%, surpassing existing models while maintaining significantly fewer parameters.

Keywords

Detection of Lung infections, COVID-19, MaxViT, Vision transformer, Deep Learning

Supporting Institution

TÜSEB

Project Number

33934

Thanks

This work was supported by the grant provided by TÜSEB under the “2023-C1-YZ” call and Project No: “33934”. We would like to thank TÜSEB for their financial support and scientific contributions.

References

  1. Abdul Gafoor, S., Sampathila, N., Madhushankara, M., & Swathi, K. S. (2022). Deep learning model for detection of COVID-19 utilizing the chest X-ray images. Cogent Engineering, 9(1). https://doi.org/10.1080/23311916.2022.2079221
  2. Ahmad, M., Usama, ·, Bajwa, I., Mehmood, Y., Muhammad, ·, & Anwar, W. (n.d.). Lightweight ResGRU: a deep learning-based prediction of SARS-CoV-2 (COVID-19) and its severity classification using multimodal chest radiography images. Neural Computing and Applications. https://doi.org/10.1007/s00521-023-08200-0
  3. Ahmed, U., & Lin, J. C. W. (2023). Robust adversarial uncertainty quantification for deep learning fine-tuning. Journal of Supercomputing, 79(10), 11355–11386. https://doi.org/10.1007/s11227-023-05087-5
  4. Alshmrani, G. M. M., Ni, Q., Jiang, R., Pervaiz, H., & Elshennawy, N. M. (2023). A deep learning architecture for multi-class lung diseases classification using chest X-ray (CXR) images. Alexandria Engineering Journal, 64, 923–935. https://doi.org/10.1016/J.AEJ.2022.10.053
  5. Aslan, E. (2024). LSTM-ESA HİBRİT MODELİ İLE MR GÖRÜNTÜLERİNDEN BEYİN TÜMÖRÜNÜN SINIFLANDIRILMASI. Adıyaman Üniversitesi Mühendislik Bilimleri Dergisi, 11(22), 63–81. https://doi.org/10.54365/adyumbd.1391157
  6. Aslan, E., & Özüpak, Y. (2024). Classification of Blood Cells with Convolutional Neural Network Model. Bitlis Eren Üniversitesi Fen Bilimleri Dergisi, 13(1), 314–326. https://doi.org/10.17798/bitlisfen.1401294
  7. Aslani, S., & Jacob, J. (2023). Utilisation of deep learning for COVID-19 diagnosis. Clinical Radiology, 78(2), 150–157. https://doi.org/10.1016/J.CRAD.2022.11.006
  8. Ayan, E., Karabulut, B., & Ünver, H. M. (2022). Diagnosis of Pediatric Pneumonia with Ensemble of Deep Convolutional Neural Networks in Chest X-Ray Images. Arabian Journal for Science and Engineering, 47(2), 2123–2139. https://doi.org/10.1007/S13369-021-06127-Z/FIGURES/12
  9. Bao, H., Dong, L., Piao, S., & Wei, F. (2021). BEiT: BERT Pre-Training of Image Transformers. Mim, 1–18.
  10. Beyer, L., Izmailov, P., Kolesnikov, A., Caron, M., Kornblith, S., Zhai, X., Minderer, M., Tschannen, M., Alabdulmohsin, I., & Pavetic, F. (2022). FlexiViT: One Model for All Patch Sizes.
APA
Pacal, I. (2024). Improved Vision Transformer with Lion Optimizer for Lung Diseases Detection. International Journal of Engineering Research and Development, 16(2), 760-776. https://doi.org/10.29137/umagd.1469472
AMA
1.Pacal I. Improved Vision Transformer with Lion Optimizer for Lung Diseases Detection. IJERAD. 2024;16(2):760-776. doi:10.29137/umagd.1469472
Chicago
Pacal, Ishak. 2024. “Improved Vision Transformer With Lion Optimizer for Lung Diseases Detection”. International Journal of Engineering Research and Development 16 (2): 760-76. https://doi.org/10.29137/umagd.1469472.
EndNote
Pacal I (June 1, 2024) Improved Vision Transformer with Lion Optimizer for Lung Diseases Detection. International Journal of Engineering Research and Development 16 2 760–776.
IEEE
[1]I. Pacal, “Improved Vision Transformer with Lion Optimizer for Lung Diseases Detection”, IJERAD, vol. 16, no. 2, pp. 760–776, June 2024, doi: 10.29137/umagd.1469472.
ISNAD
Pacal, Ishak. “Improved Vision Transformer With Lion Optimizer for Lung Diseases Detection”. International Journal of Engineering Research and Development 16/2 (June 1, 2024): 760-776. https://doi.org/10.29137/umagd.1469472.
JAMA
1.Pacal I. Improved Vision Transformer with Lion Optimizer for Lung Diseases Detection. IJERAD. 2024;16:760–776.
MLA
Pacal, Ishak. “Improved Vision Transformer With Lion Optimizer for Lung Diseases Detection”. International Journal of Engineering Research and Development, vol. 16, no. 2, June 2024, pp. 760-76, doi:10.29137/umagd.1469472.
Vancouver
1.Ishak Pacal. Improved Vision Transformer with Lion Optimizer for Lung Diseases Detection. IJERAD. 2024 Jun. 1;16(2):760-76. doi:10.29137/umagd.1469472