A Hybrid Model Based on Deep Features and Ensemble Learning for the Diagnosis of COVID-19: DeepFeat-E

Abstract

COVID-19, which has been declared a pandemic disease, has affected the lives of millions of people and caused a major epidemic. Despite the development of vaccines and vaccination to prevent the transmission of the disease, COVID-19 case rates fluctuate worldwide. Therefore, rapid and reliable diagnosis of COVID-19 disease is of critical importance. For this purpose, a hybrid model based on transfer learning methods and ensemble classifiers is proposed in this study. In this hybrid approach, called DeepFeat-E, the diagnosis process is performed by using deep features obtained from transfer learning models and ensemble classifiers consisting of classical machine learning methods. To test the proposed approach, a dataset of 21,165 X-ray images including 10,192 Normal, 6012 Lung Opacity, 1345 Viral Pneumonia and 3616 COVID-19 were used. With the proposed approach, the highest accuracy was achieved with the deep features of the DenseNet201 transfer learning model and the Stacking ensemble learning method. Accordingly, the test accuracy was 90.17%, 94.99% and 94.93% for four, three and two class applications, respectively. According to the results obtained in this study, it is seen that the proposed hybrid system can be used quickly and reliably in the diagnosis of COVID-19 and lower respiratory tract infections.

Keywords

• COVID-19
• Deep Features
• Transfer Learning
• Ensemble Classifier

References

1. Kumari S, Ranjith E, Gujjar A, Narasimman S, Zeelani HSAS. Comparative analysis of deep learning models for COVID-19 detection. Global Transitions Proceedings 2021;2:559–65.
2. Pang L, Liu S, Zhang X, Tian T, Zhao Z. Transmission dynamics and control strategies of COVID-19 in Wuhan, China. J Biol Syst 2020;28:543–60.
3. Abir FF, Alyafei K, Chowdhury MEH, Khandakar A, Ahmed R, Hossain MM, et al. PCovNet: A presymptomatic COVID-19 detection framework using deep learning model using wearables data. Comput Biol Med 2022;147:105682.
4. Lewnard JA, Lo NC. Scientific and ethical basis for social-distancing interventions against COVID-19. Lancet Infect Dis 2020;20:631–3.
5. Makris A, Kontopoulos I, Tserpes K. COVID-19 detection from chest X-Ray images using Deep Learning and Convolutional Neural Networks. 11th hellenic conference on artificial intelligence, 2020, p. 60–6.
6. Wang Y, Kang H, Liu X, Tong Z. Combination of RT‐qPCR testing and clinical features for diagnosis of COVID‐19 facilitates management of SARS‐CoV‐2 outbreak. J Med Virol 2020.
7. Verma SS, Prasad A, Kumar A. CovXmlc: High performance COVID-19 detection on X-ray images using Multi-Model classification. Biomed Signal Process Control 2022;71:103272.
8. Tung H, Tekin R. New Feature Extraction Approaches Based on Spatial Points for Visual-Only Lip-Reading. Traitement Du Signal 2022;39.

9. Noyan T, Kuncan F, Tekin R, Kaya Y. A new content-free approach to identification of document language: Angle patterns. Journal of the Faculty of Engineering and Architecture of Gazi University 2022;37:1277–92.
10. Kuncan F, Kaya Y, Tekin R, Kuncan M. A new approach for physical human activity recognition based on co-occurrence matrices. J Supercomput 2022;78:1048–70.
11. Kaya Y, Tekin R. A Novel Feature Extraction Method for Classification of Epileptic EEG Signals. Journal of Natural & Applied Sciences 2018.
12. Kaya Y, Kuncan F, Tekin R. A New Approach for Congestive Heart Failure and Arrhythmia Classification Using Angle Transformation with LSTM. Arab J Sci Eng 2022:1–17.
13. Sobahi N, Atila O, Deniz E, Sengur A, Acharya UR. Explainable COVID-19 detection using fractal dimension and vision transformer with Grad-CAM on cough sounds. Biocybern Biomed Eng 2022;42:1066–80.
14. Ren Z, Chang Y, Bartl-Pokorny KD, Pokorny FB, Schuller BW. The acoustic dissection of cough: diving into machine listening-based COVID-19 analysis and detection. MedRxiv 2022.
15. Ahamed KU, Islam M, Uddin A, Akhter A, Paul BK, Yousuf MA, et al. A deep learning approach using effective preprocessing techniques to detect COVID-19 from chest CT-scan and X-ray images. Comput Biol Med 2021;139:105014.
16. Ozcan T. A new composite approach for COVID-19 detection in X-ray images using deep features. Appl Soft Comput 2021;111:107669.
17. Gilanie G, Bajwa UI, Waraich MM, Asghar M, Kousar R, Kashif A, et al. Coronavirus (COVID-19) detection from chest radiology images using convolutional neural networks. Biomed Signal Process Control 2021;66:102490.
18. Basu A, Sheikh KH, Cuevas E, Sarkar R. COVID-19 detection from CT scans using a two-stage framework. Expert Syst Appl 2022;193:116377.
19. Chowdhury MEH, Rahman T, Khandakar A, Mazhar R, Kadir MA, Mahbub Z bin, et al. Can AI help in screening viral and COVID-19 pneumonia? IEEE Access 2020;8:132665–76.
20. Mahmud T, Rahman MA, Fattah SA. CovXNet: A multi-dilation convolutional neural network for automatic COVID-19 and other pneumonia detection from chest X-ray images with transferable multi-receptive feature optimization. Comput Biol Med 2020;122:103869.
21. Karim MR, Döhmen T, Cochez M, Beyan O, Rebholz-Schuhmann D, Decker S. Deepcovidexplainer: explainable COVID-19 diagnosis from chest X-ray images. 2020 IEEE International Conference on Bioinformatics and Biomedicine (BIBM), IEEE; 2020, p. 1034–7.
22. Tang S, Wang C, Nie J, Kumar N, Zhang Y, Xiong Z, et al. EDL-COVID: Ensemble deep learning for COVID-19 case detection from chest X-ray images. IEEE Trans Industr Inform 2021;17:6539–49.
23. Banerjee A, Sarkar A, Roy S, Singh PK, Sarkar R. COVID-19 chest X-ray detection through blending ensemble of CNN snapshots. Biomed Signal Process Control 2022;78:104000.
24. Gour M, Jain S. Automated COVID-19 detection from X-ray and CT images with stacked ensemble convolutional neural network. Biocybern Biomed Eng 2022;42:27–41.
25. Apostolopoulos ID, Mpesiana TA. Covid-19: automatic detection from x-ray images utilizing transfer learning with convolutional neural networks. Phys Eng Sci Med 2020;43:635–40.
26. Ozturk T, Talo M, Yildirim EA, Baloglu UB, Yildirim O, Acharya UR. Automated detection of COVID-19 cases using deep neural networks with X-ray images. Comput Biol Med 2020;121:103792.
27. Khan AI, Shah JL, Bhat MM. CoroNet: A deep neural network for detection and diagnosis of COVID-19 from chest x-ray images. Comput Methods Programs Biomed 2020;196:105581.
28. Huang M-L, Liao Y-C. A lightweight CNN-based network on COVID-19 detection using X-ray and CT images. Comput Biol Med 2022:105604.
29. Islam MK, Habiba SU, Khan TA, Tasnim F. COV-RadNet: A Deep Convolutional Neural Network for Automatic Detection of COVID-19 from Chest X-Rays and CT Scans. Computer Methods and Programs in Biomedicine Update 2022;2:100064.
30. Rahman T, Khandakar A, Qiblawey Y, Tahir A, Kiranyaz S, Kashem SBA, et al. Exploring the effect of image enhancement techniques on COVID-19 detection using chest X-ray images. Comput Biol Med 2021;132:104319.
31. Chollet F. Xception: Deep learning with depthwise separable convolutions. Proceedings of the IEEE conference on computer vision and pattern recognition, 2017, p. 1251–8.
32. Zoph B, Vasudevan V, Shlens J, Le Q v. Learning transferable architectures for scalable image recognition. Proceedings of the IEEE conference on computer vision and pattern recognition, 2018, p. 8697–710.
33. Howard AG, Zhu M, Chen B, Kalenichenko D, Wang W, Weyand T, et al. Mobilenets: Efficient convolutional neural networks for mobile vision applications. ArXiv Preprint ArXiv:170404861 2017.
34. Huang G, Liu Z, van der Maaten L, Weinberger KQ. Densely connected convolutional networks. Proceedings of the IEEE conference on computer vision and pattern recognition, 2017, p. 4700–8.
35. Simonyan K, Zisserman A. Very deep convolutional networks for large-scale image recognition. ArXiv Preprint ArXiv:14091556 2014.
36. Szegedy C, Vanhoucke V, Ioffe S, Shlens J, Wojna Z. Rethinking the inception architecture for computer vision. Proceedings of the IEEE conference on computer vision and pattern recognition, 2016, p. 2818–26.
37. He K, Zhang X, Ren S, Sun J. Identity mappings in deep residual networks. European conference on computer vision, Springer; 2016, p. 630–45.
38. Sarkar D, Bali R, Ghosh T. Hands-On Transfer Learning with Python: Implement advanced deep learning and neural network models using TensorFlow and Keras. Packt Publishing Ltd; 2018.
39. Zhou K, Greenspan H, Shen D. Deep learning for medical image analysis. Academic Press; 2017.
40. Geurts P, Ernst D, Wehenkel L. Extremely randomized trees. Mach Learn 2006;63:3–42.
41. Li J, Cheng K, Wang S, Morstatter F, Trevino RP, Tang J, et al. Feature selection: A data perspective. ACM Computing Surveys (CSUR) 2017;50:1–45.
42. Zhou Z-H. Ensemble methods: foundations and algorithms. CRC press; 2012.
43. Wolpert DH. Stacked generalization. Neural Networks 1992;5:241–59.
44. Bohmrah MK, Kaur H. Classification of Covid-19 patients using efficient fine-tuned deep learning DenseNet model. Global Transitions Proceedings 2021;2:476–83.