The RNN-Based Deep Learning Model Design to Predict ICU Occupancy Rate and Number of Intubated Patients for Effective Healthcare System Management

Öz

Epidemics have been one of the most significant health threats in human history. Today, as new epidemics such as COVID-19 and Monkeypox emerge, it is critical for healthcare systems to be prepared for such crises. Predicting the progression of an epidemic is essential for healthcare systems to respond effectively. In this study, an artificial intelligence model design is proposed to predict the number of intubated and intensive care unit patients during a pandemic. LSTM, BiLSTM and GRU models belonging to the RNN family of machine learning algorithms are used in the predictor design and the grid search method is applied for hyperparameter optimization. In the design of the proposed model, the number of patients intubated and treated in intensive care during the COVID-19 pandemic in Türkiye is used as the dataset. The results show that the GRU model achieves the best performance with RMSE values of 15.7277 and 6.6494 for intensive care and intubated patient numbers, respectively, using an 80/20% train/test ratio. Similarly, GRU provides the highest accuracy with RMSE values of 9.9085 and 7.0271 for the same datasets using a 90/10% train/test ratio. These findings reveal that the simple structure of the GRU model, with fewer parameters and reduced computational complexity, is compatible with the dataset and provides better generalization capability, demonstrating that the deep learning model we designed can be used to predict the number of intensive care and intubated patients in order to facilitate healthcare system management in epidemic processes.

Anahtar Kelimeler

• Epidemic progression prediction
• Machine learning
• LSTM
• Bi-LSTM
• GRU

Kaynakça

1. Ahmar, A. S., & Del Val, E. B. (2020). SutteARIMA: Short-term forecasting method, a case: Covid-19 and stock market in Spain. Sci Total Environ, 729, 138883. https://doi.org/10.1016/j.scitotenv.2020.138883
2. Ankarali, H. (2020). Türkiye’de COVID-19 Salgın Sürecinde İhtiyaç Duyulacak Yoğun Bakım Yatak ve Solunum Cihazı Sayılarının Direkt Tahmini [Direct Prediction of the Number of Intensive Care Beds and Ventilators it Will be Needed for COVID-19 Outbreak in Turkey]. Anatolian Clinic the Journal of Medical Sciences, 25(Special Issue on COVID 19), 59-62. https://doi.org/10.21673/anadoluklin.715628
3. ArunKumar, K. E., Kalaga, D. V., Kumar, C. M. S., Kawaji, M., & Brenza, T. M. (2021). Forecasting of COVID-19 using deep layer Recurrent Neural Networks (RNNs) with Gated Recurrent Units (GRUs) and Long Short-Term Memory (LSTM) cells. Chaos, Solitons & Fractals, 146, 110861. https://doi.org/10.1016/j.chaos.2021.110861
4. ArunKumar, K. E., Kalaga, D. V., Mohan Sai Kumar, C., Kawaji, M., & Brenza, T. M. (2022). Comparative analysis of Gated Recurrent Units (GRU), long Short-Term memory (LSTM) cells, autoregressive Integrated moving average (ARIMA), seasonal autoregressive Integrated moving average (SARIMA) for forecasting COVID-19 trends. Alexandria Engineering Journal, 61(10), 7585-7603. https://doi.org/10.1016/j.aej.2022.01.011
5. Ayyoubzadeh, S. M., Ayyoubzadeh, S. M., Zahedi, H., Ahmadi, M., & S, R. N. K. (2020). Predicting COVID-19 Incidence Through Analysis of Google Trends Data in Iran: Data Mining and Deep Learning Pilot Study. JMIR Public Health Surveill, 6(2), e18828. https://doi.org/10.2196/18828
6. Chimmula, V. K. R., & Zhang, L. (2020). Time series forecasting of COVID-19 transmission in Canada using LSTM networks. Chaos, Solitons & Fractals, 135, 109864. https://doi.org/10.1016/j.chaos.2020.109864
7. Chowdhury, A. A., Hasan, K. T., & Hoque, K. K. S. (2021). Analysis and Prediction of COVID-19 Pandemic in Bangladesh by Using ANFIS and LSTM Network. Cognitive Computation, 13(3), 761-770. https://doi.org/10.1007/s12559-021-09859-0
8. Chung, J., Gulcehre, C., Cho, K., & Bengio, Y. (2014). Empirical evaluation of gated recurrent neural networks on sequence modeling. arXiv preprint arXiv:1412.3555. https://doi.org/10.48550/arXiv.1412.3555

9. Ciufolini, I., & Paolozzi, A. (2020). An improved mathematical prediction of the time evolution of the Covid-19 pandemic in Italy, with a Monte Carlo simulation and error analyses. Eur Phys J Plus, 135(6), 495. https://doi.org/10.1140/epjp/s13360-020-00488-4
10. Devaraj, J., Madurai Elavarasan, R., Pugazhendhi, R., Shafiullah, G. M., Ganesan, S., Jeysree, A. K.,…Hossain, E. (2021). Forecasting of COVID-19 cases using deep learning models: Is it reliable and practically significant? Results in Physics, 21, 103817. https://doi.org/10.1016/j.rinp.2021.103817
11. Dey, R., & Salem, F. M. (2017, 6-9 Aug. 2017). Gate-variants of Gated Recurrent Unit (GRU) neural networks. 2017 IEEE 60th International Midwest Symposium on Circuits and Systems (MWSCAS). https://doi.org/10.1109/MWSCAS.2017.8053243
12. Doğan, E. (2020). Analysis of the relationship between LSTM network traffic flow prediction performance and statistical characteristics of standard and nonstandard data. Journal of Forecasting, 39(8), 1213-1228. https://doi.org/10.1002/for.2683
13. Eid, M. M., El-Kenawy, E.-S. M., Khodadadi, N., Mirjalili, S., Khodadadi, E., Abotaleb, M.,…Khafaga, D. S. (2022). Meta-Heuristic Optimization of LSTM-Based Deep Network for Boosting the Prediction of Monkeypox Cases. Mathematics, 10(20), 3845. https://doi.org/10.3390/math10203845
14. Elsadany, A. A., Aldurayhim, A., & Elsonbaty, A. (2023). On forecasting of COVID-19 transmission in Saudi Arabia and Egypt using reservoir computing model. Alexandria Engineering Journal, 70, 115-131. https://doi.org/10.1016/j.aej.2023.02.028
15. Elsonbaty, A., Adel, W., Aldurayhim, A., & El-Mesady, A. (2024). Mathematical modeling and analysis of a novel monkeypox virus spread integrating imperfect vaccination and nonlinear incidence rates. Ain Shams Engineering Journal, 15(3), 102451. https://doi.org/10.1016/j.asej.2023.102451
16. Epstein, R. H., & Dexter, F. (2020). A Predictive Model for Patient Census and Ventilator Requirements at Individual Hospitals During the Coronavirus Disease 2019 (COVID-19) Pandemic: A Preliminary Technical Report. Cureus, 12(6), e8501. https://doi.org/10.7759/cureus.8501
17. Gao, Y., Zhang, Z., Yao, W., Ying, Q., Long, C., & Fu, X. (2020). Forecasting the cumulative number of COVID-19 deaths in China: a Boltzmann function-based modeling study. Infect Control Hosp Epidemiol, 41(7), 841-843. https://doi.org/10.1017/ice.2020.101
18. Gomez-Cravioto, D. A., Diaz-Ramos, R. E., Cantu-Ortiz, F. J., & Ceballos, H. G. (2024). Data Analysis and Forecasting of the COVID-19 Spread: A Comparison of Recurrent Neural Networks and Time Series Models. Cognitive Computation, 16(4), 1794-1805. https://doi.org/10.1007/s12559-021-09885-y
19. Hochreiter, S. (1998). The Vanishing Gradient Problem During Learning Recurrent Neural Nets and Problem Solutions. International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems, 06(02), 107-116. https://doi.org/10.1142/s0218488598000094
20. Hochreiter, S., & Schmidhuber, J. (1997). Long Short-Term Memory. Neural Computation, 9(8), 1735-1780. https://doi.org/10.1162/neco.1997.9.8.1735
21. Kara, A. (2024). Accurate detection of coronavirus cases using deep learning with attention mechanism and genetic algorithm. Multimedia Tools and Applications, 83(34), 81477-81490. https://doi.org/10.1007/s11042-024-18850-4
22. Khan, M. A., Khan, R., Algarni, F., Kumar, I., Choudhary, A., & Srivastava, A. (2022). Performance evaluation of regression models for COVID-19: A statistical and predictive perspective. Ain Shams Engineering Journal, 13(2), 101574. https://doi.org/10.1016/j.asej.2021.08.016
23. Le, T.-T.-H., Oktian, Y. E., Jo, U., & Kim, H. (2023). Time Series Electrical Motor Drives Forecasting Based on Simulation Modeling and Bidirectional Long-Short Term Memory. Sensors, 23(17), 7647. https://doi.org/10.3390/s23177647
24. Lymperopoulos, I. N. (2023). CovidCurve: curve fitting modeling and early forecasting of the size and duration of Covid-19 outbreaks. Applied Intelligence, 53(23), 29043-29075. https://doi.org/10.1007/s10489-023-05011-7
25. Mishra, S., Singh, T., Kumar, M., & Satakshi. (2024). Multivariate time series short term forecasting using cumulative data of coronavirus. Evolving Systems, 15(3), 811-828. https://doi.org/10.1007/s12530-023-09509-w
26. Naeem, M., Khan Mashwani, W., Abiad, M., Shah, H., Khan, Z., & Aamir, M. (2023). Soft computing techniques for forecasting of COVID-19 in Pakistan. Alexandria Engineering Journal, 63, 45-56. https://doi.org/10.1016/j.aej.2022.07.029
27. Qasem, S. N. (2024). A novel honey badger algorithm with multilayer perceptron for predicting COVID-19 time series data. The Journal of Supercomputing, 80(3), 3943-3969. https://doi.org/10.1007/s11227-023-05560-1
28. Raslan, W. E. (2021). Fractional mathematical modeling for epidemic prediction of COVID-19 in Egypt. Ain Shams Engineering Journal, 12(3), 3057-3062. https://doi.org/10.1016/j.asej.2020.10.027
29. Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986). Learning representations by back-propagating errors. Nature, 323(6088), 533-536. https://doi.org/10.1038/323533a0
30. Sağlık Bakanlığı, T. C. Retrieved 30.07.2020 from https://covid19.saglik.gov.tr/
31. Schuster, M., & Paliwal, K. K. (1997). Bidirectional recurrent neural networks. IEEE Transactions on Signal Processing, 45(11), 2673-2681. https://doi.org/10.1109/78.650093
32. Seabe, P. L., Moutsinga, C. R. B., & Pindza, E. (2023). Forecasting Cryptocurrency Prices Using LSTM, GRU, and Bi-Directional LSTM: A Deep Learning Approach. Fractal and Fractional, 7(2), 203. https://doi.org/10.3390/fractalfract7020203
33. Shahid, F., Zameer, A., & Muneeb, M. (2020). Predictions for COVID-19 with deep learning models of LSTM, GRU and Bi-LSTM. Chaos, Solitons & Fractals, 140, 110212. https://doi.org/10.1016/j.chaos.2020.110212
34. Shastri, S., Singh, K., Kumar, S., Kour, P., & Mansotra, V. (2020). Time series forecasting of Covid-19 using deep learning models: India-USA comparative case study. Chaos, Solitons & Fractals, 140, 110227. https://doi.org/10.1016/j.chaos.2020.110227
35. Sheikhi, F., & Kowsari, Z. (2023). Time series forecasting of COVID-19 infections and deaths in Alpha and Delta variants using LSTM networks. PLOS ONE, 18(10), e0282624. https://doi.org/10.1371/journal.pone.0282624
36. Shukla, S. S. P., Jain, V. K., Yadav, A. K., & Pandey, S. K. (2024). Fourth wave Covid19 analyzing using mathematical seirs epidemic model & deep neural network. Multimedia Tools and Applications, 83(9), 27507-27526. https://doi.org/10.1007/s11042-023-16609-x
37. Tomar, A., & Gupta, N. (2020). Prediction for the spread of COVID-19 in India and effectiveness of preventive measures. Sci Total Environ, 728, 138762. https://doi.org/10.1016/j.scitotenv.2020.138762
38. Yildirim, S., Durmusoglu, A., Sevim, C., Bingol, M. S., & Kalkat, M. (2022). Design of neural predictors for predicting and analysing COVID-19 cases in different regions. Neural Network World, 32(5), 233. https://doi.org/10.14311/NNW.2022.32.014
39. Zeynep, C. (2020). Estimation of COVID-19 prevalence in Italy, Spain, and France. Science of The Total Environment, 729, 138817. https://doi.org/10.1016/j.scitotenv.2020.138817
40. Zhang, A., Lipton, Z. C., Li, M., & Smola, A. J. (2023). Dive into deep learning. Cambridge University Press.
41. Zhang, R., Chen, Z., Chen, S., Zheng, J., Büyüköztürk, O., & Sun, H. (2019). Deep long short-term memory networks for nonlinear structural seismic response prediction. Computers & Structures, 220, 55-68. https://doi.org/10.1016/j.compstruc.2019.05.006
42. Zhou, L., Zhao, C., Liu, N., Yao, X., & Cheng, Z. (2023). Improved LSTM-based deep learning model for COVID-19 prediction using optimized approach. Engineering Applications of Artificial Intelligence, 122, 106157. https://doi.org/10.1016/j.engappai.2023.106157