Bayesian Optimization-based CNN Framework for Automated Detection of Brain Tumors

Abstract

Brain tumors, capable of yielding fatal outcomes, can now be identified through MRI images. However, their heterogeneous nature introduces challenges and time-consuming aspects to manual detection. This study aims to design the optimal architecture, leveraging Convolutional Neural Networks (CNNs), for the automatic identification of brain tumor types within medical images. CNN architectures frequently face challenges of overfitting during the training phase, mainly attributed to the dual complexities of limited labeled datasets and complex models within the medical domain. The depth and width hyperparameters in these architectures play a crucial role, in determining the extent of learning parameters engaged in the learning process. These parameters, encompassing filter weights, fundamentally shape the performance of the model. In this context, it is quite difficult to manually determine the optimum depth and width hyperparameters due to many combinations. With Bayesian optimization and Gaussian process, we identified models with optimum architecture from hyperparameter combinations. We performed the training process with two different datasets. With the test data of dataset 1, we reached 98.01% accuracy and 98% F1 score values. With the test data of dataset 2, which has more data, 99.62% accuracy and F1 score values were obtained. The models we have derived will prove valuable to clinicians for the purpose of brain tumor detection.

Keywords

• Deep learning
• CNN
• Bayesian optimization
• Brain tumor.

References

1. [1] Siegel, R. L., Miller, K. D., & Jemal, A. (2019). Cancer statistics, 2019. CA: a cancer journal for clinicians, 69(1), 7-34.
2. [2] Bhatele, K. R., & Bhadauria, S. S. (2020). Brain structural disorders detection and classification approaches: a review. Artificial Intelligence Review, 53(5), 3349-3401.
3. [3] Nazir, M., Shakil, S., & Khurshid, K. (2021). Role of deep learning in brain tumor detection and classification (2015 to 2020): A review. Computerized Medical Imaging and Graphics, 91, 101940.
4. [4] Sharif, M. I., Li, J. P., Naz, J., & Rashid, I. (2020). A comprehensive review on multi-organs tumor detection based on machine learning. Pattern Recognition Letters, 131, 30-37.
5. [5] Kaya, M. and Çetin-Kaya, Y. (2021). Seamless computation offloading for mobile applications using an online learning algorithm. Computing, vol. 103, no.5, pp. 771-799.
6. [6] Miao, Y., Wu, G., Li, M., Ghoneim, A., Al-Rakhami, M., & Hossain, M. S. (2020). Intelligent task prediction and computation offloading based on mobile-edge cloud computing. Future Generation Computer Systems, 102, 925-931.
7. [7] Rashed, A. E. E., Elmorsy, A. M., & Atwa, A. E. M. (2023). Comparative evaluation of automated machine learning techniques for breast cancer diagnosis. Biomedical Signal Processing and Control, 86, 105016.
8. [8] LeCun, Y., Bengio, Y., & Hinton, G. (2015). Deep learning. nature, 521(7553), 436-444.

9. [9] Alzubaidi, L., Zhang, J., Humaidi, A.J., Al-Dujaili, A., Duan, Y., Al-Shamma, O., Santamaría, J., Fadhel, M.A., Al-Amidie, M. and Farhan, L., (2021). Review of deep learning: Concepts, CNN architectures, challenges, applications, future directions. Journal of big Data, 8(1), pp.1-74.
10. [10] Mehnatkesh, H., Jalali, S. M. J., Khosravi, A., & Nahavandi, S. (2023). An intelligent driven deep residual learning framework for brain tumor classification using MRI images. Expert Systems with Applications, 213, 119087.
11. [11] Liu, Z., Tong, L., Chen, L., Jiang, Z., Zhou, F., Zhang, Q., ... & Zhou, H. (2023). Deep learning based brain tumor segmentation: a survey. Complex & intelligent systems, 9(1), 1001-1026.
12. [12] Krizhevsky, A., Sutskever I. and Hinton G. E. (2012). ImageNet classification with deep convolutional neural networks," Proc - Neural Information Processing System Conference, pp. 1-9.
13. [13] Toğaçar, M., Ergen, B., & Cömert, Z. (2020). BrainMRNet: Brain tumor detection using magnetic resonance images with a novel convolutional neural network model. Medical hypotheses, 134, 109531.
14. [14] Toğaçar, M., Cömert, Z., & Ergen, B. (2020). Classification of brain MRI using hyper column technique with convolutional neural network and feature selection method. Expert Systems with Applications, 149, 113274.
15. [15] Balamurugan, T., & Gnanamanoharan, E. (2023). Brain tumor segmentation and classification using hybrid deep CNN with LuNetClassifier. Neural Computing and Applications, 35(6), 4739-4753.
16. [16] Deepak, S., & Ameer, P. M. (2019). Brain tumor classification using deep CNN features via transfer learning. Computers in biology and medicine, 111, 103345.
17. [17] Başaran, E. (2022). A new brain tumor diagnostic model: Selection of textural feature extraction algorithms and convolution neural network features with optimization algorithms. Computers in Biology and Medicine, 148, 105857.
18. [18] Ayadi, W., Elhamzi, W., Charfi, I., & Atri, M. (2021). Deep CNN for brain tumor classification. Neural processing letters, 53, 671-700.
19. [19] Ait Amou, M., Xia, K., Kamhi, S., & Mouhafid, M. (2022). A Novel MRI Diagnosis Method for Brain Tumor Classification Based on CNN and Bayesian Optimization. In Healthcare (Vol. 10, No. 3, p. 494). MDPI.
20. [20] Alhassan, A. M., & Zainon, W. M. N. W. (2021). Brain tumor classification in magnetic resonance image using hard swish-based RELU activation function-convolutional neural network. Neural Computing and Applications, 33, 9075-9087.
21. [21] Aurna, N. F., Yousuf, M. A., Taher, K. A., Azad, A. K. M., & Moni, M. A. (2022). A classification of MRI brain tumor based on two stage feature level ensemble of deep CNN models. Computers in biology and medicine, 146, 105539.
22. [22] Kazemi, A., Shiri, M. E., & Sheikhahmadi, A. (2022). Classifying tumor brain images using parallel deep learning algorithms. Computers in Biology and Medicine, 148, 105775.
23. [23] Gómez-Guzmán, M.A., Jiménez-Beristain, L., García-Guerrero, E.E., López-Bonilla, O.R., Tamayo-Pérez, U.J., Esqueda-Elizondo, J.J., Palomino-Vizcaino, K. & Inzunza-González, E. (2023). Classifying brain tumors on magnetic resonance imaging by using convolutional neural networks. Electronics, 12, 955.
24. [24] Türkoğlu, M. (2021). Brain Tumor Detection using a combination of Bayesian optimization based SVM classifier and fine-tuned based deep features. Avrupa Bilim ve Teknoloji Dergisi, (27), 251-258.
25. [25] Mondal, A., & Shrivastava, V. K. (2022). A novel Parametric Flatten-p Mish activation function based deep CNN model for brain tumor classification. Computers in Biology and Medicine, 150, 106183.
26. [26] Saurav, S., Sharma, A., Saini, R., & Singh, S. (2023). An attention-guided convolutional neural network for automated classification of brain tumor from MRI. Neural Computing and Applications, 35(3), 2541-2560.
27. [27] Turk, O., Ozhan, D., Acar, E., Akinci, T. C., & Yilmaz, M. (2022). Automatic detection of brain tumors with the aid of ensemble deep learning architectures and class activation map indicators by employing magnetic resonance images. Zeitschrift für Medizinische Physik. https://doi.org/10.1016/j.zemedi.2022.11.010
28. [28] Alanazi, M.F.; Ali, M.U.; Hussain, S.J.; Zafar, A.; Mohatram, M.; Irfan, M.; Albarrak, A.M. (2022). Brain tumor/mass classification ramework using magnetic-resonance-imaging-based isolated and developed transfer deep-learning model. Sensors, 22, 372
29. [29] Kang, J., Ullah, Z., & Gwak, J. (2021). Mri-based brain tumor classification using ensemble of deep features and machine learning classifiers. Sensors, 21(6), 2222.
30. [30] Nergiz, M. (2023). Classification of Precancerous Colorectal Lesions via ConvNeXt on Histopathological Images. Balkan Journal of Electrical and Computer Engineering, 11(2), 129-137.
31. [31] Sartaj Bhuvaji, Brain tumor classifcation (MRI). https://www.kaggle.com/sartajbhuvaji/brain-tumor-classifcation-mri, 2020. (Accessed 1 Jan 2023).
32. [32] Masoud Nickparvar, Brain Tumor MRI Dataset. https://www.kaggle.com/datasets/masoudnickparvar/brain-tumor-mri-dataset?select=Training (Accessed 5 Jan 2023).
33. [33] Fernandes, V., Junior, G. B., de Paiva, A. C., Silva, A. C., & Gattass, M. (2021). Bayesian convolutional neural network estimation for pediatric pneumonia detection and diagnosis. Computer Methods and Programs in Biomedicine, 208, 106259.
34. [34] Pelikan, M., Goldberg, D. E., & Cantú-Paz, E. (1999). BOA: The Bayesian optimization algorithm. In Proceedings of the genetic and evolutionary computation conference GECCO-99 (Vol. 1, No. 1999).
35. [35] Brochu, E., Cora, V. M., & De Freitas, N. (2010). A tutorial on Bayesian optimization of expensive cost functions, with application to active user modeling and hierarchical reinforcement learning. arXiv preprint arXiv:1012.2599.
36. [36] Bergstra, J., Bardenet, R., Bengio, Y., & Kégl, B. (2011). Algorithms for hyper-parameter optimization. Advances in neural information processing systems, 24.
37. [37] Frazier, P. I. (2018). A tutorial on Bayesian optimization. arXiv preprint arXiv:1807.02811.
38. [38] Kaya, M., Ulutürk, S., Çetin Kaya, Y., Altıntaş, O., & Turan, B. (2023). Optimization of Several Deep CNN Models for Waste Classification. Ahmet ZENGIN, Sakarya University, Türkiye, azengin@ sakarya. edu. tr, 6(2), 91.
39. [39] Koukoulas, S., & Blackburn, G. A. (2001). Introducing new indices for accuracy evaluation of classified images representing semi-natural woodland environments. Photogrammetric Engineering and Remote Sensing, 67(4), 499-510.