Performance evaluation of classifier algorithms with Python for heart disease risk prediction

Abstract

Heart diseases are one of the biggest health problems of today. Early diagnosis for the disease can prevent early deaths. For this purpose, by using 13 independent variables in the data set obtained from the Kaggle database, people with low probability of heart disease and people with excess were tried to be distinguished. Seven classification algorithms were used in the study, namely support vector machines (SVM), k-NN, decision trees, linear discriminant analysis (LDA), Gausian Naive Bayes (GNB), Gradient Boosting (GB) and Random Forest (RF). Random forest was the algorithm that made the best estimation of the study according to the values of specificity (100%), Matthews correlation coefficient (0.90), Fowlkes-Mallows index (0.82), F1 score (89.7%) and accuracy (90.2%). There was no statistically significant difference between the groups in fasting blood glucose and it was found to be the least important among the features. No significant performance change was observed in the classification processes made by removing this feature. Only the processing times are slightly shorter. This study will help predict heart disease as it will support early diagnosis.

Keywords

• Heart disease
• prediction
• classifiers
• Python

Kalp hastalık risk tahmini için Python aracılığıyla sınıflandırıcı algoritmalarının performans değerlendirmesi

Abstract

Kalp hastalıkları, günümüzün en büyük sağlık problemlerinden birisidir. Hastalık için erken teşhis, erken ölümlerin önüne geçilebilir. Bu amaçla Kaggle veri tabanından elde dilen veri setinde bulunan 13 bağımsız değişken kullanılarak kalp hastalığı olma olasılığı az (KHOA) ve fazla (KHOF) olan kişiler ayırt edilmeye çalışılmıştır. Çalışmada destek vektör makinaları (DVM), k-en yakın komşu (k-NN), karar ağaçları (KA), lineer diskriminant analiz (LDA), Gausian Naive Bayes (GNB), Gradient Boosting (GB) ve Random Forest (RF) olmak üzere 7 sınıflandırma algoritması kullanılmıştır. Random forest, özgüllük (%100), Matthews korelasyon katsayısı (0.90), Fowlkes-Mallows indeks (0.82), F1 skoru (%89.7) ve doğruluk (%90.2) değerlerine göre çalışmanın en iyi tahminini yapan algoritması olmuştur. Açlık kan şekeri, KHOA ve KHOF grupları arasında istatiksel olarak anlamlı fark saptanamamış ve özellikler arasında en az önemli olduğu bulunmuştur. Bu özellik çıkarılarak yapılan sınıflandırma işlemlerinde önemli bir performans değişikliği görülmemiştir. Sadece işlem zamanları, az da olsa kısalmıştır. Bu çalışma, erken teşhislere destek olacağından dolayı kalp hastalığının tahmininde fayda sağlayacaktır.

Keywords

• Kalp hastalığı
• Tahmin
• sınıflandırıcılar
• Python

References

1. [1] World Health Organization, Cardiovascular Diseases, https://www.who.int/health-topics/cardiovascular-diseases/#tab=tab_1 (Erişim Tarihi: 12.07.2020).
2. [2] Anbarasi, M., Anupriya, E., Iyengar, N.C.H.S.N. 2010. Enhanced prediction of heart Disease with feature subset selection using genetic algorithm, International Journal of Engineering Science and Technology, Cilt. 2, s. 5370-5376.
3. [3] Palaniappan, S., Awang, R. 2008. Intelligent heart disease prediction system using data mining techniques, International Journal of Computer Science and Network Security, Cilt. 8, s. 343-350.
4. [4] Nahar, J., Imam, T., Tickle, K.S., Chen,Y.-P.P. 2013. Computational intelligence for heart disease diagnosis: A medical knowledge driven approach, Expert Systems with Applications, Cilt. 40, s. 96-104. DOI: 10.1016/j.eswa.2012.07.032.
5. [5] Soman, K.P., Shyam, D.M., Madhavdas, P. 2003. Efficient classification and analysis of ischemic heart disease using proximal support vector machines based decision trees. Conference on convergent technologies for AsiaPacific region, 15-17 Oct., Bangalore, India, 214-217. DOI: 10.1109/TENCON.2003.1273317
6. [6] Kim, B.-H., Lee, S.-H., Cho, D.-U., Oh, S.-Y. 2008. A proposal of heart diseases diagnosis method using analysis of face color. International conference on advanced language processing and web information technology, 23-25 July, Dalian Liaoning, China, 220-225. DOI: 10.1109/ALPIT.2008.27
7. [7] Gamboa, A.L.G., Mendoza, M.G., Orozco, R.E.I., VARGAS, J.M., Gress, N.H. 2006. Hybrid Fuzzy-SV clustering for heart disease identification, Computational intelligence for modelling International conference on control and automation, and international conference on intelligent agents, web technologies and internet commerce, 28 Nov.-1 Dec., Sydney, NSW, Australia. DOI: 10.1109/CIMCA.2006.114
8. [8] Zheng, J., Jiang, Y., Yan, H. 2006. Committee machines with ensembles of multilayer perceptron for the support of diagnosis of heart diseases. Proceedings of the international conference on, communications, circuits and systems, 25-28 June, Guilin, China, 2046-2050. DOI: 10.1109/ICCCAS.2006.285080

9. [9] Obayya, M., Abou-chadi, F. 2008. Data fusion for heart diseases classification using multi-layer feed forward neural network. International conference on computer engineering&systems, ICCES, 25-27 Nov., Cairo, Egypt, 67-70. DOI: 10.1109/ICCES.2008.4772968
10. [10] Avci, E. 2009. A new intelligent diagnosis system for the heart valve diseases by using genetic-SVM classifier, Expert Systems with Applications, Cilt. 36, s. 10618–10626. DOI: 10.1016/j.eswa.2009.02.053
11. [11] Maglogiannis, I., Loukis, E., Zafiropoulos, E., Stasis, S. 2009. Support vectors machine-based identification of heart valve diseases using heart sounds, Computer Methods and Programs in Biomedicine, Cilt. 95, s. 47–61. DOI: 10.1016/j.cmpb.2009.01.003
12. [12] Chen, A.H., Huang, S.Y., Hong, P.S., Cheng, C.H., Lin, E.J. 2011. HDPS: Heart Disease Prediction System, Computing in Cardiology, Cilt. 38, s. 557-560.
13. [13] Patel, J., Tejalupadhyay, S., Patel, S.B. 2016. Heart Disease Prediction Using Machine learning and Data Mining Technique, International Journal of Computer Science & Communication, Cilt. 7, s. 129-137. DOI: 10.090592/IJCSC.2016.018
14. [14] Jarad, A., Katkar, R., Shaikh, A.R., Salve, A. 2015. Intelligent Heart Disease Prediction System with MongoDB, International Journal of Emerging Trends & Technology in Computer Science, Cilt. 4, s. 236-239.
15. [15] Enriko, I.K.A., Suryanegara, M., Gunawan, D. 2016. Heart Disease Prediction System using k-Nearest Neighbor Algorithm with Simplified Patient’s Health Parameters, Journal of Telecommunication, Electronic and Computer Engineering (JTEC), Cilt. 8, s. 59-65.
16. [16] Shao, Y.E., Hou, C.-D., Chiu, C.-C. 2014. Hybrid intelligent modeling schemes for heart disease classification, Applied Soft Computing, Cilt. 14, s. 47-52. DOI: 10.1016/j.asoc.2013.09.020
17. [17] Taşçı, M.E., Şamlı, R. 2020. Veri Madenciliği İle Kalp Hastalığı Teşhisi, Avrupa Bilim ve Teknoloji Dergisi, Özel sayi:88-95. DOI: 10.31590/ejosat.araconf12
18. [18] Tunç, Z., Cicek, I.B., Guldogan E. 2020. Performance evaluation of the deep learning models in the classification of heart attack and determination of related factors, The Journal of Cognitive Systems, Cilt. 5 s. 99-103. https://dergipark.org.tr/tr/pub/jcs/issue/59409/801555
19. [19] Akalın, B., Veranyurt, Ü., Veranyurt, O. 2020. Classification of individuals at risk of heart disease using machine learning, Cumhuriyet Medical Journal, Cilt 42, s. 283-289. DOI: 10.7197/cmj.vi.742161
20. [20] Khan, I.H., Mondal, R.H.M. 2020. Data-Driven Diagnosis of Heart Disease, International Journal of Computer Applications, Cilt 176, s. 46-54. DOI: 10.5120/ijca2020920549
21. [21] Tougui, I., Jilbab, A., El Mhamdi, J. 2020.Heart disease classification using data mining tools and machine learning techniques, Health Technol., Cilt.10, s.1137–1144. DOI: 10.1007/s12553-020-00438-1
22. [22] Datasets. “Health care: Data set on heart attack possibility”. https://www.kaggle.com/nareshbhat/health-care-data-set-on-heart-attack possibility?select=heart.csv (Erişim Tarihi: 10.07.2020).
23. [23] Aburomma, A.A., Reaz M.B.I. 2017. A novel weighted support vector machines multiclass classifier based on differential evolution for intrusion detection systems, Information Sciences, Cilt. 414, s. 225-246. DOI: 10.1016/j.ins.2017.06.007
24. [24] Kausar, N., Samir, B.B., Sulaiman, S.B., Ahmad, I., Hussain, M. 2012. An approach towards intrusion detection using pca feature subsets and svm. 2012 International Conference on Computer & Information Science (ICCIS), 12-14 June, Kuala Lumpeu, Malaysia, 569-574. DOI: 10.1109/ICCISci.2012.6297095
25. [25] Taharwat, A., Mahdi, H., Elhoseny, M., Hassanien, A.E. 2018. Recognizing human activity in mobile crowd sensing environment using optimized k-NN algorithm, Expert Systems With Applications, Cilt. 107, s. 32-44. DOI: 10.1016/j.eswa.2018.04.017
26. [26] Venkatasubramaniam, A., Wolfson, J., Mitchel, N., Barnes, T., JaKa, M., French, S. 2017. Decision trees in epidemiological research, Emerg Themes Epidemiol., Cilt. 14, s. 1-12. DOI: 10.1186/s12982-017-0064-4
27. [27] Sifaou, H., Kammoun, A., Alouini, M.-S. 2020. High-dimensional Linear Discriminant Analysis Classifier for Spiked Covariance Model, Journal of Machine Learning Research, Cilt. 21, s. 1-24.
28. [28] Zhang, Z., Wang, S., Bian, W. 2020. Sign consistency for the linear programming discriminant rule, Pattern recognition, Cilt. 100, s. 1-11. DOI: 10.1016/j.patcog.2019.107083
29. [29] Wu, X., Kumar, V., Quinlan, J.R., Ghosh, J., Yang, Q., et al. 2008. Top 10 algorithms in data mining, Knowledge and information systems, Cilt. 14, s. 1–37. DOI: 10.1007/s10115-007-0114-2
30. [30] Ng, A.Y., Jordan, M.I., 2002. On discriminative vs. generative classifiers: A comparison of logistic regression and naive bayes, Advances in neural information processing systems, Cilt. 2,s. 841–848.
31. [31] Jahromi, A.H., Taheri, M. 2017. A non-parametric mixture of Gaussian naive Bayes classifiers based on local independent features. 2017 Artificial Intelligence and Signal Processing Conference (AISP), 25-27 Oct. Shiraz, Iran, 209-212. DOI: 10.1109/AISP.2017.8324083
32. [32] Lee, K., Kwan, M.-P.. 2018. Physical activity classification in free-living conditions using smartphone accelerometer data and exploration of predicted results, Computers, Environment and Urban Systems, Cilt. 67, s. 124-131. DOI: 10.1016/j.compenvurbsys.2017.09.012
33. [33] Friedman, J.H. 2001. Greedy Function Approximation: A Gradient Boosting Machine, The Annals of Statistics, Cilt. 29, s. 1189–1232. DOI: 10.1214/aos/1013203451
34. [34] Cutler, D.R., Edwards, T.C., Beard, K.H., Cutler, A., Hess, K.T., et al. 2007. Random forests for classification in ecology, Ecology, Cilt. 88, s. 2783–2792. DOI: 10.1890/07-0539.1
35. [35] Fu, Y. 2017. Combination of Random Forests and Neural Networks in Social Lending, Journal of Financial Risk Management, Cilt. 6, s. 418-426. DOI: 10.4236/jfrm.2017.64030