TY  - JOUR
T1  - Evaluation of Turkish Health System Capacity at Provincial Level by WISP Method Based on Weighting Methods
TT  - Türkiye Sağlık Sistemi Kapasitesinin Ağırlıklandırma Yöntemlerine Dayalı WISP Yöntemi ile İl Düzeyinde Değerlendirilmesi
AU  - Bulut, Tevfik
PY  - 2025
DA  - January
Y2  - 2024
DO  - 10.51551/verimlilik.1549245
JF  - Verimlilik Dergisi
PB  - Ministry of Industry and Technology
WT  - DergiPark
SN  - 1013-1388
SP  - 143
EP  - 166
VL  - 59
IS  - 1
LA  - en
AB  - Purpose: The study aims to evaluate the capacity and capacity gaps of the Turkish health system at the provincial level in relative terms. The secondary objective of the study is to develop application algorithms for the weighting methods utilized in the R programming language.Methodology: The decision criteria used in evaluation of health system capacity were weighted by CRITIC, Shannon Entropy, and NMV methods. The WISP method was used to evaluate the health system capacity of provinces. Data were drawn from the Ministry of Health's Health Statistics Yearbook for 2022. Findings: Tunceli, Bayburt, and Kilis are the three provinces closest to the optimal solution among 81 provinces in terms of health system capacity in Türkiye, according to CRITIC-based WISP scores. On the contrary, Bursa, İstanbul and Şanlıurfa are the three provinces furthest from an optimal solution. Originality: At the provincial level, gaps in the health system's capacity can be identified and subsequently improved. It is possible to develop self-sufficient health system capacity and enhance its resilience. The development of application algorithms for weighting methods makes a significant contribution. Decision makers are capable of generating immediate solutions for both small and large-scale data sets using the algorithms.
KW  - CRITIC
KW  - Entropy
KW  - NMV
KW  - WISP
KW  - Health System Capacity
N2  - Amaç: Bu çalışmanın birincil amacı, Türkiye sağlık sisteminin kapasite ve kapasite açıklarını il düzeyinde göreceli olarak değerlendirmektir. Çalışmanın ikincil amacı ise R programlama dilinde kullanılan ağırlıklandırma yöntemleri için uygulama algoritmaları geliştirmektir.Yöntem: Sağlık sistemi kapasitesinin değerlendirilmesinde kullanılan karar kriterleri CRITIC, Shannon Entropy ve NMV yöntemleri ile ağırlıklandırılmıştır. İllerin sağlık sistemi kapasitesini değerlendirmek için WISP yöntemi kullanılmıştır. Veriler Sağlık Bakanlığı'nın 2022 Sağlık İstatistikleri Yıllığı'ndan alınmıştır. Bulgular: Tunceli, Bayburt ve Kilis, CRITIC tabanlı WISP skorlarına göre Türkiye'de sağlık sistemi kapasitesi açısından 81 il arasında optimal çözüme en yakın üç ildir. Buna karşılık, Bursa, İstanbul ve Şanlıurfa optimal çözümden en uzak üç ildir.Özgünlük: İl düzeyinde, sağlık sisteminin kapasitesindeki boşlukları tespit edebilir ve geliştirebiliriz. Kendi kendine yeterli sağlık sistemi kapasitesi oluşturabilir ve sağlık sistemini daha dirençli hale getirilebilir. Öte yandan, ağırlıklandırma yöntemleri için uygulama algoritmalarının geliştirilmesi önemli bir katkıdır. Böylece karar vericiler küçük ve özellikle büyük ölçekli veri setleri üzerinde anlık çözümler üretebilir.
CR  - Adalı, E.A. and Tuş, A. (2019). “Hospital Site Selection with Distance-Based Multi-Criteria Decision-Making Methods”, International Journal of Healthcare Management, 14(2), 534-544. https://doi.org/10.1080/20479700.2019.1674005
CR  - Allaire, J., Xie, Y., Dervieux, C., McPherson, J., Luraschi, J., Ushey, K, Atkins, A., Wickham, H., Cheng, J., Chang, W. and Iannone, R. (2024). “rmarkdown: Dynamic Documents for R. R Package Version 2.26.”.
CR  - Arnold, J. (2024). “ggthemes: Extra Themes, Scales and Geoms for 'ggplot2'”, R Package Version 5.1.0.
CR  - Bağcı H. and Sarıay, İ. (2021). “The Role of Market Value and Market Value Initial Public Offering In Business Performance: An Applıcatıon in the Istanbul Stock Exchangepublic Offering Index”, Finansal Araştırmalar ve Çalışmalar Dergisi,13(24), 36-54. https://doi.org/10.14784/marufacd.880613.
CR  - Baydaş, M. and Pamučar, D. (2022). “Determining Objective Characteristics of MCDM Methods under Uncertainty: An Exploration Study with Financial Data”, Mathematics, 10(7), 1115.  https://doi.org/10.3390/math10071115
CR  - Bhaskar, A.S. and Khan, A. (2022). “Comparative Analysis of Hybrid MCDM Methods in Material Selection for Dental Applications”, Expert Systems with Applications, 209, 1-8. https://doi.org/10.1016/j.eswa.2022.118268
CR  - Bivand, R., Pebesma, E. and Gomez-Rubio, V. (2013). “Applied Spatial Data Analysis with R”, Second Edition. Springer, NY.
CR  - Blanchet, K., Nam, S.L., Ramalingam, B. and Pozo-Martin, F. (2017). “Governance and Capacity to Manage Resilience of Health Systems: Towards a New Conceptual Framework”, International Journal of Health Policy and Management, 1, 6(8), 431-435. https://doi.org/10.15171/ijhpm.2017.36
CR  - Broekhuizen, H., Groothuis-Oudshoorn, C.G., van Til, J.A., Hummel, J.M. and IJzerman, M.J. (2015). “A Review and Classification of Approaches for Dealing with Uncertainty in Multi-Criteria Decision Analysis for Healthcare Decisions”, Pharmacoeconomics, 33(5), 445-455. https://doi.org/10.1007/s40273-014-0251-x
CR  - Bulut, T. (2017). “Çok Kriterli Karar Verme (ÇKKV) Modellerinde Kriterlerin Ağırlıklandırılmasına Yönelik Bir Model Önerisi: Normalize Edilmiş Maksimum Değerler [NMD] Metodu (Normalized Maximum Values [NMV] Method, https://tevfikbulutcom.wordpress.com/2017/06/21/coklu-karar-verme-modellerinde-kriterlerin-agirliklandirilmasina-yonelik-model-onerisi,  (Accessed: 15.05.2024).
CR  - Bulut, T. (2022a). “R’da Normalize Edilmiş Maksimum Değerler [NMD] Uygulama Algoritması”, https://tevfikbulut.net/rda-normalize-edilmis-maksimum-degerler-nmd-metodu, (Accessed: 15.05.2024).
CR  - Bulut, T. (2022b). “Normalize Edilmiş Maksimum Değerler [NMD] Metodunun Teorik Çerçevesi”, https://tevfikbulut.net/normalize-edilmis-maksimum-degerler-nmd-metodu, (Accessed: 15.05.2024).
CR  - Chen, J., Guo, X., Pan, H. and Zhong, S. (2021). “What Determines City's Resilience Against Epidemic Outbreak: Evidence from China's COVID-19 Experience”, Sustainable Cities and Society, 70, 102892. https://doi.org/10.1016/j.scs.2021.102892
CR  - Ciardiello, F. and Genovese, A. (2023). “A Comparison between TOPSIS and SAW Methods”, Annals of Operations Research, 325:967-994. https://doi.org/10.1007/s10479-023-05339-w
CR  - Delgado, A., Huamani, A. and Brillitt, B. (2018). “Applying Shannon Entropy to Analise Health System Level by departments in Peru”, 2018 IEEE XXV International Conference on Electronics, Electrical Engineering and 
Computing (INTERCON), Lima, Peru, 1-4. https://doi.org/10.1109/INTERCON.2018.8526435
CR  - Diakoulaki, D., Mavrotas, G. and Papayannakis, L. (1995). “Determining Objective Weights in Multiple Criteria Problems: The CRITIC Method”, Computers & Operations Research, 22(7), 763-770.
CR  - Ergun, H., Gülal, M. and Kılıçarslan, A. (2022). “Measurement of Transaction Performance of Companies in the Licensed Warehouse Industry by Multicriteria Decision Making Methods”, The Journal of Accounting and Finance, 94, 105-132. https://doi.org/10.25095/mufad.1054068
CR  - Feng, J., Guo, Z., Ai, L., Liu, J., Zhang, X., Cao, C., Xu, J., Xia, S., Zhou, X., Chen, J. and Li, S. (2022). “Establishment of an Indicator Framework for Global One Health Intrinsic Drivers Index Based on the Grounded Theory and Fuzzy Analytical Hierarchy-Entropy Weight Method”, Infectious Diseases of Poverty, 11, 121. 
https://doi.org/10.1186/s40249-022-01042-3
CR  - Garnier, S., Ross, N., Rudis, R., Camargo, P.A., Sciaini, M. and Scherer, C. (2024). “viridis (Lite). Colorblind-Friendly Color Maps for R”, Viridis Package Version 0.6.5. https://doi.org/10.5281/zenodo.4679423
CR  - Guindo, L. A., Wagner, M., Baltussen, R., Rindress, D., Van Til, J., Kind, P. and Goetghebeur, M. M. (2012). “From Efficacy to Equity: Literature Review of Decision Criteria for Resource Allocation and Healthcare Decision Making”, Cost Effectiveness and Resource Allocation, 10(1), 9. https://doi.org/10.1186/1478-7547-10-9
CR  - Gupta, S., Vijayvargy, L. and Gupta, K. (2021). “Assessment of Stress Level in Urban Area’s during COVID-19 Outbreak Using CRITIC and TOPSIS: A Case of Indian Cities”, Journal of Statistics and Management Systems, 24(2), 411-433. https://doi.org/10.1080/09720510.2021.1879470
CR  - Haldane, V., De Foo, C., Abdalla, S.M., Jung, A., Tan, M., Wu, S., Chua, A., Verma, M., Shrestha, P., Singh, S., Perez, T., 
Tan, S.M., Bartos, M., Mabuchi, S., Bonk, M., McNab, C., Werner, G.K., Panjabi, R., Nordström, A. and Legido-Quigley, H. (2021). “Health Systems Resilience in Managing the COVID-19 Pandemic: Lessons from 28 Countries”, Nature 
Medicine, 27, 964-980. https://doi.org/10.1038/s41591-021-01381-y
CR  - Hassanain, A.A., Eldosoky, M.A.A. and Soliman, A.M. (2022). “Evaluating Building Performance in Healthcare Facilities using Entropy and Graph Heuristic Theories”, Scientific Reports, 12-8973. https://doi.org/10.1038/s41598-022-13004-8
CR  - Hsu, M., Anen, C. and Quartz, S.R. (2008). “The Right and the Good: Distributive Justice and Neural Encoding of Equity and Efficiency”, Science, 320(5879), 1092-1095. https://doi.org/10.1126/science.11536
CR  - Huang, S.W., Liou, J.J.H., Chuang, H.H. and Tzeng, G.H. (2021). “Using a Modified VIKOR Technique for Evaluating and Improving the National Healthcare System Quality”, Mathematics, 9(1349), 1-21. https://doi.org/10.3390/math9121349
CR  - Keleş, N. (2023). “Evaluation of Health Performance of 81 Provinces of Türkiye with Current Decision-Making Methods”, Dumlupınar University Journal of Social Sciences, (75), 120-141 https://doi.org/10.51290/dpusbe.1134082
CR  - Kılıçarslan, A. (2023). “Financial Performance Analysis of Renewable Energy Sector Companies: An Application at Borsa Istanbul”, Kastamonu University Journal of Faculty of Economics and Administrative Sciences, 25(1), 232-253. https://doi.org/10.21180/iibfdkastamonu.1191441
CR  - Kılıçarslan, A. and Sucu, M.Ç. (2021). “Multi-Criteria Decision-Making Methods and Financial Performance Rankings: An Application on Portfolio Management Companies”, Erciyes Akademi, 35(4), 1451-1480. https://doi.org/10.48070/erciyesakademi.994546
CR  - Kumar, R., Singh, S., Bilga, P. S., Jatin, N., Singh, J., Singh, S., Scutaru, M. and Pruncu, C. I. (2021). “Revealing the Benefits of Entropy Weights Method for Multi-Objective Optimization in Machining Operations: A Critical Review”, Journal of Materials Research and Technology, 10:1471-1492. https://doi.org/10.1016/j.jmrt.2020.12.114
CR  - Lee, H.C. and Chang, C.T. (2018). “Comparative Analysis of MCDM Methods for Ranking Renewable Energy Sources in Taiwan”, Renewable and Sustainable Energy Reviews, 92:883-896. https://doi.org/10.1016/j.rser.2018.05.007
CR  - Lin, Y., Alshehri, Y., Alnazzawi, N., Abid, M., Khan, S.A., Jabeen, F. and Elwarfalli, I. (2023) RETRACTED ARTICLE: Social Media Analytics and Their Applications to Evaluate an Activity in Online Health İnterventions Using CRITIC and TOPSIS Techniques”, Soft Computing. https://doi.org/10.1007/s00500-023-08004-3
CR  - Microsoft Corporation. (2018). “Microsoft Excel”, https://office.microsoft.com/excel, (Accessed: 03.04.2024].
CR  - Müller, K. and Wickham, H. (2023). “tibble: Simple Data Frames”, R package version 3.2.1.
CR  - Németh, B., Molnár, A., Bozóki, S., Wijaya, K., Inotai, A., Campbell, J. D. and Kaló, Z. (2019). “Comparison of Weighting Methods Used in Multicriteria Decision Analysis Frameworks in Healthcare with Focus on Low- and 
Middle-Income Countries”, Journal of Comparative Effectiveness Research, 8(4), 195-204. https://doi.org/10.2217/cer-2018-0102
CR  - Paradowski, B., Shekhovtsov, A., Baczkiewicz, A., Kizielewicz, B. and Sałabun, W. (2021). “Similarity Analysis of Methods for Objective Determination of Weights in Multi-Criteria Decision Support Systems”, Symmetry, 13:1874. https://doi.org/10.3390/sym13101874
CR  - Pebesma, E. and Bivand, R. (2005). “Classes and Methods for Spatial Data in R”, R News, 5(2), 9-13.
CR  - Pebesma, E. and Bivand, R. (2023). “Spatial Data Science: With applications in R”, Chapman and Hall/CRC. https://doi.org/10.1201/9780429459016
CR  - Peng, X., Krishankumar, R. and Ravichandran, K.S. (2021). “A Novel Interval-Valued Fuzzy Soft Decision-Making Method Based on CoCoSo and CRITIC for Intelligent Healthcare Management Evaluation”, Soft Computing, 25, 4213-4241. https://doi.org/10.1007/s00500-020-05437-y
CR  - Pourmohammadi, K., Shojaei, P., Rahimi, H. and Bastani, P. (2018). “Evaluating the Health System Financing of the Eastern Mediterranean Region (EMR) Countries Using Grey Relation Analysis and Shannon Entropy”, Cost Effectiveness and Resource Allocation, 16, 31. https://doi.org/10.1186/s12962-018-0151-6
CR  - Pramanik, P.K.D., Biswas, S., Pal, S., Marinković, D. and Choudhury, P. (2021). “A Comparative Analysis of Multi-Criteria Decision-Making Methods for Resource Selection in Mobile Crowd Computing”, Symmetry, 13, 1713. https://doi.org/10.3390/sym13091713
CR  - R Core Team. (2024). “R: A Language and Environment for Statistical Computing”, R Foundation for Statistical Computing, Vienna, Austria.
CR  - Rizzo, M. and Szekely, G. (2022). “energy: E-Statistics: Multivariate Inference via the Energy of Data”, R package version 1.7-11.
CR  - Salehi, V., Moradi, G., Omidi, L. and Rahimi, E. (2023). “An MCDM Approach to Assessing Influential Factors on Healthcare Providers’ Safe Performance during the COVID-19 Pandemic: Probing into Demographic Variables”, Journal of Safety Science and Resilience, 4(3), 274-83. https://doi.org/10.1016/j.jnlssr.2023.05.002
CR  - Schauberger, P. and Walker, A. (2023). “openxlsx: Read, Write and Edit xlsx Files”, R Package Version 4.2.5.2.
CR  - Shamasunder, S., Holmes, S. M., Goronga, T., Carrasco, H., Katz, E., Frankfurter, R. and Keshavjee, S. (2020). “COVID-19 Reveals Weak Health Systems by Design: Why We Must Re-Make Global Health in This Historic 
Moment”, Global Public Health, 15(7),1083-1089. https://doi.org/10.1080/17441692.2020.1760915
CR  - Shannon, C.E. (1948). “A Mathematical Theory of Communication”, The Bell System Technical Journal, 27(3), 379-423. https://doi.org/10.1002/j.1538-7305.1948.tb01338.x
CR  - Shekhovtsov, A. (2021). “How Strongly Do Rank Similarity Coefficients Differ Used in Decision Making Problems?”, Procedia Computer Science, 192, 4570-4577. https://doi.org/10.1016/j.procs.2021.09.235
CR  - Shemshadi, A., Shirazi, H., Toreihi, M. and Tarokh, M.J. (2011). “A Fuzzy VIKOR Method for Supplier Selection Based on Entropy Measure for Objective Weighting”, Expert Systems with Applications, 38, 12160-12167. https://doi.org/10.1016/j.eswa.2011.03.027
CR  - Song, M., Zhu, Q., Peng, J. and Santibanez Gonzalez, E.D.R. (2017). “Improving the Evaluation of Cross Efficiencies: A Method Based on Shannon Entropy Weight”, Computers & Industrial Engineering, 112, 99-106. https://doi.org/10.1016/j.cie.2017.07.023
CR  - Stanujkic, D., Popovic, G., Karabasevic, D., Meidute-Kavaliauskiene, I. and Ulutaş, A. (2023). “An Integrated Simple Weighted Sum Product Method-WISP”, IEEE Transactions on Engineering Management, 70(5), 1933-1944. https://doi.org/10.1109/TEM.2021.3075783
CR  - Szkely, G.J. and Rizzo, M.L. (2005). “A New Test for Multivariate Normality”, Journal of Multivariate Analysis, 93, 58-80. https://doi.org/10.1016/j.jmva.2003.12.002
CR  - Tastan, H. (2024). “TRmaps: Map Data for Türkiye”, R Package Version 0.0.0.9000.
CR  - Taylor, J.M.G. (1987). “Kendall’s and Spearman’s Correlation Coefficients in the Presence of A Blocking Variable”, 
Biometrics, 43(2), 409-416. https://doi.org/10.2307/2531822
CR  - Top, M. and Bulut, T. (2022). “A New Multi-Criteria Decision Making Method: Bulut Index-Beta (BI-β)”, Verimlilik Dergisi, 3, 393-414. https://doi.org/10.51551/verimlilik.1031366
CR  - Turkish Ministry of Health (MoH). (2024). “Health Statistics Yearbook 2022”, https://www.saglik.gov.tr/TR-103184/saglik-istatistikleri-yilligi-2022-yayinlanmistir.html,  (Accessed: 15.05.2024).
CR  - Turkish Statistical Institute (TURKSTAT). (2023).”Address Based Population Registration System Results, 2022”, https://data.tuik.gov.tr/Bulten/Index?p=The-Results-of-Address-Based-Population-Registration-System-2022-49685, (Accessed: 15.05.2024).
CR  - Vassoney, E., Mochet, A. M., Desiderio, E., Negro, G., Pilloni, M. G. and Comoglio, C. (2021). “Comparing Multi-Criteria Decision-Making Methods for the Assessment of Flow Release Scenarios From Small Hydropower Plants in the Alpine Area”, Frontiers Environmental Science, 9:635100. https://doi.org/10.3389/fenvs.2021.635100
CR  - Wang, T. and Lee, H. (2009). “Developing a fuzzy TOPSIS Approach Based on SUBJECTIVE WEIGHTS and Objective Weights”, Expert Systems with Applications, 36, 8980-8985. https://doi.org/10.1016/j.eswa.2008.11.035
CR  - Wei, T. and Simko, V. (2021). “R Package 'corrplot': Visualization of a Correlation Matrix”, R Package Version 0.92.
CR  - Wickham, H. (2016). “ggplot2: Elegant Graphics for Data Analysis”, Springer-Verlag New York.
CR  - Wickham, H. and Bryan, J. (2023). “readxl: Read Excel Files”, R Package Version 1.4.3.
CR  - Wickham, H., François, R., Henry, L., Müller, K. and Vaughan, D. (2023). “dplyr: A Grammar of Data Manipulation”, R Package Version 1.1.4.
CR  - Wickham, H., Vaughan, D. and Girlich, M. (2024). “tidyr: Tidy Messy Data”, R Package Version 1.3.1.
CR  - World Health Organization (WHO). (‎2012)‎. “Strengthening Health-System Emergency Preparedness: Toolkit for Assessing Health-System Capacity for Crisis Management: Part 1: User Manual”, https://iris.who.int/handle/10665/352566, (Accessed: 15.05.2024).
CR  - World Health Organization (WHO). (2024a). “Building Health System Resilience to Public Health Challenges: Guidance for Implementation in Countries”, https://iris.who.int/bitstream/handle/10665/377652/9789240094321-eng.pdf?sequence=1, (Accessed: 
15.05.2024).
CR  - World Health Organization (WHO). (2024b). “Health System Resilience Indicators: An Integrated Package for Measuring and Monitoring Health System Resilience in Countries”, https://iris.who.int/bitstream/handle/10665/376071/9789240088986-eng.pdf?sequence=1, (Accessed: 
15.05.2024).
CR  - Zamani-Sabzi, H., King, J.P., Gard, C.C. and Abudu, S. (2016). “Statistical and Analytical Comparison of Multi-Criteria Decision-Making Techniques under Fuzzy Environment”, Operations Research Perspectives, 3(C), 92-117. https://doi.org/10.1016/j.orp.2016.11.001
CR  - Zavadskas, E.K., Stanujkić, D., Karabašević, D. and Turskis, Z. (2022). “Analysis of the Simple WISP Method Results Using Different Normalization Procedures”, Studies in Informatics and Control, 31(1), 5-12. https://doi.org/10.24846/v31i1y202201
CR  - Zhang, X. Y., Xu, H. Q., Wang, C. F., Shao, J., Wan, Y. H. and Tao, F. B. (2023). “Application of Entropy Weight TOPSIS Comprehensive Method in the Evaluation of Students' Physical Health Level”, Chinese Journal of Preventive Medicine, 57(7), 997-1003. https://doi.org/10.3760/cma.j.cn112150-20220712-00712
CR  - Zhao, L., Jin, Y., Zhou, L., Yang, P., Qian, Y., Huang, X. and Min, M. (2023). “Evaluation of Health System Resilience in 60 Countries Based on Their Responses to COVID-19”, Front Public Health, 10, 1081068. https://doi.org/10.3389/fpubh.2022.1081068
UR  - https://doi.org/10.51551/verimlilik.1549245
L1  - https://dergipark.org.tr/en/download/article-file/4210710
ER  -