EVALUATION OF LEARNING MANAGEMENT SYSTEMS USING INTERVAL VALUED INTUITIONISTIC FUZZY-Z NUMBERS

Year 2023, Volume: 24 Issue: 4, 179 - 206, 01.10.2023

Duygu Sergı , Irem Ucal Sarı

https://doi.org/10.17718/tojde.1170338

Cited By: 1

Abstract

The use of online education tools has increased rapidly with the transition to distance education caused by the pandemic. The obligation to carry out all activities of face-to-face education online made it very important for the tools used in distance education to meet the increasing needs. In line with these needs, radical changes have occurred in the learning management systems used in distance education. Therefore, in this study, it is aimed to determine the features that the systems used in distance education should have and to compare the existing systems according to these features. For this purpose, a novel fuzzy extension, interval valued intuitionistic fuzzy Z-numbers, is defined for modeling uncertainty, and AHP and WASPAS methods using proposed fuzzy numbers are developed to determine the importance of decision criteria and compare alternatives.

Keywords

E-Learning, Interval Valued Intuitionistic Fuzzy Z-Numbers, Fuzzy AHP, Fuzzy WASPAS

References

• Abdel-Basset, M., Mohamed, M., Zhou, Y., & Hezam, I. (2017). Multi-criteria group decision making based on neutrosophic analytic hierarchy process. Journal of Intelligent & Fuzzy Systems, 33(6), 4055-4066.
• Abdullah, L., & Najib, L. (2014a). A new preference scale of intuitionistic fuzzy analytic hierarchy process in multi-criteria decision making problems. Journal of Intelligent & Fuzzy Systems, 26(2), 1039-1049.
• Abdullah, L., & Najib, L. (2014b). Sustainable energy planning decision using the intuitionistic fuzzy analytic hierarchy process: choosing energy technology in Malaysia. International Journal of Sustainable Energy, 35(4), 360-377.
• Abdullah, L., & Najib, L. (2017). Interval Type-2 fuzzy analytic hierarchy process for sustainable energy sources selection. International Journal of Fuzzy System Applications (IJFSA), 6(3), 124-137.
• Abdullah, L., Sunadia, J., & Imran, T. (2009). A new analytic hierarchy process in multi-attribute group decision making. International Journal of Soft Computing, 4(5), 208-214.
• Al-Ajlan, A. S. (2012). A comparative study between e-learning features. Methodologies, tools and new developments for e-learning, 191-214.
• Altıparmak, M., Kurt, İ. D., & Kapıdere, M. (2011). E-öğrenme ve uzaktan eğitimde açık kaynak kodlu öğrenme yönetim sistemleri. XI. Akademik Bilişim Kongresi.
• Azadeh, A., Saberi, M., Atashbar, N. Z., Chang, E., & Pazhoheshfar, P. (2013, July). Z-AHP: A Z-number extension of fuzzy analytical hierarchy process. In 2013 7th IEEE International Conference on Digital Ecosystems and Technologies (DEST) (pp. 141-147). IEEE.
• Bahadır F., (2020). Raylı sistemler programı öğrencilerinin e-öğrenmeye hazırbulunuşluklarının incelenmesi: Refahiye meslek yüksekokulu örneği. Yükseköğretim ve Bilim Dergisi/Journal of Higher Education and Science, 10(2), 310-317. https://doi.org/10.5961/jhes.2020.392.
• BAHÇECİ, F., & YILDIZ, E. (2016). Yetişkin eğitimindeki bireylerin öğrenme yönetim sistemleri hakkındaki görüşleri. Açıköğretim Uygulamaları ve Araştırmaları Dergisi, 2(1), 94-113.
• Bezovski, Z., & Poorani, S. (2016, March). The evolution of e-learning and new trends. In Information and Knowledge Management (Vol. 6, No. 3, pp. 50-57). IISTE.
• BİÇER, H., & KORUCU, A. T. (2020). E-ÖĞRENMEYE YÖNELİK TUTUM ÖLÇEĞİNİN TÜRKÇEYE UYARLANMASI. Eğitim Teknolojisi Kuram ve Uygulama, 10(1), 237-256.
• Bilgic, H. G., & Tuzun, H. (2020). Issues and Challenges in Web-Based Distance Education Programs in Turkish Higher Education Institutes. Turkish Online Journal of Distance Education, 21(1), 143-164.
• Boender, C. G. E., De Graan, J. G., & Lootsma, F. A. (1989). Multi-criteria decision analysis with fuzzy pairwise comparisons. Fuzzy sets and Systems, 29(2), 133-143.
• Boltürk, E., & Kahraman, C. (2018). A novel interval-valued neutrosophic AHP with cosine similarity measure. Soft Computing, 22(15), 4941-4958.
• Boltürk, E., & Kahraman, C. (2019, July). As/RS technology selection using interval-valued pythagorean fuzzy WASPAS. In International Conference on Intelligent and Fuzzy Systems (pp. 867-875). Springer, Cham.
• Boltürk, E., Çevik Onar, S., Öztayşi, B., Kahraman, C., & Goztepe, K. (2016). Multi-attribute warehouse location selection in humanitarian logistics using hesitant fuzzy AHP. International Journal of the Analytic Hierarchy Process, 8(2), 271-298.
• Buckley, J. J. (1985). Fuzzy hierarchical analysis. Fuzzy sets and systems, 17(3), 233-247.
• Cavus, N., & Zabadi, T. (2014). A comparison of open source learning management systems. Procedia-Social and Behavioral Sciences, 143, 521-526.
• ÇETİNKAYA, V., & DEVECİ, D. A. (2020). Optimal Sürdürülebilir Rota Tespiti İçin Gerekli Göstergelerin Bir Çok Kriterli Karar Verme Yöntemi İle Önem Düzeyi Tespiti. Dokuz Eylül Üniversitesi Denizcilik Fakültesi Dergisi, 12(1), 25-46.
• Chang, D. Y. (1996). Applications of the extent analysis method on fuzzy AHP. European journal of operational research, 95(3), 649-655.
• Chaubey, A., & Bhattacharya, B. (2015). Learning management system in Higher education. IJSTE-International Journal of Science Technology & Engineering, 2(3).
• Cheung, K. S. (2007). A Comparison of WebCT, Blackboard and Moodle for the teaching and learning of continuing education courses. In Enhancing learning through technology (pp. 219-228).
• Cigdem, H., & Ozturk, M. (2016). Factors affecting students’ behavioral intention to use LMS at a Turkish post-secondary vocational school. International Review of Research in Open and Distributed Learning, 17(3), 276-295.
• Collins, A., & Halverson, R. (2018). Rethinking education in the age of technology: The digital revolution and schooling in America. Teachers College Press.
• Dogan, O., Deveci, M., Canıtez, F., & Kahraman, C. (2019). A corridor selection for locating autonomous vehicles using an interval-valued intuitionistic fuzzy AHP and TOPSIS method. Soft Computing, 1-17.
• Dutta, B., & Guha, D. (2015). Preference programming approach for solving intuitionistic fuzzy AHP. International Journal of Computational Intelligence Systems, 8(5), 977-991.
• Dwivedi, Y. K., Hughes, D. L., Coombs, C., Constantiou, I., Duan, Y., Edwards, J. S., ... & Raman, R. (2020). Impact of COVID-19 pandemic on information management research and practice: Transforming education, work and life. International Journal of Information Management, 55, 102211.
• Ellis, R. A., Ginns, P., & Piggott, L. (2009). E‐learning in higher education: some key aspects and their relationship to approaches to study. Higher Education Research & Development, 28(3), 303-318.
• Gowda, R. S., & Suma, V. (2017, February). A comparative analysis of traditional education system vs. e-Learning. In 2017 International Conference on Innovative Mechanisms for Industry Applications (ICIMIA) (pp. 567-571). IEEE.
• Gülbahar, Y. (2017). E-öğrenme. Pegem Atıf İndeksi, 1-410.
• Gündoğdu, F. K., & Kahraman, C. (2020). A novel spherical fuzzy analytic hierarchy process and its renewable energy application. Soft Computing, 24(6), 4607-4621.
• Han, I., & Shin, W. S. (2016). The use of a mobile learning management system and academic achievement of online students. Computers & Education, 102, 79-89.
• Ilbahar, E., & Kahraman, C. (2018). Retail store performance measurement using a novel interval-valued Pythagorean fuzzy WASPAS method. Journal of Intelligent & Fuzzy Systems, 35(3), 3835-3846.
• Ilbahar, E., Cebi, S., & Kahraman, C. (2019, July). Assessment of renewable energy alternatives with Pythagorean Fuzzy WASPAS method: a case study of Turkey. In International Conference on Intelligent and Fuzzy Systems (pp. 888-895). Springer, Cham.
• Ilbahar, E., Karaşan, A., Cebi, S., & Kahraman, C. (2018). A novel approach to risk assessment for occupational health and safety using Pythagorean fuzzy AHP & fuzzy inference system. Safety science, 103, 124-136.
• Juárez Santiago, B., Olivares Ramírez, J. M., Rodríguez-Reséndiz, J., Dector, A., García García, R., González-Durán, J. E. E., & Ferriol Sánchez, F. (2020). Learning Management System-Based Evaluation to Determine Academic Efficiency Performance. Sustainability, 12(10), 4256.
• Kahraman, C., & Otay, I. (2018). Solar PV power plant location selection using a Z-fuzzy number based AHP. International Journal of the Analytic Hierarchy Process, 10(3).
• Kahraman, C., Onar, S. Ç., & Öztayşi, B. (2016). Interval valued intuitionistic fuzzy investment analysis: application to CNC lathe selection. IFAC-PapersOnLine, 49(12), 1323-1328.
• Kahraman, C., Onar, S. Ç., & Öztayşi, B. (2018). B2C marketplace prioritization using hesitant fuzzy linguistic AHP. International Journal of Fuzzy Systems, 20(7), 2202-2215.
• Kahraman, C., Onar, S. Ç., Oztaysi, B., & Ilbahar, E. (2019). Selection Among GSM Operators Using Pythagorean Fuzzy WASPAS Method. Journal of Multiple-Valued Logic & Soft Computing, 33.
• Kahraman, C., Oztaysi, B., & Onar, S. C. (2019, August). Performance Comparisons of Law Offices and Optimum Allocation of Debt Files Using Z-Fuzzy AHP. In 2019 Conference of the International Fuzzy Systems Association and the European Society for Fuzzy Logic and Technology (EUSFLAT 2019). Atlantis Press.
• Kahraman, C., Öztayşi, B., & Onar, S. C. (2020). Warehouse Location Design Using AS/RS Technologies: An Interval Valued Intuitionistic Fuzzy AHP Approach. In Customer Oriented Product Design (pp. 379-397). Springer, Cham.
• Kahraman, C., Öztayşi, B., Sarı, İ. U., & Turanoğlu, E. (2014). Fuzzy analytic hierarchy process with interval type-2 fuzzy sets. Knowledge-Based Systems, 59, 48-57.
• Kasim, N. N. M., & Khalid, F. (2016). Choosing the Right Learning Management System (LMS) for the Higher Education Institution Context: A Systematic Review. International Journal of Emerging Technologies in Learning, 11(6).
• Kaur, P. (2014). Selection of vendor based on intuitionistic fuzzy analytical hierarchy process. Advances in Operations Research, 2014.
• Kaya, M. (2012). Distance education systems used in universities of Turkey and Northern Cyprus. Procedia-Social and Behavioral Sciences, 31, 676-680.
• Keshavarzfard, R & Makui, A. (2015). An IF-DEMATEL-AHP based on Triangular Intuitionistic Fuzzy Numbers (TIFNs). Decision Science Letters , 4(2), 237-246.
• Khan, S., Haleem, A., & Khan, M. I. (2020, July). Assessment of risk in the management of Halal supply chain using fuzzy BWM method. In Supply Chain Forum: An International Journal (pp. 1-17). Taylor & Francis.
• Kışla, T., & Karaoğlan, B. (2011). Üniversite öğrencilerinin e-öğrenme araçlarına yönelik görüşlerinin incelenmesi: Uluslararası bir karşılaştırma. Ege Eğitim Dergisi, 12(1), 52-73.
• Kutlu Gundogdu, F., & Kahraman, C. (2019). Extension of WASPAS with spherical fuzzy sets. Informatica, 30(2), 269-292.
• Liao, H., & Xu, Z. (2015). Consistency of the fused intuitionistic fuzzy preference relation in group intuitionistic fuzzy analytic hierarchy process. Applied Soft Computing, 35, 812-826.
• Machado, M., & Tao, E. (2007, October). Blackboard vs. Moodle: Comparing user experience of learning management systems. In 2007 37th annual frontiers in education conference-global engineering: Knowledge without borders, opportunities without passports (pp. S4J-7). IEEE.
• Μicha, R. (2019). The Current and Future State of LMSs (No. GRI-2019-25105). Aristotle University of Thessaloniki.
• Mishra, A. R., & Rani, P. (2018). Interval-valued intuitionistic fuzzy WASPAS method: application in reservoir flood control management policy. Group Decision and Negotiation, 27(6), 1047-1078.
• Mishra, A. R., Rani, P., Pardasani, K. R., & Mardani, A. (2019a). A novel hesitant fuzzy WASPAS method for assessment of green supplier problem based on exponential information measures. Journal of Cleaner Production, 238, 117901.
• Mishra, A. R., Singh, R. K., & Motwani, D. (2019b). Multi-criteria assessment of cellular mobile telephone service providers using intuitionistic fuzzy WASPAS method with similarity measures. Granular Computing, 4(3), 511-529.
• Miyazoe, T. (2008). LMS-based EFL blended learning: Blackboard vs. Moodle. In JALT 2007 conference proceedings, Tokyo: JALT.
• Mtebe, J. (2015). Learning management system success: Increasing learning management system usage in higher education in sub-Saharan Africa. International Journal of Education and Development using ICT, 11(2).
• Muhammad, M. N., & Cavus, N. (2017). Fuzzy DEMATEL method for identifying LMS evaluation criteria. Procedia computer science, 120, 742-749.
• Nie, R. X., Wang, J. Q., & Zhang, H. Y. (2017). Solving solar-wind power station location problem using an extended weighted aggregated sum product assessment (WASPAS) technique with interval neutrosophic sets. Symmetry, 9(7), 106.
• Onar, S. C., Oztaysi, B., Otay, İ., & Kahraman, C. (2015). Multi-expert wind energy technology selection using interval-valued intuitionistic fuzzy sets. Energy, 90, 274-285.
• Orfanou, K., Tselios, N., & Katsanos, C. (2015). Perceived usability evaluation of learning management systems: Empirical evaluation of the System Usability Scale. The International Review of Research in Open and Distributed Learning, 16(2), 227-246.
• Öztaysi, B., Onar, S. Ç., Boltürk, E., & Kahraman, C. (2015, August). Hesitant fuzzy analytic hierarchy process. In 2015 IEEE international conference on fuzzy systems (FUZZ-IEEE) (pp. 1-7). IEEE.
• Payette, D. L., & Gupta, R. (2009). Transitioning from Blackboard to Moodle-Course management software: Faculty and student opinions. American Journal of Business Education (AJBE), 2(9), 67-75.
• Petrova, V. (2019, June). Using the Analytic Hierarchy Process for LMS selection. In Proceedings of the 20th International Conference on Computer Systems and Technologies (pp. 332-336).
• Poyraz, G. T., & Özkul, A. E. (2019). Bir öğrenme ortamı olarak Google Sınıf’ın incelenmesi. Açıköğretim Uygulamaları ve Araştırmaları Dergisi, 5(3), 8-27.
• Radwan, N. M., Senousy, M. B., & Alaa El Din, M. R. (2016). Neutrosophic AHP multi criteria decision making method applied on the selection of learning management system. Infinite Study.
• Ramírez-Correa, P. E., Rondan-Cataluña, F. J., Arenas-Gaitán, J., & Alfaro-Perez, J. L. (2017). Moderating effect of learning styles on a learning management system’s success. Telematics and Informatics, 34(1), 272-286.
• Rani, P., Mishra, A. R., & Pardasani, K. R. (2020). A novel WASPAS approach for multi-criteria physician selection problem with intuitionistic fuzzy type-2 sets. Soft Computing, 24(3), 2355-2367.
• Rosenberg, M. J., & Foshay, R. (2002). E‐learning: Strategies for delivering knowledge in the digital age. Performance Improvement, 41(5), 50-51.
• Saaty, T. (1994). Fundamentals of Decision Making and Priority Theory, with the Analytical Hierarchy Process. Pittsburgh, PA.: RWS Publications.
• Sadiq, R., & Tesfamariam, S. (2009). Environmental decision-making under uncertainty using intuitionistic fuzzy analytic hierarchy process (IF-AHP). Stochastic Environmental Research and Risk Assessment, 23(1), 75-91.
• Semenas, R., & Bausys, R. (2020). Modelling of Autonomous Search and Rescue Missions by Interval-Valued Neutrosophic WASPAS Framework. Symmetry, 12(1), 162.
• Sergi, D., & Sari, I. U. (2021). Prioritization of public services for digitalization using fuzzy Z-AHP and fuzzy Z-WASPAS. Complex & Intelligent Systems, 1-16.
• Sezer, B., & Yilmaz, R. (2019). Learning management system acceptance scale (LMSAS): A validity and reliability study. Australasian Journal of Educational Technology, 35(3).
• Singh, T., Agarwal, S. L., & Vipat, R. (2011, February). Current trends in e-learning. In Proceedings of the International Conference & Workshop on Emerging Trends in Technology (pp. 1361-1361).
• Turskis, Z., Zavadskas, E. K., Antucheviciene, J., & Kosareva, N. (2015). A hybrid model based on fuzzy AHP and fuzzy WASPAS for construction site selection. International Journal of Computers communications & control, 10(6), 113-128.
• Tüysüz, F., & Şimşek, B. (2017). A hesitant fuzzy linguistic term sets-based AHP approach for analyzing the performance evaluation factors: an application to cargo sector. Complex & Intelligent Systems, 3(3), 167-175.
• Ulker, D., & Yılmaz, Y. (2016). Learning management systems and comparison of open source learning management systems and proprietary learning management systems. Journal of systems integration, 7(2), 18-24.
• Unal, Z., & Unal, A. (2011). Evaluating and comparing the usability of web-based course management systems. Journal of Information Technology Education: Research, 10(1), 19-38.
• Van Laarhoven, P. J., & Pedrycz, W. (1983). A fuzzy extension of Saaty's priority theory. Fuzzy sets and Systems, 11(1-3), 229-241.
• Wang, H., Qian, G., & Feng, X. (2011). An intuitionistic fuzzy AHP based on synthesis of eigenvectors and its application. Information Technology Journal, 10(10), 1850-1866.
• Wang, J., Ma, Q., & Liu, H. C. (2021). A meta-evaluation model on science and technology project review experts using IVIF-BWM and MULTIMOORA. Expert Systems with Applications, 168, 114236.
• Wu, J., Huang, H. B., & Cao, Q. W. (2013). Research on AHP with interval-valued intuitionistic fuzzy sets and its application in multi-criteria decision making problems. Applied Mathematical Modelling, 37(24), 9898-9906.
• Xu, Z. (2007). Methods for aggregating interval-valued intuitionistic fuzzy information and their application to decision making. Control and decision, 22(2), 215-219.
• Zadeh, L. A. (2011, August). The concept of a Z-number-A new direction in uncertain computation. In 2011 IEEE International Conference on Information Reuse & Integration (pp. xxii-xxiii). IEEE.
• Zavadskas, E. K., Antucheviciene, J., Hajiagha, S. H. R., & Hashemi, S. S. (2014). Extension of weighted aggregated sum product assessment with interval-valued intuitionistic fuzzy numbers (WASPAS-IVIF). Applied soft computing, 24, 1013-1021.
• Zavadskas, E. K., Baušys, R., & Lazauskas, M. (2015). Sustainable assessment of alternative sites for the construction of a waste incineration plant by applying WASPAS method with single-valued neutrosophic set. Sustainability, 7(12), 15923-15936.
• Zavadskas, E. K., Baušys, R., Stanujkic, D., & Magdalinovic-Kalinovic, M. (2016). Selection of lead-zinc flotation circuit design by applying WASPAS method with single-valued neutrosophic set. Infinite Study.
• Zavadskas, E. K., Turskis, Z., Antucheviciene, J., & Zakarevicius, A. (2012). Optimization of weighted aggregated sum product assessment. Elektronika ir elektrotechnika, 122(6), 3-6.
• Zhang, C., Li, W., & Wang, L. (2011, July). AHP under the intuitionistic fuzzy environment. In 2011 Eighth International Conference on Fuzzy Systems and Knowledge Discovery (FSKD) (Vol. 1, pp. 583-587). IEEE.
• Zhang, S. S. (2017). A model of based on Z-number and fuzzy analytic hierarchy process. Journal of Mathematics and Informatics, 7, 63-71.