Kim Tamamlar, Kim Sertifika Alır? MOOC'larda Dijital İzler ve Öğrenme Çıktıları

Year 2025, Volume: 9 Issue: 2, 201 - 209

Rukiye Orman , Hasan Çakır , Nergiz Çağıltay

Abstract

Bu çalışma, Kitlesel Açık Çevrimiçi Kurslar (MOOC'lar) bağlamında katılımcılar arasında kurs tamamlama ve sertifikasyonu etkileyen faktörleri araştırmayı amaçlamaktadır. Lojistik regresyon analizleri, katılımcıların demografik özelliklerine ve Massachusetts Teknoloji Enstitüsü (MIT) tarafından sunulan "Yapıların Öğeleri" adlı çevrimiçi kurstaki öğrenme etkileşimlerine dayanarak gerçekleştirilmiştir. Analizler, lisansüstü eğitim düzeyi, yaş grupları (özellikle 45 yaş ve üzeri), etkileşim günü sayısı, video oynatma sayısı, tamamlanan bölüm sayısı ve yazma etkinliği gibi değişkenlerin hem kurs tamamlama hem de sertifika alma olasılığı üzerinde anlamlı etkileri olduğunu ortaya koymuştur. Yazılı etkileşim ve içerik tamamlamanın başarıya katkısının özellikle anlamlı olduğu bulunmuştur. Model performansı, ROC eğrileri ve AUC (Eğri Altındaki Alan) kullanılarak değerlendirilmiştir. Sırasıyla 0,80 ve 0,92 olan AUC değerleri, yüksek sınıflandırma doğruluğu göstermiştir. Bulgular, lojistik regresyon analizinin MOOC platformlarında kullanıcı başarısını tahmin etmek için öngörücü modeller geliştirmede etkili bir araç olduğunu ve kişiselleştirilmiş, etkileşim odaklı öğrenme ortamları tasarımı için stratejik öneriler sunduğunu ortaya çıkarmaktadır.

Keywords

Kitlesel Açık Çevrimiçi Dersler (MOOC , Eğitim Veri Madenciliği , Lojistik Regresyon , Kurs Tamamlama , Sertifikasyon

Who Completes, Who Gets a Certificate? Digital Traces and Learning Outcomes in MOOCs

Abstract

This study aims to investigate the factors affecting course completion and certification among participants in the context of Massive Open Online Courses (MOOCs). Logistic regression analyses were conducted based on participants' demographic characteristics and learning interactions in the online course "Elements of Structures" offered by the Massachusetts Institute of Technology (MIT). The analyses revealed that variables such as graduate education level, age groups (especially ages 45 and above), number of days of interaction, number of video plays, number of chapters completed, and writing activity had significant effects on the likelihood of both course completion and certification. The contribution of written interaction and content completion to success was found to be particularly significant. Model performance was evaluated using ROC curves and AUC (Area Under the Curve). The AUC values of 0.80 and 0.92, respectively, demonstrated high classification accuracy. The findings reveal that logistic regression analysis is an effective tool in developing predictive models for predicting user success on MOOC platforms and offer strategic recommendations for personalized, interaction-oriented design of learning environments.

Keywords

Massive Open Online Courses (MOOCs) , Educational Data Mining , Logistic Regression , Course Completion , Certification

Thanks

The data were used with permission from Prof. Dr. Kürşat ÇAĞILTAY of MIT. We are grateful to MITx for allowing us to obtain the MOOC data.

References

• [1] P. Diver and I. Martinez, "MOOCs as a massive research laboratory: Opportunities and challenges.," Distance Education, vol. 36, no. 1, pp. 5-25, 2015.
• [2] J. Goopio and C. Cheung, "The MOOC dropout phenomenon and retention strategies," Journal of Teaching in Travel & Tourism, vol. 21, no. 2, pp. 177-197, 2020, doi: 10.1080/15313220.2020.1809050.
• [3] C. T. Swai and S. E. Mangowi, "Mining school teachers' MOOC training responses to infer their face-to-face teaching strategy preference," The International Journal of Information and Learning Technology, vol. 39, no. 1, pp. 82-94, 2022, doi: 10.1108/ijilt-07-2021-0102.
• [4] S. Joksimović et al., "How Do We Model Learning at Scale? A Systematic Review of Research on MOOCs," Review of Educational Research, vol. 88, no. 1, pp. 43-86, 2017, doi: 10.3102/0034654317740335.
• [5] B. C. Padilla Rodriguez, A. Armellini, and M. C. Rodriguez Nieto, "Learner engagement, retention and success: why size matters in massive open online courses (MOOCs)," Open Learning: The Journal of Open, Distance and e-Learning, vol. 35, no. 1, pp. 46-62, 2019, doi: 10.1080/02680513.2019.1665503.
• [6] A. Heusler, D. Molitor, and M. Spann, "How Knowledge Stock Exchanges can increase student success in Massive Open Online Courses," PLoS One, vol. 14, no. 9, p. e0223064, 2019, doi: 10.1371/journal.pone.0223064.
• [7] H. B. Shapiro, C. H. Lee, N. E. Wyman Roth, K. Li, M. Çetinkaya-Rundel, and D. A. Canelas, "Understanding the massive open online course (MOOC) student experience: An examination of attitudes, motivations, and barriers," Computers & Education, vol. 110, pp. 35-50, 2017, doi: 10.1016/j.compedu.2017.03.003.
• [8] J. Swacha and K. Muszyńska, "Predicting dropout in programming MOOCs through demographic insights," Electronics, vol. 12, no. 22, p. 4674, 2023.
• [9] Z. Liu, X. Kong, S. Liu, Z. Yang, and C. Zhang, "Looking at MOOC discussion data to uncover the relationship between discussion pacings, learners’ cognitive presence and learning achievements," Education and information technologies, vol. 27, no. 6, pp. 8265-8288, 2022.
• [10] J. He, J. Bailey, B. Rubinstein, and R. Zhang, "Identifying at-risk students in massive open online courses," in Proceedings of the AAAI Conference on Artificial Intelligence, 2015, vol. 29, no. 1.
• [11] A. Bozkurt et al., "A global outlook to the interruption of education due to COVID-19 pandemic: Navigating in a time of uncertainty and crisis," Asian journal of distance education, vol. 15, no. 1, pp. 1-126, 2020.
• [12] I. Despujol Zabala, L. Castaņeda, V. I. Marín, and C. Turro, "What do we want to know about MOOCs? Results from a machine learning approach to a systematic literature mapping review," 2022.
• [13] G. Veletsianos and S. Houlden, "An analysis of flexible learning and flexibility over the last 40 years of Distance Education," Distance Education, vol. 40, no. 4, pp. 454-468, 2019.
• [14] E. Anghel, J. Littenberg-Tobias, and M. von Davier, "What Did We Learn About Massive Open Online Courses for Teachers? A Scoping Review," International Review of Research in Open and Distributed Learning, vol. 26, no. 2, pp. 130-161, 2025.
• [15] D. Gašević, S. Dawson, T. Rogers, and D. Gasevic, "Learning analytics should not promote one size fits all: The effects of instructional conditions in predicting academic success," The Internet and Higher Education, vol. 28, pp. 68-84, 2016.
• [16] S. Joksimović et al., "How do we model learning at scale? A systematic review of research on MOOCs," Review of Educational Research, vol. 88, no. 1, pp. 43-86, 2018.
• [17] M. Zhu, A. R. Sari, and M. M. Lee, "Trends and issues in MOOC learning analytics empirical research: A systematic literature review (2011–2021)," Education and Information Technologies, vol. 27, no. 7, pp. 10135-10160, 2022.
• [18] S. Menard, Applied logistic regression analysis. SAGE publications, 2001.
• [19] C.-Y. J. Peng, K. L. Lee, and G. M. Ingersoll, "An introduction to logistic regression analysis and reporting," The journal of educational research, vol. 96, no. 1, pp. 3-14, 2002.
• [20] D. T. Seaton, Y. Bergner, I. Chuang, P. Mitros, and D. E. Pritchard, "Who does what in a massive open online course?," Communications of the ACM, vol. 57, no. 4, pp. 58-65, 2014.
• [21] R. F. Kizilcec, C. Piech, and E. Schneider, "Deconstructing disengagement: Analyzing learner subpopulations in massive open online courses," presented at the Proceedings of the third international conference on learning analytics and knowledge, 2013.
• [22] M. C. Almodiel, "Assessing Online Learners’ Access Patterns and Performance Using Data Mining Techniques," International Journal in Information Technology in Governance Education and Business, vol. 3, no. 1, pp. 46-56, 2021, doi: 10.32664/ijitgeb.v3i1.87.
• [23] J. DeBoer, A. D. Ho, G. S. Stump, and L. Breslow, "Changing “course”: Reconceptualizing educational variables for massive open online courses," Educational Researcher, vol. 43, no. 2, pp. 74-84, 2014.
• [24] B. P. Cohen and M. Nycz, "Learning analytics in MOOCs: A literature review," International Journal of Learning Analytics and Artificial Intelligence for Education, vol. 1, no. 1, pp. 33-48, 2017.
• [25] J. Kim, P. J. Guo, D. T. Seaton, P. Mitros, K. Z. Gajos, and R. C. Miller, "Understanding in-video dropouts and interaction peaks in online lecture videos," presented at the Proceedings of the first ACM conference on Learning@ scale conference, 2014.
• [26] N. H. Ling, C. J. Chen, C. S. Teh, D. S. John, L.-C. Ch’ng, and Y. F. Lay, "Global Trends of Educational Data Mining in Online Learning," International Journal of Technology in Education, vol. 6, no. 4, pp. 656-680, 2023, doi: 10.46328/ijte.558.
• [27] M. T. Sarıtaş, C. Börekci, and S. Demirel, "Quality Assurance in Distance Education Through Data Mining," International Journal of Technology in Education and Science, vol. 6, no. 3, pp. 443-457, 2022, doi: 10.46328/ijtes.396.
• [28] A. Urban, "How Hands-on Assessments Can Boost Retention, Satisfaction, Skill Development, and Career Outcomes in Online Courses," Ai Computer Science and Robotics Technology, vol. 2, 2023, doi: 10.5772/acrt.23.
• [29] S. Batool, J. Rashid, M. W. Nisar, J. Kim, H. Y. Kwon, and A. Hussain, "Educational data mining to predict students' academic performance: A survey study," Education and Information Technologies, vol. 28, no. 1, pp. 905-971, 2023.
• [30] C. Romero and S. Ventura, "Educational Data Mining: A Survey from 1995 to 2005," Expert Systems with Applications, pp. 135-146, 2017.
• [31] Ş. Büyüköztürk, "Sosyal bilimler için veri analizi el kitabı," Pegem Atıf İndeksi, pp. 001-214, 2018.
• [32] J. Pallant, SPSS survival manual: A step by step guide to data analysis using IBM SPSS. Routledge, 2020.
• [33] T. Fawcett, "An introduction to ROC analysis," Pattern recognition letters, vol. 27, no. 8, pp. 861-874, 2006.
• [34] J. Littenberg-Tobias, J. A. Ruipérez-Valiente, and J. Reich, "Studying learner behavior in online courses with free-certificate coupons: Results from two case studies," International Review of Research in Open and Distributed Learning, vol. 21, no. 1, pp. 1-22, 2020.
• [35] V. Sherimon, P. Sherimon, L. Francis, D. Devassy, and T. K. George, "Factors associated with Student enrollment, completion, and dropout of massive open online courses in the Sultanate of Oman," International Journal of Learning, Teaching and Educational Research, vol. 20, no. 11, pp. 154-169, 2021.
• [36] L. Caprara and C. Caprara, "Effects of virtual learning environments: A scoping review of literature," Education and Information Technologies, vol. 27, no. 3, pp. 3683-3722, 2022.
• [37] A. Eltayar, S. R. Aref, H. M. Khalifa, and A. S. Hammad, "Prediction of graduate learners’ academic achievement in an online learning environment using a blended trauma course," Advances in Medical Education and Practice, pp. 137-144, 2023.
• [38] S. Gunes, "Design entrepreneurship in product design education," Procedia-Social and Behavioral Sciences, vol. 51, pp. 64-68, 2012.
• [39] A. Wald, P. A. Muennig, K. A. O'Connell, and C. E. Garber, "Associations between healthy lifestyle behaviors and academic performance in US undergraduates: a secondary analysis of the American College Health Association's National College Health Assessment II," American Journal of Health Promotion, vol. 28, no. 5, pp. 298-305, 2014.
• [40] A. S. Schulze, Massive open online courses (MOOCs) and completion rates: are self-directed adult learners the most successful at MOOCs? Pepperdine University, 2014.
• [41] V. Sherimon, L. Francis, D. Devassy, and W. Aboraya, "Exploring the Impact of Learners’ Demographic Characteristics on Course Completion and Dropout in Massive Open Online Courses," International Journal of Research -Granthaalayah, vol. 10, no. 1, pp. 149-160, 2022, doi: 10.29121/granthaalayah.v10.i1.2022.4469.
• [42] Q. Zhang, F. C. Bonafini, B. B. Lockee, K. W. Jablokow, and X. Hu, "Exploring demographics and students’ motivation as predictors of completion of a massive open online course," International Review of Research in Open and Distributed Learning, vol. 20, no. 2, 2019.
• [43] L. R. Gorfinkel, A. Giesler, H. Dong, E. Wood, N. Fairbairn, and J. Klimas, "Development and evaluation of the online addiction medicine certificate: free novel program in a Canadian setting," JMIR medical education, vol. 5, no. 1, p. e12474, 2019.
• [44] P. J. Guo, J. Kim, and R. Rubin, "How video production affects student engagement: An empirical study of MOOC videos," presented at the Proceedings of the First ACM Conference on Learning@ Scale Conference, 2014.
• [45] N. P. Morris, B. Swinnerton, and S. Hotchkiss, "Can demographic information predict MOOC learner outcomes?," in Experience track: proceedings of the European MOOC stakeholder, 2015: Leeds.
• [46] Y.-P. Chao et al., "Using a 360 virtual reality or 2D video to learn history taking and physical examination skills for undergraduate medical students: pilot randomized controlled trial," JMIR serious games, vol. 9, no. 4, p. e13124, 2021.
• [47] I. Bingol, E. Kursun, and H. Kayaduman, "Factors for success and course completion in massive open online courses through the lens of participant types," Open Praxis, vol. 12, no. 2, pp. 223-239, 2020.
• [48] N. E. Cagiltay, K. Cagiltay, and B. Celik, "An analysis of course characteristics, learner characteristics, and certification rates in MITx MOOCs," International Review of Research in Open and Distributed Learning, vol. 21, no. 3, pp. 121-139, 2020.
• [49] L. Breslow, D. E. Pritchard, J. DeBoer, G. S. Stump, A. D. Ho, and D. T. Seaton, "Studying learning in the worldwide classroom research into edX's first MOOC," Research & Practice in Assessment, vol. 8, pp. 13-25, 2013.
• [50] A. D. Ho et al., "Harvardx and mitx: The first year of open online courses—fall 2012–summer 2013 (harvardx and mitx working paper# 1)," EducationXPress, vol. 2014, no. 2, pp. 1-1, 2014.
• [51] Q. Zhang et al., "Exploring the communication preferences of MOOC learners and the value of preference-based groups: Is grouping enough?," Educational Technology Research and Development, vol. 64, pp. 809-837, 2016.