Analysing the Effects of Assessment and Evaluation Applications and Exam Formats in Distance Education

Abstract

This study examines the online assessment-evaluation activities in distance education processes. The effects of different online exam application styles considering the online assessment-evaluation in distance education processes, including all programs of a higher education institution, were documented. The population for online assessment-evaluation activities, exam types, and student achievement scores comprised 3830 courses by 805 academics over the Uşak University learning management system and 29511 students. organisThe data were analysed with descriptive statistics and t-tests for comparisons. It was found that academics preferred multiple-choice exam formats more than online assignments or classical (written) ones. Moreover, students' success scores in multiple-choice exams were significantly higher than exams including open-ended questionsIt was also found that average exam success was higher when the questions were presented as separate but as a group. The findings were discussed and reported with a literature review.

Keywords

• Online exam
• exam formats
• e-assessment
• e-exam
• online assessment

References

1. Al-Hakeem, M. S., & Abdulrahman, M. S. (2017). Developing a new e-exam platform to enhance the university academic examinations: the case of Lebanese French University. I.J. Modern Education and Computer Science, 5, 9-16. https://doi.org/10.5815/ijmecs.2017.05.02
2. Ann, M., & Christie, T. (2002). The role of classrooms in educational technology research: An example. Concord Consortium. https://concord.org/wp-content/uploads/2016/12/pdf/MTC.AERA02.rtf.pdf
3. Ar, M. E. (2019). Fen bilimleri öğretmenlerine yönelik geliştirilen nitelikli yaşam temelli açık uçlu soru hazırlama kursunun uygulanması ve değerlendirilmesi [Master thesis]. Uludağ University.
4. Bahar, M., Nartgün, Z., Durmuş, S., & Bıçak, B. (2012). Geleneksel-tamamlayıcı ölçme ve değerlendirme teknikleri öğretmen el kitabı. Pegem Akademi.
5. Baran, H. (2020). Açık ve uzaktan eğitimde ölçme ve değerlendirme. Açıköğretim Uygulamaları ve Araştırmaları Dergisi,6(1), 28-40.
6. Best, L. M., & Shelley, D. J. (2018). Academic dishonesty: Does social media allow for increased and more sophisticated levels of student cheating? International Journal of Information and Communication Technology Education, 14(3), 1-14.
7. Bilen, E., & Matros, A. (2021). Online cheating amid COVID-19. Journal of Economic Behavior & Organization, 182, 196-211. https://doi.org/10.1016/j.jebo.2020.12.004
8. Büyüköztürk, Ş. (2018). Sosyal bilimler için veri analizi el kitabı (24 Ed.). Pegem Akademi. https://doi.org/10.14527/9789756802748

9. Can, E. (2020). Coronavirüs (Covid-19) pandemisi ve pedagojik yansımaları: Türkiye’de açık ve uzaktan eğitim uygulamaları. Açıköğretim Uygulamaları ve Araştırmaları Dergisi, 6(2), 11-53.
10. Chaudhary, S., & Dey, N. (2013). Assessment in open and distance learning system (odl): A challenge. Open Praxis, 207–216. http://dx.doi.org/10.5944/openpraxis.5.3.65
11. Çakan, M. (2011). Eğitim sistemimizde yaygın olarak kullanılan test türleri. In S. Tekindal, Eğitimde ölçme ve değerlendirme (pp. 91-126). Pegem.
12. DeFranzo, S. E. (2018). Advantages and disadvantages of open questions in course evaluations questions in course evaluations. Snapsurveys. https://www.snapsurveys.com/blog/advantages-disadvantages-open-questions-course-eval/
13. Delandshere, G. (1990). Diagnostic assessment procedures. In H. Walberg, & G. Haertel, The international encyclopedia of educational evaluation (pp. 340-343). Pergamon Press.
14. Demir, E. (2010). Uluslararası öğrenci değerlendirme programı (PISA) bilişsel alan testlerinde yer alan soru tiplerine göre Türkiye'de öğrenci başarıları [Master thesis]. Hacettepe University
15. Dendir, S., & Maxwell, R. S. (2020). Cheating in online courses: evidence from online proctoring. Computers in Human Behavior, 2, 1-10. https://doi.org/10.1016/j.chbr.2020.100033
16. Dossetto, F. (2021). Open-ended questions vs. close-ended questions: examples and how to survey users. Hotjar. https://www.hotjar.com/blog/open-ended-questions/
17. Eviren, Ö. S. (2017). Eğitim değerlendirme modelleri. The Journal of Limitless Education and Research, 2(3), 57-76.
18. Genç, Z., & Aydemir, E. (2015). An alternative evaluation: online puzzle as a course-end activity. Interactive Technology and Smart Education, 12(3), 169-182. http://dx.doi.org/10.1108/ITSE-04-2015-0008
19. Gunawardena, C., & LaPointe, D. (2003). Planning and management of student assessment. In S. Panda, Planning & management in distance education (pp. 195-205). Kogan Page.
20. Güler, N. (2017). Eğitimde ölçme ve değerlendirme. Pegem Akademi.
21. Güneş, F. (2014). Eğitimde ödev tartışmaları. Bartın Üniversitesi Eğitim Fakültesi Dergisi, 1-22. http://doi.org/10.14686/BUEFAD.201428169
22. Huhta, A. (2008). Diagnostic and formative assessment. In B. Spolsky, & F. M. Hult, The handbook of educational linguistics (pp. 469-522). Blackwell Publishing.
23. Ismail, M., Mokhtar, W. Z., Nasir, N. N., Rashid, N. R., & Ariffin, A. K. (2014). The development of a web-based assignment system (wbh) via tcexam. Mediterranean Journal of Social Sciences, 5(15), 249. http://dx.doi.org/10.5901/mjss.2014.v5n15p249
24. Karadağ, N. (2014). Açık ve uzaktan eğitimde ölçme ve değerlendirme Mega üniversitelerdeki uygulamalar [Doctoral dissertation], Anadolu University
25. Karagöz, Y., & Bardakçı, S. (2020). Bilimsel araştırmalarda kullanılan ölçme araçları ve ölçek geliştirme (1 Ed.). Nobel Akademik.
26. Kargın, T. (1989). Ölçme ve değerlendirme. Ankara Üniversitesi Açık Ders Sistemi. https://acikders.ankara.edu.tr/pluginfile.php/1989/mod_resource/content/1/5.%20EDD-%20DERS-%205-%20%C3%96L%C3%87ME%20DE%C4%9EERLEND%C4%B0RME%20.pdf
27. Kuikkaa, M., Kitola, M., & Laakso, M.-J. (2014). Challenges when introducing electronic exam. Research in Learning Technology, 22, 1-17. https://doi.org/10.3402/rlt.v22.22817
28. Linn, R. L., & Gronlund, N. E. (1995). Measurement and assessment in teaching. Merril.
29. Martiarini, E. (2017). Contrasting multiplechoice and cloze task on student’s reading comprehension. DEIKSIS, 9(3), 292-299.
30. Miyazoe, T., & Anderson, T. (2010). Learning outcomes and students' perceptions of online writing: Simultaneous implementation of a forum, blog, and wiki in an EFL blended learning setting. International Journal of Educational Technology and Applied Linguistics, 38(2), 185-199. http://dx.doi.org/10.1016/j.system.2010.03.006
31. Neuert, C. E., Meitinger, K., Behr, D., & Schonlau, M. (2021). Editorial: the use of open-ended questions in surveys. methods, data, analyses. A Journal For Quantitative Methods And Survey Methodology (Mda), 15(1), 3-6.
32. Özalkan, G. Ş. (2021). Uzaktan eğitimde ölçme ve değerlendirme: pandemi sürecinde sosyal bilimler eğitimini yeniden düşünmek. International Journal of Economics Administrative and Social Sciences, 4, 18-26.
33. Özkan, Y. Ö., & Özaslan, N. (2018). Student achievement in Turkey, according to question types used in Pısa 2003-2012 mathematic literacy tests. International Journal of Evaluation and Research in Education (IJERE), 7(1), 57-64. https://doi.org/10.11591/ijere.v7.i1.11045
34. Parker, J. M., Anderson, C. W., Heidemann, M., Merrill, J., Merritt, B., Richmond, G., & Urban-Lurain, M. (2012). Exploring undergraduates' understanding of photosynthesis using diagnostic question clusters. CBE Life Sci Educ., 47-57. https://doi.org/10.1187/cbe.11-07-0054
35. Pedhazur, E. J., & Schmelkin, L. P. (1991). Measurement, design, and analysis: an ıntegrated approach. Lawrence Erlbaum Associate.
36. Reja, U., Manfreda, K. L., Hlebec, V., & Vehovar, V. (2003). Open-ended vs. close-ended questions in web questionnaires. Developments in Applied Statistics,19, 159-176.
37. Sarı, H. İ. (2020). Evde kal döneminde uzaktan eğitim: Ölçme ve değerlendirmeyi neden karantinaya almamalıyız? Uluslararası Eğitim Araştırmacıları Dergisi, 3(1), 121-128.
38. Sarrayrih, M. A., & Ilyas, M. (2013). Challenges of online exam, performances and problems for online university exam. IJCSI International Journal of Computer Science Issues, 439-443.
39. Semerci, Ç., & C.Bektaş. (2005). İnternet temelli ölçmelerin geçerliğini sağlamada yeni yaklaşımlar. The Turkish Online Journal of Educational Technology – TOJET, 4(1), 130-134.
40. Shraim, K. (2019). Online examination practices in higher education institutions: learners' perspectives. Turkish Online Journal of Distance Education-TOJDE, 20(4), 185-196.
41. Simonson, M., Smaldino, S., Albright, M., & Zvacek, S. (2012). Teaching and learning at a distance: Foundations of distance education (3 b.). Prentice Hall.
42. Tekin, H. (1996). Eğitimde ölçme ve değerlendirme. Yargı Yayınevi.
43. Temizkan, M., & Sallabaş, M. E. (2011). Okuduğunu anlama becerisinin değerlendirilmesinde çoktan seçmeli testlerle açık uçlu yazılı yoklamaların karşılaştırılması. Dumlupınar Üniversitesi Sosyal Bilimler Dergisi, 30, 207-220.
44. Torrance, H., & Pryor, J. (1998). Investigating formative assesment: teaching, learning and assessment in the classroom. PA Open University Press.
45. Turani, A. A., Alkhateeb, J. H., & Alsewari, A. A. (2020). Students online exam proctoring: a case study using 360 degree security cameras. 2020 Emerging Technology in Computing, Communication and Electronics (ETCCE) (pp. 1-5). Bangladesh: IEEE. http://doi.org/10.1109/ETCCE51779.2020.9350872
46. Turgut, M. F. (1987). Eğitimde ölçme ve değerlendirme metotları. Saydam.
47. Turgut, M., & Baykul, Y. (2015). Eğitimde ölçme ve değerlendirme. Pegem.
48. Weimer, M. (2021). Advantages and disadvantages of different types of test questions. Office of Educational Development. http://educationaldevelopment.uams.edu/advantages-and-disadvantages-of-different-types-of-test-questions/
49. Yaşar, Ş. (1998). Evaluation of educational programmes in Turkey. Annual Meeting of the American Educational Research Association (pp. 1-6). San Diego: ERIC.
50. YÖK. (2020). Yükseköğretim kurumlarında uzaktan öğretime ilişkin usul ve esaslar.https://www.yok.gov.tr/Documents/Kurumsal/egitim_ogretim_dairesi/Uzaktan_ogretim/yuksekogretim_kurumlarinda_uzaktan_ogretime_iliskin_usul_ve_esaslar.pdf