CONDUCTING REMOTE ELECTRONIC EXAMINATIONS IN DISTANCE HIGHER EDUCATION: STUDENTS’ PERCEPTIONS

Year 2023, Volume: 24 Issue: 2, 167 - 182, 01.04.2023

George Vorvılas Alexandros Lıapıs Alkis Korovesıs Dimitra Aggelopoulou Nikos Karousos Efstathios Efstathopoulos

https://doi.org/10.17718/tojde.971889

Abstract

The COVID-19 pandemic forced Higher Educational Institutes (HEIs) to adopt alternative approaches in delivering their learning activities including examinations. Regarding the latter, remote electronic examinations were selected as a one-way solution due to physical presence restriction measures imposed by governments around the world. This paper presents the evaluation of the remote examinations conducted by the Anonymized Open University [AOU]. The evaluation sought to inform decision making about the future of remote examinations at that distance learning organization. A sample of 9.276 students participated voluntarily and filled out a questionnaire. Both qualitative and quantitative analysis was employed. Results revealed that students were satisfied with the remote electronic examination process and they expressed their desire to be examined remotely again. Avoiding travelling and saving money were the main benefits mentioned by students. Issues were reported regarding the examination topics and the examination time. Students suggested the provision of more examination time and improvements in the university procedures and infrastructures that support remote examinations.

Keywords

Remote e-examinations, COVID-19, examination evaluation, challenges, suggestions

References

• Adebayo, O., & Abdulhamid, S. (2014). E- exams system for Nigerian universities with emphasis on security and result integrity. International Journal of the Computer, the Internet and Management (IJCIM) 18 (2): 1-12. Adegbija, M. V. (2012). New technologies and the conduct of e-examinations: A case study of the National Open University of Nigeria. Journal of the Collaboration of Education Faculties in West Africa 2 (1): 104-113.
• Alruwais, N. (2018). Advantages and challenges of using e-assessment. International Journal of Information and Education Technology, 8, 34–37. https://doi.org/10.18178/ijiet.2018.8.1.1008
• Babo, R., Babo, R., Suhonen, J. T., & Tukiainen, M. (2020). E- assessment with multiple-choice questions: a 5-year study of students’ opinions and experience. Journal of Information Technology Education: Innovations in Practice, 19, 001–029. https://doi.org/10.28945/4491
• Bashitialshaaer, R., Alhendawi, M., & Lassoued, Z. (2021). Obstacle comparisons to achieving distance learning and applying electronic exams during COVID-19 pandemic. Symmetry, 13(1), 99. https://doi.org/10.3390/sym13010099 Bayazit, A., & Aşkar, P. (2012). Performance and duration differences between online and paper–pencil tests. Asia Pacific Education Review, 13(2), 219–226. https://doi.org/10.1007/s12564-011-9190-9
• Betlej, P. (2013). E-examinations from student’s perspective—The future of knowledge evaluation. Studia Ekonomiczne, 153, 9–22.
• Bothwell, E. (2020, March 18). Flexible admissions could mitigate Covid-19 impact. Retrieved October 14, 2020, from Times Higher Education (THE) website: https://www.timeshighereducation.com/news/flexible-admissions-could-mitigate-covid-19-impact
• Bryman, A. (2014). Social research methods. Oxford University press.
• Dammas, A. (2016). Investigate students’ attitudes toward computer based test (CBT) at chemistry course. International Journal of Scientific and Research Publications, 6, 209–216.
• Datsenka, R., Stankov, I., & Kurbel, K. (2012). Design and implementation of remotely supervised video-based distance examinations. 2012 IEEE 12th International Conference on Advanced Learning Technologies, 208–212. https://doi.org/10.1109/ICALT.2012.94
• Davis, S. F., Grover, C. A., Becker, A. H., & McGregor, L. N. (1992). Academic dishonesty: prevalence, determinants, techniques, and punishments. Teaching of Psychology, 19(1), 16–20. https://doi.org/10.1207/s15328023top1901_3
• OECD (2020). Remote online exams in higher education during the COVID-19 crisis. OECD Education Policy Perspectives, 6. https://doi.org/10.1787/f53e2177-en
• Elsalem, L., Al-Azzam, N., Jum’ah, A. A., Obeidat, N., Sindiani, A. M., & Kheirallah, K. A. (2020). Stress and behavioral changes with remote e-exams during the COVID-19 pandemic: a cross-sectional study among undergraduates of medical sciences. Annals of Medicine and Surgery, 60, 271–279. https://doi.org/10.1016/j.amsu.2020.10.058
• Farzin, S. (2017). Attitude of students towards e-examination system: an application of e-learning. Science Journal of Education, 4(6), 222. https://doi.org/10.11648/j.sjedu.20160406.19
• Fluck, A., Pálsson, H., Coleman, M., Hillier, M., Schneider, D., Frankl, G., & Uolia, K. (2017). eExam symposium: Design decisions and implementation experience. Retreived July 14, 2021 from http://www.transformingexams.com/files/Fluck_etal_2017_eExam_Symposium_at_IFIP_TC3_WCCE_Ireland.pdf
• Gotlib, J., Panczyk, M., Gębski, P., Zarzeka, A., Iwanow, L., Dabrowski, F., & Malczyk, M. (2015). Comparative analysis of opinions of Warsaw Medical University students on electronic examinations and final tests by their participation in this form of knowledge assessment – preliminary report. Polish Journal of Public Health, 125, 153–158. https://doi.org/10.1515/pjph-2015-0044
• Hillier, M. (2014). The very idea of e-exams: student (pre)conceptions. In H. Bronwyn, J. McDonald, and S.-K. Lok (Eds.), Australasian Society for Computers in Learning in Tertiary Education Conference, 2014 (pp. 77-88). New Zealand: Dunedin.
• Hillier, M. (2015). e-Exams with student owned devices: Student voices. In D. Churchill, T. K. F. Chiu, & N. J. Gu (Eds.), Proceedings of the International Mobile Learning Festival: Mobile Learning, MOOCs and 21st Century Learning, 2015, (pp. 582-608). China: Hong Kong. Hillier, M., & Grant, S. (2018). Do-it-yourself e-exams. In M. Campbell, et al. (Eds.), Annual Conference of the Australasian Society for Computers in Learning in Tertiary Education 2018, (pp.121-130). Australia: Geelong.
• Hillier, M., Grant, S., & Coleman, M. (2018). Towards authentic e-exams at scale: Robust networked Moodle. In M. Campbell, et al. (Eds.), Annual Conference of the Australasian Society for Computers in Learning in Tertiary Education 2018, (pp.111-141). Australia: Geelong.
• Hillier, M., Kumar, N., & Wijenayake, N. (2020). e-examinations: The impact of technology problems on student experience. In T. Brinda, D. Passey, & T. Keane (Eds.), Empowering Teaching for Digital Equity and Agency (pp. 35–45). Cham: Springer International Publishing. https://doi.org/10.1007/978-3-030-59847-1_4
• Hodgson, P., & Pang, M. Y. C. (2012). Effective formative e-assessment of student learning: A study on a statistics course. Assessment & Evaluation in Higher Education, 37(2), 215–225. https://doi.org/10.1080/02602938.2010.523818
• Hollinger, R. C., & Lanza-Kaduce, L. (1996). Academic dishonesty and the perceived effectiveness of countermeasures. NASPA Journal, 33(4), 292–306. https://doi.org/10.1080/00220973.1996.11072417
• Iannone, P., & Simpson, A. (2017). University students’ perceptions of summative assessment: The role of context. Journal of Further and Higher Education, 41(6), 785–801. https://doi.org/10.1080/0309877X.2016.1177172
• Ilgaz, H., & Afacan Adanır, G. (2020). Providing online exams for online learners: Does it really matter for them? Education and Information Technologies, 25(2), 1255–1269. https://doi.org/10.1007/s10639-019-10020-6
• James, R. (2016). Tertiary student attitudes to invigilated, online summative examinations. International Journal of Educational Technology in Higher Education, 13(1), 19. https://doi.org/10.1186/s41239-016-0015-0
• Jimoh, R., Shittu, A. J., Kawu, Y., & Kola. (2012). Students’ Perception of Computer Based Test (CBT) for Examining Undergraduate Chemistry Courses. Journal of Emerging Trends in Computing and Information Sciences 3, 125-134.
• Jr, J. H. W. (1963). Hierarchical Grouping to Optimize an Objective Function. Journal of the American Statistical Association, 58(301), 236–244. https://doi.org/10.1080/01621459.1963.10500845
• Khan, S., & Khan, R. A. (2019). Online assessments: Exploring perspectives of university students. Education and Information Technologies, 24(1), 661–677. https://doi.org/10.1007/s10639-018-9797-0
• Kuikka, M., Kitola, M., & Laakso, M.-J. (2014). Challenges When Introducing Electronic Exam. Research in Learning Technology, 22. https://doi.org/10.3402/rlt.v22.22817
• Laine, K., Sipilä, E., Anderson, M., & Sydänheimo, L. (2016). Electronic exam in electronics studies. Rereived July 14, 2021 from https://www.sefi.be/wp-content/uploads/2017/09/laine-electronic-exam-in-eletronics-studies-9.pdf.
• lamas-Nistal, M., Fernández-Iglesias, M. J., González-Tato, J., & Mikic-Fonte, F. A. (2013). Blended e-assessment: Migrating classical exams to the digital world. Computers & Education, 62, 72–87. https://doi.org/10.1016/j.compedu.2012.10.021 Marinoni, G., van’t Land, H., & Jensen, T. (2020). The impact of COVID-19 on higher education around the world. Retrieved July 14, 2021 from https://www.iau-aiu.net/IMG/pdf/iau_covid19_and_he_survey_report_final_may_2020.pdf
• Means, B., Bakia, M., & Murphy, R. (2014). Learning online: What research tells us about whether, when and how. Routledge. Nardi, A., & Ranieri, M. (2019). Comparing paper-based and electronic multiple-choice examinations with personal devices: Impact on students’ performance, self-efficacy and satisfaction. British Journal of Educational Technology, 50(3), 1495–1506. https://doi.org/10.1111/bjet.12644
• Nguyen, Q., Rienties, B., Toetenel, L., Ferguson, R., & Whitelock, D. (2017). Examining the designs of computer-based assessment and its impact on student engagement, satisfaction, and pass rates. Computers in Human Behavior, 76, 703–714. https://doi.org/10.1016/j.chb.2017.03.028
• Omidian, F., & Nedayeh Ali, F. (2015). A study on the attitudes of students, instructors, and educational principals to electronic administration of final-semester examinations in Payame Noor University in Iran. Turkish Online Journal of Distance Education, 16(3), 118–125.
• Osuji, U. (2012). The Use of e-assessments in the Nigerian higher education system. Turkish Online Journal of Distance Education 13(4), 140-152. https://doi.org/10.17718/TOJDE.25466
• Pagram, J., Cooper, M., Jin, H., & Campbell, A. (2018). Tales from the exam room: Trialing an e-exam system for computer education and design and technology students. Education Sciences, 8(4), 188. https://doi.org/10.3390/educsci8040188
• Ranganth, R., Rajalaksmi, C., & Simon, M. (2017). Medical students’ perceptions of e-assessment: Multiple choice questions used as a tool of assessment for preclinical years. Journal of Medical Education, 16, 35–43.
• Sahu, P. (2020). Closure of universities due to coronavirus disease 2019 (COVID-19): Impact on education and mental health of students and academic staff, Cureus 12(4), e7541. https://doi.org/10.7759/cureus.7541
• Shraim, K. (2019). Online Examination Practices in Higher Education Institutions: Learners’ Perspectives. Turkish Online Journal of Distance Education, 20(4), 185–196.
• Sindre, G., & Chirumamilla, A. (2015). E-exams and exam process improvement. Retrieved July 14, 2021 from https://www.researchgate.net/publication/299497855_E-exams_and_exam_process_improvement
• Snodgrass, S. J., Ashby, S. E., Rivett, D. A., & Russell, T. (2014). Implementation of an electronic objective structured clinical exam for assessing practical skills in pre-professional physiotherapy and occupational therapy programs: Examiner and course coordinator perspectives. Australasian Journal of Educational Technology, 30(2). https://doi.org/10.14742/ajet.348
• Thomas, P., Price, B., Paine Schofield, C., & Richards, M. (2002). Remote electronic examinations: Student experiences. British Journal of Educational Technology, 33. https://doi.org/10.1111/1467-8535.00290
• Walker, R., & Handley, Z. (2016). Designing for learner engagement with computer-based testing. Research in Learning Technology, 24. https://doi.org/10.3402/rlt.v24.30083
• Washburn, S., Herman, J., & Stewart, R. (2017). Evaluation of performance and perceptions of electronic vs. Paper multiple-choice exams. Advances in Physiology Education, 41(4), 548–555. https://doi.org/10.1152/advan.00138.2016
• Wibowo, S., Grandhi, S., Chugh, R., & Sawir, E. (2016). A pilot study of an electronic exam system at an Australian university. Journal of Educational Technology Systems, 45(1), 5–33. https://doi.org/10.1177/0047239516646746
• Zhai, C., & Massung, S. (2016). Text Data Management and Analysis: A Practical Introduction to Information Retrieval and Text Mining. Morgan & Claypool.