CONDUCTING REMOTE ELECTRONIC EXAMINATIONS IN DISTANCE HIGHER EDUCATION: STUDENTS’ PERCEPTIONS

George Vorvılas; Alexandros Lıapıs; Alkis Korovesıs; Dimitra Aggelopoulou; Nikos Karousos; Efstathios Efstathopoulos

doi:10.17718/tojde.971889

EN

CONDUCTING REMOTE ELECTRONIC EXAMINATIONS IN DISTANCE HIGHER EDUCATION: STUDENTS’ PERCEPTIONS

Abstract

The COVID-19 pandemic forced Higher Educational Institutes (HEIs) to adopt alternative approaches in delivering their learning activities including examinations. Regarding the latter, remote electronic examinations were selected as a one-way solution due to physical presence restriction measures imposed by governments around the world. This paper presents the evaluation of the remote examinations conducted by the Anonymized Open University [AOU]. The evaluation sought to inform decision making about the future of remote examinations at that distance learning organization. A sample of 9.276 students participated voluntarily and filled out a questionnaire. Both qualitative and quantitative analysis was employed. Results revealed that students were satisfied with the remote electronic examination process and they expressed their desire to be examined remotely again. Avoiding travelling and saving money were the main benefits mentioned by students. Issues were reported regarding the examination topics and the examination time. Students suggested the provision of more examination time and improvements in the university procedures and infrastructures that support remote examinations.

Keywords

Remote e-examinations, COVID-19, examination evaluation, challenges, suggestions

References

Adebayo, O., & Abdulhamid, S. (2014). E- exams system for Nigerian universities with emphasis on security and result integrity. International Journal of the Computer, the Internet and Management (IJCIM) 18 (2): 1-12. Adegbija, M. V. (2012). New technologies and the conduct of e-examinations: A case study of the National Open University of Nigeria. Journal of the Collaboration of Education Faculties in West Africa 2 (1): 104-113.
Alruwais, N. (2018). Advantages and challenges of using e-assessment. International Journal of Information and Education Technology, 8, 34–37. https://doi.org/10.18178/ijiet.2018.8.1.1008
Babo, R., Babo, R., Suhonen, J. T., & Tukiainen, M. (2020). E- assessment with multiple-choice questions: a 5-year study of students’ opinions and experience. Journal of Information Technology Education: Innovations in Practice, 19, 001–029. https://doi.org/10.28945/4491
Bashitialshaaer, R., Alhendawi, M., & Lassoued, Z. (2021). Obstacle comparisons to achieving distance learning and applying electronic exams during COVID-19 pandemic. Symmetry, 13(1), 99. https://doi.org/10.3390/sym13010099 Bayazit, A., & Aşkar, P. (2012). Performance and duration differences between online and paper–pencil tests. Asia Pacific Education Review, 13(2), 219–226. https://doi.org/10.1007/s12564-011-9190-9
Betlej, P. (2013). E-examinations from student’s perspective—The future of knowledge evaluation. Studia Ekonomiczne, 153, 9–22.
Bothwell, E. (2020, March 18). Flexible admissions could mitigate Covid-19 impact. Retrieved October 14, 2020, from Times Higher Education (THE) website: https://www.timeshighereducation.com/news/flexible-admissions-could-mitigate-covid-19-impact
Bryman, A. (2014). Social research methods. Oxford University press.
Dammas, A. (2016). Investigate students’ attitudes toward computer based test (CBT) at chemistry course. International Journal of Scientific and Research Publications, 6, 209–216.
Datsenka, R., Stankov, I., & Kurbel, K. (2012). Design and implementation of remotely supervised video-based distance examinations. 2012 IEEE 12th International Conference on Advanced Learning Technologies, 208–212. https://doi.org/10.1109/ICALT.2012.94
Davis, S. F., Grover, C. A., Becker, A. H., & McGregor, L. N. (1992). Academic dishonesty: prevalence, determinants, techniques, and punishments. Teaching of Psychology, 19(1), 16–20. https://doi.org/10.1207/s15328023top1901_3

OECD (2020). Remote online exams in higher education during the COVID-19 crisis. OECD Education Policy Perspectives, 6. https://doi.org/10.1787/f53e2177-en
Elsalem, L., Al-Azzam, N., Jum’ah, A. A., Obeidat, N., Sindiani, A. M., & Kheirallah, K. A. (2020). Stress and behavioral changes with remote e-exams during the COVID-19 pandemic: a cross-sectional study among undergraduates of medical sciences. Annals of Medicine and Surgery, 60, 271–279. https://doi.org/10.1016/j.amsu.2020.10.058
Farzin, S. (2017). Attitude of students towards e-examination system: an application of e-learning. Science Journal of Education, 4(6), 222. https://doi.org/10.11648/j.sjedu.20160406.19
Fluck, A., Pálsson, H., Coleman, M., Hillier, M., Schneider, D., Frankl, G., & Uolia, K. (2017). eExam symposium: Design decisions and implementation experience. Retreived July 14, 2021 from http://www.transformingexams.com/files/Fluck_etal_2017_eExam_Symposium_at_IFIP_TC3_WCCE_Ireland.pdf
Gotlib, J., Panczyk, M., Gębski, P., Zarzeka, A., Iwanow, L., Dabrowski, F., & Malczyk, M. (2015). Comparative analysis of opinions of Warsaw Medical University students on electronic examinations and final tests by their participation in this form of knowledge assessment – preliminary report. Polish Journal of Public Health, 125, 153–158. https://doi.org/10.1515/pjph-2015-0044
Hillier, M. (2014). The very idea of e-exams: student (pre)conceptions. In H. Bronwyn, J. McDonald, and S.-K. Lok (Eds.), Australasian Society for Computers in Learning in Tertiary Education Conference, 2014 (pp. 77-88). New Zealand: Dunedin.
Hillier, M. (2015). e-Exams with student owned devices: Student voices. In D. Churchill, T. K. F. Chiu, & N. J. Gu (Eds.), Proceedings of the International Mobile Learning Festival: Mobile Learning, MOOCs and 21st Century Learning, 2015, (pp. 582-608). China: Hong Kong. Hillier, M., & Grant, S. (2018). Do-it-yourself e-exams. In M. Campbell, et al. (Eds.), Annual Conference of the Australasian Society for Computers in Learning in Tertiary Education 2018, (pp.121-130). Australia: Geelong.
Hillier, M., Grant, S., & Coleman, M. (2018). Towards authentic e-exams at scale: Robust networked Moodle. In M. Campbell, et al. (Eds.), Annual Conference of the Australasian Society for Computers in Learning in Tertiary Education 2018, (pp.111-141). Australia: Geelong.
Hillier, M., Kumar, N., & Wijenayake, N. (2020). e-examinations: The impact of technology problems on student experience. In T. Brinda, D. Passey, & T. Keane (Eds.), Empowering Teaching for Digital Equity and Agency (pp. 35–45). Cham: Springer International Publishing. https://doi.org/10.1007/978-3-030-59847-1_4
Hodgson, P., & Pang, M. Y. C. (2012). Effective formative e-assessment of student learning: A study on a statistics course. Assessment & Evaluation in Higher Education, 37(2), 215–225. https://doi.org/10.1080/02602938.2010.523818
Hollinger, R. C., & Lanza-Kaduce, L. (1996). Academic dishonesty and the perceived effectiveness of countermeasures. NASPA Journal, 33(4), 292–306. https://doi.org/10.1080/00220973.1996.11072417
Iannone, P., & Simpson, A. (2017). University students’ perceptions of summative assessment: The role of context. Journal of Further and Higher Education, 41(6), 785–801. https://doi.org/10.1080/0309877X.2016.1177172
Ilgaz, H., & Afacan Adanır, G. (2020). Providing online exams for online learners: Does it really matter for them? Education and Information Technologies, 25(2), 1255–1269. https://doi.org/10.1007/s10639-019-10020-6
James, R. (2016). Tertiary student attitudes to invigilated, online summative examinations. International Journal of Educational Technology in Higher Education, 13(1), 19. https://doi.org/10.1186/s41239-016-0015-0
Jimoh, R., Shittu, A. J., Kawu, Y., & Kola. (2012). Students’ Perception of Computer Based Test (CBT) for Examining Undergraduate Chemistry Courses. Journal of Emerging Trends in Computing and Information Sciences 3, 125-134.
Jr, J. H. W. (1963). Hierarchical Grouping to Optimize an Objective Function. Journal of the American Statistical Association, 58(301), 236–244. https://doi.org/10.1080/01621459.1963.10500845
Khan, S., & Khan, R. A. (2019). Online assessments: Exploring perspectives of university students. Education and Information Technologies, 24(1), 661–677. https://doi.org/10.1007/s10639-018-9797-0
Kuikka, M., Kitola, M., & Laakso, M.-J. (2014). Challenges When Introducing Electronic Exam. Research in Learning Technology, 22. https://doi.org/10.3402/rlt.v22.22817
Laine, K., Sipilä, E., Anderson, M., & Sydänheimo, L. (2016). Electronic exam in electronics studies. Rereived July 14, 2021 from https://www.sefi.be/wp-content/uploads/2017/09/laine-electronic-exam-in-eletronics-studies-9.pdf.
lamas-Nistal, M., Fernández-Iglesias, M. J., González-Tato, J., & Mikic-Fonte, F. A. (2013). Blended e-assessment: Migrating classical exams to the digital world. Computers & Education, 62, 72–87. https://doi.org/10.1016/j.compedu.2012.10.021 Marinoni, G., van’t Land, H., & Jensen, T. (2020). The impact of COVID-19 on higher education around the world. Retrieved July 14, 2021 from https://www.iau-aiu.net/IMG/pdf/iau_covid19_and_he_survey_report_final_may_2020.pdf
Means, B., Bakia, M., & Murphy, R. (2014). Learning online: What research tells us about whether, when and how. Routledge. Nardi, A., & Ranieri, M. (2019). Comparing paper-based and electronic multiple-choice examinations with personal devices: Impact on students’ performance, self-efficacy and satisfaction. British Journal of Educational Technology, 50(3), 1495–1506. https://doi.org/10.1111/bjet.12644
Nguyen, Q., Rienties, B., Toetenel, L., Ferguson, R., & Whitelock, D. (2017). Examining the designs of computer-based assessment and its impact on student engagement, satisfaction, and pass rates. Computers in Human Behavior, 76, 703–714. https://doi.org/10.1016/j.chb.2017.03.028
Omidian, F., & Nedayeh Ali, F. (2015). A study on the attitudes of students, instructors, and educational principals to electronic administration of final-semester examinations in Payame Noor University in Iran. Turkish Online Journal of Distance Education, 16(3), 118–125.
Osuji, U. (2012). The Use of e-assessments in the Nigerian higher education system. Turkish Online Journal of Distance Education 13(4), 140-152. https://doi.org/10.17718/TOJDE.25466
Pagram, J., Cooper, M., Jin, H., & Campbell, A. (2018). Tales from the exam room: Trialing an e-exam system for computer education and design and technology students. Education Sciences, 8(4), 188. https://doi.org/10.3390/educsci8040188
Ranganth, R., Rajalaksmi, C., & Simon, M. (2017). Medical students’ perceptions of e-assessment: Multiple choice questions used as a tool of assessment for preclinical years. Journal of Medical Education, 16, 35–43.
Sahu, P. (2020). Closure of universities due to coronavirus disease 2019 (COVID-19): Impact on education and mental health of students and academic staff, Cureus 12(4), e7541. https://doi.org/10.7759/cureus.7541
Shraim, K. (2019). Online Examination Practices in Higher Education Institutions: Learners’ Perspectives. Turkish Online Journal of Distance Education, 20(4), 185–196.
Sindre, G., & Chirumamilla, A. (2015). E-exams and exam process improvement. Retrieved July 14, 2021 from https://www.researchgate.net/publication/299497855_E-exams_and_exam_process_improvement
Snodgrass, S. J., Ashby, S. E., Rivett, D. A., & Russell, T. (2014). Implementation of an electronic objective structured clinical exam for assessing practical skills in pre-professional physiotherapy and occupational therapy programs: Examiner and course coordinator perspectives. Australasian Journal of Educational Technology, 30(2). https://doi.org/10.14742/ajet.348
Thomas, P., Price, B., Paine Schofield, C., & Richards, M. (2002). Remote electronic examinations: Student experiences. British Journal of Educational Technology, 33. https://doi.org/10.1111/1467-8535.00290
Walker, R., & Handley, Z. (2016). Designing for learner engagement with computer-based testing. Research in Learning Technology, 24. https://doi.org/10.3402/rlt.v24.30083
Washburn, S., Herman, J., & Stewart, R. (2017). Evaluation of performance and perceptions of electronic vs. Paper multiple-choice exams. Advances in Physiology Education, 41(4), 548–555. https://doi.org/10.1152/advan.00138.2016
Wibowo, S., Grandhi, S., Chugh, R., & Sawir, E. (2016). A pilot study of an electronic exam system at an Australian university. Journal of Educational Technology Systems, 45(1), 5–33. https://doi.org/10.1177/0047239516646746
Zhai, C., & Massung, S. (2016). Text Data Management and Analysis: A Practical Introduction to Information Retrieval and Text Mining. Morgan & Claypool.

Details

Primary Language

English

Subjects

-

Journal Section

Research Article

Authors

George Vorvılas ^* This is me
0000-0001-9472-6774
Greece

Alexandros Lıapıs This is me
0000-0002-0299-5051
Greece

Alkis Korovesıs This is me
0000-0002-5174-7855
Greece

Dimitra Aggelopoulou This is me
0000-0001-9442-3052
Greece

Nikos Karousos This is me
0000-0003-2530-4820
Greece

Efstathios Efstathopoulos This is me
0000-0003-2747-3353
Greece

Publication Date

April 1, 2023

Submission Date

July 28, 2021

Acceptance Date

September 6, 2022

Published in Issue

Year 2023 Volume: 24 Number: 2

DOI

https://doi.org/10.17718/tojde.971889

IZ

https://izlik.org/JA59AG72NF

APA

Vorvılas, G., Lıapıs, A., Korovesıs, A., Aggelopoulou, D., Karousos, N., & Efstathopoulos, E. (2023). CONDUCTING REMOTE ELECTRONIC EXAMINATIONS IN DISTANCE HIGHER EDUCATION: STUDENTS’ PERCEPTIONS. Turkish Online Journal of Distance Education, 24(2), 167-182. https://doi.org/10.17718/tojde.971889

AMA

1.Vorvılas G, Lıapıs A, Korovesıs A, Aggelopoulou D, Karousos N, Efstathopoulos E. CONDUCTING REMOTE ELECTRONIC EXAMINATIONS IN DISTANCE HIGHER EDUCATION: STUDENTS’ PERCEPTIONS. TOJDE. 2023;24(2):167-182. doi:10.17718/tojde.971889

Chicago

Vorvılas, George, Alexandros Lıapıs, Alkis Korovesıs, Dimitra Aggelopoulou, Nikos Karousos, and Efstathios Efstathopoulos. 2023. “CONDUCTING REMOTE ELECTRONIC EXAMINATIONS IN DISTANCE HIGHER EDUCATION: STUDENTS’ PERCEPTIONS”. Turkish Online Journal of Distance Education 24 (2): 167-82. https://doi.org/10.17718/tojde.971889.

EndNote

Vorvılas G, Lıapıs A, Korovesıs A, Aggelopoulou D, Karousos N, Efstathopoulos E (April 1, 2023) CONDUCTING REMOTE ELECTRONIC EXAMINATIONS IN DISTANCE HIGHER EDUCATION: STUDENTS’ PERCEPTIONS. Turkish Online Journal of Distance Education 24 2 167–182.

IEEE

[1]G. Vorvılas, A. Lıapıs, A. Korovesıs, D. Aggelopoulou, N. Karousos, and E. Efstathopoulos, “CONDUCTING REMOTE ELECTRONIC EXAMINATIONS IN DISTANCE HIGHER EDUCATION: STUDENTS’ PERCEPTIONS”, TOJDE, vol. 24, no. 2, pp. 167–182, Apr. 2023, doi: 10.17718/tojde.971889.

ISNAD

Vorvılas, George - Lıapıs, Alexandros - Korovesıs, Alkis - Aggelopoulou, Dimitra - Karousos, Nikos - Efstathopoulos, Efstathios. “CONDUCTING REMOTE ELECTRONIC EXAMINATIONS IN DISTANCE HIGHER EDUCATION: STUDENTS’ PERCEPTIONS”. Turkish Online Journal of Distance Education 24/2 (April 1, 2023): 167-182. https://doi.org/10.17718/tojde.971889.

JAMA

1.Vorvılas G, Lıapıs A, Korovesıs A, Aggelopoulou D, Karousos N, Efstathopoulos E. CONDUCTING REMOTE ELECTRONIC EXAMINATIONS IN DISTANCE HIGHER EDUCATION: STUDENTS’ PERCEPTIONS. TOJDE. 2023;24:167–182.

MLA

Vorvılas, George, et al. “CONDUCTING REMOTE ELECTRONIC EXAMINATIONS IN DISTANCE HIGHER EDUCATION: STUDENTS’ PERCEPTIONS”. Turkish Online Journal of Distance Education, vol. 24, no. 2, Apr. 2023, pp. 167-82, doi:10.17718/tojde.971889.

Vancouver

1.George Vorvılas, Alexandros Lıapıs, Alkis Korovesıs, Dimitra Aggelopoulou, Nikos Karousos, Efstathios Efstathopoulos. CONDUCTING REMOTE ELECTRONIC EXAMINATIONS IN DISTANCE HIGHER EDUCATION: STUDENTS’ PERCEPTIONS. TOJDE. 2023 Apr. 1;24(2):167-82. doi:10.17718/tojde.971889

CONDUCTING REMOTE ELECTRONIC EXAMINATIONS IN DISTANCE HIGHER EDUCATION: STUDENTS’ PERCEPTIONS

Abstract

CONDUCTING REMOTE ELECTRONIC EXAMINATIONS IN DISTANCE HIGHER EDUCATION: STUDENTS’ PERCEPTIONS

Abstract

Keywords

References

Details

Primary Language

Subjects

Journal Section

Authors

Publication Date

Submission Date

Acceptance Date

Published in Issue

DOI

IZ

Cite

Cited By

A Hybrid Text Summarization Technique of Student Open-Ended Responses to Online Educational Surveys

Online examinations, reliability and quality issues

Auditing students’ perceptions of online assessments and e-proctoring systems

Summarizing responses to open-ended questions in educational surveys: A microservice-oriented approach