ELECTRONIC ASSESSMENT ANXIETY SCALE: DEVELOPMENT, VALIDITY AND RELIABILITY

Year 2024, Volume: 25 Issue: 4, 16 - 32, 01.10.2024

Osman Tat , Abdullah Faruk Kilic

https://doi.org/10.17718/tojde.1380131

Abstract

The widespread availability of internet access in daily life has resulted in a greater acceptance of online assessment methods. E-assessment platforms offer various features such as randomizing questions and answers, utilizing extensive question banks, setting time limits, and managing access during online exams. Electronic assessment enables real-time monitoring, customization, and scalability of feedback, benefiting students, academic staff, and administrative personnel. However, students encounter specific challenges in the electronic assessment environments. These challenges include limited control over test settings and the isolated nature of taking exams without peers. Furthermore, the technological proficiency of both instructors and students, along with resource constraints (computers, mobile devices, internet), can impede the effective utilization of these assessment tools. Technical issues like slow internet connection or disconnections can have significant consequences, especially in online exams, posing difficulties for corrections. The main goal of this study is to develop a Likert-type scale capable of measuring anxiety related to technical issues, social isolation, and the test interface experienced in e-assessment contexts. The study consists of two separate groups: the first group comprising 359 participants and the second group consisting of 356 participants. Both groups include undergraduate and pedagogical formation certificate program students from a university in the Eastern Anatolia Region of Turkiye. Construct validity was assessed through exploratory and confirmatory factor analyses. Item parameters were examined using item analysis based on classical test theory. As a result of the study, a two-factor scale structure comprising 21 items measuring social and technical anxiety was developed. These two dimensions account for 59.89% of the total variance. The Cronbach’s alpha coefficient for the entire scale was 0.93, the McDonald’s omega coefficient was 0.93, and the construct reliability was 0.99.

Keywords

anxiety, e-assessment, social isolation, technical problems

Supporting Institution

Van Yuzuncu Yıl University, Scientifc Research Projects Coordination Unit

Project Number

SYD-2021-9537

References

• Anderson, J. C., & Gerbing, D. W. (1984). The effect of sampling error on convergence, improper solutions, and goodness-of-fit indices for maximum likelihood confirmatory factor analysis. Psychometrika, 49(2), 155–173. https://doi.org/10.1007/BF02294170
• Bahar, M., & Asil, M. (2018). Attitude towards e-assessment: influence of gender, computer usage and level of education. Open Learning: The Journal of Open, Distance and E-Learning, 33(3), 221–237. https://doi.org/10.1080/02680513.2018.1503529
• Benson, R. (2010). Online learning and assessment in higher education: A planning guide. Oxford: Chandos Publishing.
• Brink, R., & Lautenbach, G. (2011). Electronic assessment in higher education. Educational Studies, 37(5), 503–512. https://doi.org/10.1080/03055698.2010.539733
• Brown, T. A. (2015). Confirmatory factor analysis for applied research (2nd ed.). The Guilford.