STATE OF RESEARCH ON E-ASSESSMENT IN EDUCATION: A BIBLIOMETRIC ANALYSIS

Betul Tonbuloglu

doi:10.17718/tojde.1184218

EN

STATE OF RESEARCH ON E-ASSESSMENT IN EDUCATION: A BIBLIOMETRIC ANALYSIS

Abstract

This study aimed to reveal the trend of research on e-assessment in the field of educational sciences through scientific mapping and bibliometric analyses. For this purpose, the numerical distribution of research on e-assessment, citation analysis, research themes and the change of trend topics were examined. The publications to be examined were selected from WoS database according to PRISMA model, and 911 studies were included in the analysis. VOSviewer, Biblioshiny, Smart Bibliometrics and Leximancer software were used in data analysis. Apparently, there has been a significant increase in the number of research since 2005, and publications have been mostly produced in form of articles and papers. The most cited and the most productive countries are the USA, the United Kingdom and Australia, while the most cited journals are Assessment & Evaluation in Higher Education and British Journal of Educational Technology. An analysis of the keyword map revealed that the themes of technology and motivation, blended learning and collaboration, interaction and innovative approaches, validity and reliability, higher education, quality, basic disciplines and Covid-19 were frequently emphasized in the studies on e-assessment. An analysis of trend topics by years showed that, between 2010 and 2021, the trend topic distribution changed to include topics such as Covid-19, academic integrity, engagement, cheating, case study, and higher education. All these findings reveal that e-evaluation activities have displayed a development and transformation over time with the effect of developing technology, the pandemic, the spread of e-learning, the expansion of communication opportunities and many other factors.

Keywords

E-assessment, online assessment, online evaluation, e-learning, bibliometric analysis

References

Akiri, E., Tor, H. M., & Dori, Y. J. (2021). Teaching and Assessment Methods: STEM Teachers' Perceptions and Implementation. Eurasia Journal of Mathematics, Science and Technology Education, 17(6). https://eric.ed.gov/?id=EJ1302499
Akyol, Z., Garrison, D. R., & Ozden, M. Y. (2009). Online and blended communities of inquiry: Exploring the developmental and perceptional differences. The International Review of Research in Open and Distributed Learning, 10(6), 65-83. https://doi.org/10.19173/irrodl.v10i6.765
Balstad, M. T., Berg, T. (2020). A long-term bibliometric analysis of journals influencing management accounting and control research. Journal of Management Control, 30, 357-380. https://doi.org/10.1007/s00187-019-00287-8
Bradford, S. C. (1934). Sources of information on specific subjects. Engineering, 137, 85-86.
Broadus, R. N. (1987). Toward a definition of “bibliometrics”. Scientometrics, 12(5), 373-379. https://link.springer.com/article/10.1007/BF02016680
Cong, X., Zhang, Y., Xu, H., Liu, L. M., Zheng, M., Xiang, R. L., ... & Wu, L. L. (2020). The effectiveness of formative assessment in pathophysiology education from students’ perspective: a questionnaire study. Advances in Physiology Education, 44(4), 726-733. https://doi.org/10.1152/advan.00067.2020
Conn, C., & Norris, J. (2005). Investigating strategies for increasing student response rates to online delivered course evaluations. 2003 Annual Proceedings-Anaheim: 77- 85. https://files.eric.ed.gov/fulltext/ED496305.pdf#page=87
Crisp, V., & Ward, C. (2008). The development of a formative scenario-based computer assisted assessment tool in psychology for teachers: The PePCAA project. Computers & Education, 50(4), 1509-1526. https://doi.org/10.1016/j.compedu.2007.02.004
Donthu, N., Kumar, S., Mukherjee, D., Pandey, N., & Lim, W. M. (2021). How to conduct a bibliometric analysis: An overview and guidelines. Journal of Business Research, 133, 285-296. https://doi.org/10.1016/j.jbusres.2021.04.070
Flavin, M. (2021). A Disruptive Innovation perspective on students’ opinions of online assessment. Research in Learning Technology, 29. https://journal.alt.ac.uk/index.php/rlt/article/view/2611/2887

Fructuoso, I. N., Roldán, A. E. G., Hidalgo, E. H., Roca, R., & Besora, D. B. (2018). Enhancing the quality of online assessment with the support of an e-authentication system. Edulearn 18. 10th International Conference on Education and New Learning Technology:(Palma, 2nd-4th of July, 2018). Conference proceedings (pp. 1893-1903). IATED Academy.
Gamage, S. H., Ayres, J. R., & Behrend, M. B. (2022). A systematic review on trends in using Moodle for teaching and learning. International Journal of STEM Education, 9(1), 1-24. https://doi.org/10.1186/s40594-021-00323-x
Garfield, E. (1980). Is information retrieval in the arts and humanities inherently different from that in science? The effect that ISI®'s citation index for the arts and humanities is expected to have on future scholarship. The Library Quarterly, 50(1), 40-57. https://doi.org/10.1086/629874
Ghergulescu, I., & Muntean, C. H. (2014). A novel sensor-based methodology for learner's motivation analysis in game-based learning. Interacting with Computers, 26(4), 305-320. https://ieeexplore.ieee.org/abstract/document/8154837
Gikandi, J. W., Morrow, D., & Davis, N. E. (2011). Online formative assessment in higher education: A review of the literature. Computers & education, 57(4), 2333-2351. https://doi.org/10.1016/j.compedu.2011.06.004
Joint Information Systems Committee (JISC). (2007). Effective practice with e-assessment: An overview of technologies, policies and practice in further and higher education. http://www.jisc.ac.uk/media/documents/themes/elearning/effpraceassess.pdf
Jordan, S. (2013). E-assessment: Past, present and future. New Directions in the Teaching of Physical Sciences, 9, 87–106. https://doi.org/10.29311/ndtps.v0i9.504
Karim, N. A., & Shukur, Z. (2015). Review of user authentication methods in online examination. Asian Journal of Information Technology, 14(5), 166-175.
Khan, M. A., Pattnaik, D., Ashraf, R., Ali, I., Kumar, S., & Donthu, N. (2021). Value of special issues in the journal of business research: A bibliometric analysis. Journal of business research, 125, 295-313. https://doi.org/10.1016/j.jbusres.2020.12.015
Kocdar, S., Karadeniz, A., Peytcheva-Forsyth, R., & Stoeva, V. (2018). Cheating and plagiarism in e-assessment: Students' perspectives. Open Praxis, 10(3), 221-235.
MacCoun, R. J. (1998). Biases in the interpretation and use of research results. Annual review of psychology, 49(1), 259-287. https://bit.ly/3rosoin
Massimo, A., & Cuccurullo, C. (2021). Biblioshiny: the shiny interface for bibliometrix. https://bibliometrix.org/About.html
Mattsson, P., Sundberg, C.J., Laget, P. (2011). Is correspondence reflected in the author position? A bibliometric study of the relation between corresponding author and byline position. Scientometrics, 87, 99–105. https://doi.org/10.1007/s11192-010-0310-9
Mellar, H., Peytcheva-Forsyth, R., Kocdar, S., Karadeniz, A., & Yovkova, B. (2018). Addressing cheating in e-assessment using student authentication and authorship checking systems: teachers’ perspectives. International Journal for Educational Integrity, 14(1), 1-21. https://doi.org/10.1007/s40979-018-0025-x
Mishra, S., Sahoo, S., & Pandey, S. (2021). Research trends in online distance learning during the COVID-19 pandemic. Distance Education, 1-26. https://doi.org/10.1080/01587919.2021.1986373
Moodle Project, (2022). Moodle statistics. https://stats.moodle.org/ . Accessed 6 Sept 2022.
Na, S. J., Ji, Y. G., & Lee, D. H. (2021). Application of Bloom’s taxonomy to formative assessment in real-time online classes in Korea. Korean Journal of Medical Education, 33(3), 191. https://doi.org/10.3946/kjme.2021.199
Nicol, D. J., & Macfarlane‐Dick, D. (2006). Formative assessment and self‐regulated learning: A model and seven principles of good feedback practice. Studies in higher education, 31(2), 199-218. https://doi.org/10.1080/03075070600572090
Nicol, D. (2007). Laying a foundation for lifelong learning: Case studies of e-assessment in large first year classes. British Journal of Educational Technology, 38(4): 668–78. https://doi.org/10.1111/j.1467-8535.2006.00657.x
Nikou, S. A., & Economides, A. A. (2018). Mobile-based assessment: A literature review of publications in major referred journals from 2009 to 2018. Computers & Education, 125, 101–119. https://doi.org/10.1016/j.compedu.2018.06.00
Okada, A., Noguera, I., Alexieva, L., Rozeva, A., Kocdar, S., Brouns, F., ... & Guerrero‐Roldán, A. E. (2019). Pedagogical approaches for e‐assessment with authentication and authorship verification in Higher Education. British Journal of Educational Technology, 50(6), 3264-3282. https://doi.org/10.1111/bjet.12733
Page, M.J., McKenzie, J., Bossuyt, P., Boutron, I., Hoffmann, T., Mulrow, C.D., Shamseer, L., Tetzlaff, J., Akl, E., Brennan, S.E., Chou, R., Glanville, J., Grimshaw, J., Hróbjartsson, A., Lalu, M.M., Li, T., Loder, E., Mayo-Wilson, E., McDonald, S., … Moher, D. (2020). The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. https://doi.org/10.31222/osf.io/v7gm2
Pessin, V. Z., Yamane, L. H., & Siman, R. R. (2022). Smart bibliometrics: an integrated method of science mapping and bibliometric analysis. Scientometrics, 1-24. https://link.springer.com/article/10.1007/s11192-022-04406-6
Peytcheva-Forsyth, R., Aleksieva, L., & Yovkova, B. (2018). The impact of prior experience of e-learning and e-assessment on students’ and teachers’ approaches to the use of a student authentication and authorship checking system. EDULEARN18 Proceedings, 2311-2321. https://bit.ly/3OCGK80
Rialp, A., Merigó, J. M., Cancino, C. A., & Urbano, D. (2019). Twenty-five years (1992–2016) of the international business review: a bibliometric overview. International Business Review, 28(6), 101587. https://doi.org/10.1016/j.ibusrev.2019.101587
Rolim, C., & Isaias, P. (2019). Examining the use of e-assessment in higher education: Teachers and students' viewpoints. British Journal of Educational Technology, 50(4), 1785–1800. https://doi.org/10.1111/bjet.12669
Singh, J. (2015). Moodle Statistics – Moodle now has more than 78 million users all over the World. . Retrieved 6 Sept 2022 from https://www.lmspulse.com/2015/moodle-statistics-moodle-now-has-more-than-78-million-users-all-over-the-world-moodleworld-moodle/
Smith, A. E., & Humphreys, M. S. (2006). Evaluation of unsupervised semantic mapping of natural language with Leximancer concept mapping. Behavior research methods, 38(2), 262-279. https://doi.org/10.3758/BF03192778
Snyder, H. (2019). Literature review as a research methodology: An overview and guidelines. Journal of business research, 104, 333-339. https://doi.org/10.1016/j.jbusres.2019.07.039
Stödberg, U. (2012). A research review of e-assessment. Assessment & Evaluation in Higher Education, 37(5), 591-604. https://doi.org/10.1080/02602938.2011.557496
St‐Onge, C., Ouellet, K., Lakhal, S., Dubé, T., & Marceau, M. (2022). COVID‐19 as the tipping point for integrating e‐assessment in higher education practices. British Journal of Educational Technology, 53(2), 349-366. https://doi.org/10.1111/bjet.13169
Sudakova, N. E., Savina, T. N., Masalimova, A. R., Mikhaylovsky, M. N., Karandeeva, L. G., & Zhdanov, S. P. (2022). Online Formative Assessment in Higher Education: Bibliometric Analysis. Education Sciences, 12(3), 209. https://doi.org/10.3390/educsci12030209
Thomson, K. & Falchikov, N. (1998). ‘Full on until the sun comes out’: The effects of assessment on student approaches to studying. Assessment & Evaluation in Higher Education, 23(4): 379–390. https://doi.org/10.1080/0260293980230405
Tight, M. (2019). Globalization and internationalization as frameworks for higher education research. Research Papers in Education. 36(1), 52-74. https://doi.org/10.1080/02671522.2019.1633560
Van der Pol, J., Van den Berg, B. A. M., Admiraal, W. F., & Simons, P. R. J. (2008). The nature, reception, and use of online peer feedback in higher education. Computers & Education, 51(4), 1804-1817. https://doi.org/10.1016/j.compedu.2008.06.001
Van Eck, N. J., & Waltman, L. (2010). Software survey: VOSviewer, a computer program for bibliometric mapping. Scientometrics, 84(2), 523–538. https://doi.org/10.1007/s11192-009-0146-3
Wang, T. H. (2008). Web-based quiz-game-like formative assessment: Development and evaluation. Computers & Education, 51(3), 1247-1263. https://doi.org/10.1016/j.compedu.2007.11.011
Whitelock, D., Thorpe, M., & Galley, R. (2015). Student workload: A case study of its significance, evaluation and management at the Open University. Distance Education, 36(2), 161–176. https://doi.org/10.1080/01587919.2015.10550
Xie, L.; Chen, Z.; Wang, H.; Zheng, C.; Jiang, J. (2020). Bibliometric and Visualized Analysis of Scientific Publications on Atlantoaxial Spine Surgery Based on Web of Science and VOSviewer. World Neurosurg, 137, 435–442. https://doi.org/10.1016/j.wneu.2020.01.171
Zawacki-Richter, O., & Latchem, C. (2018). Exploring four decades of research in Computers & Education. Computers & Education, 122, 136-152. https://doi.org/10.1016/j.compedu.2018.04.001

Details

Primary Language

English

Subjects

Lifelong learning

Journal Section

Research Article

Authors

Betul Tonbuloglu ^*
0000-0003-1542-2380
Türkiye

Publication Date

October 1, 2023

Submission Date

October 4, 2022

Acceptance Date

December 12, 2022

Published in Issue

Year 2023 Volume: 24 Number: 4

DOI

https://doi.org/10.17718/tojde.1184218

IZ

https://izlik.org/JA47NG97XT

APA

Tonbuloglu, B. (2023). STATE OF RESEARCH ON E-ASSESSMENT IN EDUCATION: A BIBLIOMETRIC ANALYSIS. Turkish Online Journal of Distance Education, 24(4), 276-301. https://doi.org/10.17718/tojde.1184218

AMA

1.Tonbuloglu B. STATE OF RESEARCH ON E-ASSESSMENT IN EDUCATION: A BIBLIOMETRIC ANALYSIS. TOJDE. 2023;24(4):276-301. doi:10.17718/tojde.1184218

Chicago

Tonbuloglu, Betul. 2023. “STATE OF RESEARCH ON E-ASSESSMENT IN EDUCATION: A BIBLIOMETRIC ANALYSIS”. Turkish Online Journal of Distance Education 24 (4): 276-301. https://doi.org/10.17718/tojde.1184218.

EndNote

Tonbuloglu B (October 1, 2023) STATE OF RESEARCH ON E-ASSESSMENT IN EDUCATION: A BIBLIOMETRIC ANALYSIS. Turkish Online Journal of Distance Education 24 4 276–301.

IEEE

[1]B. Tonbuloglu, “STATE OF RESEARCH ON E-ASSESSMENT IN EDUCATION: A BIBLIOMETRIC ANALYSIS”, TOJDE, vol. 24, no. 4, pp. 276–301, Oct. 2023, doi: 10.17718/tojde.1184218.

ISNAD

Tonbuloglu, Betul. “STATE OF RESEARCH ON E-ASSESSMENT IN EDUCATION: A BIBLIOMETRIC ANALYSIS”. Turkish Online Journal of Distance Education 24/4 (October 1, 2023): 276-301. https://doi.org/10.17718/tojde.1184218.

JAMA

1.Tonbuloglu B. STATE OF RESEARCH ON E-ASSESSMENT IN EDUCATION: A BIBLIOMETRIC ANALYSIS. TOJDE. 2023;24:276–301.

MLA

Tonbuloglu, Betul. “STATE OF RESEARCH ON E-ASSESSMENT IN EDUCATION: A BIBLIOMETRIC ANALYSIS”. Turkish Online Journal of Distance Education, vol. 24, no. 4, Oct. 2023, pp. 276-01, doi:10.17718/tojde.1184218.

Vancouver

1.Betul Tonbuloglu. STATE OF RESEARCH ON E-ASSESSMENT IN EDUCATION: A BIBLIOMETRIC ANALYSIS. TOJDE. 2023 Oct. 1;24(4):276-301. doi:10.17718/tojde.1184218

Cited By

Padlet: ¿muro virtual para mejorar el proceso de enseñanza-aprendizaje en el nivel superior?

Texto Livre

https://doi.org/10.1590/1983-3652.2025.49123

Teachers’ beliefs and attitudes towards teaching and learning mathematics: a bibliometric analysis in scopus database (1991–2024)

Discover Education

https://doi.org/10.1007/s44217-025-01058-5