TY  - JOUR
T1  - STATE OF RESEARCH ON E-ASSESSMENT IN EDUCATION: A BIBLIOMETRIC ANALYSIS
AU  - Tonbuloglu, Betul
PY  - 2023
DA  - October
DO  - 10.17718/tojde.1184218
JF  - Turkish Online Journal of Distance Education
JO  - TOJDE
PB  - Anadolu University
WT  - DergiPark
SN  - 1302-6488
SP  - 276
EP  - 301
VL  - 24
IS  - 4
LA  - en
AB  - This study aimed to reveal the trend of research on e-assessment in the field of educational sciences through scientific mapping and bibliometric analyses. For this purpose, the numerical distribution of research on e-assessment, citation analysis, research themes and the change of trend topics were examined. The publications to be examined were selected from WoS database according to PRISMA model, and 911 studies were included in the analysis. VOSviewer, Biblioshiny, Smart Bibliometrics and Leximancer software were used in data analysis. Apparently, there has been a significant increase in the number of research since 2005, and publications have been mostly produced in form of articles and papers. The most cited and the most productive countries are the USA, the United Kingdom and Australia, while the most cited journals are Assessment & Evaluation in Higher Education and British Journal of Educational Technology. An analysis of the keyword map revealed that the themes of technology and motivation, blended learning and collaboration, interaction and innovative approaches, validity and reliability, higher education, quality, basic disciplines and Covid-19 were frequently emphasized in the studies on e-assessment. An analysis of trend topics by years showed that, between 2010 and 2021, the trend topic distribution changed to include topics such as Covid-19, academic integrity, engagement, cheating, case study, and higher education. All these findings reveal that e-evaluation activities have displayed a development and transformation over time with the effect of developing technology, the pandemic, the spread of e-learning, the expansion of communication opportunities and many other factors.
KW  - E-assessment
KW  - online assessment
KW  - online evaluation
KW  - e-learning
KW  - bibliometric analysis
CR  - Akiri, E., Tor, H. M., & Dori, Y. J. (2021). Teaching and Assessment Methods: STEM Teachers' Perceptions and Implementation. Eurasia Journal of Mathematics, Science and Technology Education, 17(6). https://eric.ed.gov/?id=EJ1302499
CR  - Akyol, Z., Garrison, D. R., & Ozden, M. Y. (2009). Online and blended communities of inquiry: Exploring the developmental and perceptional differences. The International Review of Research in Open and Distributed Learning, 10(6), 65-83. https://doi.org/10.19173/irrodl.v10i6.765
CR  - Balstad, M. T., Berg, T. (2020). A long-term bibliometric analysis of journals influencing management accounting and control research. Journal of Management Control, 30, 357-380. https://doi.org/10.1007/s00187-019-00287-8
CR  - Bradford, S. C. (1934). Sources of information on specific subjects. Engineering, 137, 85-86.
CR  - Broadus, R. N. (1987). Toward a definition of “bibliometrics”. Scientometrics, 12(5), 373-379. https://link.springer.com/article/10.1007/BF02016680
CR  - Cong, X., Zhang, Y., Xu, H., Liu, L. M., Zheng, M., Xiang, R. L., ... & Wu, L. L. (2020). The effectiveness of formative assessment in pathophysiology education from students’ perspective: a questionnaire study. Advances in Physiology Education, 44(4), 726-733. https://doi.org/10.1152/advan.00067.2020
CR  - Conn, C., & Norris, J. (2005). Investigating strategies for increasing student response rates to online delivered course evaluations. 2003 Annual Proceedings-Anaheim: 77- 85. https://files.eric.ed.gov/fulltext/ED496305.pdf#page=87
CR  - Crisp, V., & Ward, C. (2008). The development of a formative scenario-based computer assisted assessment tool in psychology for teachers: The PePCAA project. Computers & Education, 50(4), 1509-1526. https://doi.org/10.1016/j.compedu.2007.02.004
CR  - Donthu, N., Kumar, S., Mukherjee, D., Pandey, N., & Lim, W. M. (2021). How to conduct a bibliometric analysis: An overview and guidelines. Journal of Business Research, 133, 285-296. https://doi.org/10.1016/j.jbusres.2021.04.070
CR  - Flavin, M. (2021). A Disruptive Innovation perspective on students’ opinions of online assessment. Research in Learning Technology, 29. https://journal.alt.ac.uk/index.php/rlt/article/view/2611/2887
CR  - Fructuoso, I. N., Roldán, A. E. G., Hidalgo, E. H., Roca, R., & Besora, D. B. (2018). Enhancing the quality of online assessment with the support of an e-authentication system. Edulearn 18. 10th International Conference on Education and New Learning Technology:(Palma, 2nd-4th of July, 2018). Conference proceedings (pp. 1893-1903). IATED Academy.
CR  - Gamage, S. H., Ayres, J. R., & Behrend, M. B. (2022). A systematic review on trends in using Moodle for teaching and learning. International Journal of STEM Education, 9(1), 1-24. https://doi.org/10.1186/s40594-021-00323-x
CR  - Garfield, E. (1980). Is information retrieval in the arts and humanities inherently different from that in science? The effect that ISI®'s citation index for the arts and humanities is expected to have on future scholarship. The Library Quarterly, 50(1), 40-57. https://doi.org/10.1086/629874
CR  - Ghergulescu, I., & Muntean, C. H. (2014). A novel sensor-based methodology for learner's motivation analysis in game-based learning. Interacting with Computers, 26(4), 305-320. https://ieeexplore.ieee.org/abstract/document/8154837
CR  - Gikandi, J. W., Morrow, D., & Davis, N. E. (2011). Online formative assessment in higher education: A review of the literature. Computers & education, 57(4), 2333-2351. https://doi.org/10.1016/j.compedu.2011.06.004
CR  - Joint Information Systems Committee (JISC). (2007). Effective practice with e-assessment: An overview of technologies, policies and practice in further and higher education. http://www.jisc.ac.uk/media/documents/themes/elearning/effpraceassess.pdf
CR  - Jordan, S. (2013). E-assessment: Past, present and future. New Directions in the Teaching of Physical Sciences, 9, 87–106. https://doi.org/10.29311/ndtps.v0i9.504
CR  - Karim, N. A., & Shukur, Z. (2015). Review of user authentication methods in online examination. Asian Journal of Information Technology, 14(5), 166-175.
CR  - Khan, M. A., Pattnaik, D., Ashraf, R., Ali, I., Kumar, S., & Donthu, N. (2021). Value of special issues in the journal of business research: A bibliometric analysis. Journal of business research, 125, 295-313. https://doi.org/10.1016/j.jbusres.2020.12.015
CR  - Kocdar, S., Karadeniz, A., Peytcheva-Forsyth, R., & Stoeva, V. (2018). Cheating and plagiarism in e-assessment: Students' perspectives. Open Praxis, 10(3), 221-235.
CR  - MacCoun, R. J. (1998). Biases in the interpretation and use of research results. Annual review of psychology, 49(1), 259-287. https://bit.ly/3rosoin
CR  - Massimo, A., & Cuccurullo, C. (2021). Biblioshiny: the shiny interface for bibliometrix. https://bibliometrix.org/About.html
CR  - Mattsson, P., Sundberg, C.J., Laget, P. (2011). Is correspondence reflected in the author position? A bibliometric study of the relation between corresponding author and byline position. Scientometrics, 87, 99–105. https://doi.org/10.1007/s11192-010-0310-9
CR  - Mellar, H., Peytcheva-Forsyth, R., Kocdar, S., Karadeniz, A., & Yovkova, B. (2018). Addressing cheating in e-assessment using student authentication and authorship checking systems: teachers’ perspectives. International Journal for Educational Integrity, 14(1), 1-21. https://doi.org/10.1007/s40979-018-0025-x
CR  - Mishra, S., Sahoo, S., & Pandey, S. (2021). Research trends in online distance learning during the COVID-19 pandemic. Distance Education, 1-26. https://doi.org/10.1080/01587919.2021.1986373
CR  - Moodle Project, (2022). Moodle statistics. https://stats.moodle.org/ . Accessed 6 Sept 2022.
CR  - Na, S. J., Ji, Y. G., & Lee, D. H. (2021). Application of Bloom’s taxonomy to formative assessment in real-time online classes in Korea. Korean Journal of Medical Education, 33(3), 191. https://doi.org/10.3946/kjme.2021.199
CR  - Nicol, D. J., & Macfarlane‐Dick, D. (2006). Formative assessment and self‐regulated learning: A model and seven principles of good feedback practice. Studies in higher education, 31(2), 199-218. https://doi.org/10.1080/03075070600572090
CR  - Nicol, D. (2007). Laying a foundation for lifelong learning: Case studies of e-assessment in large first year classes. British Journal of Educational Technology, 38(4): 668–78.  https://doi.org/10.1111/j.1467-8535.2006.00657.x
CR  - Nikou, S. A., & Economides, A. A. (2018). Mobile-based assessment: A literature review of publications in major referred journals from 2009 to 2018. Computers & Education, 125, 101–119. https://doi.org/10.1016/j.compedu.2018.06.00
CR  - Okada, A., Noguera, I., Alexieva, L., Rozeva, A., Kocdar, S., Brouns, F., ... & Guerrero‐Roldán, A. E. (2019). Pedagogical approaches for e‐assessment with authentication and authorship verification in Higher Education. British Journal of Educational Technology, 50(6), 3264-3282. https://doi.org/10.1111/bjet.12733
CR  - Page, M.J., McKenzie, J., Bossuyt, P., Boutron, I., Hoffmann, T., Mulrow, C.D., Shamseer, L., Tetzlaff, J., Akl, E., Brennan, S.E., Chou, R., Glanville, J., Grimshaw, J., Hróbjartsson, A., Lalu, M.M., Li, T., Loder, E., Mayo-Wilson, E., McDonald, S., … Moher, D. (2020). The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. https://doi.org/10.31222/osf.io/v7gm2
CR  - Pessin, V. Z., Yamane, L. H., & Siman, R. R. (2022). Smart bibliometrics: an integrated method of science mapping and bibliometric analysis. Scientometrics, 1-24. https://link.springer.com/article/10.1007/s11192-022-04406-6
CR  - Peytcheva-Forsyth, R., Aleksieva, L., & Yovkova, B. (2018). The impact of prior experience of e-learning and e-assessment on students’ and teachers’ approaches to the use of a student authentication and authorship checking system. EDULEARN18 Proceedings, 2311-2321. https://bit.ly/3OCGK80
CR  - Rialp, A., Merigó, J. M., Cancino, C. A., & Urbano, D. (2019). Twenty-five years (1992–2016) of the international business review: a bibliometric overview. International Business Review, 28(6), 101587. https://doi.org/10.1016/j.ibusrev.2019.101587
CR  - Rolim, C., & Isaias, P. (2019). Examining the use of e-assessment in higher education: Teachers and students' viewpoints. British Journal of Educational Technology, 50(4), 1785–1800. https://doi.org/10.1111/bjet.12669
CR  - Singh, J. (2015). Moodle Statistics – Moodle now has more than 78 million users all over the World. . Retrieved 6 Sept 2022 from https://www.lmspulse.com/2015/moodle-statistics-moodle-now-has-more-than-78-million-users-all-over-the-world-moodleworld-moodle/
CR  - Smith, A. E., & Humphreys, M. S. (2006). Evaluation of unsupervised semantic mapping of natural language with Leximancer concept mapping. Behavior research methods, 38(2), 262-279. https://doi.org/10.3758/BF03192778
CR  - Snyder, H. (2019). Literature review as a research methodology: An overview and guidelines. Journal of business research, 104, 333-339. https://doi.org/10.1016/j.jbusres.2019.07.039
CR  - Stödberg, U. (2012). A research review of e-assessment. Assessment & Evaluation in Higher Education, 37(5), 591-604. https://doi.org/10.1080/02602938.2011.557496
CR  - St‐Onge, C., Ouellet, K., Lakhal, S., Dubé, T., & Marceau, M. (2022). COVID‐19 as the tipping point for integrating e‐assessment in higher education practices. British Journal of Educational Technology, 53(2), 349-366. https://doi.org/10.1111/bjet.13169
CR  - Sudakova, N. E., Savina, T. N., Masalimova, A. R., Mikhaylovsky, M. N., Karandeeva, L. G., & Zhdanov, S. P. (2022). Online Formative Assessment in Higher Education: Bibliometric Analysis. Education Sciences, 12(3), 209. https://doi.org/10.3390/educsci12030209
CR  - Thomson, K. & Falchikov, N. (1998). ‘Full on until the sun comes out’: The effects of assessment on student approaches to studying. Assessment & Evaluation in Higher Education, 23(4): 379–390. https://doi.org/10.1080/0260293980230405
CR  - Tight, M. (2019). Globalization and internationalization as frameworks for higher education research. Research Papers in Education. 36(1), 52-74. https://doi.org/10.1080/02671522.2019.1633560
CR  - Van der Pol, J., Van den Berg, B. A. M., Admiraal, W. F., & Simons, P. R. J. (2008). The nature, reception, and use of online peer feedback in higher education. Computers & Education, 51(4), 1804-1817. https://doi.org/10.1016/j.compedu.2008.06.001
CR  - Van Eck, N. J., & Waltman, L. (2010). Software survey: VOSviewer, a computer program for bibliometric mapping. Scientometrics, 84(2), 523–538. https://doi.org/10.1007/s11192-009-0146-3
CR  - Wang, T. H. (2008). Web-based quiz-game-like formative assessment: Development and evaluation. Computers & Education, 51(3), 1247-1263. https://doi.org/10.1016/j.compedu.2007.11.011
CR  - Whitelock, D., Thorpe, M., & Galley, R. (2015). Student workload: A case study of its significance, evaluation and management at the Open University. Distance Education, 36(2), 161–176. https://doi.org/10.1080/01587919.2015.10550
CR  - Xie, L.; Chen, Z.; Wang, H.; Zheng, C.; Jiang, J. (2020). Bibliometric and Visualized Analysis of Scientific Publications on Atlantoaxial Spine Surgery Based on Web of Science and VOSviewer. World Neurosurg, 137, 435–442. https://doi.org/10.1016/j.wneu.2020.01.171
CR  - Zawacki-Richter, O., & Latchem, C. (2018). Exploring four decades of research in Computers & Education. Computers & Education, 122, 136-152. https://doi.org/10.1016/j.compedu.2018.04.001
UR  - https://doi.org/10.17718/tojde.1184218
L1  - https://dergipark.org.tr/en/download/article-file/2688203
ER  -