Scientific Mapping of Chatgpt Usage in Education: A Bibliometric Perspective

Abstract

The rapid advancement of digital technologies and computer science indicates that society is evolving towards a technological future. Among these developments, core technologies with far-reaching effects such as ChatGPT have emerged. This study aims to examine the use and role of ChatGPT in the field of education from a bibliometric perspective and to reveal its position in the academic literature in detail. For this reason, the searches using the words "ChatGPT" and "School", "Teacher" or "Student" in the Scopus and WOS database on 29/05/2024 form the basis of this study. The research findings reveal that global collaboration plays an important role. Furthermore, the applications of AI and ChatGPT in higher education and medical education have been identified as an indicator of the transformative effect of AI in the field of education. In conclusion, AI applications offer insights that are both positive and negative for all areas of education, offering exciting potential for future educational methods and strategies. A more in-depth examination of the role of ChatGPT in education is critical in shaping the future in this field.

Keywords

• Artificial intelligence
• ChatGPT
• Education
• School
• Teacher
• Bibliometric analysis

Ethical Statement

CONFLICT OF INTEREST STATEMENT The authors declare that there is no conflict of interest in this study. RESEARCH AND PUBLICATION ETHICS STATEMENT The authors declare that research and publication ethics are followed in this study. AUTHOR LIABILITY STATEMENT The authors declare that the “Conceptual Framework, Post Draft, Review and Editing” part of this work was done by Assist. Prof. Dr. Mustafa TAKTAK, “Method Design, Post Draft, Research, Visualization” part of this work was done by İsmail Eray DURSUN.

References

1. Ansari, A.N., Ahmad, S. & Bhutta, S.M. (2023). Mapping the global evidence around the use of ChatGPT in higher education: A systematic scoping review. Educ Inf Technol, 29, 11281-11321. https://doi.org/10.1007/s10639-023-12223-4
2. Arslan, E. (2022). Sosyal bilim araştırmalarında VOSviewer ile bibliyometrik haritalama ve örnek bir uygulama. Anadolu Üniversitesi Sosyal Bilimler Dergisi, 22(Özel Sayı 2), 33-56.
3. Chen, H., Widarso, G., & Sutrisno, H. (2020). A chatbot for learning chinese: learning achievement and technology acceptance. Journal of Educational Computing Research, 58(6), 1161-1189. https://doi.org/10.1177/0735633120929622
4. Chocarro, R., Cortinas, M., & Marcos-Matás, G. (2023). Teachers’ attitudes towards chatbots in education: a technology acceptance model approach considering the effect of social language, bot proactiveness, and users’ characteristics. Educational Studies, 49(2), 295-313. https://doi.org/10.1080/03055698.2020.1850426
5. Chuah, K. & Kabilan, M. (2021). Teachers’ views on the use of chatbots to support english language teaching in a mobile environment. International Journal of Emerging Technologies in Learning (Ijet), 16(20), 223. https://doi.org/10.3991/ijet.v16i20.24917
6. Cobo, M. J., López‐Herrera, A. G., Herrera‐Viedma, E., & Herrera, F. (2011). Science mapping software tools: Review, analysis, and cooperative study among tools. Journal of the American Society for information Science and Technology, 62(7), 1382-1402. https://doi.org/10.1002/asi.21525
7. Cotton, D. R., Cotton, P. A., & Shipway, J. R. (2024). Chatting and cheating: Ensuring academic integrity in the era of ChatGPT. Innovations in Education and Teaching International, 61(2), 228-239. https://doi.org/10.1080/14703297.2023.2190148
8. Donthu, N., Kumar, S., Mukherjee, D., Pandey, N., & Lim, W. M. (2021). How to conduct a bibliometric analysis: An overview and guidelines. Journal of Business Research, 133, 285–296. https://doi.org/10.1016/j.jbusres.2021.04.070

9. Fauzi, F., Tuhuteru, L., Sampe, F., Ausat, A. M. A., & Hatta, H. R. (2023). Analysing the role of ChatGPT in improving student productivity in higher education. Journal on Education, 5(4), 14886-14891. https://jonedu.org/index.php/joe/article/view/2563/2162
10. Gilson, A., Safranek, C. W., Huang, T., Socrates, V., Chi, L., Taylor, R. A., & Chartash, D. (2023). How does ChatGPT perform on the United States Medical Licensing Examination (USMLE)? The implications of large language models for medical education and knowledge assessment. JMIR Medical Education, 9(1), e45312. https://doi.org/10.2196/45312
11. Grové, C. (2021). Co-developing a mental health and wellbeing chatbot with and for young people. Frontiers in Psychiatry, 11, 606041. https://doi.org/10.3389/fpsyt.2020.606041
12. Gülmez, D., Özteke, İ., & Gümüş, S. (2021). Overview of educational research from turkey published in international journals: A bibliometric analysis. Education & Science/Egitim ve Bilim, 46(206), 1-7. https://doi.org/10.15390/EB.2020.9317
13. Huang, W., Hew, K., & Fryer, L. (2021). Chatbots for language learning—are they really useful? a systematic review of chatbot‐supported language learning. Journal of Computer Assisted Learning, 38(1), 237-257. https://doi.org/10.1111/jcal.12610
14. Jasin, J., Ng, H., Atmosukarto, I., Iyer, P., Osman, F., Wong, P., … & Cheow, W. (2023). The implementation of chatbot-mediated immediacy for synchronous communication in an online chemistry course. Education and Information Technologies, 28(8), 10665-10690. https://doi.org/10.1007/s10639-023-11602-1
15. Jeong, T., Liu, H., Alessandri‐Bonetti, M., Pandya, S., Nguyen, V. T., & Egro, F. M. (2023). Revolutionizing patient education: ChatGPT outperforms Google in answering patient queries on free flap reconstruction. Microsurgery, 43(7), 752-761. https://doi.org/10.1002/micr.31106
16. Jia-qi, Y., Goh, T., Bing, Y., & Xiao, Y. (2020). Conversation technology with micro-learning: the impact of chatbot-based learning on students’ learning motivation and performance. Journal of Educational Computing Research, 59(1), 154-177. https://doi.org/10.1177/0735633120952067
17. Kang, K., Kim, S., & Kang, S. (2022). Elementary school students' awareness of the use of artificial intelligence chatbots in violence prevention education in South Korea: a descriptive study. Child Health Nursing Research, 28(4), 291-298. https://doi.org/10.4094/chnr.2022.28.4.291
18. Khan, M. A., Pattnaik, D., Ashraf, R., Ali, I., Kumar, S., & Donthu, N. (2021). Value of special issues in the journal of business research: A bibliometric analysis. Journal of business research, 125, 295-313. https://doi.org/10.1016/j.jbusres.2020.12.015
19. Korsakova, E., Sokolovskaya, O., Minakova, D., Gavronskaya, Y., Maksimenko, N., & Kurushkin, M. (2021). Chemist bot as a helpful personal online training tool for the final chemistry examination. Journal of Chemical Education, 99(2), 1110-1117. https://doi.org/10.1021/acs.jchemed.1c00789
20. Lund, B. D., Wang, T., Mannuru, N. R., Nie, B., Shimray, S., & Wang, Z. (2023). ChatGPT and a new academic reality: Artificial Intelligence‐written research papers and the ethics of the large language models in scholarly publishing. Journal of the Association for Information Science and Technology, 74(5), 570-581. https://doi.org/10.1002/asi.24750
21. Nguyen, H., Tran, T., Pham, X., Huynh, A., & Nhon, V. (2021). Ontology-based integration of knowledge base for building an intelligent searching chatbot. Sensors and Materials, 33(9), 3101. https://doi.org/10.18494/sam.2021.3264
22. Perkins, M. (2023). Academic Integrity considerations of AI Large Language Models in the post-pandemic era: ChatGPT and beyond. Journal of University Teaching and Learning Practice, 20(2). https://doi.org/10.53761/1.20.02.07
23. Pradana, M., Elisa, H. P., & Syarifuddin, S. (2023). The growing trend of Islamic fashion: A bibliometric analysis. Cogent Social Sciences, 9(1), 2184557. https://doi.org/10.1080/23311886.2023.2184557
24. Prahani, B. K., Rizki, I. A., Jatmiko, B., Suprapto, N., & Tan, A. (2022). Artificial intelligence in education research during the last ten years: A review and bibliometric study. International Journal of Emerging Technologies in Learning, 17(08), 169-188. https://doi.org/10.3991/ijet.v17i08.29833
25. Pu, S., Ahmad, N. A., Khambari, M. N. M., & Yap, N. K. (2021). Identification and analysis of core topics in educational artificial intelligence research: A bibliometric analysis. Cypriot Journal of Educational Sciences, 16(3), 995-1009. https://doi.org/10.18844/cjes.v16i3.5782
26. Qadir, J. (2023, May). Engineering education in the era of ChatGPT: Promise and pitfalls of generative AI for education. In 2023 IEEE Global Engineering Education Conference (EDUCON) (pp. 1-9). IEEE. https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10125121
27. Qasem, F. (2023). Chatgpt in scientific and academic research: future fears and reassurances. Library Hi Tech News, 40(3), 30-32. https://doi.org/10.1108/lhtn-03-2023-0043
28. Rahman, M. M., & Watanobe, Y. (2023). ChatGPT for education and research: Opportunities, threats, and strategies. Applied Sciences, 13(9), 5783. https://doi.org/10.3390/app13095783
29. Rudolph, J., Tan, S., & Tan, S. (2023a). ChatGPT: Bullshit spewer or the end of traditional assessments in higher education?. Journal of Applied Learning and Teaching, 6(1), 342-363. https://doi.org/10.37074/jalt.2023.6.1.9
30. Rudolph, J., Tan, S., & Tan, S. (2023b). War of the chatbots: Bard, Bing Chat, ChatGPT, Ernie and beyond. The new AI gold rush and its impact on higher education. Journal of Applied Learning and Teaching, 6(1), 364-389. https://doi.org/10.37074/jalt.2023.6.1.23
31. Sallam, M. (2023). The utility of ChatGPT as an example of large language models in healthcare education, research and practice: Systematic review on the future perspectives and potential limitations. MedRxiv, 2023-02. https://doi.org/10.1101/2023.02.19.23286155
32. Strzelecki, A. (2024). Students’ acceptance of ChatGPT in higher education: An extended unified theory of acceptance and use of technology. Innovative Higher Education, 49(2), 223-245. https://doi.org/10.1007/s10755-023-09686-1
33. Su, J. & Yang, W. (2023). Unlocking the power of ChatGPT: A framework for applying generative AI in education. ECNU Review of Education, 6(3), 355-366. https://doi.org/10.1177/20965311231168423 Taktak, M., Bellibaş, M. Ş, & Özgenel, M. (2024). Use of ChatGPT in education: Future strategic road map with swot analysis. Educational Process: International Journal, 13(3): 7-21. https://doi.org/10.22521/edupij.2024.133.1
34. Tsang, R. (2023). Practical applications of chatgpt in undergraduate medical education. Journal of Medical Education and Curricular Development, 10, 238212052311784. https://doi.org/10.1177/23821205231178449
35. Van Eck, N., & Waltman, L. (2010). Software survey: VOSviewer, a computer program for bibliometric mapping. Scientometrics, 84(2), 523-538.
36. Zheltukhina, M. R., Sergeeva, O. V., Masalimova, A. R., Budkevich, R. L., Kosarenko, N. N., & Nesterov, G. V. (2024). A bibliometric analysis of publications on ChatGPT in education: Research patterns and topics. Online Journal of Communication and Media Technologies, 14(1), e202405. https://doi.org/10.30935/ojcmt/14103
37. Zhu, J., & Liu, W. (2020). A tale of two databases: the use of Web of Science and Scopus in academic papers. Scientometrics, 123(1), 321-335.