General trends in studies on the use of Chatbot technology in second language teaching

Öz

The purpose of this research is to reveal existing trends by examining research article-type studies on the use of "Chatbot" technology in second language teaching. This study, carried out in accordance with the qualitative research approach, utilized the document review method. Forty studies in the form of research articles addressing the use of Chatbots in second language teaching constituted the main data source of this research. As a result of the analysis, it was determined that a significant part of the relevant studies was designed as mixed methods research, in which an experimental process was first carried out, and then opinions were obtained from the participants. The most frequently used approaches after mixed methods research are quantitative and qualitative approaches, respectively. Additionally, it was observed that the research largely focuses on teaching English, and apart from one study on Chinese and German, no studies on different target languages were found. The general trend in the studies is to use existing chatbots, and in this sense, Replika, Andy, Alexa, Elbot, Mitsiku, and Google Assistant have been widely used. There are also examples of studies where researchers developed their own Chatbot. It was observed that the participant groups in the studies were largely composed of university students, and it was determined that studies in which high school, secondary school, and primary school students and teachers were the study groups were rare. Studies often focus on the academic success factor around speaking and grammar skills. It was also determined that there are studies aimed at determining the opinions and perceptions of the participants, but there are few studies conducted around affective characteristics such as motivation, interest, and attitude.

Anahtar Kelimeler

• Chatbot
• Second language teaching
• Trends

İkinci dil öğretiminde Chatbot teknolojisinin kullanımına yönelik çalışmalardaki genel eğilimler

Öz

Bu araştırmanın amacı, ikinci dil öğretiminde “Chatbot” teknolojisinin kullanımına yönelik araştırma makalesi türündeki çalışmaların incelenerek bu konuda var olan eğilimlerin ortaya koyulmasıdır. Nitel araştırma yaklaşımına uygun olarak yürütülen bu çalışma, doküman incelemesi yöntemi ile yürütülmüştür. İkinci dil öğretiminde Chatbot kullanımını ele alan araştırma makalesi türündeki 40 çalışma ise bu araştırmanın temel veri kaynağını oluşturmuştur. Analizler sonucunda ikinci dil eğitiminde Chatbot kullanımına yönelik çalışmaların önemli bir kısmının önce deneysel bir sürecin yürütüldüğü, ardından katılımcılardan görüş alınan karma yöntem araştırmaları şeklinde kurgulandığı belirlenmiştir. Karma yöntem araştırmalarından sonra en sık olarak kullanılan yaklaşımların ise sırasıyla nicel ve nitel yaklaşımlar olduğu görülmüştür. Ayrıca araştırmaların büyük oranda İngilizcenin öğretimine odaklandığı görülmüş, Çince ve Almanca dillerine yönelik birer çalışma dışında farklı bir hedef dillere yönelik çalışmalara rastlanılmamıştır. Çalışmalardaki genel eğilimin hâlihazırda var olan chatbotları kullanma yönünde olduğu belirlenmiş, bu anlamda Replika, Andy, Alexa, Elbot, Mitsiku ve Google Asistan’ın yaygın olarak kullanıldığı görülmüştür. Araştırmacıların kendi Chatbot’unu geliştirdiği çalışma örneklerine de rastlanmıştır. Araştırmalardaki katılımcı gruplarını büyük oranda üniversite öğrencilerinin oluşturduğu görülmüş, lise, ortaokul ve ilkokul öğrencileri ile öğretmenlerin çalışma grubu olduğu çalışmaların nadir olduğu belirlenmiştir. Çalışmaların sıklıkla konuşma ve gramer becerileri etrafındaki akademik başarı faktörüne odaklandığı görülmüştür. Ayrıca katılımcıların görüş ve algılarını belirlemeye yönelik çalışmaların da bulunduğu, bu noktada en az çalışmanın motivasyon, ilgi, tutum gibi duyuşsal özellikler etrafında gerçekleştirildiği belirlenmiştir.

Anahtar Kelimeler

• Chatbot
• Eğilim
• İkinci dil öğretimi

Kaynakça

1. Alm, A. & Nkomo, L.M. (2020). Chatbot experiences of informal language learners: A sentiment analysis. International Journal of Computer-Assisted Language Learning and Teaching, 10(4), 51-65. https://doi.org/10.4018/ijcallt. 2020100104.
2. Abdollahzadeh, M., Golshan, M. & Allami, H. (2022). Using a messenger bot as a tool for providing written corrective feedback: Examining L2 development and learners’ attitudes. Research in English Language Pedagogy, 10(4), 599-624, 10.30486/RELP.2022.1946281.1327
3. Ahn, S. (2022). The effects of chatbot on grammar competence for Korean efl college students. Journal of Digital Convergence, 20(3),53-61.
4. Alsadoon, R. (2021). Chatting with AI Bot: Vocabulary learning assistant for Saudi EFL learners. English Language Teaching, 14(6), 135-157.
5. Belda-Medina, J. & Calvo-Ferrer, J.R. (2022). Using Chatbots as AI Conversational Partners in Language Learning. Appl. Sci. 12, 8427. https://doi.org/10.3390/ app12178427
6. Çakmak, F. (2022). Chatbot-human interaction and its effects on EFL students’ L2 speaking performance and speaking anxiety. Novitas-ROYAL (Research on Youth and Language), 16(2), 113–131.
7. Chen, X., Xie, H., & Hwang, G. J. (2020a). A Multi-perspective study on artificial intelligence in education: Grants, conferences, journals, software tools, institutions, and researchers. Computers and Education: Artificial Intelligence, 1, 100005. https://doi.org/10.1016/j.caeai.2020.100005
8. Chen, H.-L., Vicki Widarso, G., & Sutrisno, H. (2020b). A chatbot for learning chinese: learning achievement and technology acceptance. Journal of Educational Computing Research, 58(6), 1161–1189. doi:10.1177/0735633120929622

9. Chuah, K.M. & Kabilan, M.K. (2021). Teachers’ views on the use of chatbots to support English language teaching in a mobile environment. International Journal of Emerging Technologies in Learning, 16(20), 223-237.
10. Dizon, G. (2017). Using intelligent personal assistants for l2 learning: A case study of Alexa. Tesol Journal, 8(4), 811-830. https://doi.org/10.1002/tesj.353.
11. Dizon, G. (2020). Evaluating intelligent personal assistants for l2 listening and speaking development. Language Learning & Technology, 24(1), 16-26. https://doi. org/10125/44705.
12. Ebadi, S.& Amini, A. (2022): Examining the roles of social presence and human-likeness on Iranian EFL learners’ motivation using artificial intelligence technology: a case of CSIEC chatbot, Interactive Learning Environments, 10.1080/10494820.2022.2096638
13. El-Magd. M.A. (2022). Text chatbot assisted edublogs for enhancing the EFL Technical writing performance among computer and ınformatics students. JFEES, 46(2), 99-145, 10.21608/jfees.2022.241755
14. Fryer, L., & Carpenter, R. (2006). Bots as Language Learning Tools, Language Learning and Technology, 10(3), 8-14.
15. Fryer, L. K., Ainley, M., Thompson, A., Gibson, A., Sherlock, Z. (2017). Stimulating and sustaining interest in a language course: An experimental comparison of chatbot and human task partners. Computers in Human Behavior, 75, 461-468. https://doi.org/10.1016/j.chb.2017.05.045
16. Fryer, L. K., Coniam, D., Carpenter, R., Lăpușneanu, D. (2020). Bots for language learning now: Current and future directions. Language Learning & Technology, 24(2), 8-22.
17. Goda, vd., (2014). Conversation with a chatbot before an online EFL group discussion and the effects on critical thinking. The Journal of Information and Systems in Education, 13(1), 1-7.
18. Han, D. (2021). An analysis of korean efl learners’ experience on english classes using aı chatbot. Robotics & AI Ethics, 6(3) 1-9
19. Han, D.E. (2020). The Effects of Voice-based AI Chatbot on Korean EFL Students’ Speaking Ability and Affective Factors. International Journal of Computer Science and Information Technology for Education, 5(1), 25-30, http://dx.doi.org/10.21742/ijcsite.2020.5.1.03
20. Hsu, M.H. & Chen, P.D. & Yu, C.S. (2021) Proposing a task- oriented chatbot system for EFL learners speaking practice, Interactive Learning Environments, DOI: 10.1080/10494820.2021.1960864
21. Huang, W., Hew, K.F., & Fryer, L.K. (2022). Chatbots for language learning-Are they really useful? A systematic review of chatbot-supported language learning. Journal of computer assisted learning, 38, 237-257. https://doi.org/10.1111/jcal.12610
22. Hwang, G. J., Xie, H., Wah, B. W. & Gašević, D. (2020). Vision, challenges, roles and research issues of artificial intelligence in education. Computers & Education: Artificial Intelligence, 1, 100001.
23. Hwang, G.J., & Chang, C.Y. (2023). A review of opportunities and challenges of chatbots in education. Interactive Learning Environments, 31(7), 4099-4112. https://doi.org/10.1080/10494820.2021.1952615
24. Ifelebuegu, A, Kulume, P., & Cherukut, P. (2023). Chatbots and AI in Education (AIEd) tools: The good, the bad, and the ugly. Journal of Applied Learning & Teaching, 6(2), 332-345. https://doi.org/10.37074/jalt.2023.6.2.29
25. Jeon, J. (2021). Chatbot-assisted dynamic assessment (CA-DA) for L2 vocabulary learning and diagnosis. Computer Assisted Language Learning. https://doi.org/10.1080/09588221.2021.1987272
26. Jeon, J. (2022). Exploring AI chatbot affordances in the EFL classroom: young learners’ experiences and perspectives. Computer Assisted Language Learning, 10.1080/09588221.2021.2021241.
27. Ji, H.,Han, I. & Ko,Y. (2022). A systematic review of conversational AI in language education: focusing on the collaboration with human teachers. Journal of Research on Technology in Education. 55(2),1-16.
28. Kim, H. S., Kim, N.Y., & Cha, Y. (2021b). Is it beneficial to use AI chatbots to improve learners’ speaking performance?. The Journal of Asia TEFL 18(1), 161-178.
29. Kim, H.S., Cha, Y. & Kim. N.Y. (2021a). Effects of AI chatbots on EFL students’ communication skills. Korean Journal of English Language and Linguistics, 21, 712-734.
30. Kim, H.S., Cha, Y. & Kim, N.Y. (2020). Impact of Mobile Interactions With AI on Writing Performance, Modern English Education, 21(2), 1-13.
31. Kim, N.Y. (2017a). Effects of different types of chatbots on EFL learners’ speaking competence and learner perception. Cross Cultural Studies 48, 223-252.
32. Kim, N.Y. (2017b). Effects of different voice-chat conditions on EFL learners’ topic negotiation according to proficiency levels. Modern English Education, 18(1), 49-74.
33. Kim, N.Y. (2018a). Chatbots and Korean EFL students' English vocabulary learning. Journal of Digital Convergence, 16(2), 1-7.
34. Kim, N. Y. (2018b). A study on chatbots for developing Korean college students’ English listening and reading skills. Journal of Digital Convergence, 16(8), 19-26.
35. Kim, N. Y. (2018c). Effect of text chat on EFL writing fluency, accuracy, and complexity by interlocutors. Foreign Languages Education, 25(1), 27-54.
36. Kim, N. Y. (2018d). Different chat modes of a chatbot and EFL students’ writing skills development. Studies in Foreign Language Education, 32(1), 263-290.
37. Kim, N.Y. (2019). A study on the use of artificial intelligence chatbots for improving English grammar skills. Journal of Digital Convergence, 17(8), 37-46.
38. Kim, H., Yang, H., Shin, D., & Lee, J. H. (2022). Design principles and architecture of a second language learning chatbot. Language Learning & Technology, 26(1), 1–18.
39. Klímová, B., & Ibna Seraj, P. M. (2023). The use of chatbots in university EFL settings: Research trends and pedagogical implications. Frontiers in Psychology, 14, 1131506. https://doi.org/10.3389/fpsyg.2023.1131506
40. Kohnke, L., Moorhouse, B. L., & Zou, D. (2023). ChatGPT for language teaching and learning. RELC Journal, 54(2), 537-550. https://doi.org/10.1177/00336882231162868
41. Kuhail, M.A., Alturki, N., Alramlawi, S. et al. (2023). Interacting with educational chatbots: A systematic review. Educ Inf Technol 28, 973–1018. https://doi.org/10.1007/s10639-022-11177-3
42. Lakshmi, V. & Majid, I. (2022). Chatbots in education system. University News, 60(08), 15-18.
43. Lin, C.J., & Mubarok, H. (2021). Learning analytics for ınvestigating the mind map-guided AI chatbot approach in an EFL flipped speaking classroom. Educational Technology & Society, 24 (4), 16–35.
44. Lin, C., Huang, A. Y., & Yang, S. J. (2022). A review of AI-driven conversational chatbots ımplementation methodologies and challenges (1999–2022). Sustainability, 15(5), 4012. https://doi.org/10.3390/su15054012
45. Mageira, K., Pittou, D., Papasalouros, A., Kotis, K., Zangogianni, P. & Daradoumis, A. (2022). Educational AI chatbots for content and language integrated learning. Appl. Sci.-Basel, 12, 3239.
46. Mahmoud, R.H. (2022). Implementing AI-based conversational chatbots in EFL speaking classes: an evolutionary perspective. Res. Square. 10.21203/rs.3.rs-1911791/v1
47. Mazilli, F. (2021). Chatbots for action-oriented language learning using elbot to enhance conflict-solving skills in learners of German as a foreign language. Language Education, 10(1), 96-116.
48. Nee, C.K.,Rahman, M.H.A., Yahaya, N., Ibrahim, N.H., Razak, R.A., Sugino, C. (2023). Exploring the trend and potential distribution of chatbot in education: A systematic review. International Journal of Information and Education Technology, 13(3), 516-528. https://doi.org/10.18178/ijiet.2023.13.3.1834
49. Nghi, T.T., Phuc, T.H., & Thang, N.T. (2019). Applying AI chatbot for teaching a foreign language: An empirical research. Internatıonal Journal of Scıentıfıc & Technology Research 8(12), 897-902.
50. Nguyen, T.T., Le, A.D.., Hoang, H.T., Nguyen, T. (2021). NEU-chatbot: Chatbot for admission of National Economics University. Computers and Education: Artificial Intelligence, 2, 100036.
51. Qinghua, Y. & Satar, M. (2020). English as a foreign language learner interaction with chatbots: Negotiation for meaning. International Online Journal of Education and Teaching (IOJET), 7(2), 390-410.
52. Pérez, J. Q., Daradoumis, T., & Puig, J. M. M. (2020). Rediscovering the use of chatbots in education: A systematic literature review. Computer Applications in Engineering Education. https://doi.org/10.1002/cae.22326
53. Ramandanis, D. & Xinogalos, S. (2023).Designing a Chatbot for Contemporary Education: A Systematic Literature Review. nformation. 2023; 14(9):503. https://doi.org/10.3390/info14090503
54. Shin, D., Kim, H., Lee, J.H, Yang, H. (2021). Exploring the use of an artificial intelligence chatbot as second language conversation partners. Korean Journal of English Language and Linguistics, 21, 375-391.
55. Şenyaman, G. (2023). Arapça yabancı dil öğretiminde yapay zekânın geleceği: ChatGPT örneği. RumeliDE Dil ve Edebiyat Araştırmaları Dergisi, (33), 1057-1070. https://doi.org/10.29000/rumelide.1285940
56. Sunyoung K., Joobo S. & Jaechang S. (2023). A study on the utilization of OpenAI ChatGPT as a second language learning tool. J Multimed Inf Syst 10(1), 79-88. https://doi.org/10.33851/JMIS.2023.10.1.79
57. Tai, T.Y., & Chen, H.H.J. (2020). The impact of Google Assistant on adolescent EFL learners’ willingness to communicate. Interactive Learning Environments, 1–18.
58. Vanjani, M. Aiken, & M. Park. (2020). Using a multilingual chatbot for foreign language practice. Issues in Information Systems, 21(2), 85-92.
59. Vázquez Cano, E., Mengual Andrés, S. & López Meneses, E. (2021). Chatbot to improve learning punctuation in Spanish and to enhance open and flexible learning environments. International Journal of Educational Technology in Higher Education. 38, 237-257.
60. Winkler, R. & Söllner, M. (2018). Unleashing the potential of chatbots in education: A state-of the-art analysis. Academy of Management Annual Meeting. Chicago, USA.
61. Wollny, S., Schneider, J., Di Mitri, D., Weidlich, J., Rittberger, M., & Drachsler, H. (2021). Are we there yet? - A systematic literature review on chatbots in education. Front. Artif. Intell. 4:654924. https://doi.org/10.3389/frai.2021.654924
62. Yan, D. (2023). Impact of ChatGPT on learners in a L2 writing practicum: An exploratory investigation. Education and Information Technologies, https://doi.org/10.1007/s10639-023-11742-4
63. Yang, H., Kim, H., Lee, J.H., & Shin, D. (2022). Implementation of an AI chatbot as an english conversation partner in EFL speaking classes. ReCall, 34(3), 327-343.
64. Yıkar, G. (2023). Farsça dil eğitiminde yapay zekâ (Al) destekli çeviri ve metin üretme üzerine bir değerlendirme. RumeliDE Dil ve Edebiyat Araştırmaları Dergisi (36), 1204-1221. https://doi.org/10.29000/rumelide.1369151
65. Yıldırım A. & Şimşek H. (2016). Sosyal bilimlerde nitel araştırma yöntemleri. Ankara: Seçkin Yayıncılık
66. Yin, Q., & Satar, M. (2020). English as a foreign language learner interactions with chatbots: Negotiation for meaning. Int. Online J. Educ. Teach. 7, 390–410.
67. Zileli, E.N. (2023). Yabancı dil olarak Türkçe öğreniminde ChatGPT örneği. Uluslararası Karamanoğlu Mehmetbey Eğitim Araştırmaları Dergisi, 5(1), 42-51. https://doi.org/10.47770/ukmead.1296013