THE EFFECTS OF CHATBOTS-BASED INTERVENTIONS ON FOREIGN LANGUAGE SPEAKING PERFORMANCE: A META-ANALYSIS STUDY
Abstract
The aim of this study is to examine the effect of chatbot-based interventions on foreign language speaking performance through a meta-analysis. Studies investigating the effects of chatbots on speaking performance were retrieved from various databases (e.g., ERIC, ScienceDirect, Taylor & Francis) using a range of keyword phrases. Following the inclusion and exclusion criteria, this meta-analysis included 16 experimental studies (k = 17) that implemented chatbot-based interventions to enhance learners’ foreign language speaking performance. All statistical data were collected and transferred to the Comprehensive Meta-Analysis (CMA) software to compute Hedges’ g values. The overall effect size of the intervention studies on foreign language speaking performance was 1.035, indicating a large effect. Intervention duration and education level were examined as moderator variables, but they did not significantly affect foreign language speaking performance. This study offers a theoretical basis for using artificial intelligence tools in language teaching by emphasizing chatbots’ potential to improve speaking.
Keywords
chatbots, speaking performance, foreign language, meta-analysis.
References
- Adamopoulou, E., & Moussiades, L. (2020). Chatbots: History, technology, and applications. Machine Learning with Applications, 2, 100006. https://doi.org/10.1016/j.mlwa.2020.100006
- Al-Abdullatif, A. M., Al-Dokhny, A. A., & Drwish, A. M. (2023). Implementing the Bashayer chatbot in Saudi higher education: Measuring the influence on students’ motivation and learning strategies. Frontiers in Psychology, 14, 1129070. https://doi.org/10.3389/fpsyg.2023.1129070
- Alemdag, E. (2023). The effect of chatbots on learning: A meta-analysis of empirical research. Journal of Research on Technology in Education, 1-23. https://doi.org/10.1080/15391523.2023.2255698
- Almawadeh, N. S., Almaharma, H., Qatawneh, S., & Tareef, M. (2024). Enhancing the ability of Jordanian secondary-school students to speak English through employing AI chatbot instruction. Educational Administration: Theory and Practice, 30(5), 3188-3196.
- Bahari, A., Smith, M., & Scott, H. (2024). Examining the impact of chatbot-based language learning support, adaptive learning algorithms, and virtual reality language immersion on EFL learners’ language learning proficiency and self-regulated learning skills. Preprints, 2024031715. https://doi.org/10.20944/preprints202403.1715.v1