The effect of LLM-powered value-integrated story cards on English vocabulary acquisition: A generative AI-supported convergent mixed methods study in middle school students

Abstract

This study investigates the effectiveness of large language model (LLM)-powered value-integrated story cards in English vocabulary instruction using a convergent mixed methods design with 30 sixth-grade middle school students over a four-week intervention. Story cards embedding universal values (empathy, responsibility, honesty, and cooperation) were developed via systematic prompt engineering with GPT-4, a generative AI (GenAI) tool, reviewed by domain experts, and applied within a quasi-experimental pre-test/post-test control group design. Generative AI was additionally employed in the preliminary coding phase of qualitative data analysis and in generating the item pool for the Vocabulary Achievement Test. Data were collected via a Vocabulary Achievement Test (KR-20 = .83), structured classroom observation forms, and semi-structured individual interviews. Quantitative findings revealed a statistically significant and practically large difference in favour of the experimental group [t(28) = 4.15, p = .001, Cohen's d = 1.52]. Qualitative content analysis generated four main themes: contextual recall, motivation-enjoyment, value awareness, and material usability. Findings offer pedagogical implications for GenAI-supported, holistic, and value-integrated material design in foreign language education.

Keywords

• foreign language teaching
• values education
• context-based instruction
• vocabulary acquisition

References

1. Al Mahmud, M. (2023). Generative AI tools and their impact on EFL vocabulary and grammar learning. TESOL Journal, 14(4), e734.
2. Arnold, J. (2011). Attention to affect in language learning. Anglistik: International Journal of English Studies, 22(1), 11-22.
3. Ausubel, D. P. (1963). The psychology of meaningful verbal learning. Grune & Stratton.
4. Beck, I. L., McKeown, M. G., & Kucan, L. (2013). Bringing words to life: Robust vocabulary instruction (2nd ed.). Guilford Press.
5. Brewster, J., Ellis, G., & Girard, D. (2002). The primary English teacher's guide (New ed.). Penguin English.
6. Byram, M. (1997). Teaching and assessing intercultural communicative competence. Multilingual Matters.
7. Cameron, L. (2001). Teaching languages to young learners. Cambridge University Press.
8. Campbell, D. T., & Stanley, J. C. (1963). Experimental and quasi-experimental designs for research. Rand McNally.

9. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Lawrence Erlbaum Associates.
10. Crompton, H. (2024). Artificial intelligence in English language teaching and learning: A systematic review. Language Teaching Research. https://doi.org/10.1177/13621688241227693
11. Creswell, J. W. (2014). Research design: Qualitative, quantitative, and mixed methods approaches (4th ed.). SAGE.
12. Creswell, J. W., & Plano Clark, V. L. (2018). Designing and conducting mixed methods research (3rd ed.). SAGE.
13. Deci, E. L., & Ryan, R. M. (2000). The 'what' and 'why' of goal pursuits: Human needs and the self-determination of behavior. Psychological Inquiry, 11(4), 227-268. https://doi.org/10.1207/S15327965PLI1104_01
14. Dornye, Z., & Ushioda, E. (2021). Teaching and researching motivation (3rd ed.). Routledge.
15. Field, A. (2018). Discovering statistics using IBM SPSS statistics (5th ed.). SAGE.
16. Fraenkel, J. R., Wallen, N. E., & Hyun, H. H. (2019). How to design and evaluate research in education (10th ed.). McGraw-Hill.
17. Ghosn, I. K. (2013). Four good reasons to use literature in primary school ELT. ELT Journal, 56(2), 172-179. https://doi.org/10.1093/elt/56.2.172
18. Hulstijn, J. H. (2015). Language proficiency in native and non-native speakers: Theory and research. John Benjamins.
19. Johnson, R. B., & Onwuegbuzie, A. J. (2004). Mixed methods research: A research paradigm whose time has come. Educational Researcher, 33(7), 14-26. https://doi.org/10.3102/0013189X033007014
20. Kasneci, E., Sessler, K., Kuchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Gunnemann, S., Hullermeier, E., Krusche, S., Kutyniok, G., Michaeli, T., Nerdel, C., Pfeffer, J., Poquet, O., Sailer, M., Schmidt, A., Seidel, T., ... Kasneci, G. (2023). ChatGPT for good? On opportunities and challenges of large language models for education. Learning and Individual Differences, 103, 102274. https://doi.org/10.1016/j.lindif.2023.102274
21. Krashen, S. D. (1982). Principles and practice in second language acquisition. Pergamon Press.
22. Laufer, B., & Hulstijn, J. H. (2001). Incidental vocabulary acquisition in a second language: The construct of task-induced involvement. Applied Linguistics, 22(1), 1-26. https://doi.org/10.1093/applin/22.1.1
23. Lawshe, C. H. (1975). A quantitative approach to content validity. Personnel Psychology, 28(4), 563-575.
24. Lena, M. S., & Nikolov, M. (2025). A systematic review of empirical studies on young EFL learners' motivation and task engagement. SAGE Open, 15(2). https://doi.org/10.1177/21582440251386566
25. Li, B. (2025). A systematic review of empirical generative AI research in language learning and teaching from 2023 to 2024. Computers & Education: Artificial Intelligence, 8, 100352.
26. Li, Z., Wu, S., & Liu, D. (2025). The effects of context, story-type, and language proficiency on EFL word learning and retention from reading. International Review of Applied Linguistics in Language Teaching, 63(2), 1507-1531. https://doi.org/10.1515/iral-2023-0155
27. Lickona, T. (2009). Educating for character: How our schools can teach respect and responsibility. Bantam Books.
28. Lincoln, Y. S., & Guba, E. G. (1985). Naturalistic inquiry. SAGE.
29. Lo, C. K. (2023). What is the impact of ChatGPT on education? A rapid review of the literature. Education Sciences, 13(4), 410. https://doi.org/10.3390/educsci13040410
30. Mages, W. K. (2006). Drama and imagination: A cognitive theory of drama's effect on narrative understanding and story internalization. Research in Drama Education, 11(3), 329-340.
31. Merriam, S. B. (2009). Qualitative research: A guide to design and implementation. Jossey-Bass.
32. Miles, M. B., Huberman, A. M., & Saldana, J. (2014). Qualitative data analysis: A methods sourcebook (3rd ed.). SAGE.
33. Ministry of National Education (MoNE). (2018). English language curriculum (Primary and middle school grades 2-8). Board of Education and Discipline.
34. Mollick, E., & Mollick, L. (2023). Assigning AI: Seven approaches for students, with prompts. SSRN. https://doi.org/10.2139/ssrn.4475995
35. Nation, I. S. P. (2013). Learning vocabulary in another language (2nd ed.). Cambridge University Press.
36. Nation, I. S. P. (2022). Making and using word lists for language learning and testing (2nd ed.). John Benjamins.
37. Nation, I. S. P., & Webb, S. (2011). Researching and analyzing vocabulary. Heinle Cengage Learning.
38. OpenAI. (2023). GPT-4 technical report. arXiv. https://doi.org/10.48550/arXiv.2303.08774
39. Paivio, A. (1991). Dual coding theory: Retrospect and current status. Canadian Journal of Psychology, 45(3), 255-287. https://doi.org/10.1037/h0084295
40. Pratiwi, Y., Andajani, K., Suyitno, I., Ismail, A., & Prastio, B. (2023). Representing and implementing moral values in foreign students in Indonesia textbooks for learners other than Indonesians. International Journal of English Language and Literature Studies, 12(1), 1-12.
41. Puspitasari, D., Widodo, H. P., Widyaningrum, L., Allamnakhrah, A., & Lestariyana, R. P. D. (2021). How do primary school English textbooks teach moral values? A critical discourse analysis. System, 96, 102397. https://doi.org/10.1016/j.system.2020.102397
42. Schmitt, N. (2010). Researching vocabulary: A vocabulary research manual. Palgrave Macmillan.
43. Schmitt, N., & Schmitt, D. (2020). Vocabulary in language teaching (2nd ed.). Cambridge University Press.
44. Schwartz, S. H. (2012). An overview of the Schwartz theory of basic values. Online Readings in Psychology and Culture, 2(1). https://doi.org/10.9707/2307-0919.1116
45. Sembiring, E., & Simajuntak, D. C. (2023). Digital storytelling to enhance vocabulary knowledge. Journal of English Language Teaching and Applied Linguistics, 5(1), 12-21.
46. Song, C., & Song, Y. (2023). Using ChatGPT for second language writing: Pitfalls and potentials. System, 118, 103149. https://doi.org/10.1016/j.system.2023.103149
47. Tok, H., & Yigin, M. (2013). Teachers' views on vocabulary instruction in teaching English as a foreign language. Turkish Studies, 8(9), 2151-2164.
48. Tsou, W. (2008). Improving speaking skills through instruction in oral classroom participation. Foreign Language Annals, 38(1), 46-55.
49. Tumen Akyildiz, S. (2025). Exploring pedagogical and ethical dimensions of AI use in EFL classrooms: teachers' views from private high schools. Journal of Educational Technology and Online Learning, 8(4), 409-428. https://doi.org/10.31681/jetol.1744526
50. Webb, S. (2020). The Routledge handbook of vocabulary studies. Routledge.
51. Webb, S., & Nation, P. (2017). How vocabulary is learned. Oxford University Press.
52. Wentzel, K. R. (2014). Socialization in school settings. In J. E. Grusec & P. D. Hastings (Eds.), Handbook of socialization: Theory and research (2nd ed., pp. 251-275). Guilford Press.
53. Wright, A. (1995). Storytelling with children. Oxford University Press.
54. Yildirim, A., & Simsek, H. (2022). Qualitative research methods in social sciences (12th ed.). Seckin Publishing.
55. Zhou, X., & Wu, S. (2024). The impact of internal-generated contextual clues on EFL vocabulary learning: Insights from EEG. Frontiers in Psychology, 15, 1332098. https://doi.org/10.3389/fpsyg.2024.1332098