Exploring EFL Students’ AI Literacy in Academic Writing: Insights into Familiarity, Knowledge and Ethical Perceptions

Abstract

As artificial intelligence (AI) increasingly influences education, understanding learners' experiences, engagement and literacy of these tools is critical. This study explores AI literacy among Turkish EFL (English as a Foreign Language) students regarding their familiarity, knowledge, and ethical perceptions of AI technologies in academic writing. Using a descriptive exploratory approach, the study surveyed 427 students from two Turkish universities. Findings reveal a moderate level of AI familiarity and usage among participants, with a significant reliance on AI tools for translation and grammar proofreading. Despite recognizing AI's potential to enhance academic writing, students exhibited limited technical proficiency and understanding of AI's underlying mechanisms, highlighting a need for targeted and structured AI education for EFL writing. The findings contribute to the ongoing discourse on AI integration in EFL education, offering insights for policymakers, educators, and researchers to better prepare students for an AI-driven academic environment.

Keywords

• AI Literacy
• EFL
• Academic Writing
• Generative AI
• AI Tools in Education
• Türkiye

References

1. Alexander, B., Ashford-Rowe, K., Barajas-Murph, N., Dobbin, G., Knott, J., McCormack, M., ... & Weber, N. (2019). Horizon report 2019 higher education edition (pp. 3-41). EDU19. https://www.learntechlib.org/p/208644/ Al Mahmud, F. (2023). Investigating EFL students’ writing skills through artificial intelligence: Wordtune application as a tool. Journal of Language Teaching and Research, 14(5), 1395-1404. https://jltr.academypublication.com/index.php/jltr/article/view/6649
2. Amirjalili, F., Neysani, M., & Nikbakht, A. (2024). Exploring the boundaries of authorship: A comparative analysis of AI-generated text and human academic writing in English literature. Frontiers in Education, 9, p. 1347421. Frontiers Media SA. https://doi.org/10.3389/feduc.2024.1347421
3. Bahroun, Z., Anane, C., Ahmed, V., & Zacca, A. (2023). Transforming education: A comprehensive review of generative artificial intelligence in educational settings through bibliometric and content analysis. Sustainability, 15(17), 12983. https://doi.org/10.3390/su151712983
4. Becker, S. A., Brown, M., Dahlstrom, E., Davis, A., DePaul, K., Diaz, V., & Pomerantz, J. (2018). NMC horizon report: 2018 higher education edition. Louisville, CO: Educause. https://cit.bnu.edu.cn/docs/2018-09/20180918163624337480.pdf
5. Bianchi, T. (2023). ChatGPT website visits 2023. Statista. https://www.statista.com/statistics/1415201/chatopenaicom-chatgpt-audience-reach-visitors/?utm_source=chatgpt.com
6. Bosch, T., & Uzuegbunam, C. E. (2023, November 19). South African university students use AI to help them understand – not to avoid work. The Conversation. https://theconversation.com/south-african-university-students-use-ai-to-help-them-understand-not-to-avoid-work-216754
7. Chan, C. K. Y., & Hu, W. (2023). Students’ voices on generative AI: Perceptions, benefits, and challenges in higher education. International Journal of Educational Technology in Higher Education, 20(1), 43. https://doi.org/10.1186/s41239-023-00411-8
8. Chen, L., Chen, P., & Lin, Z. (2020). Artificial intelligence in education: A review. IEEE Access, 8, 75264-75278. https://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=9069875

9. Conde, J., Reviriego, P., Salvachúa, J., Martínez, G., Hernández, J. A., & Lombardi, F. (2024). Understanding the impact of artificial intelligence in academic writing: Metadata to the rescue. Computer, 57(1), 105–109. https://doi.org/10.1109/MC.2023.3327330
10. Creswell, J. W. (2014). Research design: Qualitative, quantitative and mixed methods approaches (4th ed.). SAGE Publications, Inc.
11. Darvishi, A., Khosravi, H., Abdi, S., Sadiq, S., & Gašević, D. (2022). Incorporating training, self-monitoring and AI-assistance to improve peer feedback quality. Proceedings of the Ninth ACM Conference on Learning @ Scale, 35–47. https://doi.org/10.1145/3491140.3528265
12. Digital Transformation Office. (2021). National artificial intelligence strategy 2021-2025. https://cbddo.gov.tr/en/nais
13. Dong, Y. (2023). Revolutionizing academic English writing through AI-Powered pedagogy: Practical exploration of teaching process and assessment. Journal of Higher Education Research, 4(2), 52. https://doi.org/10.32629/jher.v4i2.1188
14. Gayed, J. M., Carlon, M. K. J., Oriola, A. M., & Cross, J. S. (2022). Exploring an AI-based writing Assistant’s impact on English language learners. Computers and Education: Artificial Intelligence, 3, 100055. https://doi.org/10.1016/j.caeai.2022.100055
15. Ge, Z. and Hu, Y. (2020, April) Innovative application of artificial intelligence (AI) in the management of higher education and teaching. Journal of Physics: Conference Series, IOP Publishing 1533(3): 032089. https://doi.org/10.1088/1742-6596/1533/3/032089
16. Ginting, P., Batubara, H. M., & Hasnah, Y. (2023). Artificial intelligence powered writing tools as adaptable aids for academic writing: Insight from EFL college learners in writing final project. International Journal of Multidisciplinary Research and Analysis, 6, 4640-50. https://ijmra.in/v6i10/Doc/15.pdf Hossain, Z. (2023). Unlocking tomorrow’s potential by integrating AI literacy into school curriculum: ICS initiatives and future directions. Connections-The ICS School Magazine 2(33), pp.16-19. https://issuu.com/inter-community-school-zurich/docs/ics_autumn_connections_2023/1
17. Hossain, Z. (2024). School librarians developing AI literacy for an AI-driven future: leveraging the AI Citizenship Framework with scope and sequence. Library Hi Tech News. https://doi.org/10.1108/LHTN-10-2024-0186
18. Hossain, Z., Çelik, Ö. and Hertel, C. (2024). Academic integrity and copyright literacy policy and instruction in K-12 schools: a global study from the perspective of school library professionals. International Journal for Educational Integrity 20(1): 4. https://doi.org/10.1007/s40979-024-00150-x
19. Jiang, R. (2022). How does artificial intelligence empower EFL teaching and learning nowadays? A review on artificial intelligence in the EFL context. Frontiers in Psychology, 13, 1049401. https://www.frontiersin.org/articles/10.3389/fpsyg.2022.1049401/full
20. Kong, S.-C., Lee, J. C.-K., & Tsang, O. (2024). A pedagogical design for self-regulated learning in academic writing using text-based generative artificial intelligence tools: 6-P pedagogy of plan, prompt, preview, produce, peer-review, portfolio-tracking. Research and Practice in Technology Enhanced Learning, 19, 030. https://doi.org/10.58459/rptel.2024.19030
21. Kurniati, E. Y., & Fithriani, R. (2022). Post-graduate students’ perceptions of Quillbot utilization in English academic writing class. Journal of English Language Teaching and Linguistics, 7(3), 437-451. https://dx.doi.org/10.21462/jeltl.v7i3.852
22. Lee, A. V. Y. (2023). Supporting students’ generation of feedback in large-scale online course with artificial intelligence-enabled evaluation. Studies in Educational Evaluation, 77, 101250. https://doi.org/10.1016/j.stueduc.2023.101250
23. Limna, P., Jakwatanatham, S., Siripipattanakul, S., Kaewpuang, P., & Sriboonruang, P. (2022). A review of artificial intelligence (AI) in education during the digital era. Advance Knowledge for Executives, 1(1), 1-9. https://ssrn.com/abstract=4160798
24. Luckin, R., Holmes, W., Griffiths, M., & Forcier, L. B. (2016). Intelligence unleashed. An argument for AI in Education, 18. https://discovery.ucl.ac.uk/id/eprint/1475756
25. Layali K., Al-Shlowiy A. (2020). Students perceptions of e-learning for ESL/EFL in Saudi universities at time of coronavirus: A literature review. Indonesian EFL Journal, 6(2), 97-108. https://journal.uniku.ac.id/index.php/IEFLJ/article/view/3378
26. Malik, A. R., Pratiwi, Y., Andajani, K., Numertayasa, I. W., Suharti, S., & Darwis, A. (2023). Exploring artificial intelligence in academic essay: higher education student's perspective. International Journal of Educational Research Open, 5, 100296. https://doi.org/10.1016/j.ijedro.2023.100296
27. Milberg, T. (2024, April 28). The future of learning: AI is revolutionizing education 4.0. World Economic Forum. https://www.weforum.org/agenda/2024/04/future-learning-ai-revolutionizing-education-4-0/
28. Moss, S. (2021). Turkey publishes its national artificial intelligence strategy. Informatech - Taylor & Francis Group. https://aibusiness.com/verticals/turkey-publishes-its-national-artificial-intelligence-strategy
29. Nazari, N., Shabbir, M. S., & Setiawan, R. (2021). Application of Artificial Intelligence powered digital writing assistant in higher education: Randomized controlled trial. Heliyon, 7(5). https://doi.org/10.1016/j.heliyon.2021.e07014
30. OECD.AI. (2021). National AI policies & strategies. Database of national AI policies powered by EC/OECD. https://oecd.ai/en/dashboards/overview
31. Roe, J., Renandya, W. A., & Jacobs, G. M. (2023). A review of AI-powered writing tools and their implications for academic integrity in the language classroom. Journal of English and Applied Linguistics, 2(1), 22-30. https://doi.org/10.59588/2961-3094.1035
32. Shofiah, N., & Putera, Z. F. (2024). Examining the user experience of artificial intelligence tools in academic writing: The perceptions lecturers practices. Research Square. https://doi.org/10.21203/rs.3.rs-3871916/v1
33. Song, C., & Song, Y. (2023). Enhancing academic writing skills and motivation: assessing the efficacy of ChatGPT in AI-assisted language learning for EFL students. Frontiers in Psychology, 14, 1260843. https://doi.org/10.3389/fpsyg.2023.1260843
34. Stolpe, K., & Hallström, J. (2024). Artificial intelligence literacy for technology education. Computers and Education Open, 6, 100159. https://doi.org/10.1016/j.caeo.2024.100159
35. Su, J., Ng, D. T. K., & Chu, S. K. W. (2023). Artificial intelligence (AI) literacy in early childhood education: The challenges and opportunities. Computers and Education: Artificial Intelligence, 4, 100124. https://doi.org/10.1016/j.caeai.2023.100124
36. Sumakul, D. T. Y., Hamied, F. A., & Sukyadi, D. (2022, February). Students’ Perceptions of the Use of AI in a Writing Class. In 67th TEFLIN international virtual conference & the 9th ICOELT 2021 (TEFLIN ICOELT 2021) (pp. 52-57). Atlantis press.
37. Syahnaz, M., & Fithriani, R. (2023). Utilizing artificial intelligence-based paraphrasing tool in EFL writing class: A focus on Indonesian university students’ perceptions. Scope: Journal of English Language Teaching, 7(2), 210-218. http://dx.doi.org/10.30998/scope.v7i2.14882
38. Shibani, A., Knight, S., Kitto, K., Karunanayake, A., & Buckingham Shum, S. (2024). Untangling critical interaction with AI in students’ written assessment. Extended abstracts of the CHI conference on Human Factors in Computing Systems, 1–6. https://doi.org/10.1145/3613905.3651083
39. Sperling, K., Stenberg, C., McGrath, C., Åkerfeldt, A., Heintz, F., & Stenliden, L. (2024). In search of artificial intelligence (AI) literacy in Teacher Education: A scoping review. Computers and Education Open, 6, 100169. https://doi.org/10.1016/j.caeo.2024.100169
40. Tran, T. T. H. (2024). AI Tools in Teaching and Learning English Academic Writing Skills. Proceedings of the AsiaCALL international conference, 4, 170–187. https://doi.org/10.54855/paic.23413
41. Udell, E. (2024, March) The World of AI: How libraries are integrating and navigating this powerful technology. American Libraries Magazine. https://americanlibrariesmagazine.org/2024/03/01/the-world-of-ai/
42. UNESCO. (2021). International Forum on AI and Education: Ensuring AI as a Common Good to Transform Education, 7-8 December 2021; synthesis report. UNESDOC Digital Library. https://unesdoc.unesco.org/ark:/48223/pf0000381226
43. UNESCO. (2023). Education in the age of artificial intelligence. UNESCO.org. https://courier.unesco.org/en/articles/education-age-artificial-intelligence
44. Wu, Y. (2024). Study on the impact of utilizing ChatGPT and other AI Tools for feedback in EAP writing classrooms on the discursive writing performance of English major students. Transactions on Social Science, Education and Humanities Research, 4, 143-150. https://doi.org/10.62051/4se95x52
45. Zhao, X., Xu, J., & Cox, A. (2024). Incorporating artificial intelligence into student academic writing in higher education: The use of Wordtune by Chinese international students. In Proceedings of the 57th Hawaii International Conference on System Sciences. https://hdl.handle.net/10125/106712