Potential Benefits and Risks of Artificial Intelligence in Education

Abstract

Artificial Intelligence (AI) technologies are rapidly advancing and causing profound transformations in all aspects of life. In particular, the widespread adoption of generative AI systems like ChatGPT is taking this transformation to even more dramatic dimensions. In this context, the most comprehensive impact is observed in educational systems. Educational systems, on one hand, are faced with the urgent need to rapidly restructure education in response to skill changes in professions caused by the proliferation of such systems in the labor market. On the other hand, challenging questions arise about whether and to what extent these systems should be integrated into education, how they should be integrated if at all, and how ethical issues arising from AI systems can be addressed. This study evaluates the potential benefits and possible risks of using AI systems in educational systems from the perspectives of students, teachers, and education administrators. Therefore, the study discusses the potential uses of AI systems in education, as well as the risks they may pose. Policy recommendations are developed to maximize the benefits of AI systems while mitigating the ethical and other issues they may cause. Additionally, the study emphasizes the importance of increasing AI literacy for all education stakeholders. It suggests that raising awareness of both the benefits and ethical issues caused by AI systems can contribute to enhancing the benefits of these systems in education while minimizing their potential harms.

Keywords

• artificial intelligence
• ChatGPT
• ethics
• education
• AI literacy
• education policy

Eğitimde Yapay Zekâ Uygulamalarının Potansiyel Yararları ve Riskleri

Abstract

Yapay zekâ (AI) teknolojileri hızla gelişmekte ve yaşamın tüm alanlarında köklü dönüşümlere yol açmaktadır. Özellikle, ChatGPT gibi generative AI sistemlerinin yaygınlaşması bu dönüşümü çok daha dramatik boyutlara taşımaktadır. Bu bağlamda en kapsamlı etki eğitim sistemlerinde gerçekleşmektedir. Eğitim sistemleri bir taraftan, bu tip sistemlerin işgücü piyasasında yaygınlaşması ile mesleklerde yaşanan beceri değişikliklerine hızla cevap üreterek eğitimi yeniden yapılandırma zorunluluğuyla karşı karşıyadır. Diğer taraftan, bu sistemlerin eğitime dâhil edilip edilmeyeceği, edilecekse nasıl ve ne derece dâhil edileceği, AI sistemlerinin yol açacağı etik sorunlara nasıl cevap üretilebileceği gibi meydan okuyucu sorularla yüzleşmektedir. Bu çalışmada bu kapsamda AI sistemlerin eğitim sistemlerinde kullanılmasının potansiyel faydaları ve olası riskleri öğrenci, öğretmen ve eğitim yöneticileri açısından değerlendirilmektedir. Bu nedenle bu çalışmada, AI sistemlerinin eğitimde nasıl kullanılabileceği olası potansiyelleri ve yol açabileceği riskler ele alınmaktadır. AI sistemlerinin sağlayacağı faydayı maksimum yaparken yol açacağı etik ve diğer sorunların etkilerini hafifletmeye yönelik politika önerileri geliştirilmektedir. Ayrıca, tüm eğitim paydaşları açısından AI okuryazarlığının artırılması, AI sistemlerinin sağlayacağı faydaları kadar yol açacağı etik ve diğer sorunların da farkındalığına yol açacağı ve böylece bu sistemlerin eğitimde faydalarını artırırken zararlarının hafifletilmesinin mümkün olabileceği vurgulanmaktadır.

Keywords

• yapay zekâ
• ChatGPT
• etik
• eğitim
• AI okuryazarlığı
• eğitim politikası

References

1. Acemoğlu, D., & Restrepo, P. (2018). Artificial intelligence, automation and work. NBER Working Paper 24196. National Bureau of Economic Research, Cambridge.
2. Aghion, P., & Howitt, P. (1990). A model of growth through creative destruction. NBER Working Paper 3223. National Bureau of Economic Research, Cambridge.
3. Aghion, P., & Howitt, P. (1994). Growth and unemployment. Review of Economic Studies, 61, 477–494. https://doi.org/10.2307/2297900
4. Al-Worafi, Y. M., Hermansyah, A., Goh, K.W., & Ming, L.C. (2023). Artificial intelligence use in university: Should we ban ChatGPT? Preprints.org 2023.
5. Aquino, Y. S. J. (2023). Making decisions: Bias in artificial intelligence and data-driven diagnostic tools. Australian Journal of General Practice, 52(7), 439-442. https://doi.org/10.31128/ajgp-12-22-6630
6. Arntz, M., Gregory, T., & Zierahn, U. (2016). The risk of automation for jobs in OECD countries: A comparative analysis. Social, Employment and Migration Working Paper 189. OECD Publishing, Paris. https://doi.org/10.1787/1815199X
7. Atlas, S. (2023). ChatGPT for higher education and professional development: A guide to conversational AI. Available online: https://digitalcommons.uri.edu/cba_facpubs/548.
8. Babitha, M. M., & Sushma, C. (2022). Trends of artificial intelligence for online exams in education. International Journal of Early Childhood Special Education, 14, 2457–2463. doi: 10.9756/INT-JECSE/V14I1.290

9. Bartelsman, E., Haltiwanger, J., & Scarpetta, S. (2004). Microeconomic evidence of creative destruction in industrial and developing countries. World Bank, Washington DC.
10. Bašic, Ž., Banovac, A., Kružic, I., & Jerkovic, I. (2023). Better by you, better than me, ChatGPT3 as writing assistance in students essays. arXiv: 2302.04536.
11. Bhutoria, A. (2022). Personalized education and Artificial Intelligence in the United States, China, and India: A systematic review using a Human-In-The-Loop model. Computers and Education: Artificial Intelligence, 3, 100068.
12. Boyd, D., & Crawford, K. (2012). Critical questions for big data: Provocations for a cultural, technological, and scholarly phenomenon. Information, Communication & Society, 15(5), 662–679. https://doi.org/10.1080/1369118X.2012.678878
13. Brinkmann, L., Baumann, F., Bonnefon, J. F. et al. (2023). Machine culture. Nature Human Behavior, 7(11), 1855-1868. https://doi.org/10.1038/s41562-023-01742-2
14. Bulathwela, S., Pérez-Ortiz, M., Holloway, C., Cukurova, M., & Shawe-Taylor, J. (2024). Artificial intelligence alone will not democratise education: On educational inequality, techno-solutionism and inclusive tools. Sustainability. 16(2), 781.
15. Chen, L., Chen, P., & Lin, Z. (2020). Artificial intelligence in education: A review. IEEE Access, 8, 75264-75278. https://doi.org/10.1109/ACCESS.2020.2988510
16. Chen, X., Zou, D., Xie, H., Cheng, G., & Liu, C. (2022). Two decades of artificial intelligence in education: Contributors, collaborations, research topics, challenges and future directions. Educational Technology & Society, 25(1), 28-47. https://www.jstor.org/stable/48647028
17. Chiu, T. K. F. (2023). The impact of generative AI (GenAI) on practices, policies and research direction in education: A case of ChatGPT and Midjourney. Interactive Learning Environments, 1-17. https://doi.org/10.1080/10494820.2023.2253861
18. Conijn, R., Kahr, P., & Snijders, C. (2023). The effects of explanations in automated essay scoring systems on student trust and motivation. Journal of Learning Analytics, 10, 37–53. https://doi.org/18608/jla.2023.7801
19. Cotton, D. R., Cotton, P. A., & Shipway, J.R. (2023). Chatting and cheating: Ensuring academic integrity in the era of ChatGPT. Innovations in Education and Teaching International, 1–12. https://doi.org/10.1080/14703297.2023.2190148
20. Crawford, K., Calo, R. (2016). There is a blind spot in AI research. Nature, 538, 311-313. https://doi.org/10.1038/538311a
21. De Cremer, D., & Kasparov, G. (2021). AI should augment human intelligence, not replace it. Harvard Business Review, 18.
22. Denecke, K., Glauser, R., & Reichenpfader, D. (2023). Assessing the potential and risks of ai-based tools in higher education: Results from an eSurvey and SWOT analysis. Trends in Higher Education, 2(4), 667-688.
23. Dignum, V. (2021). The role and challenges of education for responsible AI. London Review of Education, 19(1), 1-11. https://doi.org/10.14324/LRE.19.1.01
24. Elgammal, A., Liu, B., Elhoseiny, M., & Mazzone, M. C. (2017). Creative adversarial networks, generating "art" by learning about styles and deviating from style norms. arXiv:1706.07068.
25. Farazouli, A., Cerratto-Pargman, T., Bolander-Laksov, K., & McGrath, C. (2023). Hello GPT! Goodbye home examination? An exploratory study of AI chatbots impact on university teachers’ assessment practices. Assessment & Evaluation in Higher Education. https://doi.org/10.1080/02602938.2023.2241676
26. Farrokhnia, M., Banihashem, S. K., Noroozi, O., & Wals, A. (2023). A SWOT analysis of ChatGPT: Implications for educational practice and research. Innovations in Education and Teaching International, 1–15. https://doi.org/10.1080/14703297.2023.2195846
27. Fitria, T. N. (2021). “Grammarly” as AI-powered English writing assistant: Students’ alternative for writing English. Metathesis: Journal of English Language, Literature, and Teaching, 5(1), 65-78. https://doi.org/10.31002/metathesis.v5i1.3519
28. Frank, M. R., Autor, D., Bessen, J. E. et al. (2019). Toward understanding the impact of artificial intelligence on labor. PNAS, 116(14), 6531-6539. https://doi.org/10.1073/pnas.1900949116
29. Gangadharbatla, H. (2022). The role of AI attribution knowledge in the evaluation of artwork. Empirical Studies of the Arts, 40, 125–142. https://doi.org/10.1177/0276237421994697
30. García-Gorrostieta, J. M., López-López, A., & González López, S. (2018). Automatic argument assessment of final project reports of computer engineering students. Computer Applications in Engineering Education, 26(5), 1217-1226. https://doi.org/10.1002/cae.21996
31. Gilson, A., Safranek, C. W., Huang, T., Socrates, V., Chi, L., Taylor, R. A., & Chartash, D. (2023). How does ChatGPT perform on the United States medical licensing examination? The implications of large language models for medical education and knowledge assessment. JMIR Medical Education, 9, e45312. https://doi.org/10.2196/45312
32. Grassini, S. (2023). Shaping the future of education: Exploring the potential and consequences of AI and ChatGPT in educational settings. Education Sciences, 13, 692.
33. Halaweh, M. (2023). ChatGPT in education: Strategies for responsible implementation. Bastas: Tokyo, Japan.
34. Harari, Y. N. (2017). Reboot for the AI revolution. Nature, 550(19), 324-327. https://doi.org/10.1038/550324a
35. Howard, J. (2019). Artificial intelligence: Implications for the future of work. American Journal of Industrial Medicine, 62, 917–926. https://doi.org/10.1002/ajim.23037
36. Huang, L. (2023). Ethics of artificial intelligence in education: Student privacy and data protection. Science Insights Education Frontiers, 16(2), 2577–2587.
37. Humble, N., & Mozelius, P. (2019) Artificial intelligence in education - a promise, a threat or a hype? In: P. Griffiths and M. N. Kabir (Eds.), Proceedings of the European Conference on the impact of artificial intelligence and robotics, EM-Normandie Business School Oxford, UK, 31 October-1 November 2019, ECIAIR.19.005 (pp. 149-156).
38. Kamalov, F., Santandreu Calonge, D., & Gurrib, I. (2023). New era of artificial intelligence in education: Towards a sustainable multifaceted revolution. Sustainability, 15(16), 12451.
39. Kasneci, E., Seßler, K., Küchemann, S., Bannert, M., Dementieva, D. et al. (2023). ChatGPT for good? On opportunities and challenges of large language models for education. Learning and Individual Differences, 103, 102274. https://doi.org/10.1016/j.lindif.2023.102274
40. Katz, D. M., Bommarito, M. J., Gao, S., & Arredondo, P. (2023). GPT-4 passes the bar exam. Available at SSRN: 4389233.
41. Khan, R. A., Jawaid, M., Khan, A. R., Sajjad, M. (2023). ChatGPT—Reshaping medical education and clinical management. Pakistan Journal of Medical Sciences, 39, 605–607. https://doi.org/12669/pjms.39.2.7653
42. King, M. R. A. (2023). Conversation on artificial intelligence, chatbots, and plagiarism in higher education. Cellular and Molecular Bioengineering, 16, 1–2. https://doi.org/10.1007/s12195-022-00754-8
43. Koltovskaia, S. (2020). Student engagement with automated written corrective feedback (AWCF) provided by Grammarly: A multiple case study. Assessing Writing, 44, 100450. https://doi.org/10.1016/j.asw.2020.100450
44. Köbis, N., & Mossink, L. D. (2021). Artificial intelligence versus Maya Angelou: Experimental evidence that people cannot differentiate AI-generated from human-written poetry. Computers in Human Behavior, 114, 106553. https://doi.org/10.1016/j.chb.2020.106553
45. Lo, C. K. (2023). What is the impact of ChatGPT on education? A rapid review of the literature. Education Sciences, 13, 410. https://doi.org/10.3390/educsci13040410
46. Marshall, R., Pardo, A., & Smith, D., & Watson, S. (2022). Implementing next generation privacy and ethics research in education technology. British Journal of Educational Technology, 53(4), 737-755.
47. Mbakwe, A. B., Lourentzou, I., Celi, L. A., Mechanic, O. J., & Dagan, A. (2023). ChatGPT passing USMLE shines a spotlight on the flaws of medical education. PLoS Digital Health, 2, e0000205. https://doi.org/10.1371/journal.pdig.0000205
48. Mehrabanian, M., & Zariat, Y. (2023). ChatGPT passes anatomy exam. Br Dent J, 235, 295.
49. Mhlanga, D. (2023). Open AI in education, the responsible and ethical use of ChatGPT towards lifelong learning. SSRN. https://doi.org/10.2139/ssrn.4354422
50. Miao, H., & Ahn, H. (2023). Impact of ChatGPT on interdisciplinary nursing education and research. Asian/Pacific Island Nursing Journal, 7(1), e48136. https://doi.org/10.2196/48136
51. Mizumoto, A., & Eguchi, M. (2023). Exploring the potential of using an AI language model for automated essay scoring. Research Methods in Applied Linguistics, 2(2), 100050.
52. Mogali, S. R. (2023). Initial impressions of ChatGPT for anatomy education. Anatomical Sciences Education, 1–4. https://doi.org/10.1002/ase.2261
53. Morgan, H. (2021). Conducting a qualitative document analysis. The Qualitative Report, 27(1), 64-77. https://doi.org/10.46743/2160-3715/2022.5044
54. Naik, R. R., Landge, M. B., & Mahender, C. N. (2015). A review on plagiarism detection tools. International Journal of Computer Applications, 125, 16–22.
55. Nazari, N., Shabbir, M. S., & Setiawan, R. (2021). Application of artificial intelligence powered digital writing assistant in higher education: Randomized controlled trial. Heliyon, 7(5), e07014. https://doi.org/10.1016/j.heliyon.2021.e07014
56. Newman, M., Gough, D. (2020). Systematic reviews in educational research: Methodology, perspectives and application. In: Zawacki-Richter, O., Kerres, M., Bedenlier, S., Bond, M., Buntins, K. (eds) Systematic reviews in educational research. Springer VS, Wiesbaden.
57. O’Neil, C. (2016). Weapons of math destruction: How big data increases inequality and threatens democracy. Crown Books.
58. Özer, M., Suna, H. E., Çelik, Z., & Aşkar, P. (2020). Covid-19 salgını dolayısıyla okulların kapanmasının eğitimde eşitsizlikler üzerine etkisi. İnsan ve Toplum, 10(4), 217-246. https://doi.org/10.12658/M0611
59. Özer, M., & Suna, H. E. (2020). Covid-19 salgını ve eğitim. In M. Şeker, A. Özer & C. Korkut (Eds.), Küresel salgının anatomisi: İnsan ve toplumun geleceği (pp. 171-192). TÜBA.
60. Özer, M., Suna, H. E., Perc, M., Şensoy, S., & İlikhan, S. U. (2022). Turkey’s transition to face-to-face schooling during the COVID-19 pandemic. Turkish Journal of Medical Sciences, 52, 529-540. https://doi.org/10.55730/1300-0144.5343
61. Özer, M. (2023a). The Matthew effect in Turkish education system. Bartın University Journal of Faculty of Education, 12(4), 704-712. https://doi.org/10.14686/buefad.1359312
62. Özer, M. (2023b). Matta etkisi. Uluslararası Yönetim İktisat ve İşletme Dergisi, 19(4), 974-984. https://doi.org/10.17130/ijmeb.1374798
63. Pajarinen, M., Rouvinen, P., & Ekeland, A. (2015). Computerization threatens one-third of Finnish and Norwegian employment. ETLA Brief, 34.
64. Peng, H., Ma, S., & Spector, J. M. (2019). Personalized adaptive learning: An emerging pedagogical approach enabled by a smart learning environment. Smart Learning Environments, 6(1), 1-14.
65. Perc, M., Özer, M., & Hojnik, J. (2019). Social and juristic challenges of artificial intelligence. Palgrave Communications, 5, 61. https://doi.org/10.1057/s41599-019-0278-x
66. Piano, S. L. (2020). Ethical principles in machine learning and artificial intelligence: cases from the field and possible ways forward. Humanities & Social Sciences Communications, 7, 9. https://doi.org/10.1057/s41599-020-0501-9
67. Rahwan, I. (2018). Society-in-the-loop: Programming the algorithmic social contract. Ethics and Information Technology, 20(1), 5-14.
68. Ramesh, D., & Sanampudi, S. K. (2022). An automated essay scoring systems: a systematic literature review. Artif Intell Rev, 55, 2495–2527.
69. Rubinstein, Y. (2020). Uneasy listening: Towards a hauntology of AI-generated 835 music. Resonance: The Journal of Sound and Culture, 1, 77–93. https://doi.org/10.1525/res.2020.1.1.77
70. Rudolph, J., Tan, S., Tan, S. C. (2023). ChatGPT: Bullshit spewer or the end of traditional assessments in higher education? Journal of Applied Learning & Teaching, 6(1), 1-22. https://doi.org/10.37074/jalt.2023.6.1.9
71. Seo, K., Tang, J., Roll, I. et al. (2021). The impact of artificial intelligence on learner–instructor interaction in online learning. Int J Educ Technol High Educ, 18, 54. https://doi.org/10.1186/s41239-021-00292-9
72. Shiri, A. (2023). ChatGPT and academic integrity. Information Matters, 3(2), 1-5. https://doi.org/10.2139/ssrn.4360052
73. Skavronskaya, L., Hadinejad, A., & Cotterell, D. (2023). Reversing the threat of artificial intelligence to opportunity: A discussion of ChatGPT in tourism education. Journal of Teaching in Travel & Tourism, 23, 253–258.. https://doi.org/1080/15313220.2023.2196658
74. Sok, S., & Heng, K. (2023). ChatGPT for education and research: A review of benefits and risks. Cambodian Journal of Educational Research, 3(1), 110-121. https://doi.org/10.2139/ssrn.4378735
75. Stahl, B. C. (2023). Embedding responsibility in intelligent systems: From AI ethics to responsible AI ecosystems. Scientific Reports, 13, 7586. https://doi.org/10.1038/s41598-023-34622-w
76. Stanovich, K. E. (1986). Matthew effects in reading: Some consequences of individual differences in the acquisition of literacy. Reading Research Quarterly, 21(4), 360-407. https://doi.org/10.1598/RRQ.21.4.1
77. Suleyman, M. (2023). The coming wave: Technology, power, and the twenty-first century’s greatest dilemma. Crown: New York.
78. Suna, H. E., Tanberkan, H., Gür, B.S., Perc, M., & Özer, M. (2020). Socioeconomic status and school type as predictors of academic achievement. Journal of Economy Culture and Society, 61, 41-64. https://doi.org/10.26650/JECS2020-0034
79. Suna, H. E., Özer, M., Şensoy, S., Gür , B. S., Gelbal , S., & Aşkar , P. (2021). Determinants of academic achievement in Türkiye. Journal of Economy Culture and Society, 64, 143-162. https://doi.org/10.26650/JECS2021-934211
80. Suna, H. E., & Özer, M. (2022). The relationship of preschool attendance with academic achievement and socioeconomic status in Türkiye. Journal of Measurement and Evaluation in Education and Psychology, 13(1), 54-68. https://doi.org/10.21031/epod.1060460
81. Tlili, A., Shehata, B., Adarkwah, M. A., Bozkurt, A. et al. (2023). What if the devil is my guardian angel: ChatGPT as a case study of using chatbots in education. Smart Learning Environments, 10, 15. https://doi.org/10.1186/s40561-023-00237-x
82. Trojer, L., Ambele, R. M., Kaijage, S. F., & Dida, M. A. (2022). A review of the development trend of personalized learning technologies and its applications. International Journal of Advances in Scientific Research and Engineering, 8, 75–91. https://doi.org/10.31695/IJASRE.2022.8.11.9
83. Tsai, S. C., Chen, C. H., Shiao, Y. T., Ciou, J. S., & Wu, T. N. (2020). Precision education with statistical learning and deep learning: A case study in Taiwan. International Journal of Educational Technology in Higher Education, 17, 12. https://doi.org/10.1186/s41239-020-00186-2
84. Ulnicane, I., & Aden, A. (2023). Power and politics in framing bias in artificial intelligence policy. Review of Policy Research, 40, 665-687. https://doi.org/10.1111/ropr.12567
85. UNESCO (2019). Artificial intelligence in education: Challenges and opportunities for sustainable development. UNESCO Publishing. Retrieved from https://unesdoc.unesco.org/ark:/48223/pf0000366994
86. Villegas-Ch, W., Arias-Navarrete, A., & Palacios-Pacheco, X. (2020). Proposal of an architecture for the integration of a Chatbot with artificial intelligence in a smart campus for the improvement of learning. Sustainability, 12, 1500. https://doi.org/10.3390/su12041500
87. Wang, L., Lyu, C., Ji, T., Zhang, Z., Yu, D. et al. (2023). Document-level machine translation with large language models. arXiv:2304.02210. https://doi.org/10.18653/v1/2023.emnlp-main.1036
88. Welle, D. (2023). ChatGPT is changing education, AI experts say — but how?. https://news.abs-cbn. com/spotlight/01/25/23/chatgpt-is-changing-education-ai-experts-say-but-how
89. Yau, S., Chai, C. S., Chiu, T. K. F., Meng, H., King, I., & Yam, Y. (2022). A phenomenographic approach on teacher conceptions of teaching artificial intelligence (AI) in K-12 schools. Education and Information Technologies, 28, 1041–1064. https://doi.org/10.1007/s10639-022-11161-x
90. Zawacki-Richter, O., Marín, V. I., Bond, M., & Gouverneur, F. (2019). Systematic review of research on artificial intelligence applications in higher education–where are the educators? International Journal of Educational Technology in Higher Education, 16(1), 1-27. https://doi.org/10.1186/s41239-019-0171-0