Improving Annual Plans Developed through Traditional Methods with ChatGPT: The Experiences of Doctoral Students

Abstract

The aim of this study is to evaluate the contributions of the AI tool, ChatGPT, used by doctoral students to improve their annual plans, and to examine the advantages and challenges that arise throughout the process. The research was conducted using a qualitative case study approach and carried out with 13 doctoral students. The data were analyzed by content analysis, the themes obtained from the analysis result were explained in detail using student quotes. The study identified themes related to ChatGPT's contributions to annual plan improvement, its advantages and disadvantages in education, and the barriers to its usage. Additionally, students' perspectives on ChatGPT were examined. The findings reveal that students generally have a positive outlook on using ChatGPT although some students expressed cautious and critical attitudes, voicing concerns about AI usage. While ChatGPT offers advantages such as addressing shortcomings, generating new ideas, clarifying learning outcomes, and saving time, it also presents disadvantages, including a reduction in teacher-student interaction, issues with objectivity, and the potential stifling of critical thinking skills. Furthermore, challenges such as access limitations, language barriers, and technical infrastructure issues were found to restrict the effective use of this technology.

Keywords

• Artificial intelligence
• Artificial intelligence tools
• ChatGPT
• Annual plan development
• Doctoral student experiences

Geleneksel Yöntemlerle Geliştirilen Yıllık Planların ChatGPT ile İyileştirilmesi: Doktora Öğrencilerinin Deneyimleri

Abstract

Bu çalışmanın amacı, doktora öğrencilerinin geliştirdikleri yıllık planlarını iyileştirmek amacıyla kullandıkları yapay zekâ aracı olan ChatGPT'nin sağladığı katkıları ve bu süreçte ortaya çıkan avantajlar ile zorlukları değerlendirmektir. Araştırmada nitel araştırma yöntemlerinden durum çalışması kullanılmış ve çalışma 13 doktora öğrencisi ile yürütülmüştür. Veriler içerik analizi ile analiz edilmiş ve analiz sonucundan elde edilen temalar öğrenci alıntılarıyla detaylandırılarak açıklanmıştır. Çalışma sonucunda ChatGPT'nin yıllık plan iyileştirmesine katkıları, eğitimde avantaj ve dezavantajları ile kullanım engelleri başlıklarında temalar belirlenmiştir. Ayrıca öğrencilerin ChatGPT'ye karşı bakış açıları da incelenmiştir. Elde edilen bulgulara göre, öğrencilerin ChatGPT kullanımına yönelik bakış açıları genel olarak olumlu olduğu görülmüştür. Ancak bazı öğrenciler temkinli ve eleştirel yaklaşımlar sergilemiş, yapay zekâ kullanımına yönelik endişelerini dile getirmişlerdir. Bunun yanı sıra ChatGPT’nin eğitimde kullanımı, eksikliklerin giderilmesi, yeni fikirlerin üretilmesi, ders kazanımlarının netleştirilmesi ve zaman tasarrufu sağlama gibi avantajlar sunarken; öğretmen-öğrenci etkileşiminin azalması, objektiflik sorunları ve eleştirel düşünme becerilerini köreltmesi gibi dezavantajları da ortaya çıkmıştır. Ayrıca, erişim sınırlamaları, dil bariyeri ve teknik altyapı sorunları gibi engellerin bu teknolojinin etkili kullanımını kısıtladığı görülmüştür.

Keywords

• Yapay zekâ
• Yapay zekâ araçları
• ChatGPT
• Yıllık plan geliştirme
• Doktora öğrenci deneyimleri

References

1. Adeshola, I., & Adepoju, A. P. (2023). The opportunities and challenges of ChatGPT in education. Interactive Learning Environments, 1-14. https://doi.org/10.1080/10494820.2023.2253858
2. Adisaturrahimi, A., & Marlia, S. R. I. (2024). Metacognitive atrategies used in comprehending reading academic texts for doctoral students. International Journal of Current Science Research and Review, 7(4), 2025-2029. https://doi.org/10.47191/ijcsrr/V7-i4-05
3. Albadarin, Y., Saqr, M., Pope, N., & Tukiainen, M. (2024). A systematic literature review of empirical research on ChatGPT in education. Discover Education, 3(1), 60. https://doi.org/10.1007/s44217-024-00138-2
4. Ausat, A. M. A., Massang, B., Efendi, M., Nofirman, N., & Riady, Y. (2023). Can chat GPT replace the role of the teacher in the classroom: A fundamental analysis. Journal on Education, 5(4), 16100-16106. https://doi.org/10.31004/joe.v5i4.2745
5. Baidoo-Anu, D., & Ansah, L. O. (2023). Education in the era of generative artificial intelligence (AI): Understanding the potential benefits of ChatGPT in promoting teaching and learning. Journal of AI, 7(1), 52-62. https://doi.org/10.61969/jai.1337500
6. Baig, M. I., & Yadegaridehkordi, E. (2024). ChatGPT in the higher education: A systematic literature review and research challenges. International Journal of Educational Research, 127(2024), 1-20. https://doi.org/10.1016/j.ijer.2024.102411
7. Barrot, J. S. (2024). ChatGPT as a language learning tool: An emerging technology report. Technology, Knowledge and Learning, 29(2), 1151-1156. https://doi.org/10.1007/s10758-023-09711-4
8. Bommasani, R., Hudson, D. A., Adeli, E., Altman, R., Arora, S., von Arx, S., ... & Liang, P. (2021). On the opportunities and risks of foundation models. arXiv preprint arXiv:2108.07258. Erişim adresi: https://arxiv.org/pdf/2108.07258

9. Broutın, M. S. T. (2024). Exploring Mathematics Teacher Candidates' Instrumentation Process of Generative Artificial Intelligence for Developing Lesson Plans. Yükseköğretim Dergisi, 14(1), 165-176. https://doi.org/10.53478/yuksekogretim.1347061
10. Cengiz, B., Çal, A., Açıl, D., Bahar, Z., & Beşer, A. (2019). Sağlık bilimlerinde eğitim alan doktora öğrencilerinin problem çözme becerileri. Acıbadem Üniversitesi Sağlık Bilimleri Dergisi, 10(4), 696-701. https://doi.org/10.31067/0.2018.77
11. Deng, J., & Lin, Y. (2022). The benefits and challenges of ChatGPT: An overview. Frontiers in Computing and Intelligent Systems, 2(2), 81-83. https://doi.org/10.54097/fcis.v2i2.4465
12. Dhara, S., Chatterjee, S., Chaudhuri, R., Goswami, A., & Ghosh, S. K. (2022). Artificial Intelligence in Assessment of Students' Performance. Artificial Intelligence in Higher Education içinde (s. 153-167). Boca Raton: CRC Press.
13. Eke, D. O. (2023). ChatGPT and the rise of generative AI: Threat to academic integrity?. Journal of Responsible Technology, 13(2023), 1-4. https://doi.org/10.1016/j.jrt.2023.100060
14. Eli-Chukwu, N. C. (2019). Applications of artificial intelligence in agriculture: A review. Engineering, Technology & Applied Science Research, 9(4), 4377-4383. Erişim adresi: https://pdfs.semanticscholar.org/6e08/7108aa8048da8cfc82cdecb7071a55bab488.pdf
15. Glaser, N. (2023). Exploring the potential of ChatGPT as an educational technology: An emerging technology report. Technology, Knowledge and Learning, 28(4), 1945-1952. https://doi.org/10.1007/s10758-023-09684-4
16. Gupta, P., Raturi, S., & Venkateswarlu, P. (2023). Chatgpt for designing course outlines: A boon or bane to modern technology. SSRN Electronic Journal. https://doi.org/10.2139/ssrn.4386113
17. Haleem, A., Javaid, M., & Khan, I. H. (2019). Current status and applications of Artificial Intelligence (AI) in medical field: An overview. Current Medicine Research and Practice, 9(6), 231-237. https://doi.org/10.1016/j.cmrp.2019.11.005
18. Hong, W. C. H. (2023). The impact of ChatGPT on foreign language teaching and learning: Opportunities in education and research. Journal of Educational Technology and Innovation, 5(1), 37-45. https://doi.org/10.61414/jeti.v5i1.103
19. Hsu, H. P., Mak, J., Werner, J., White-Taylor, J., Geiselhofer, M., Gorman, A., & Capurro, C. T. (2024). Preliminary Study on pre-service teachers’ applications and perceptions of generative artificial intelligence for lesson planning. Journal of Technology and Teacher Education, 32(3), 409-437. Erişim adresi: https://www.learntechlib.org/primary/p/224413/
20. Huang, X., Zou, D., Cheng, G., Chen, X., & Xie, H. (2023). Trends, research issues and applications of artificial intelligence in language education. Educational Technology & Society, 26(1), 112-131. Erişim adresi: https://www.jstor.org/stable/48707971
21. İşman, A., & Eskicumalı, A. (2003). Eğitimde planlama ve değerlendirme. İstanbul: Değişim Yayınları.
22. Kabak, T., & Kırbaş, İ. (2023). Chatgpt With Risks And Opportunities. Mehmet Akif Ersoy Üniversitesi Fen Bilimleri Enstitüsü Dergisi, 14(2), 365-376. https://doi.org/10.29048/makufebed.1271477
23. Kanık, M. (2024). The use of ChatGPT in assessment. International Journal of Assessment Tools in Education, 11(3), 608-621. https://doi.org/10.21449/ijate.1379647
24. Kaplan, A., & Haenlein, M. (2019). Siri, Siri, in my hand: Who’s the fairest in the land? On the interpretations, illustrations, and implications of artificial intelligence. Business horizons, 62(1), 15-25. https://doi.org/10.1016/j.bushor.2018.08.004
25. Kasneci, E., Seßler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., ... & Kasneci, G. (2023). ChatGPT for good? On opportunities and challenges of large language models for education. Learning and Individual Differences, 103(102274), 1-9 https://doi.org/10.1016/j.lindif.2023.102274
26. Kavak, V. İ., Evis, D., & Ekinci, A. (2024). The Use of ChatGPT in Language Education. Experimental and Applied Medical Science, 5(2), 72-82. https://doi.org/10.46871/eams.1461578
27. Koni, I., & Krull, E. (2018). Differences in novice and experienced teachers’ perceptions of planning activities in terms of primary instructional tasks. Teacher Development, 22(4), 464–480. https://doi.org/10.1080/13664530.2018.1442876
28. Korkmaz, İ., & Akbaşlı S. (2004). Göreve Yeni Başlayan Sınıf Öğretmenlerinin Karşılaştıkları Güçlükler. Kuram ve Uygulamada Eğitim Yönetimi, 38(38), 266-277. Erişim Adresi: https://dergipark.org.tr/tr/pub/kuey/issue/10359/126826
29. Li, Y. (2019). Impact of Artificial Intelligence on Creative Digital Content Production. Journal of Digital Art Engineering and Multimedia, 6(2), 121-132. https://doi.org/10.29056/jdaem.2019.12.05
30. Lo, C. K. (2023). What is the impact of ChatGPT on education? A rapid review of the literature. Education Sciences, 13(4), 410. https://doi.org/10.3390/educsci13040410
31. Miles, M. B. & Huberman, A. M. (1994). Qualitative data analysis. London: Sage Publication.
32. Moqbel, M. S. S., & Al-Kadi, A. M. T. (2023). Foreign language learning assessment in the age of ChatGPT: A theoretical account. Journal of English Studies in Arabia Felix, 2(1), 71-84. https://doi.org/10.56540/jesaf.v2i1.62
33. Mhlanga, D. (2023). Open AI in education, the responsible and ethical use of ChatGPT towards lifelong learning. FinTech and artificial intelligence for sustainable development: The role of smart technologies in achieving development goals içinde (s. 387-409). Cham: Springer Nature Switzerland. https://doi.org/10.1007/978-3-031-37776-1_17
34. Montenegro-Rueda, M., Fernández-Cerero, J., Fernández-Batanero, J. M., & López-Meneses, E. (2023). Impact of the implementation of ChatGPT in education: A systematic review. Computers, 12(8), 153. https://doi.org/10.3390/computers12080153
35. Nti, I. K., Adekoya, A. F., Weyori, B. A., & Nyarko-Boateng, O. (2022). Applications of artificial intelligence in engineering and manufacturing: a systematic review. Journal of Intelligent Manufacturing, 33(6), 1581-1601. https://doi.org/10.1007/s10845-021-01771-6
36. Nunez Lira, L. A., Soria Perez, Y. F., Collanque Pinto, J. D., & Rivera-Lozada, O. (2020). Development of Critical Thinking in Doctoral Students in Education. International Journal of Higher Education, 9(9), 71-79. https://doi.org/10.5430/ijhe.v9n9p71
37. Onwuegbuzie, A. J. (2001). Critical thinking skills: A comparison of doctoral-and master's-level students. College Student Journal, 35(3), 477-481.
38. OpenAI, (2023). GPT-4. Erişim Tarihi: 8.10.2024. Erişim Adresi: https://openai.com/index/gpt-4-research/
39. Pallathadka, H., Ramirez-Asis, E. H., Loli-Poma, T. P., Kaliyaperumal, K., Ventayen, R. J. M., & Naved, M. (2023). Applications of artificial intelligence in business management, e-commerce and finance. Materials Today: Proceedings, 80(2023), 2610-2613. https://doi.org/10.1016/j.matpr.2021.06.419
40. Panigrahi, C. M. A. (2020). Use of artificial intelligence in education. Management Accountant, 55(5), 64-67. Erişim adresi: https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3606936
41. Pender, H. L., Bohl, L., Schönberger, M., & Knopf, J. (2022, May). An AI-based lesson planning software to support competence-based learning. 8th International Conference on Higher Education Advances (HEAd'22) içinde (s. 1033-1041). Editorial Universitat Politècnica de València. http://dx.doi.org/10.4995/HEAd22.2022.14599
42. Rahman, M. S., Sabbir, M. M. ., Zhang, D. J., Moral, I. H., & Hossain, G. M. S. . (2023). Examining students’ intention to use ChatGPT: Does trust matter?. Australasian Journal of Educational Technology, 39(6), 51–71. https://doi.org/10.14742/ajet.8956
43. Ray, P. P. (2023). ChatGPT: A comprehensive review on background, applications, key challenges, bias, ethics, limitations and future scope. Internet of Things and Cyber-Physical Systems, 3(2023), 121-154. https://doi.org/10.1016/j.iotcps.2023.04.003
44. Rudolph, J., Tan, S., & Tan, S. (2023). ChatGPT: Bullshit spewer or the end of traditional assessments in higher education?. Journal of applied learning and teaching, 6(1), 342-363. https://doi.org/10.37074/jalt.2023.6.1.9
45. Sok, S., & Heng, K. (2023). ChatGPT for education and research: A review of benefits and risks. Cambodian Journal of Educational Research, 3(1), 110-121. https://dx.doi.org/10.2139/ssrn.4378735
46. Yıldırım, A., & Gündoğdu, K. (2004). Teachers’ Perceptions of Long Term Instructional Plans. Educaiton and Science, 29(133), 11-19. Erişim adresi: https://eb.ted.org.tr/index.php/EB/article/view/5057
47. Yıldırım, A., & Şimşek, H. (2011). Sosyal bilimlerde nitel araştırma yöntemleri (8. Baskı). Ankara: Seçkin.
48. Yu, H. (2024). The Application and challenges of ChatGPT in educational transformation: New demands for teachers’ roles. Heliyon, 10(2024), e24289. https://doi.org/10.1016/j.heliyon.2024.e24289
49. Zileli, E. N. (2023). Yabancı Dil Olarak Türkçe Öğreniminde ChatGPT Örneği. Uluslararası Karamanoğlu Mehmetbey Eğitim Araştırmaları Dergisi, 5(1), 42-51. https://doi.org/10.47770/ukmead.1296013