Examination of studies on artificial intelligence and chatbots in the context of secondary school science course: content analysis

Abstract

This study aims to investigate the applications of artificial intelligence and chatbots in secondary school science lessons through descriptive content analysis. Using a qualitative case study approach, 20 theses from YÖKTEZ database and 10 international articles from Google Scholar were analysed, focusing on chatbots in science education. The results of the analysis revealed a notable increase in AI and chatbot-related theses between 2012 and 2023, especially in the last two years, highlighting the growing interest in e-learning and AI in STEM fields. Positive effects on student and teacher attitudes towards STEM education have been widely reported. However, besides the limited number of international studies, the discovery of only one secondary school thesis on chatbots unrelated to Science in Türkiye points to a significant research gap in AI and chatbot integration into Science education. Addressing this gap may improve the application of AI and chatbot technologies in science teaching and reveal the need for further research to explore their potential benefits and applications in educational settings.

Keywords

• Artificial intelligence
• Chatbot
• Science
• Descriptive content analysis
• Education

References

1. [1] Kusal S, Patil S, Choudrie J, Kotecha K, Mishra S, Abraham A. AI-Based Conversational Agents: A Scoping Review From Technologies to Future Directions. IEEE Access. 2022; 10: 92337–92356. DOI: http://dx.doi.org/10.1109/access.2022.3201144
2. [2] Kis A. Eğitimde Yapay Zeka [Artificial Intelligence in Education]. In: 14th International Congress on Educational Administration Full Text Proceedings; 2019. Available from: https://www.researchgate.net/profile/Nese-Boerue/publication/339662111_Egitimde_Sosyal_Adalet_icin_Yerel_Yonetimler/links/5e5e9d83a6fdccbeba181d3c/Egitimde-Sosyal-Adalet-icin-Yerel-Yoenetimler.pdf#page=207
3. [3] Popenici S, Kerr S. Exploring the impact of artificial intelligence on teaching and learning in higher education. Res Pract Technol Enhanc Learn. 2017; 12(1). DOI: http://dx.doi.org/10.1186/s41039-017-0062-8
4. [4] Hwang GJ, Xie H, Wah B, Gašević D. Vision, challenges, roles and research issues of Artificial Intelligence in Education. Computers and Education: Artificial Intelligence. 2020; 1(1): 100001. DOI: http://dx.doi.org/10.1016/j.caeai.2020.100001
5. [5] Kooli C. Chatbots in Education and Research: A Critical Examination of Ethical Implications and Solutions. Sustainability. 2023; 15(7): 5614. DOI: https://doi.org/10.3390/su15075614
6. [6] Chang J, Park J, Park J. Using an Artificial Intelligence Chatbot in Scientific Inquiry: Focusing on a Guided-Inquiry Activity Using Inquirybot. Asia-Pac Sci Educ. 2023; 9(1): 44–74. DOI: http://dx.doi.org/10.1163/23641177-bja10062
7. [7] Lin YT, Ye JH. Development of an educational chatbot system for enhancing students’ biology learning performance. J Internet Technol. 2023; 24(2): 275–281. DOI: http://dx.doi.org/10.53106/160792642023032402006
8. [8] Rosmiati NS, Sujana A, Aeni AN. Development of Chatbot learning media on Earth rotation and revolution materials for Grade 6 elementary school students. Jurnal IPA Dan Pembelajaran IPA. 2023; 7(3): 210–233. DOI: http://dx.doi.org/10.24815/jipi.v7i3.32054

9. [9] Yildirim A, Simsek H. Sosyal Bilimlerde Nitel Araştırma Yöntemleri [Qualitative Research Methods in Social Sciences]. Ankara: Seckin Publishing; 2011.
10. [10] Creswell JW. Qualitative Inquiry & Research Design: Choosing Among Five Approaches. USA: SAGE Publications; 2007.
11. [11] Marshall C, Rossman GB. Designing Qualitative Research. Sage Publications; 2014.
12. [12] Patton MQ. Nitel Araştırma ve Değerlendirme Yöntemleri [Qualitative Research and Evaluation Methods] (Çev. M. Butun, S. B. Demir). Ankara: Pegem Academy; 2014.
13. [13] Bowen GA. Document analysis as a qualitative research method. Qual Res J. 2009; 9(2): 27–40. DOI: http://dx.doi.org/10.3316/qrj0902027
14. [14] Dincer S. Eğitim bilimleri araştırmalarında içerik analizi: Meta-Analiz, Meta-Sentez, Betimsel içerik analizi [Content Analysis in for Educational Science Research: Meta-Analysis, Meta-Synthesis, and Descriptive Content Analysis]. Bartin Univ J Fac Educ. 2018; 7(1): 176–190. DOI: http://dx.doi.org/10.14686/buefad.363159
15. [15] Cohen L, Manion L, Morrison K. Research Methods in Education. 6th ed. London and New York, NY: Routledge Falmer; 2007.
16. [16] Calik M, Sozbilir M. İçerik Analizinin Parametreleri [Parameters of content analysis]. Educ Sci. 2014; 39(174). http://dx.doi.org/10.15390/eb.2014.3412
17. [17] Acar N, Gulnar B. Sosyal Ağ Yorgunluğunun Öncüllerinin Belirlenmesinde Kullanılan Modellerin Betimsel İçerik Analizi ile İncelenmesi [Investigation of the models used in determining the precursors of social network fatigue by descriptive content analysis]. J Commun Theory Res. 2023; (63): 131–151. DOI: http://dx.doi.org/10.47998/ikad.1251158
18. [18] Miles MB, Huberman AM. Qualitative Data Analysis: An Expanded Sourcebook (2nd ed.). USA: SAGE; 1994.
19. [19] Guba EG, Lincoln YS. Epistemological and Methodological Bases of Naturalistic Inquiry. Educ Commun Technol. 1982; 30(4): 233–252. Available from: http://www.jstor.org/stable/30219846
20. [20] Yavuzalp N. E-öğrenme ortamında kullanılan öğrenme stil ve stratejilerinin web kullanım madenciliği ile analizi [Analysis of learning styles and strategies used in e-learning environment with web usage mining] (Doctoral thesis). Fırat University Institute of Educational Sciences, Elazig, Türkiye; 2012.
21. [21] Ozen EN. STEM alanındaki öğretmen adayları için geliştirilen makine öğrenmesi öğretiminin planlanması, uygulanması ve değerlendirilmesi [Planning, implementation and evaluation of machine learning instruction developed for pre-service teachers in the field of Stem] (Master's thesis). Bahçeşehir University Institute of Educational Sciences, Istanbul; 2021.
22. [22] Altun Y. The effect of using artificial intelligence technologies in education on student achievement: A meta-analysis study (Master's thesis). Bahçeşehir University Institute of Postgraduate Education, Istanbul; 2022.
23. [23] Colak AM. Okullarda yapay zeka öğretimi için geliştirilen kurs planı ve içeriklerin öğrencilerin üstbilişsel davranışlarına etkisi [The effect of course plan and contents developed for artificial intelligence teaching in schools on students' metacognitive behaviors] (Master's thesis). Trabzon University Institute of Postgraduate Education, Trabzon; 2022.
24. [24] Yetisensoy O. [Sosyal bilgiler öğretiminde yapay zekâ uygulaması örneği olarak chatbotların kullanımı] The use of chatbots as an example of artificial intelligence application in social studies teaching] (Doctoral thesis). Anadolu University Institute of Educational Sciences, Eskisehir; 2022.
25. [25] Alan B. Fen öğretiminde yapay zekâ ile belirlenen çoklu zekâ alanlarına göre hazırlanmış e-öğrenme ortamlarının farklı değişkenler açısından incelenmesi [The analysis of e-learning settings, which are prepared on the basis of multiple intelligence domains determined by artificial intelligence in science instruction, as per different variables] (Doctoral thesis). Fırat University Institute of Educational Sciences, Elazig; 2023.
26. [26] Yazar E. Eğitimde yapay zekâ uygulamalarına ilişkin meta analiz çalışması [Meta-analysis study on artificial intelligence applications in education] (Master's thesis). Fırat University Institute of Educational Sciences, Elazig; 2023.
27. [27] Ferikoglu D. Öğretmenler için yapay zeka farkındalık düzeyi ölçeği: Güvenilirlik ve geçerlilik çalışması [Artificial intelligence awareness level scale for teachers: Reliability and validity study] (Master's thesis). Bahçeşehir University Institute of Educational Sciences, Istanbul; 2021.
28. [28] Bagir M. Fen bilimleri öğretmenlerinin eğitimde yapay zekâ kullanımı ile ilgili görüşleri [Science teachers' views on the use of artificial intelligence in education] (Master's thesis). Fırat University Institute of Educational Sciences, Elazig; 2022.
29. [29] Dumlupinar Arslan A. Öğretmen adaylarının yapay zekâ kavramı ve yapay zekâ uygulamalarına ilişkin farkındalık düzeylerinin belirlenmesi [Determining the awareness levels of prospective teachers about the concept of artificial intelligence and artificial intelligence applications] (Master's thesis). Inonu University Institute of Educational Sciences, Malatya; 2023.
30. [30] Yorganci N. Öğretmenlik mesleğine karşı tutum ile akademik başarı arasındaki ilişkinin yapay sinir ağları ile analizi [Analyzing the relationship between attitude towards teaching profession and academic achievement with artificial neural networks] (Master's thesis). Burdur Mehmet Akif Ersoy University Institute of Educational Sciences, Burdur; 2018.
31. [31] Bulbul Ozdemir Ş. Öğrenciler tarafından kodlanarak tasarlanan eğitsel dijital oyunların sosyal bilgiler öğretimine etkisi [The effect of educational digital games designed by coding by students on social studies teaching] (Master's thesis). Atatürk University Institute of Educational Sciences, Erzurum; 2022.
32. [32] Soylu E. Ortaokul öğrencilerine yönelik geliştirilen yapay zekâ eğitim içeriğinin yapay zekâ okuryazarlığına etkisi [The effect of artificial intelligence education content developed for middle school students on artificial intelligence literacy] (Master's thesis). Sakarya University Institute of Educational Sciences, Sakarya; 2023.
33. [33] Baser EH. LGS İnkılap Tarihi ve Atatürkçülük alt testi doğru sayılarının yapay zeka yöntemleriyle tahmin edilmesi [Predicting the correct numbers of LGS History of Turkish Revolution and Kemalism subtest with artificial intelligence methods] (PhD thesis). Kutahya Dumlupinar University Graduate School of Education, Kutahya; 2022.
34. [34] Kalayci D. PISA'da başarılı ülkelerin ve Türkiye'nin ana dili öğretim programlarının incelenmesi ve programların ANFIS ile analizi [Investigation of the mother tongue teaching programs of successful countries in PISA and Türkiye and analysis of the programs with ANFIS] (Doctoral dissertation). Gazi University Institute of Educational Sciences, Ankara; 2022.
35. [35] Sanca M. Fen öğretiminde yapay zekâ destekli teknolojilerin kullanımına ilişkin fen bilimleri öğretmenlerinin görüşlerinin incelenmesi [Investigation of science teachers' opinions on the use of artificial intelligence supported technologies in science teaching] (Master's thesis). Van Yuzuncu Yil University Institute of Educational Sciences, Van; 2022.
36. [36] Yaz OM. Fen bilgisi öğretmen adaylarının enerji konusuna ilişkin temellendirilmiş zihinsel modellerinin tespiti ve derin sinir ağları ile sınıflandırılması [Determination of the grounded mental models of prospective science teachers about the subject of energy and their classification with deep neural networks] (Doctoral thesis). Kastamonu University Institute of Science and Technology, Kastamonu; 2022.
37. [37] YamaC RZ. Fen bilgisi konularına yönelik REACT stratejisiyle hazırlanan ders materyallerinin etkililiğinin incelenmesi [Investigation of the effectiveness of course materials prepared with REACT strategy for science subjects] (Doctoral dissertation). Bolu Abant Izzet Baysal University Institute of Postgraduate Education, Bolu; 2023.
38. [38] Erdurmus M. Yapay zekanın sanat eğitiminde kullanılmasına yönelik bir uygulama örneği [An application example for the use of artificial intelligence in art education] (Master's thesis). Gazi University Institute of Educational Sciences, Ankara; 2023.
39. [39] Ozmutlu M. Ortaokul öğrencileri için yapay zekâ okuryazarlığı öğretim programının geliştirilmesi [Development of an artificial intelligence literacy curriculum for middle school students] (Doctoral dissertation). Bahçeşehir University Institute of Postgraduate Education, Istanbul; 2023.
40. [40] Gabrielli S, Rizzi S, Carbone S, Donisi V. A Chatbot-Based Coaching Intervention for Adolescents to Promote Life Skills: A Pilot Study. JMIR Human Factors. 2020; 7(1): e16762. DOI: http://doi.org/10.2196/16762
41. [41] Han D. The effects of voice-based AI chatbots on Korean EFL middle school students' speaking competence and affective domains. Asia-Pac J Converg Res Interchange. 2020; 6(7): 71-80. DOI: http://doi.org/10.47116/apjcri.2020.07.07
42. [42] Barsoum SS, Elnagar MS, Awad BM. The Effectiveness of Using a Cognitive Style-based Chatbot in Developing Science Concepts and Critical Thinking Skills among Preparatory School Pupils. Eur Sci J, ESJ. 2022; 18(22): 52. DOI: http://doi.org/10.19044/esj.2022.v18n22p52
43. [43] Lin YT, Ye JH. Development of an educational chatbot system for enhancing students' biology learning performance. J Internet Technol. 2023; 24(2): 275-281. DOI: http://doi.org/10.53106/160792642023032402006
44. [44] Rosmiati NS, Sujana A, Aeni AN. Development of Chatbot learning media on Earth rotation and revolution materials for Grade 6 elementary school students. Jurnal IPA Dan Pembelajaran IPA. 2023; 7(3): 210-233. DOI: http://doi.org/10.24815/jipi.v7i3.32054
45. [45] Mendoza S, Hernández-León M, Sánchez-Adame LM, Rodríguez J, Decouchant D, Viveros AM. Supporting Student-Teacher interaction through a chatbot. In: Lecture Notes in Computer Science. 2020; pp. 93-107. DOI: http://doi.org/10.1007/978-3-030-50506-6_8
46. [46] Liu CC, Liao MG, Chang CH, Lin HM. An analysis of children' interaction with an AI chatbot and its impact on their interest in reading. Computers & Education. 2022; 189: 104576. DOI: http://doi.org/10.1016/j.compedu.2022.104576
47. [47] Chang J, Park J, Park J. Using an Artificial Intelligence Chatbot in Scientific Inquiry: Focusing on a Guided-Inquiry Activity Using Inquirybot. Asia-Pac Sci Educ. 2023; 9(1): 44-74. DOI: http://doi.org/10.1163/23641177-bja10062
48. [48] Young Oh E, Song D, Hong H. Interactive Computing Technology in Anti-Bullying Education: The Effects of Conversation-Bot's Role on K-12 Students' Attitude Change Toward Bullying Problems. J Educ Comput Res. 2020; 58(1): 200-219. DOI: http://doi.org/10.1177/0735633119839177
49. [49] Darayseh AA. Acceptance of artificial intelligence in teaching science: Science teachers' perspective. Computers & Education: Artificial Intelligence. 2023; 4: 100132. DOI: http://doi.org/10.1016/j.caeai.2023.100132