Generative Artificial Intelligence as a Lifelong Learning Self Efficacy: Usage and Competence Scale

Year 2024, Volume: 6 Issue: 2, 288 - 302, 31.12.2024

Veysel Bilal Arslankara , Ertuğrul Usta

https://doi.org/10.51535/tell.1489304

Abstract

The aim of this study is to develop a scale to measure the usage and competence levels of generative artificial intelligence as a lifelong learning self-efficacy among young and adult lifelong learners. Research data were collected from 248 individuals aged between 18 and 55. After a thorough review of the literature and theoretical frameworks such as the Technology Acceptance Model, Self-Efficacy Theory and Connectivism, an item pool for the scale was created. Similar scales in the related field were examined, and the item pool was developed accordingly. The items were reviewed by experts in educational technology, lifelong learning, and scale development. After making the necessary revisions, the trial form of the scale was presented to the participants. To determine the construct validity of the scale, exploratory factor analysis was conducted. The results of the exploratory factor analysis indicated that the scale consisted of two factors. The first factor comprises 10 items, while the second factor consists of 9 items. Confirmatory factor analysis was performed to reveal the relationships within the factors, the relationships between the variables and the factors, and the explanatory power of the factors on the model. The internal consistency coefficient, Cronbach’s alpha reliability value, was determined to be .833, and the Spearman-Brown coefficient was found to be .711, both of which indicate acceptable reliability. In conclusion, the Generative Artificial Intelligence Usage and Competence (GAIUC) Scale is expected to fill a gap in the literature by providing a validated tool to measure both the usage and competence of lifelong learners in using AI. This scale can serve as a foundation for future studies exploring AI-supported learning in various educational contexts.

Keywords

artificial intelligence, scale, lifelong learning, usage, competence

References

• Akkaya, B., Özkan, A., & Özkan, H. (2021). Artificial Intelligence Anxiety (AIA) Scale: Adaptation to Turkish, validity, and reliability study. Alanya Academic Review, 5(2), 1125-1146.
• Ali, F., Rasoolimanesh, S. M., Sarstedt, M., Ringle, C. M., & Ryu, K. (2018). An assessment of the use of partial least squares structural equation modeling (PLS-SEM) in hospitality research. International Journal of Contemporary Hospitality Management.
• Arslan, K. (2020). Artificial Intelligence and Applications in Education. Western Anatolia Journal of Educational Sciences, 11(1), 71-88.
• Arslankara, V. B., & Usta, E. (2018). Development of Virtual World Risk Perception Scale (VWRPS). Bartın University Journal of Faculty of Education, 7(1), 111-131. https://doi.org/10.14686/buefad.356898
• Arslankara, V. B., Demir, A., Öztaş, Ö., & Usta, E. (2022). Digital Well-Being Scale Validity and Reliability Study. Journal of Teacher Education and Lifelong Learning, 4(2), 263-274. https://doi.org/10.51535/tell.1206193
• Aslan, A. A. (2019). The Use of Artificial Intelligence in Museum Education. Ankara University Institute of Educational Sciences, (Master’s Thesis), 16-20.
• Azcona, D. (2019). Artificial intelligence in computer science and mathematics education. Conference on Educational Data Mining, 109-115.
• Bandura, A. (1977). Self-efficacy: Toward a unifying theory of behavioral change. Psychological Review, 84(2), 191-215. https://doi.org/10.1037/0033-295X.84.2.191
• Baranidharan, K. (2023). A study of the ideas behind artificial intelligence in financial technology. International Journal of Advanced Research in Science, Communication, and Technology (IJARSCT), 10(3), 58-68. https://doi.org/10.48175/ijarsct-13880
• Bhattad, P., & Jain, V. (2020). Artificial intelligence in modern medicine: The evolving necessity of the present and role in transforming the future of medical care. Cureus, 12(3), e8041. https://doi.org/10.7759/cureus.8041
• Bohr, A., & Memarzadeh, K. (2020). The rise of artificial intelligence in healthcare applications. In Artificial intelligence in healthcare (pp. 25-60). Elsevier. https://doi.org/10.1016/B978-0-12-818438-7.00002-2
• Brown, T. A. (2015). Confirmatory factor analysis for applied research. New York: Guilford Publications.
• Büyüköztürk, Ş. (2002). Handbook of data analysis for social sciences. Ankara: Pegem Publishing.
• Byrne, B. M. (2011). Structural equation modeling with AMOS: Basic concepts, applications, and programming (Multivariate Applications Series). Routledge, New York.
• Byrne, B. M. (2013). Structural Equation Modeling with AMOS: Basic Concepts, Applications, and Programming. Routledge. https://doi.org/10.4324/9781410600219
• Çelebi, C., Yılmaz, F., Demir, U., & Karakuş, F. (2023). Artificial Intelligence Literacy: An Adaptation Study. Instructional Technology and Lifelong Learning, 4(2), 291-306. https://doi.org/10.52911/itall.1401740
• Çokluk, O., Şekercioğlu, G., & Büyüköztürk, Ş. (2010). Multivariate statistics for social sciences: SPSS and L1SREL applications. Ankara: Pegem A.
• Davis, F. D. (1989). Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly, 319-340.
• Ersöz, E. (2020, March). AI and Human Adaptation. Harvard Business Review.
• Fan, O., Wu, M., Zheng, L., Zhang, L., & Jiao, P. (2023). Integration of artificial intelligence performance prediction and learning analytics to improve student learning in online engineering course. International Journal of Educational Technology in Higher Education, 20(1), 72. https://doi.org/10.1186/s41239-022-00372-4
• Ferikoğlu, D., & Akgün, E. (2022). An investigation of teachers’ artificial intelligence awareness: A scale development study. Malaysian Online Journal of Educational Technology, 10(3), 215–231. https://doi.org/10.52380/mojet.2022.10.3.407
• Gunkel, D. J. (2012). Communication and artificial intelligence: Opportunities and challenges for the 21st century. Communication+ 1, 1(1), 1-25.
• Hair, J. F., Hult, G. T. M., Ringle, C. M., & Sarstedt, M. (2021). A primer on partial least squares structural equation modeling (PLS-SEM). Sage publications.
• Hair, J. F., Risher, J. J., Sarstedt, M., & Ringle, C. M. (2019). When to use and how to report the results of PLS-SEM. European business review, 31(1), 2-24.
• Hrnjica, B., & Softic, S. (2020). Explainable AI in manufacturing: A predictive maintenance case study. In R. A. Wysk (Ed.), Emerging trends in intelligent systems and applications (pp. 67-79). Springer. https://doi.org/10.1007/978-3-030-57997-5_8
• Karaoğlan Yılmaz, F. G., & Yılmaz, R. (2023). Adaptation of the Artificial Intelligence Literacy Scale into Turkish. Journal of Information and Communication Technologies, 5(2), 172-190. https://doi.org/10.53694/bited.1376831
• Karaoğlan Yılmaz, F. G., Yılmaz, R., & Ceylan, M. (2023). Generative artificial intelligence acceptance scale: a validity and reliability study. International Journal of Human–Computer Interaction. https://doi.org/10.1080/10447318.2023.2288730
• Karasar, N. (2007). Scientific research method. Nobel Publishing.
• Kaya, F., Aydın, F., Schepman, A., Rodway, P., Yetişensoy, O., & Demir-Kaya, M. (2022). The roles of personality traits, AI anxiety, and demographic factors in attitudes toward artificial intelligence. International Journal of Human–Computer Interaction, 1-18. https://doi.org/10.1080/10447318.2022.2151730
• Korkmaz, Ö., Vergili, M., & Karadaş, E. (2021). Development of the Online Privacy Awareness Scale: Reliability and Validity Study. Journal of Scientific Research in Turkey, 6(2), 297-311.
• Li, B.-H., Hou, B., Yu, W., Lu, X., & Yang, C.-W. (2017). Applications of artificial intelligence in intelligent manufacturing: A review. Frontiers of Information Technology & Electronic Engineering, 18(1), 86-96. https://doi.org/10.1631/FITEE.1601885
• Marsh, H. W., Balla, J. R., & McDonald, R. P. (1988). Goodness-of-fit indexes in confirmatory factor analysis: The effect of sample size. Psychological Bulletin, 103(3), 391–410. https://doi.org/10.1037/0033-2909.103.3.391
• Maseleno, A., Sabani, N., Huda, M., Ahmad, R., Jasmi, K. A., & Basiron, B. (2018). Demystifying learning analytics in personalized learning. International Journal of Engineering & Technology, 7(3), 112-115. https://doi.org/10.14419/ijet.v7i3.9789
• Medvedev, A. V., Golovyatenko, T. A., & Podymova, L. S. (2022). The role of artificial intelligence in the modern higher education system. Higher Education in Russia, 31(3-4), 149-153. https://doi.org/10.18137/rnu.het.22.03-04.p.149
• Mertala, P., Fagerlund, J., & Calderon, O. (2022). Finnish 5th and 6th grade students’ pre-instructional conceptions of artificial intelligence (AI) and their implications for AI literacy education. Computers and Education: Artificial Intelligence, 3, 100095.
• Pirim, A. (2006). Artificial Intelligence. Journal of Yaşar University, 1(1), 81-93.
• Polatgil, M., & Güler, A. (2023). Adaptation of the Artificial Intelligence Literacy Scale into Turkish. Journal of Quantitative Research in Social Sciences, 3(2), 99–114.
• Qin, H., & Wang, G. (2022). Benefits, challenges, and solutions of artificial intelligence applied in education. Proceedings of the 2022 International Conference on Educational Innovation and Technology (ICEIT), 42-50. https://doi.org/10.1109/ICEIT54416.2022.9690739
• Safadi, F., Fonteneau, R., & Ernst, D. (2015). Artificial intelligence in video games: Towards a unified framework. International Journal of Computer Games Technology, 5, 1-30.
• Şahin, A., Asal Özkan, R., & Turan, B. N. (2022). Development of the Digital Literacy Scale for Primary School Students: Validity and Reliability Study. Journal of Mother Tongue Education, 10(3), 619-630. https://doi.org/10.16916/aded.1109283
• Say, C. (2018). 50 Questions on Artificial Intelligence. Yedi Renk Publishing.
• Schermelleh-Engel, K., Moosbrugger, H., & Müller, H. (2003). Evaluating the Fit of Structural Equation Models: Tests of Significance and Descriptive Goodness-of-Fit Measures. Methods of Psychological Research, 8(2), 23–74.
• Semenov, V. P., Baranova, L. Y., & Yagya, T. (2022). Application of artificial intelligence in medicine. 2022 IEEE 5th International Conference on Smart Computing Machines (SCM), 34-39. https://doi.org/10.1109/scm55405.2022.9794891
• Shen, J. (2020). The innovation of education in the era of artificial intelligence. Proceedings, 47(1), 57-63. https://doi.org/10.3390/proceedings2020047057
• Siemens, G. (2005). Connectivism: A learning theory for the digital age. International Journal of Instructional Technology & Distance Learning, 2, 3-10.
• Singh, G., Garg, V., & Tiwari, P. (2019). Application of artificial intelligence on behavioral finance. In V. Jain (Ed.), Artificial intelligence and machine learning applications (pp. 411-422). Springer. https://doi.org/10.1007/978-3-030-34152-7_26
• Stanciu, V., & Rindasu, S. M. (2021). Artificial Intelligence in Retail: Benefits and Risks Associated with Mobile Shopping Applications. The Amfiteatru Economic Journal, 23(56), 1-46.
• Staš, O., Tolnay, M., & Magdolen, Ľ. (2009). Application of artificial intelligence in manufacturing systems. In K. S. Warwick (Ed.), Artificial intelligence in engineering (pp. 45-50). World Scientific. https://doi.org/10.1142/9789814289795_0005
• Tegmark, M. (2019). Life 3.0: Being Human in the Age of Artificial Intelligence (Trans. E. C. Göksoy). Istanbul: Pegasus.
• Tunç, Ü., & Sanduvaç, İ. H. (2020). Deep Learning with TensorFlow. Istanbul: KODLAB.
• Usta, E. (2023). Lifelong Learning Motivation Scale (LLMS): Validity and Reliability Study. Journal of Teacher Education and Lifelong Learning, 5(1), 429-438. https://doi.org/10.51535/tell.1309487
• Wang, B., Rau, P., & Yuan, T. (2023). Measuring User Competence in Using Artificial Intelligence: Validity and Reliability of the Artificial Intelligence Literacy Scale. Behaviour & Information Technology, 42(9), 1324–1337. https://doi.org/10.1080/0144929x.2022.2072768
• Wang, Y. Y., & Wang, Y. S. (2019). Development and validation of an artificial intelligence anxiety scale: An initial application in predicting motivated learning behavior. Interactive Learning Environments, 1–16. https://doi.org/10.1080/10494820.2019.1674887
• Wieland, A., Durach, C. F., Kembro, J., & Treiblmaier, H. (2017). Statistical and judgmental criteria for scale purification. Supply Chain Management: An International Journal, 22(4), 321-328.
• Xie, M. (2019). Development of artificial intelligence and effects on the financial system. Journal of Physics: Conference Series, 1187(3), 032084. https://doi.org/10.1088/1742-6596/1187/3/032084
• Zhu, A. (2019). Personalized college English learning based on artificial intelligence. 2019 International Conference on Computer Modeling and Computing Engineering (ICMCCE), 134-138. https://doi.org/10.1109/ICMCCE48743.2019.00150