Artificial intelligence literacy scale: A study of reliability and validity in Turkish university students
Abstract
This study aims to adapt to Turkish the "Scale for the assessment of non-experts: AI literacy" developed by Laupichler et al. (2023a). The scale consists of 31 items with three sub-dimensions: technical understanding, critical thinking, and practical applications. The data required for the validity and reliability study of the scale were collected from 642 undergraduate and graduate students studying in different departments of a state university in the fall semester of the 2023-2024 academic year. First, CFA was applied to the data according to the factor structure in the original scale, but as acceptable fit values could not be obtained because of the analysis, exploratory factor analysis was performed. In the reliability analysis of the factor structure determined by EFA, KMO was calculated as =0.948. It was determined that the scale items were collected in three factors and explained 61.1% of the total variance ("critical thinking" is 25.8%, "technical knowledge" is 25.2%, and "practical applications" explains 10.2% of the total variance). As a result of EFA, it was seen that the sub-dimensions of some of the items in the original scale had changed, and since the factor load values of the three items were very close to each other, they were removed from the scale. Because of CFA, which was conducted to evaluate whether the data supported the hypothesized relationships between the measured variables, Cronbach’s alpha value was found to be 0.90. As a result of the CFA analysis conducted with the 3 sub-dimensions and 28 items in the scale, the Chi-square value (X²=2.85; df=345, N=317, p< .001), which is the fit index of the model, has a good fit and is significant, SRMR = 0.0545and RMSEA = 0.077 values and fit indices and the model has an acceptable fit.
Keywords
Artificial intelligence literacy scale, artificial intelligence competencies, confirmatory factor analysis, psychometric measurement, scale adaptation
Ethical Statement
Ethics Committee: "Ethics Committee Permission" was obtained on 23.08.2023 with the number E-10017888-204.01.07-467360 from Kocaeli University.
References
- Ayyıldız, H. & Cengiz, E. (2006). A conceptual investigation of structural equation model (SEM) on testing marketing models. Süleyman Demirel University İ.İ.B.F. 11(1), 63-84. https://dergipark.org.tr/tr/download/article-file/194860
- Bora Semiz, B. & Altunışık R. (2016). An evaluation of various attributes of Likert-likert type scales on response styles in marketing research. Bartın Üniversitesi İİBF Dergisi, 7 (14), 577-598.
- Büyüköztürk, Ş. (2012). Faktör analizi: Temel kavramlar ve ölçek geliştirmede kullanımı. Kuram ve Uygulamalarda Eğitim Yönetimi, (32), 470-483.
- Büyüköztürk, Ş., Akgün, Ö.E., Özkahveci, Ö. and Demirel, F. (2004). The validity and reliability study of the Turkish version of the Motivated Strategies for Learning Questionnaire. Educational Scienses: Theory&Practice, 4(2), 231-239.
- Casal-Otero, L., Catala, A., Fernández-Morante, C., Taboada, M., Cebreiro, B., & Barro, S. (2023). AI literacy in K-12: A systematic literature review. International Journal of STEM Education, 10(1), 29. https://doi.org/10.1186/s40594-023-00418-7
- Child, D. (2006). The essentials of factor analysis. Continuum, London.
- Coghlan, S., Miller, T., & Paterson, J. (2021). Good proctor or “big brother”? Ethics of online exam supervision technologies. Philosophy & Technology, 34(4), 1581-1606. https://doi.org/10.1007/s13347-021-00476-1
- Çokluk Ö, Şekercioğlu G, Büyüköztürk Ş. (2016). Sosyal Bilimler İçin Çok Değişkenli İstatistik SPSS ve LISREL Uygulamaları (4. Baskı). Ankara: Pegem Akademi.
- Cortina, J. M. (1993). What is coefficient alpha? An examination of theory and applications. Journal of Applied psychology, 78(1), 98‐104.
- Coşkun, R., Altunışık, R., Yıldırım, E. & Bayraktaroğlu, S. (2010). Sosyal Bilimlerde Araştırma Yöntemleri SPSS Uygulamaları. Sakarya: Sakarya Yayıncılık.