Turkish adaptation of Digital Fluency Scale for high school students

Abstract

The aim of this study was to examine the validity and reliability of the Turkish adaptation of the Digital Fluency Scale developed by Chou and Chiu (2020). The structural and linguistic validity, and the equivalence of the scale with the Turkish version was confirmed. For the pilot study, the scale was administered to 60 high school students using a test-retest method at a two-month interval, and correlations were examined. Validity and reliability analyses were conducted with a sample of 420 high school students in Eskişehir. Confirmatory Factor Analysis (CFA) was used to assess the construct validity of the scale, and the following fit indices were obtained: χ² / df = 3.862; RMSEA = .079; SRMR = .056; GFI = .907; NFI = .856; TLI = .866; and CFI = .888. The first-level CFA results confirmed that the sample size was sufficient for factor analysis. Additionally, a second-order CFA supported the conceptualization of digital fluency as a higher-order latent construct encompassing four core factors. The scale demonstrated high internal consistency, with a Cronbach's alpha of 0.89. Significant correlations were observed among the subscales and between each subscale and the total scale score. These findings demonstrate that the Turkish version of the Digital Fluency Scale is a valid and reliable tool for assessing digital fluency in high school students.

Keywords

• Confirmatory factor analysis
• Digital fluency
• Reliability
• Scale adaptation
• Validity

References

1. Akbulut, O. (2022). Bilimsel araştırmalarda istatistiksel anlamlılığın raporlanmasında güncel yaklaşımlar: hatalar ve doğrular [Current Approaches in Reporting Statistical Significance in Scientific Research: Errors and Truths]. International Journal of Eastern Mediterranean Agricultural Research, 5(1), 01-19.
2. Aksoy, N.C., Karabay, E., & Aksoy, E. (2021). Sınıf öğretmenlerinin dijital okuryazarlık düzeylerinin incelenmesi [Examining the digital literacy levels of classroom teachers]. Selçuk İletişim, 14(2), 859-894. https://doi.org/10.18094/josc.871290
3. Alexander, B., Ashford-Rowe, K., Barajas-Murphy, N., Dobbin, G., Knott, J., McCormack, M., Pomerantz, J., Seilhamer, R., & Weber, N. (2019). EDUCAUSE Horizon Report: 2019 Higher Education Edition. EDUCAISE. EDU19. https://www.learntechlib.org/p/208644/
4. Altunkaynak, M., & Çağımlar, Z. (2023). Türkçe dersinde dijital akıcılığın geliştirilmesi için hazırlanan programın sınıf öğretmenlerinin dijital akıcılıklarına etkisi [The effect of the program prepared to develop digital fluency in turkish classes on the digital fluency of classroom teachers]. Ana Dili Eğitimi Dergisi, 11(3), 580-599. https://doi.org/10.16916/aded.1243661
5. Borsa, J.C., Damásio, B.F., & Bandeira, D.R. (2012). Cross Cultural adaptation and validation of psychological instruments: Some considerations. Paidéia, 22(53), 423 432. https://doi.org/10.1590/S0103-863X2012000300014
6. Briggs, C., & Makice, K. (2012). Digital fluency: Building success in the digital age. Bloomington, SociaLens.
7. Blayone, T. (2019). Theorising effective uses of digital technology with activity theory. Technology, Pedagogy and Education, 28(4), 447–462. https://doi.org/10.1080/1475939X.2019.1645728
8. Büyüköztürk, Ş. (2012). Sosyal bilimler için veri analizi el kitabı [Handbook of data analysis for the social sciences]. Pegem Academy Publishing.

9. Byrne, B.M. (1998). Structural equation modeling with LISREL, PRELIS, and SIMPLIS: basic concepts, applications, and programming (1st ed.). Psychology Press. https://doi.org/10.4324/9780203774762
10. Calvani, A., Cartelli, A., Fini, A., & Ranieri, M. (2008). Models and instruments for assessing digital competence at school. Journal of e Learning and Knowledge Society, 4(3), 183 193. https://doi.org/10.20368/1971-8829/288
11. Chou, Y.C., & Chiu, C.H., (2020). The development and validation of a digital fluency scale for preadolescents. The Asia Pacific Education Researcher, 29(6): 541 551. https://doi.org/10.1007/s40299-020-00505-1
12. Chow, J.C.C., Snowden, L.R. & McConnell, W. (2001). A confirmatory factor analysis of the BASIS-32 in racial and ethnic samples. The Journal of Behavioral Health Services and Research. 28(4), 400-411. https://doi.org/10.1007/BF02287771
13. Coward, M. (2018). Reflection and professional learning. Nursing Management, 31(2): 38 41. https://doi.org/10.7748/nm.2018.e1752
14. Demir, K. (2018). Öğretmen adaylarının dijital akıcılıklarının incelenmesi [Examining the digital fluency of prospective teachers] [Unpublished doctoral dissertation]. Anadolu University.
15. Dunn, T.J., Baguley, T., & Brunsden, V. (2014). From alpha to omega: A practical solution to the pervasive problem of internal consistency estimation. British Journal of Psychology, 105(3), 399-412.
16. Eynon, R., & Geniets, A. (2016). The digital skills paradox: How do digitally excluded youth develop skills to use the internet? Learning, Media and Technology, 41(3), 463 479. https://doi.org/10.1080/17439884.2014.1002845
17. Eshet-Alkalai, Y. (2004). Digital literacy: A conceptual framework for survival skills in the digital era. Journal of Educational Multimedia and Hypermedia, 13(1), 93 106. https://www.learntechlib.org/primary/d/4793
18. Geisinger, K.F. (1994). Cross-cultural normative assessment: Translation and adaptation issues influencing the normative interpretation of assessment instruments. Psychological Assessment, 6(4), 304-312. https://doi.org/10.1037/1040-3590.6.4.304
19. Gil-Flores, J., Torres-Gordillo, J.J., & Perera-Rodríguez, V.H. (2012). The role of online reader experience in explaining students’ performance in digital reading. Computers & Education, 59(2), 653-660. https://doi.org/10.1016/j.compedu.2012.03.014
20. Güngör, D. (2016). A Guide to scale development and adaptation in psychology. Turkish Psychological Articles, 19(38), 104 112. https://psikolog.org.tr/tr/yayinlar/dergiler/1031828/tpy1301996120160000m000041.pdf
21. Hague, C., & Payton, S. (2010). Digital literacy across the curriculum. Futurelab. https://www.nfer.ac.uk/media/jnhety2n/digital_literacy_across_the_curriculum.pdf
22. Hair, J.F., Black, W.C., Babin, B.J., & Anderson, R.E. (2010). Multivariate data analysis: A global perspective. Prentice Hall.
23. Harrington, D. (2009). Confirmatory Factor Analysis. Oxford University Press.
24. Hambleton, R.K., & Patsula, L. (1999). Increasing the validity of adapted tests: Myths to be avoided and guidelines for improving test adaptation practices. Journal of Applied Testing Technology, 1(1), 1-16. https://api.semanticscholar.org/CorpusID:146275641
25. Hambleton, R.K. (2001). The next generation of the ITC test translation and adaptation guidelines. European Journal of Psychological Assessment, 17(3), 164 172. https://psycnet.apa.org/doi/10.1027/1015-5759.17.3.164
26. Hamutoğlu, N.B., Güngören, Ö.C., Uyanık, G.K., & Erdoğan, D.G. (2017). Dijital okuryazarlık ölçeği: türkçe’ye uyarlama çalışması [Digital literacy scale: adaptation to turkish]. Ege Eğitim Dergisi, 18(1), 408-429. https://doi.org/10.12984/egeefd.295306
27. Hatlevik, O.E., Guðmundsdóttir, G.B., & Loi, M. (2015). Digital diversity among upper secondary school students: A multilevel analysis of the relationship between cultural capital, self-efficacy, and digital competence. Computers & Education, 81, 345 353. https://doi.org/10.1016/j.compedu.2014.10.019
28. Howland, K., & Scott, S.K. (2016). Oral reading fluency testing: Pitfalls for children with speech disorders. The Reading Teacher, 69(6), 653-658. http://dx.doi.org/10.1002/trtr.1441
29. Hu, L.T. & Bentler, P.M. (1999) Cutoff criteria for fit ındexes in covariance structure analysis: conventional criteria versus new alternatives. Structural equation modeling: A Multidisciplinary Journal, 6, 1-55. http://dx.doi.org/10.1080/10705519909540118
30. Ince, F. (2022). Digital literacy training: Opportunities and challenges. In M. Taher (Ed.), Handbook of research on the role of libraries, archives, and museums in achieving civic engagement and social justice in smart cities (pp. 185 199). IGI Global Scientific Publishing. https://doi.org/10.4018/978-1-7998-8363-0.ch009
31. International Test Commission (ITC) (2017). ITC guidelines for translating and adapting tests (2nd ed.). https://www.intestcom.org
32. International Society for Technology in Education (ISTE) (n.d.). ISTE standards: For education leaders. Retrieved April 8, 2024, from https://www.iste.org/standards/for-education-leaders
33. Joint Information Systems Committee. (n.d.). Quick guide: Developing students’ digital literacy. https://digitalcapability.jiscinvolve.org/wp/files/2014/09/JISC_REPORT_Digital_Literacies_280714_PRINT.pd
34. Khine, M.S. (Ed.). (2013). Application of structural equation modeling in educational research and practice. Sense Publishers.
35. Kim, S., Chung, K., & Yu, H. (2013). Enhancing digital fluency through a training program for creative problem solving using computer programming. The Journal of Creative Behavior, 47(3), 171-199. https://doi.org/10.1002/jocb.30
36. Kozan, M., & Özek, M.B. (2019). Böte bölümü öğretmen adaylarının dijital okuryazarlık düzeyleri ve siber zorbalığa ilişkin duyarlılıklarının incelenmesi [Examining the digital literacy levels and cyberbullying sensitivities of Department of Computer and Instructional Technologies Education teacher candidates]. Fırat University Journal of Social Sciences, 29(1), 107 120. https://doi.org/10.18069/firatsbed.538657
37. Liu, A., Li, Y., & Ye, H. (2018). Digital fluency and social media use: An empirical ınvestigation of we chat use. In T.X. Bui (Ed.), Proceedings of the 51st Hawaii international conference on system sciences (pp. 503-512). HICSS Conference Office. https://doi.org/10.24251/HICSS.2018.065
38. Lorenzo, G., & Dziuban, C. (2006). Ensuring the Net Generation Is Net Savvy. In D. Oblinger (Ed.), EDUCAUSE Learning Initiative (pp. 1-19). EDUCAUSE.
39. Marsh, H.W., Hau, K.T., Artelt, C., Baumert, J., & Peschar, J.L. (2006). OECD’s brief self-report measure of educational psychology’s most useful affective constructs: Cross-cultural, psychometric comparisons across 25 countries. International Journal of Testing, 6(4), 311-360. https://doi.org/10.1207/s15327574ijt0604_1
40. Marsh, H.W., Hau, K.T., & Wen, Z. (2004). In search of golden rules: comment on hypothesis-testing approaches to setting cutoff values for fit ındexes and dangers in overgeneralizing hu and bentler’s (1999) findings. Structural Equation Modeling: A Multidisciplinary Journal, 11(3), 320–341. https://doi.org/10.1207/s15328007sem1103_2
41. Miller, C., & Bartlett, J. (2012). Digital fluency: towards young people’s critical use of the internet. Journal of Information Literacy, 6(2), 35-55. http://dx.doi.org/10.11645/6.2.1714
42. Mudra, H. (2020). Digital literacy among young learners: How do EFL teachers and learners view its benefits and barriers? Teaching English with Technology, 20(3), 3 24. http://files.eric.ed.gov/fulltext/EJ1264169.pdf Munro, B.H. (2005). Statistical methods for health care research. Lippincott Williams & Wilkins.
43. Murtadho, M.I., Rohmah, R.Y., Jamilah, Z., & Furqon, M. (2023). The role of digital literacy in improving students’ competence in digital era. AL-WIJDÃN Journal of Islamic Education Studies, 8(2), 253-260. https://doi.org/10.58788/alwijdn.v8i2.2328
44. National Research Council, Committee on Information Technology Literacy (1999). Being fluent with information technology. The National Academies Press.
45. Nilsson, J., Gardulf, A., & Lepp, M. (2016). Process of translation and adaptation of the Nurse Professional Competence (NPC) Scale. Journal of Nursing Education and Practice, 6(1), 100-103. http://dx.doi.org/10.5430/jnep.v6n1p100
46. Pallant, J. (2005). SPSS survival manual: A step by step guide to data analysis using SPSS for windows. Australian Copyright.
47. Pichler, D., & Stehrer, R. (2021). Breaking through the digital ceiling: ICT skills and labour market opportunities (Working Paper No. 193). The Vienna Institute for International Economic Studies. https://wiiw.ac.at/breaking-through-the-digital-ceiling-ict-skills-and-labour-market-opportunities-dlp-5597.pdf
48. Reddy, P., Sharma, B.N., & Chaudhary, K. (2020). Digital literacy: a review of literature. Int. J. Technoethics, 11, 65-94. http://dx.doi.org/10.4018/IJT.20200701.oa1
49. Resnick, M. (2012). Mother’s Day, warrior cats, and digital fluency: Stories from the Scratch online community. In Proceedings of the constructionism 2012 conference: Theory, practice and impact (pp. 52-58). https://web.media.mit.edu/~mres/papers/mothers-day-warrior-cats.pdf
50. Ribble, M. (2011). Digital citizenship in schools (2nd ed.). International Society for Technology in Education.
51. Schermelleh-Engel, K., & Moosbrugger, H. (2003). Evaluating the fit of structural equation models: Tests of significance and descriptive goodness-of-fit measures. Methods of Psychological Research Online, 8(2), 23-74. https://psycnet.apa.org/record/2003-08119-003
52. Spante, M., Hashemi, S.S., Lundin, M., & Algers, A. (2018). Digital competence and digital literacy in higher education research: Systematic review of concept use. Cogent Education, 5(1), 1519143. https://doi.org/10.1080/2331186X.2018.1519143
53. Sönmez, E.E., & Gül, H.Ü. (2014, November 27-29). Dijital okuryazarlık ve okul yöneticileri [Digital literacy and school administrators] [Paper presentation]. 19th Internet Conference of Turkey, İzmir, Türkiye. https://inet-tr.org.tr/inetconf19/ozet/69.html
54. Şahin, Y. (2023). Lise öğrencilerinin 21. Yy. Becerileri ile dijital akıcılık düzeyleri arasındaki ilişkinin demografik özellikler bağlamında incelenmesi [Examining the relationship between high school students' 21st century skills and digital fluency levels in the context of demographic characteristics] [Unpublished Master's Thesis]. Gaziosmanpaşa University.
55. Tabachnick, B.G., & Fidell, L.S. (2013). Using multivariate statistics (6th ed.). Pearson.
56. Tunca, E. (2024). Dijital akıcılık ölçeğinin uyarlanması ve lise öğrencilerinin dijital akıcılık düzeylerinin incelenmesi [Adaptation of the digital fluency scale and examination of high school students' digital fluency levels] [Unpublished Master's Thesis]. Kocaeli University.
57. Wang, R., Wiesemes, R., & Gibbons, C. (2012). Developing digital fluency through ubiquitous mobile devices: Findings from a small scale study. Computers & Education, 58(1): 570 578. https://doi.org/10.1016/j.compedu.2011.04.013
58. Wang, Q., Myers, M.D., & Sundaram, D. (2013). Digital natives and digital ımmigrants towards a model of digital fluency. Business & Information Systems Engineering, 55(6), 409 419. http://dx.doi.org/10.1007/s11576-013-0390-2