Development of Computational Thinking Scale: Validity and Reliability Study

Abstract

Computational thinking is a way of thinking that covers 21st century skills and includes new generation concepts such as robotics, coding, informatics and information construction. Computational thinking has reached an important point especially in the field of science in line with the rapid developments in technology. Robotics applications, software-based activities, STEM (Science, Technology, Engineering, Math) education and problem-based studies are some of the areas where this thinking is used. In this study, which is based on this point, it is aimed to develop a scale for computational thinking. Exploratory sequential design, one of the mixed research methods, was used in the study. First of all, a detailed literature review was conducted and needs analysis was carried out. This study consists of two stages. In the first stage, exploratory factor analysis was performed and analyzed with SPSS 23 program. In the second stage, confirmatory factor analysis was performed and analyzed with LISREL 9.2 program. As a result of the study, the goodness of fit indexes of the scale was found. According to this; X2/df value 1.81; NNFI value 0.97; NFI value 0.93; CFI value 0.98; RMR value 0.05; SRMR value 0.04; AGFI value 0.91 and GFI value was found to be 0.93. When the reliability values of the study were examined, Cronbach’s Alpha value was found to be 0.86. As a result of the research, a computational thinking scale consisting of 3 factors and 30 items was developed. This scale was developed for prospective teachers and can be used at all levels of prospective teachers.

Keywords

• Computational thinking,scale development,21st century skills,science education

References

1. Acar, I. H. (2017). Karma yontem arastirmalarina giris [Introduction to mixed method research]. In M. Sozbilir (Eds.). Temel ve gelismis karma yontem desenleri [Basic and advanced mixed method designs] (pp. 35-51). Ankara, Turkey: Pegem Academy.
2. Aho, A. V. (2012). Computation and computational thinking. The Computer Journal, 55(7), 832-835.
3. Ardies, J., Maeyer, S.D., & Gijbels, D. (2013). Reconstructing the pupils attitude towards technology survey. Design and Technology Education: An International Journal, 18(1), 8-19.
4. Barr, V. (2014). Computational thinking. In T. Gonzalez & A. Tucker (Eds.), Computation handbook (3rd ed.). Abingdon, UK: Chapman & Hall/CRC Press.
5. Brennan, K., & Resnick, M. (2012). New frameworks for studying and assessing the development of computational thinking. In Proceedings of the 2012 Annual Meeting of the American Educational Research Association. Vancouver, Canada.
6. Burton, B. A. (2010). Encouraging algorithmic thinking without a computer. Olympiads in Informatics, 4, 3-14.
7. Buyukozturk, S. (2010). Sosyal bilimler icin veri analizi el kitabi: Istatistik, arastirma deseni SPSS uygulamalari ve yorum [Data analysis manual for social sciences: Statistics, research design SPSS applications and interpretation] (11th ed.). Ankara, Turkey: Pegem Academy.
8. Calvini, A., Fini, A., & Ranieri M. (2008). Models and instruments for assessing digital competence at school. Journal of E-Learning and Knowledge Society, 3(4), 183-193.

9. Cetin, I., & Toluk Ucar, Z. (2017). Bilgi islemsel dusunmeden programlaya [From computational thinking to programming]. In Y. Gulbahar (Eds.), Bilgi islemsel dusunme tanimi ve kapsami [Definition and content of computational thinking] (pp.42-78). Ankara, Turkey: Pegem Academy.
10. Cinar, M., & Tuzun, H. (2017). Bilgisayimsal dusunme surecinin dogasina iliskin nitel bir analiz [A qualitative analysis of the nature of computational thinking]. Paper presented at the 19th Academic Informatics Conference. Aksaray University, Aksaray, Turkey.
11. Cokluk, O., Sekercioglu, G., & Buyukozturk, S. (2014). Sosyal bilimler icin cok degiskenli istatistik: SPSS ve LISREL uygulamalari [Variable statistics for social sciences: SPSS and LISREL applications]. Ankara, Turkey: Pegem Academy.
12. Dalgic, G. Y. (2008). Turk yuksekogretiminde ogretim elemanlarinin Bologna sureci kapsamindaki uygulamalara iliskin gorusleri [The views of the academic staff in Turkish higher education about the applications within the Bologna process] (Unpublished doctoral dissertation). Gazi University, Ankara, Turkey.
13. Dalrymple, P. W. (2011). Data, information, knowledge: The emerging field of health informatics. Bulletin of the American Society for Information Science and Technology, 20(2), 307-315.
14. Denning, P. J. (2014). Structure and organization of computing. In T. Gonzales, J. Diaz-Herrera & A.Tucker (Eds), Computing handbook: Computer Science and Software Engineering (3rd ed.) (pp. 1-14). Boca Raton, FL: Chapman & Hall/CRC.
15. Denning, P. J. (2016). Remaining trouble spots with computational thinking. Communications of the ACM, 60(6), 33-39. https://doi.org/ 10.1145/2998438
16. Erkus, A. (2012). Psikolojide olcek ve olcek gelistirme-I: Temel kavramlar ve islemler [Scale and scale development in psychology-I: Basic concepts and operations] (1st ed.). Ankara: Pegem Academy.
17. Feurzeig, W., & Papert, S. A. (2011). Programming-languages as a conceptual framework for teaching mathematics. Interactive Learning Environments, 19(5), 487-501. https://doi.org/10.1080/10494820903520040
18. Fraenkel, J. R., & Wallen, N. E. (2003). How to design and evaluate research in education, (5th ed.). New York, NY: McGraw-Hill.
19. George, D., & Mallery, M. (2010). SPSS for windows step by step: A simple guide and reference. Boston, MA: Pearson.
20. Gulbahar, Y., Kert, S. B., & Kalelioglu F. (2019). The self-efficacy perception scale for computational thinking skill: Validity and reliability study. Turkish Journal of Computer and Mathematics Education, 10(1), 1-29.
21. Gul, S., & Sozbilir, M. (2015). Thematic content analysis of scale development studies published in the field of science and mathematics education. Education and Science, 40(178), 85-102. http://dx.doi.org/10.15390/EB.2015.4070
22. Kalelioglu, F., Gulbahar, Y., & Kukul, V. (2016). A framework for computational thinking based on a systematic research review. Baltic Journal of Modern Computing, 4(3), 583-596.
23. Kert, S. B. (2017). Bilgi islemsel dusunmeden programlaya [From computational thinking to programming]. In Y. Gulbahar (Ed.), Bilgisayar bilimi egitimine giris [Introduction to computer science education] (pp.1-20). Ankara, Turkey: Pegem Academy.
24. Kline, P. (1994). An easy guide to factor analysis. Abingdon, UK: Routledge.
25. Korkmaz, O., Cakir, R., & Ozden, M. Y. (2017). A validity and reliability study of the computational thinking scales (CTS). Computers in Human Behavior, 72, 558-569. https://doi.org/10.1016/j.chb.2017.01.005
26. Kramer, J. (2007). Is abstraction the key to computing? Communications of the ACM, 50(4), 36-42.
27. Kucuk, S., Yilmaz, R. M., Baydas, O., & Goktas, Y. (2014). Okullarda artirilmis gerceklik uygulamalari tutum olcegi: Gecerlik ve guvenirlik calismasi [Augmented reality applications attitude scale in schools: Validity and reliability study]. Education and Science, 39(174), 383-392. http://dx.doi.org/10.15390/EB.2014.3590
28. Kurnaz, M. A., & Yigit, N. (2010). Fizik tutum olcegi: Gelistirilmesi, gecerliligi ve guvenilirligi [Physical attitude scale: Development, validity and reliability]. Necatibey Faculty of Education, Electronic Journal of Science and Mathematics Education, 4(1), 29-49.
29. Lawshe, C. H. (1975). A quantitative approach to content validity. Personnel Psychology, 28(4), 563-575. http://dx.doi.org/10.1111/j.1744-6570.1975.tb01393.x
30. Light, J. S. (1999). When computers were women. Technology and Culture, 40(3), 455-483.
31. McMillan, J. H., & Schumacher, S. (2006). Research in education: Evidence-based inquiry (6th ed.). Boston, MA: Pearson.
32. Ozden, M. Y. (2015). Bilgisayarca dusunme [Computer Thinking]. Retrieved on June 2, 2019 from http://myozden.blogspot.com.tr
33. Ozturk, M. A. (2010). An exploratory study on measuring educators’ attitudes toward educational research. Educational Research and Reviews, 5(12), 758-769.
34. Schneider, G. M., & Gersting, J. (2016). Invitation to computer science. Toronto, Canada: Nelson Education.
35. Selby, C., & Woollard, J. (2013). Computational thinking: The developing definition. In J. Carter, I. Utting, & A. Clear (Eds.), Proceedings of 18th Annual Conference on Innovation and Technology in Computer Science education. Canterbury: University of Southampton.
36. Simsek, O. F. (2007). Yapisal esitlik modellemesine giris: Temel ilkeler ve LISREL uygulamalari [Introduction to structural equation modeling: Basic principles and LISREL applications] Ankara, Turkey: Ekinoks.
37. Tabachnick, B. G., & Fidell, L. S. (2007). Using multivariate statistics (5th ed.). Boston, MA: Allyn ve Bacon.
38. Tavsancil, E. (2006). Tutumlarin olculmesi ve SPSS ile veri analizi [Measurement of attitudes and data analysis with SPSS] (3rd ed.) Ankara, Turkey: Nobel.
39. Whetton, D. A., & Cameron, K. S. (2002). Answers to exercises taken from developing management skills (3rd ed.). Evanston, IL: Northwestern University.
40. Wilson, F. R., Pan. W., & Donald, A. S. (2012). Recalculation of the critical values for Lawshe’s content validity ratio. Measurement and Evaluation in Counseling and Development, 45(3), 197-210. https://doi.org/10.1177/0748175612440286
41. Wing, J. M. (2006). Computational thinking. Communications of the ACM, 49(3), 33-35.
42. Yilmaz, A., Gulgun, C., Cetinkaya, M., & Doganay, K. (2018). Initiatives and new trends towards STEM education in Turkey. Journal of Education and Training Studies, 6(11), 1-10.
43. Yilmaz, A., & Ertugrul Akyol, B. (2017). Required quality standards for augmented reality applications. International Journal on Lifelong Education and Leadership, 3(2), 13-21.
44. Yilmaz, A., & Aydin, S. (2017). Quality standards for the content of the program and admission to the students in science education teacher training programs. Paper presented at the International Teacher Education Conference (ITEC), Harvard University in Cambridge, MA, USA.
45. Yilmaz, A. (2018). The determination of the quality standards of teacher training programs related to teachers of science education: The study of scale development and application (Unpublished doctoral dissertation). Kastamonu University, Kastamonu, Turkey.
46. Yurdagul, H., & Bayrak, F. (2012). Olcek gelistirme calismalarinda kapsam gecerlik olcutleri: Kapsam gecerlik indeksi ve Kappa istatistiginin karsilastirilmasi [Content validity criteria in scale development studies: Comparison of content validity index and Kappa statistics]. Hacettepe University Journal of Education, 2(Special Issue), 264-271.