Okullarda Veriye Dayalı Karar Alma Ölçeğinin Geliştirilmesi

Öz

Veriler; eğitim-öğretim, sınıf düzeyinde sorunlar, yönetim veya eğitimcilerle karşılaşılan diğer bir dizi karar hakkında eğitim kararlarının temel bir parçası haline gelmiştir. Nitelikli kararlar alınmasında başvurulan ve yararlanılan bir kaynak olan verilerin yaygın kullanımından dolayı okullarda veriye dayalı karar almaya yönelik yönetici ve öğretmenlerin algılarını belirlemek için geçerli ve güvenilir bir ölçme aracı ihtiyacı doğmuştur. Bu amaç doğrultusunda “Okullarda Veriye Dayalı Karar Alma Ölçeği” şeklinde adlandırılan beşli likert tipi bir ölçek sistematik bir süreçle geliştirilmiştir. Araştırmanın örneklemi açımlayıcı faktör analizi için 584, doğrulayıcı faktör analizi için 392 öğretmen ve yöneticiden oluşmuştur. Faktör analizi öncesinde veri uygunluğu için bakılan KMO (KaiserMeyer-Olkin) değeri .97; Cronbach-Alpha katsayısı .95 olarak belirlenmiştir. Araştırmada geçerlik ve güvenirlik sağlandıktan sonra Okullarda Veriye Dayalı Karar Alma Ölçeği'nin (OVEDKA) son hali toplam 23 maddeden ve üç boyuttan oluşmuştur. Bu boyutlar; verilerin toplanması ve saklanması, verilerin analizi ve yorumlanması ve veriye dayalı kültür olarak sıralanmıştır. Analiz sonuçları OVEDKA'nın öğretmen ve yöneticilerin okullarda veriye dayalı karar almaya yönelik algılarını belirlemede güvenilir ve geçerli bir ölçüm aracı olduğunu göstermektedir.

Anahtar Kelimeler

• Veriye Dayalı Karar Alma
• Okullarda Veri Yönetimi
• Ölçek Geliştirme

Development and Validation of Data-Driven Decision Making in Schools Scale

Öz

Data has become an essential part of educational decisions about teaching and learning, classroom-level issues, management or a range of other decisions faced by educators. Due to the widespread use of data, which is a resource used and benefited from in making qualified decisions, the need for a valid and reliable measurement tool to determine the perceptions of administrators and teachers towards data-driven decision making in schools has arisen. For this purpose, a five-point Likert-type scale called "Data-Driven Decision Making in Schools Scale" was developed through a systematic process. The sample of the study consisted of 584 teachers and administrators for exploratory factor analysis and 392 teachers and administrators for confirmatory factor analysis. The McDonald’s omega (ω) and Cronbach’s alpha (α) coefficients calculated for the scale were found to be in the range of .84 – .96, and the CR and AVE values were above .60 and between .52–.60, respectively, indicating sufficient reliability and convergent validity. After the validity and reliability were ensured, the final version of the Data-Driven Decision Making in Schools Scale consisted of 23 items and three dimensions. These dimensions are data collection and storage, data analysis and interpretation, and data-driven culture. The analysis's findings demonstrate that the 3DM-School is a valid and reliable measuring instrument for figuring out how administrators and teachers feel about making decisions in schools based on data.

Anahtar Kelimeler

• Data-Driven Decision Making
• Data For School Management
• Scale Development

Kaynakça

1. Alshikhi, O. A., & Abdullah, B. M. (2018). Information quality: definitions, measurement, dimensions, and relationship with decision making. European Journal of Business and Innovation Research, 6(5), 36-42.
2. Altun, N., & Karasu, N. (2021). Data-driven decision making in the pre-submission process for at-risk students. Turkish Journal of Educational Sciences, 19(1), 593-612. DOI: 10.37217/tebd.906636
3. Bertrand, M., & Marsh, J. A. (2015). Teachers’ sensemaking of data and ımplications for equity. American Educational Research Journal, 52(5), 861–893. https://doi.org/10.3102/0002831215599251
4. Blau, A. (2011). Uncertainty and the History of Ideas. History and Theory, 50(3), 358-372.
5. Boudett, K. P., & Murnane, RJ (Eds.).(2005). Data wise: A step-by-step guide to using assessment results to improve teaching and learning.
6. Brooks Jr, W. D. (2012). South Carolina middle school principals' use of data-driven decision making (Doctoral dissertation, University of South Carolina).
7. Browne, M. W., & Cudeck, R. (1993). Alternative ways of assessing model fit. In K. A. Bollen & J. S. Long (Eds.), Testing structural equation models (pp. 136-162). Newbury Park: Sage.
8. Brynjolfsson, E., & McElheran, K. (2016). The rapid adoption of data-driven decision-making. American Economic Review, 106(5), 133-139.

9. Calzada Prado, J., & Marzal, M. Á. (2013). Incorporating data literacy into information literacy programs: Core competencies and contents. Libri, 63(2), 123-134.
10. Campbell, C., & Levin, B. (2009). Using data to support educational improvement, Educational Assessment, Evaluation and Accountability, 21, 47–65. doi:10.1007/s11092-008-9063-x
11. Cemaloğlu, N. (Ed.). (2019). Data-driven management. Ankara: Pegem Akademi Publishing.
12. Comrey, A. L. & Lee, H. B. (1992). A firstcourse in factor analysis. Hillsdale, NJ: Lawrence Erlbaum.
13. Creighton, L. L. (2007). Becoming an elementary science teacher: Identity development in a science methods course. University of Colorado at Boulder.
14. Çokluk, Ö., Şekercioğlu, G., & Büyüköztürk, Ş. (2012). Multivariate statistics for social sciences: SPSS and LISREL applications (Vol. 2). Ankara: Pegem akademi.
15. Datnow, A., & Park, V. (2014). Data-driven leadership. John Wiley & Sons.
16. Datnow, A., Choi, B., Park, V., & John, E. S. (2018). Teacher talk about student ability and achievement in the era of data-driven decision making. Teachers College Record, 120(4), 1–34. https://doi.org/10.1177/016146811812000408
17. Davenport, T. H. (2006). Competing on analytics. Harvard Business Review, 84(1), 98.
18. Deal, T. E., & Peterson, K. D. (2016). Shaping school culture. New York: John Wiley & Sons.
19. DeVellis, R. F. (2017). Scale Development: Theory and Applications (4th ed.). Thousand Oaks, CA: Sage
20. DeVellis, R. F., & Thorpe, C. T. (2021). Scale development: Theory and applications. Sage publications.
21. Dilekçi, Ü., Nartgün, S. Ş., & Nartgün, Z. (2020). Data Driven Management in Schools. International Pegem Education Congress (IPCEDU - 2020) 232.
22. Doğan, E. (2021). Evaluation of Data-driven Decision Making Process in School Management According to Administrator Opinions. (Unpublished doctoral dissertation). Gazi University.
23. Doğan, E., & Demirbolat, A. O. (2021). Data-Driven Decision-Making in Schools Scale: A Study of Validity and Reliability. International Journal of Curriculum and Instruction, 13(1), 507-523.
24. Dunn, K. E. (2016). Educational psychology’s instructional challenge: Pre-service teacher concerns regarding classroom-level data-driven decision-making. Psychology Learning & Teaching, 15(1), 31-43.
25. Dunn, K., Airola, D., & Garrison, M. (2013). Concerns, knowledge, and efficacy: an application of the teacher change model to data driven decision-making professional development. Creative Education, 4, 673-682.
26. Earl, L. M., & Katz, S. (2006). Leading schools in a data-rich world. Harnessing data for school improvement. Thousand Oaks, CA: Corwin Press.
27. Epstein, S. (2008). Intuition from the perspective of cognitive experiential self-theory. New York, NY: Erlbaum.
28. Farrell, T. S. (2015). Reflective language teaching: From research to practice. London: Bloomsbury Publishing. Field, A. (2017). Discovering Statistics Using IBM SPSS Statistics. 5th ed. SAGE Publications Ltd.
29. Firestone, W. A., & González, R. A. (2007). Culture and Processes Affecting Data Use in School Districts. Teachers College Record, 109(13), 132–154. https://doi.org/10.1177/016146810710901308
30. Fraenkel, J. R., Wallen, N. E., & Hyun, H. H. (2011). How to design and evaluate research in education. New York: McGraw-Hill Humanities/Social Sciences/Languages.
31. Hogg, A., & Vaughan, G. M. (2007). Social psychology. I. Yıldız and A. Gelmez (Translation). Ankara: Ütopya Publishing House.
32. Hu, L.-T., & Bentler, P. M. (1998). Fit indices in covariance structure modeling: Sensitivity to underparameterized model misspecification. Psychological Methods, 3, 424-453.
33. Ikemoto, G. S., & Marsh, J. A. (2007). Cutting through the “data-driven” mantra: Different conceptions of data-driven decision making. Teachers College Record, 109(13), 105-131.
34. Kahneman, D., & Klein, G. (2009). Conditions for intuitive expertise: a failure to disagree. American psychologist, 64(6), 515.
35. Kartal, I. (2021). Influencing factors of data-driven decision-making adoption in the Netherlands. (Master's thesis) University of Twente, Netherlands.
36. Kaufman, T. E., Graham, C. R., Picciano, A. G., Popham, J. A., & Wiley, D. (2014). Data-driven decision making in the K-12 classroom. Handbook of research on educational communications and technology, 337-346.
37. Kennedy, K. (2019). The Role of Data during the European Migration Crisis: Frontex and Data Management. Kowalski, T. J., & Lasley, T. J. (2009). Handbook of data-based decision making in education. London: Taylor & Francis.
38. Lasater, K., Albiladi, W. S., Davis, W. S., & Bengtson, E. (2020). The data culture continuum: An examination of school data cultures. Educational Administration Quarterly, 56(4), 533-569.
39. Mandinach, E. B., & Gummer, E. S. (2013). A systemic view of implementing data literacy in educator preparation. Educational Researcher, 42(1), 30-37.
40. Mandinach, E. B., & Gummer, E. S. (2016). What does it mean for teachers to be data literate: Laying out the skills, knowledge, and dispositions. Teaching and Teacher Education, 60, 366-376.
41. Mandinach, E. B., & Jimerson, J. B. (2016). Teachers learning how to use data: A synthesis of the issues and what is known. Teaching and Teacher Education, 60, 452-457.
42. Mandinach, E. B., Honey, M., & Light, D. (2006b). A theoretical framework for data-driven decision making. In annual meeting of the American Educational Research Association, San Francisco, CA.
43. Mandinach, E. B., Rivas, L., Light, D., Heinze, C., & Honey, M. (2006a). The impact of data-driven decision making tools on educational practice: A systems analysis of six school districts. In annual meeting of the American Educational Research Association, San Francisco, CA.
44. Mandinach, E., Honey, M., Light, D., & Brunner, C. (2008). A conceptual framework for data-driven decision-making. In E. B. Mandinach & M. Honey (Eds.), Data-driven school improvement: Linking data and learning (pp. 13–31). New York, NY: Teachers College Press.
45. Mandinach, E.B., & Jackson, S.S. (2012). Transforming Teaching and Learning Through Data-Driven Decision Making. United Kingdom: Corvin.
46. Mandinach, E. B. (2012). A perfect time for data use: Using data-driven decision making to inform practice. Educational Psychologist, 47(2), 71-85.
47. Mandinach, E. B., & Honey, M. (2008). Data-driven school improvement: Linking data and learning., New York: Teachers College Press.
48. Manyika, J., Chui, M., Brown, B., Bughin, J., Dobbs, R., Roxburgh, C., & Hung Byers, A. (2011). Big data: The next frontier for innovation, competition, and productivity.
49. Marsh, H. W., & Hocevar, D. (1985). The application of confirmatory factor analysis to the study of self-concept: First and higher order factor structures and their invariance across age groups. Psychological Bulletin, 97, 562-582.
50. Maqbool, S., Mahmood, S. A., & Khaliq, A. (2022). A Study of Data Driven Decision Making for School Administrators. Journal of Educational Research and Social Sciences Review (JERSSR), 2(1), 25-31.
51. Marsh, J. A. (2012). Interventions promoting educators’ use of data: Research insights and gaps. Teachers College Record, 114(11), 1–48.
52. McGuire, T., Manyika, J., & Chui, M. (2012). Why Big Data Is the New Competitive Advantage. Ivey Business Journal (Online).
53. McNaughton, S., Lai, M. K., & Hsiao, S. (2012). Testing the effectiveness of an intervention model based on data use: A replication series across clusters of schools. School Effectiveness and School Improvement, 23, 203–228. doi:10.1080/09243453.2011.652126
54. Ning, C., & You, F. (2018). Data-driven decision making under uncertainty integrating robust optimization with principal component analysis and kernel smoothing methods. Computers & Chemical Engineering, 112. https://doi.org/10.1016/j.compchemeng.2018.02.007.
55. Öz, Ö. (2020). Digital Leadership: Being a School Leader in a Digital World. International Journal of Leadership: Theory and Practice, 3/1.
56. Park, V., & Datnow, A. (2017). Ability grouping and differentiated instruction in an era of data-driven decision making. American Journal of Education, 123(2).
57. Qiao, S., Li, L. X., & Chen, D. (2025). Teachers’ data-driven decision-making: developing and validating a measurement scale. Educational Research, 1-23.
58. Robinson, H. S., Carrillo, P. M., Anumba, C. J., & Al‐Ghassani, A. M. (2005). Performance measurement in knowledge management. Knowledge management in construction, 132-150.
59. Schildkamp, K., & Ehren, M. C. M. (2013). From “intuition” to data-based decision making in Dutch secondary schools? In Schildkamp, K. , Lai, M. K. , & Earl, L. (Eds.), Data-based decision making in education: Challenges and opportunities(pp. 49–67). Dordrecht, the Netherlands: Springer
60. Schildkamp, K., & Poortman, C. (2015). Factors influencing the functioning of data teams. Teachers college record, 117(4), 1-42.
61. Schildkamp, K., Poortman, C. L., & Handelzalts, A. (2016) Data teams for school improvement. School Effectiveness and School Improvement, 27:2, 228-254, DOI: 10.1080/09243453.2015.1056192
62. Schildkamp, K., Poortman, C., Luyten, H., & Ebbeler, J. (2017) Factors promoting and hindering data-based decision making in schools, School Effectiveness and School Improvement, 28:2, 242-258, DOI: 10.1080/09243453.2016.1256901
63. Simpson, G. H. (2011). School leaders' use of data-driven decision-making for school improvement: A study of promising practices in two california charter schools. University of Southern California.
64. Spillane, J. (2012). Data in Practice: Conceptualizing the Data-Based Decision-Making Phenomena. American Journal of Education, 118, 113-141. 10.1086/663283.
65. Staman, L., Visscher, A. J., & Luyten, H. (2014). The effects of professional development on the attitudes, knowledge and skills for data-driven decision making. Studies in Educational Evaluation, 42, 79-90.
66. Swan, G. (2009). Tools for data-driven decision making in teacher education: Designing a portal to conduct field observation inquiry. Journal of Computing in Teacher Education, 25(3), 107-113.
67. Şencan, H. (2005). Reliability and Validity in Social and Behavioural Measurements. Ankara: Seçkin Publication.
68. Şimşek, Ö. F. (2007). Introduction to structural equation modelling: Basic principles and LISREL applications. Ekinoks Publication.
69. Tabachnick, B. G., & Fidel, L. S. (2013). Using Multivariate Statistics. (Sixth Edition). USA: Pearson Education Limited
70. Tabak, H., Şahin, F., & Tabak, B. Y. (2020). Okul yöneticilerinin karar alma yaklaşımları: veriye dayalı karar almaya geçiş. Türkiye Sosyal Araştırmalar Dergisi, 24(3), 713-725. https://dergipark.org.tr/en/pub/tsadergisi/issue/58254/727254
71. Thorndike, R. M. (2005). Measurement and evaluation in psychology and education. Upper Saddle River, NJ: Pearson.
72. Vicki, P., & Datnow, A. (2009) Co-constructing distributed leadership: district and school connections in data-driven decision-making. School Leadership & Management, 29:5, 477-494, DOI: 10.1080/13632430903162541
73. Williams, B., & Hummelbrunner, R. (2011). Systems concepts in action: A practitioner's toolkit. Stanford: Stanford University Press.
74. Yılmaz, E., & Jafarova, G. (2022). Development of data driven decision making scale: a validity and reliability study. Research on Education and Psychology, 6(Special Issue), 69-91.
75. Young, V. M. (2006). Teachers’ use of data: Loose coupling, agenda setting, and team norms. American Journal of Education, 112(4), 521-548.
76. Yurdugül, H., & Aşkar, P. (2008). An investigation of the factorial structures of pupils’ attitude towards technology (PATT): A Turkish sample. [Electronic version] Elementary Education 7(2), 288-309.
77. Zeide, E. (2017). The structural consequences of big data-driven education. Big Data, 5(2), 164-172.