Predicting Classroom Teachers' Program Evaluation Skills from Program Literacy

Year 2024, Volume: 14 Issue: 2, 190 - 219, 27.12.2024

Cengiz Ağlar , Aysel Arslan

https://doi.org/10.17984/adyuebd.1471757

Abstract

This study aims to predict the level to which classroom teachers' program literacy explains their program evaluation level, utilizing the "Program Literacy Scale" developed by Bolat (2017) and the "Program Evaluation Scale" developed by Baş (2016). Additionally, we seek to determine the impact of participant demographics, including gender, age, seniority, and faculty type graduated, on these skills. We employed a quantitative research method with a scanning design and a random sampling approach. The study involved 380 classroom teachers from state schools during the 2023-2024 academic year. We analysed the obtained data by using descriptive analyses, independent t-tests, ANOVA tests, Tukey's HSD test, and Simple Linear Regression. Analysis revealed significant differences (p<.05) in program literacy based on teacher age, seniority, and faculty graduation. Additionally, program evaluation skills differed based on gender, seniority, and faculty graduation factors. Importantly, the study found that program literacy positively predicted the level of program evaluation skills. These results suggest a link between teachers' program knowledge and their capability to evaluate program effectively.

Keywords

Program evaluation, Program literacy, Classroom teacher

Sınıf Öğretmenlerinin Eğitim Programları Okuryazarlığı Becerilerinin Eğitim Programlarını Değerlendirmelerini Yordaması

Abstract

Bu çalışma, Bolat (2017) tarafından geliştirilen "Program Okuryazarlığı Ölçeği" ve Baş (2016) tarafından geliştirilen "Program Değerlendirme Ölçeği" kullanılarak sınıf öğretmenlerinin program okuryazarlığının program değerlendirme düzeylerini ne düzeyde açıkladığını tahmin etmeyi amaçlamaktadır. Ayrıca, cinsiyet, yaş, kıdem ve mezun olunan fakülte türü gibi katılımcı demografik özelliklerinin bu beceriler üzerindeki etkisini belirlemeyi amaçlamaktadır. Tarama tasarımı ve rastgele örnekleme yaklaşımı ile nicel bir araştırma yöntemi kullanılmıştır. Çalışmaya 2023-2024 akademik yılında devlet okullarından 380 sınıf öğretmeni katıldı. Elde edilen veriler ile betimsel analizler, bağımsız t-testleri, ANOVA testleri, Tukey'in HSD testi ve Basit Doğrusal Regresyon kullanarak analiz edildi. Analiz, öğretmen yaşı, kıdem ve mezun olunan fakülteye dayalı olarak program okuryazarlığında anlamlı farklılıklar (p<.05) olduğunu ortaya çıkardı. Ayrıca, program değerlendirme becerileri cinsiyet, kıdem ve mezun olunan değişkenlerine göre farklılık gösterdi. Önemli olarak, çalışma ile program okuryazarlığının program değerlendirme becerilerinin seviyesini pozitif şekilde yordadığı görüldü. Bu sonuçlar öğretmenlerin program bilgisi ile programı etkili bir şekilde değerlendirme yetenekleri arasında bir bağlantı olduğunu göstermektedir.

Keywords

Program değerlendirmesi, Program okuryazarlığı, Sınıf öğretmeni

References

• Ağlar, C., Arslan, A. & Şahbaz, A. F. (2024a). Analysis of Turkish program at the middle school level prepared during the republican era. Journal of Computer and Education Research, 12(23), 2-30. https://doi.org/10.18009/jcer.1309488
• Ağlar, C., Arslan, A. & Şahbaz, A. F. (2024b). Analysis of theses on Turkish language teaching program in Turkey: A document analysis. International e-Journal of Educational Studies, 8(16), 1-13. https://doi.org/10.31458/iejes.1324803
• Akınoğlu, O. & Doğan, S. (2012). Eğitimde program geliştirme alanına yeni bir kavram önerisi: Program okuryazarlığı [A new concept proposal in the field of program development in education: Program literacy]. Paper Presented at the 21st National Educational Sciences Congress, İstanbul.
• Alak, G., & Nalçacı, A. (2012). Assessment of elements relating the instructional program of social studies as a school subject based on the views of teachers. Buca Eği̇ti̇m Fakültesi Dergi̇si̇, 33, 36–51. https://dergipark.org.tr/en/pub/deubefd/issue/25117/265205
• Aslan, S. (2019). An analysis of prospective teachers’ program literacy levels in terms of reading and writing. Universal Journal of Educational Research, 7(4), 973–979. https://doi.org/10.13189/ujer.2019.070408
• Bal, P., Karabay, A., & Kuşdemir-Kayıran, B. (2021). Analysis of elementary school teachers’ evaluations regarding the mathematics program. Trakya Eğitim Dergisi, 11(2), 717–731. https://doi.org/10.24315/tred.696848
• Baş, G. (2016). Currciulum evaluation scale: Validity and reliability study abstract. Turkish Journal of Educational Studies, 3(1), 53–80. https://dergipark.org.tr/tr/pub/turkjes/issue/34163/377683
• Bharvad, A. J. (2010). Program evaluation. International Research Journal, 1(12), 72–74. http://meb.ai/UXBzjTT
• Bolat, Y. (2017). Concept of program literacy and program literacy scale. Turkish Studies-International Periodical for the Languages, Literature and History of Turkish or Turkic, 12(18), 121–138. https://doi.org/10.7827/TurkishStudies.12103
• Bulut, İ. (2008). Teacher views on student-centered practices in the new primary education program. Kuram ve Uygulamada Eğitim Yönetimi, 56, 521–546.
• Creswell, J. W. (2013). Research design. SAGE.
• Çetinkaya, S., & Tabak, S. (2019). Program literacy efficiency of preservice teachers. OMÜ Eğitim Fakültesi Dergisi, 38(1), 296–309. https://doi.org/10.7822/omuefd.535482
• Dawson, B., & Trapp, R. G. (2001). Basic & clinical biostatistics. Mc Graw Hill.
• Demirel, Ö. (2020). Program development in education. Pegem Akademi. https://doi.org/10.14527/9786053180265
• Demirtaş, Z. (2017). A general view to program evaluation approaches in education. Sakarya University Journal of Education, 7(4), 756–768. https://doi.org/10.19126/suje.388616
• Erdamar, F. S., & Akpunar, B. (2020). Analysis of classroom teachers’ perceptions of program literacy. Journal of Education and Training Studies, 8(3), 21. https://doi.org/10.11114/jets.v8i3.4619
• Erdem, C., & Eğmir, E. (2018). Prospective teachers’ levels of program literacy. Afyon Kocatepe University Journal of Social Sciences, 20(2), 123–138. https://doi.org/10.32709/akusosbil.428727
• Esen-Aygün, H. (2019). The prediction of the teaching readiness level of prospective teachers in terms of program literacy. Uluslararası Eğitim Programları ve Öğretim Çalışmaları Dergisi, 9(2), 203–220. https://doi.org/10.31704/ijocis.2019.009
• Fowler, F. J. (2014). Survey research methods (5th edition). SAGE. https://www.jstor.org/stable/3250956?origin=crossref
• Gündoğan, G., Şan, İ., & Uyar, A. (2023). Program literacy perception level of teachers. International Journal of Educational Research Review, 8(3), 422–434. https://doi.org/10.24331/ijere.1270528
• Gürbüz, S., & Şahin, F. (2018). Sosyal bilimlerde araştırma yöntemleri [Research methods in social sciences]. Seçkin.
• Karakuyu, A. (2023). The contribution of teachers’ program literacy on their program fidelity: Program literacy-program fidelity. International Journal of Program and Instruction, 15(3), 1785–1800.
• Küçüktepe, S. E. & Kerimoğlu, E. (2021). Evaluation of the intensive English language teaching program for the 5th grade according to teachers’ views. International Journal of Progressive Education, 17(5), 14-32. https://doi.org/10.29329/ijpe.2021.375.2
• Leathwood, C., & Phillips, D. (2000). Developing program evaluation research in higher education: Process, politics and practicalities. Higher Education, 40(3), 313–330.
• McCormick, R., & James, M. (1988). Program evaluation in school. Routledge.
• Modiba, M., & Van Rensburg, W. (2009). Cultural diversity in the classroom: Implications for program literacy in South African classrooms. Pedagogy, Culture and Society, 17(2), 177–187. https://doi.org/10.1080/14681360902934418
• Moon, B., Harris, B., & Hays, A. M. (2021). Secondary program literacy and teacher word-knowledge: Further findings from a western Australian ITE cohort study. Australian Journal of Teacher Education, 46(11), 89–109. https://doi.org/10.14221/ajte.2021v46n11.6
• National Research Council. (2011). Assessing 21st century skills: Summary of a workshop, J. A. Koenig (Ed.). National Academies.
• OECD. (2023a). PISA 2022 results (volume I): The state of learning and equity in education. OECD Publishing. https://doi.org/10.1787/53f23881-en
• OECD. (2023b). Education at a glance 2023. OECD Publishing. https://doi.org/10.1787/e13bef63-en
• Orbeyi, S., & Güven, B. (2008). Teachers’ perceptions related to the evaluation component of the education program of primary school education mathematics studies. Eğitimde Kuram ve Uygulama, 4(1), 133–147. http://eku.comu.edu.tr/article/view/1044000062
• Öner, F., & Cırık, İ. (2023). Exploring curriculum literacy skills: An in-depth analysis through explanatory sequential design. Journal of Pedagogical Research, 7(4), 165-185. https://doi.org/10.33902/JPR.202321974
• ÖYGM. (2017). Öğretmenlik mesleği ve genel yeterlilikleri [Teaching profession and general qualifications]. Öğretmen Yetiştirme Genel Müdürlüğü. http://oygm.meb.gov.tr/www/ogretmenlikmeslegi-genel yeterlikleri/icerik/39
• Özdemir, S. M. (2009). Program evaluation in education and examinatıon of the program evaluation studies in Turkey. Yüzüncü Yıl Üniversitesi Eğitim Fakültesi Dergisi, 6(2), 126–149. http://efdergi.yyu.edu.tr
• Özdemir, S. M. (2012). Metaphoric perceptions of prospective teachers regarding the concept of program. Journal of Theoretical Educational Science, 5(3), 369–393. http://www.keg.aku.edu.tr
• Özenç, M., & Çakır, M. (2015). Exploring primary school teachers’ competencies of alternative assessment and evaluation. Elementary Education Online, 14(3), 914–933. https://doi.org/10.17051/io.2015.22900
• Sağ, R., & Sezer, R. (2012). Analysis of the professional needs of the teachers of multigrade classes. İlköğretim Online, 11(2), 491–503.
• Schroeder, S., & Curcio, R. (2022). Critiquing, curating, and adapting: Cultivating 21st-century critical program literacy with teacher candidates. Journal of Teacher Education, 73(2), 129–144. https://doi.org/10.1177/00224871221075279
• Seferoğlu, S. S. (2001). Peer coaching: A new approach in the professional development of teachers. Eğitim ve Bilim, 26(119), 20–25. https://egitimvebilim.ted.org.tr/index.php/EB/article/ download/5228/1395
• Sharma, G. (2017). Pros and cons of different sampling techniques. International Journal of Applied Research, 3, 749–752. https://www.allresearchjournal.com/archives/2017/vol3issue7/PartK/3-7-69-542.pdf
• Şimşek, H., & Yıldırım, A. (2013). Sosyal bilimlerde bilimsel araştırma yöntemleri [Scientific research methods in social sciences] .Seçkin.
• Smith, O. (2015). There is an Art to teaching science in the 21st century. In X. Ge, D. Ifenthaler, & J. M. Spector (Eds.), emerging technologies for STEAM education (pp. 81–92). Springer. https://doi.org/10.1007/978-3-319-02573-5_5
• Steiner, D., Magee, J., Jensen, B., & Button, J. (2018). Program literacy in schools of education? https://jscholarship.library.jhu.edu/bitstream/handle/1774.2/62968/curriculu-literacy-in-schools-of-education-final-2911-1.pdf?sequence=1
• Süer, S., & Demirkol, M. (2023). Are primary teachers literate or not: A study program literacy of primary teachers. International Journal of Contemporary Educational Research, 10(1), 72–88. https://doi.org/10.33200/ijcer.1160273
• Süğümlü, Ü. (2022). Investigation of the relationship between program literacy and teacher performance. International Journal of Psychology and Educational Studies, 9(4), 1342–1355. https://doi.org/10.52380/ijpes.2022.9.4.948
• Tanaş, R., & Murat, T. (2023). The relationship between teachers’ program literacy skills and their program fidelity. The Journal of Educational Reflections, 7(1), 13–21. https://dergipark.org.tr/tr/pub/eduref
• Turgut, M. F. (1983). Program değerlendirme, Cumhuriyet döneminde eğitim [Program evaluation, education in the Republican period]. Milli Eğitim Basımevi.
• Yazıcıoğlu, Y., & Erdoğan, S. (2014). SPSS uygulamalı bilimsel araştırma yöntemleri [SPSS applied scientific research methods]. Detay.