Investigating Teachers’ Competencies in Using Assessment Tools Through the Many-Facet Rasch Model
Öz
The purpose of this study is to analyze teachers’ perceived competencies in using various assessment tools through the Many-Facet Rasch Model (MFRM). The study, designed as a quantitative survey included 37 volunteer teachers working in middle schools and high schools in Türkiye during the 2025–2026 academic year. Data were collected using six assessment tools: self-assessment, peer assessment, performance task, rubric, digital tools and portfolio and seven competency criteria related to the use of these tools. The research design, in which the rater, assessment tool and assessment-criterion facets were crossed, was analyzed using FACETS 4.3.1. The results indicated that the core assumptions of the Rasch model were satisfied and that model-data fit was high, supporting the comparability of the obtained measures. Findings showed that teachers’ perceived competencies vary by assessment tool. Teachers perceived themselves as less competent in self-assessment and performance tasks and these tools were positioned at higher difficulty levels. In contrast, a higher level of perceived competence was observed in portfolio use. The high separation index obtained for the rater facet indicates pronounced individual differences among teachers in terms of perceived competence. Regarding the assessment criteria, design-oriented areas, such as preparing content, integrating with learning outcomes and aligning the tool with existing learning outcomes and content, were found to be more challenging. By contrast, teachers perceived themselves as more competent in implementation and in sustaining student motivation. The findings suggest that summarizing teacher competencies with a single mean score is not sufficient. The MFRM approach, which jointly considers tool, criterion and rater variables, can reveal differentiated competency areas more clearly. Accordingly, professional development programs should be structured based on priorities identified at the tool and criterion levels.
Anahtar Kelimeler
Destekleyen Kurum
Etik Beyan
Teşekkür
Kaynakça
- Akpınar, Ş. Y., Boduroğlu, E., & Yiğiter, M. S. (2025). Examination of primary school teachers’ attitudes and self-efficacy levels towards formative assessment. Kahramanmaraş Sütçü İmam Üniversitesi Sosyal Bilimler Dergisi, 22(1), 1–12. https://doi.org/10.33437/ksusbd.1644021
- Black, P., & Wiliam, D. (1998). Assessment and classroom learning. Assessment in Education: Principles, Policy & Practice, 5(1), 7–74. https://doi.org/10.1080/0969595980050102
- Brookhart, S. M. (2024). Educational assessment knowledge and skills for teachers revisited. Education Sciences, 14(7), 751. https://doi.org/10.3390/educsci14070751
- Büyüköztürk, Ş., Akgün, Ö. E., Demirel, F., Karadeniz, Ş., & Çakmak, E. K. (2015). Bilimsel araştırma yöntemleri. Pegem Akademi.
- DeLuca, C., & Klinger, D. A. (2010). Assessment literacy development: Identifying gaps in teacher candidates’ learning. Assessment in Education: Principles, Policy & Practice, 17(4), 419–438. https://doi.org/10.1080/0969594X.2010.516643
- Eckes, T. (2015). Introduction to many-facet Rasch measurement: analyzing and evaluating rater-mediated assessments (2nd ed.). New York: Peter Lang.
- Hair, J. F., Babin, B. J., Anderson, R. E., & Black, W. C. (2019). Multivariate Data Analysis (8th ed.). Cengage Learning.
- Hambleton, R. K., & Swaminathan, H. (1985). Item response theory: Principles and applications. Kluwer-Nijhoff Publishing.
Ayrıntılar
Birincil Dil
İngilizce
Konular
Eğitimde ve Psikolojide Ölçme Teorileri ve Uygulamaları
Bölüm
Araştırma Makalesi
Yayımlanma Tarihi
30 Mart 2026
Gönderilme Tarihi
13 Şubat 2026
Kabul Tarihi
19 Mart 2026
Yayımlandığı Sayı
Yıl 2026 Cilt: 8 Sayı: 1