How valid and reliable are teachers’ assessments of gifted students?

Yıl 2025, Cilt: 12 Sayı: 1, 45 - 61

Sümeyye Arkan , Sema Tan

https://doi.org/10.21449/ijate.1472939

Öz

Teachers' perceptions, attitudes, and opinions about students, curricula, or evaluation methods contribute to the development of students’ talents. Thus, researchers often collect data from teachers to identify gifted students, determine educational practices to meet the students’ needs and assess gifted education programs. Researchers often develop measurement tools or utilize existing ones to collect valid and reliable data from teachers. This systematic literature review screened online databases to investigate measurement tools for teachers developed from 2017 to 2024. We combined the keywords “scale”, “instrument”, “questionnaire”, “inventory”, “gifted,” and "teacher" to screen Web of Science (WoS) and Scopus databases. We categorized the measurement tools based on their intended use and analyzed seventeen instruments across themes including identification/nomination, attitude-behavior-perception, and knowledge and opinion. Nearly half of these studies employed exploratory or confirmatory factor analysis for construct validity, although some relied on the more superficial face validity. Overall, the studies demonstrated high reliability and validity, but simple analyses should be repeated to further enhance the robustness of measurement instruments.

Anahtar Kelimeler

Questionnaire, Scale, Systematic literature review, Teacher evaluation.

Kaynakça

• Acar, S., Sen, S., & Cayirdag, N. (2016). Consistency of the performance and nonperformance methods in gifted identification: A multilevel meta-analytic review. Gifted Child Quarterly, 60(2), 81–101. https://doi.org/10.1177/0016986216634438
• Akgül, G. (2021). Teachers’ metaphors and views about gifted students and their education. Gifted Education International, 37(3), 273 289. https://doi.org/10.1177/0261429421988927
• Aljughaiman, A.M., & Ayoub, A.E.A. (2017). Giftedness in Arabic environments: Concepts, implicit theories, and the contributed factors in the enrichment programs. Cogent Education, 4(1), 1364900. https://doi.org/10.1080/2331186X.2017.1364900
• Al-Mamari, S.S., Al-Zoubi, S.M., Bakkar, B.S., & Al-Mamari, K.H. (2020). Effects of a training module on omani teachers’ awareness of gifted students with learning disabilities. Journal of Education and E Learning Research, 7(3), 300 305. https://doi.org/10.20448/journal.509.2020.73.300.305
• Al-Mamari, S.S., Al-Zoubi, S.M., Bakkar, B.S., Al-Mamari, K.H. (2020). Effects of a training module on Omani teachers' awareness of gifted students with learning disabilities. Journal of Education and e-Learning Research, 7(3), 300- 305.
• Alnaim, F.A. (2023). The services provided to students with attention deficit hyperactivity disorder in primary schools from the special education teachers’ perspectives. International Journal of Learning, Teaching and Educational Research, 12(4), 20 42. https://doi.org/10.36941/jesr-2022-0107
• Alshammaria, M.M., & Rababahb, A.A. (2019). Developing a scale for teachers to identify gifted students with learning disabilities in the primary stage in the eastern province of Saudi Arabia. International Journal of Innovation, Creativity and Change, 8(4), 128-154.
• American Psychological Association. (2020). Publication manual of the American Psychological Association (7th ed.). https://doi.org/10.1037/0000165-000
• American Educational Research Association, American Psychological Association, & National Council on Measurement in Education (Eds.). (2014). Standards for educational and psychological testing. American Educational Research Association.
• Bildiren, A., & Kargın, T. (2019). Proje temelli yaklaşıma dayalı erken müdahale programının üstün yetenekli çocukların problem çözme becerisine etkisi [The effect of early intervention programme based on project-based approach on gifted children's problem-solving skills]. Education and Science, 44(198), 343 360. http://doi.org/10.15390/EB.2019.7360
• Cao, T.H., Jung, J.Y., & Lee, J. (2017). Assessment in gifted education: A review of the literature from 2005 to 2016. Journal of Advanced Academics, 28(3), 163-203.
• Cheung, A.C.K., Shek, D.T.L., Hui, A.N.N., Leung, K.H., & Cheung, R.S.H. (2022). Professional development for teachers of gifted education in Hong Kong: Instrument validation and training effectiveness. International Journal of Environmental Research and Public Health, 19(15), 9433. https://doi.org/10.3390/ijerph19159433
• Cook, D.A. and West, C.P. (2012). Conducting systematic reviews in medical education: a stepwise approach. Medical Education, 46(10), 943-952. https://doi.org/10.1111/j.1365-2923.2012.04328.x
• Dağlıoğlu, H.E, Ömeroğlu, E., Turupcu Doğan, A., Şahin, M.G., Sarıcı Bulut, S., Sabancı, O., ... Karataş, S. (2019). The reliability and validity study of ‘classroom practices in inclusive preschool education environment with talented and gifted children scale. Pegem Journal of Education and Instruction, 9(2), 413 434. http://doi.org/10.14527/pegegog.2019.013
• Dai, D.Y., Swanson, J.A., & Cheng, H. (2011). State of research on giftedness and gifted education: A survey of empirical studies published during 1998—2010 (April). Gifted Child Quarterly, 55(2), 126–138. https://doi.org/10.1177/0016986210397831
• Dersch, A.S., Heyder, A. & Eitel, A. (2022). Exploring the nature of teachers’ math-gender stereotypes: The math-gender misconception questionnaire. Frontier in Psychology, 13, 820254. https://doi.org/10.3389/fpsyg.2022.820254
• Dixon-Woods, M. (2016). Systematic reviews and qualitative studies. D, Silverman (Ed.), Qualitative Research (4th ed.). Sage.
• Farah, Y.N., & Chandler, K.L. (2018). Structured observation instruments assessing instructional practices with gifted and talented students: A review of the literature. Gifted Child Quarterly, 62(3), 276–288. https://doi.org/10.1177/0016986218758439
• Gagné, F., & Nadeau, L. (1991). Opinions about the gifted and their education. Unpublished instrument.
• Goddard, C., & Evans, D. (2018). Primary pre-service teachers' attitudes towards inclusion across the training years. Australian Journal of Teacher Education, 43(6), 122-142. https://doi.org/10.14221/ajte.2018v43n6.8
• Güngör, D. (2016). Psikolojide ölçme araçlarının geliştirilmesi ve uyarlanması kılavuzu [Guide to the development and adaptation of measurement instruments in psychology]. Turkish Psychology Writings, 19(38), 104-112.
• Idsøe, E., Campbell, J., Idsøe, I., & Størksen, I. (2021). Development and psychometric properties of nomination scales for high academic potential in early childhood education and care. European Early Childhood Education Research Journal, 1 14. https://doi.org/10.1080/1350293X.2021.2007969
• Jarrah, A.M., & Almarashdi, H.S. (2019). Mathematics teachers’ perceptions of teaching gifted and talented learners in general education classrooms in the UAE. Journal for the Education of Gifted Young Scientists, 7(4), 835 847. http://doi.org/10.17478/jegys.628395
• Jarosewich, T., Pfeiffer, S.I., & Morris, J. (2002). Identifying gifted students using teacher rating scales: A review of existing instruments. Journal of Psychoeducational Assessment, 20(4), 322–336. https://doi.org/10.1177/073428290202000401
• Kandemir, M.A., Tezci, E., Shelley, M., & Demirli, C. (2019). Measurement of creative teaching in mathematics class. Creativity Research Journal, 31(3), 272 283. https://doi.org/10.1080/10400419.2019.1641677
• Karakoç, F.Y.& Dönmez, L. (2014). Ölçek geliştirme çalışmalarında temel ilkeler [Basic principles of scale development]. World of Medical Education, 13(40), 39-49.
• Kaufman, J.C., Plucker, J.A., & Russell, C.M. (2012). Identifying and assessing creativity as a component of giftedness. Journal of Psychoeducational Assessment, 30(1), 60–73. https://doi.org/10.1177/0734282911428196
• Kim, M. (2016). A meta-analysis of the effects of enrichment programs on gifted students. Gifted Child Quarterly, 60(2), 102-116. https://doi.org/10.1177/0016986216630607
• Knekta, E., Runyon, C., & Eddy, S. (2019). One size doesn't fit all: using factor analysis to gather validity evidence when using surveys in your research. CBE life sciences education, 18(1). https://doi.org/10.1187/cbe.18-04-0064
• Laine, S., Hotulainen, R., & Tirri, K. (2019). Finnish elementary school teachers’ attitudes toward gifted education. Roeper Review, 41(2), 76 87. https://doi.org/10.1080/02783193.2019.1592794
• Lockwood, A.B., Farmer, R.L., Bohan, K.J., Winans, S., & Sealander, K. (2021). Academic achievement test use and assessment practices: A national survey of special education administrators. Journal of Psychoeducational Assessment, 39(4), 436 451. https://doi.org/10.1177/0734282920984290
• Maison, D., Astalini, D., Agus, K., & Sumaryanti, R.P. (2020). Supporting assessment in education: E-assessment interest in physics. Universal Journal of Educational Research, 8(1), 89- 97. https://doi.org/10.13189/ujer.2020.080110
• McCoach, D.B., & Siegle, D. (2007). What predicts teachers’ attitudes toward the gifted? Gifted Child Quarterly, 51(3), 246-254. https://doi.org/10.1177/0016986207302719
• Nel, N., Muller, H., Hugo, A., Helldin, R., Bãckmann, Õ., Dwyer, H., & Skarlind, A. (2011). A comparative perspective on teacher attitude-constructs that impact on inclusive education in South Africa and Sweden. South African Journal of Education, 31(1), 74-90.
• Nunnally, J.C. (1978). Psychometric theory. 2nd Edition, McGraw-Hill.
• Österling, L., & Christiansen, I. (2022). Whom do they become? A systematic review of research on the impact of practicum on student teachers’ affect, beliefs, and identities. International Electronic Journal of Mathematics Education, 17(4), em0710. https://doi.org/10.29333/iejme/12380
• Palacios Gonzalez, P., & Jung, J.Y. (2021). The predictors of attitudes toward acceleration as an educational intervention: Primary school teachers in Mexico. High Ability Studies, 32(1), 27–49. https://doi.org/10.1080/13598139.2019.1692649
• Pajares, M.F. (1992). Teachers’ beliefs and educational research: Cleaning up a messy construct. Review of Educational Research, 62(3), 307-332.
• Park, S., Callahan, C.M., & Ryoo, J.H. (2016). Assessing gifted students’ beliefs about intelligence with a psychometrically defensible scale. Journal for the Education of the Gifted, 39(4), 288–314. https://doi.org/10.1177/0162353216671835
• Peters, S.J., & Gentry, M. (2010). Multigroup construct validity evidence of the HOPE scale: Instrumentation to identify low-income elementary students for gifted programs. Gifted Child Quarterly, 54(4), 298–313. https://doi.org/10.1177/0016986210378332
• Peters, S.J., & Gentry, M. (2013). Additional validity evidence and across-group equivalency of the HOPE teacher rating scale. Gifted Child Quarterly, 57(2), 85 100. https://doi.org/10.1177/0016986212469253
• Pfeiffer, S.I., & Jarosewich, T. (2007). The gifted rating scales-school form: An analysis of the standardization sample based on age, gender, race, and diagnostic efficiency. Gifted Child Quarterly, 51(1), 39–50. https://doi.org/10.1177/0016986206296658
• Rammstedt, B., & Bluemke, M. (2019). Measurement instruments for the social sciences. Measurement Instruments for the Social Sciences, 1(1), 1 3. https://doi.org/10.1186/s42409-018-0003-3
• Raykov, T., & Marcoulides, G.A. (2019). Thanks coefficient alpha, we still need you!, Educational and Psychological Measurement, 79(1), 200 210. https://doi.org/10.1177/0013164417725127
• Renzulli, J. (2010). Scales for Rating the Behavioral Characteristics of Superior Students: Technical and Administration Manual (3rd ed.). Routledge. https://doi.org/10.4324/9781003237808
• Sak, U., Bal Sezerel, B., Ayas, B., Tokmak, F., Özdemir, N., Demirel Gürbüz, Ş., & Öpengin, E. (2016). Anadolu Sak Zekâ Ölçeği (ASİS) uygulayıcı kitabı. Anadolu Üniversitesi ÜYEP Merkezi.
• Siegle, D., Moore, M., Mann, R.L., & Wilson, H.E. (2010). Factors that influence in-service and preservice teachers’ nominations of students for gifted and talented programs. Journal for the Education of the Gifted, 33(3), 337 360. https://doi.org/10.1177/016235321003300303
• Staff, A.I., Oosterlaan, J., van der Oord, S., Hoekstra, P.J., Vertessen, K., de Vries, R., van den Hoofdakker, B.J., & Luman, M. (2021). The validity of teacher rating scales for the assessment of ADHD symptoms in the classroom: A systematic review and meta-analysis. Journal of Attention Disorders, 25(11), 1578 1593. https://doi.org/10.1177/1087054720916839
• Al-Mamari, S.S., Al-Zoubi, S.M., Bakkar, B.S., Al-Mamari, K.H. (2020). Effects of a training module on Omani teachers' awareness of gifted students with learning disabilities. Journal of Education and e-Learning Research, 7(3), 300- 305.
• Şencan, H. (2005). Güvenilirlik ve geçerlilik [Reliability and validity]. Seçkin Publishing.
• Terzi, R. (2020). Nicel veri toplama teknikleri [Quantitative data collection techniques]. In S. Şen, & İ. Yıldırım (eds.), Eğitimde araştırma yöntemleri (2.ed, pp. 357-382), Nobel Publishing.
• Uzunboylu, H., Akçamete, G., Sarp, N., & Demirok, M. (2022). Primary school teachers’ opinions about gifted education programmes in distance education. Sustainability, 14, 17031. https://doi.org/10.3390/su142417031
• Wadaani, M. (2023). The influence of preservice education and professional development in mathematics Teachers’ attitudes toward nurturing creativity and supporting the gifted. Journal of Creativity, 33(1), 100043. https://doi.org/10.1016/j.yjoc.2023.100043
• Westphal, A., Vock, M., & Stubbe, T. (2017). Grade skipping from the perspective of teachers in Germany: The links between teachers’ decisions, acceptance, and perceived knowledge. Gifted Child Quarterly, 61(1), 73 86. https://doi.org/10.1177/0016986216670727
• Weyns, T., Preckel, F., & Verschueren, K. (2021). Teachers-in-training perceptions of gifted children’s characteristics and teacher-child interactions: An experimental study. Teaching and Teacher Education, 97, 103215. https://doi.org/10.1016/j.tate.2020.103215
• Woodcock, S. (2011). A cross-sectional study of pre-service teacher efficacy throughout the training years. Australian Journal of Teacher Education, 36(10), 23 34. https://doi.org/10.14221/ajte.2011v36n10.1
• Yetim-Karaca, S., & Türk, T. (2020). Ortaokul matematik dersi öğretim programının üstün yetenekli öğrencilerin eğitimi açısından öğretmen görüşlerine göre değerlendirilmesi [Evaluation of secondary school mathematics curriculum in terms of education of gifted students according to teachers' opinions]. Turkish Journal of Computer and Mathematics Education, 11(1), 241-279. https://doi.org/10.16949/turkbilmat.526817