Development of the rubric self-efficacy scale
Yıl 2018,
Cilt: 5 Sayı: 1, 187 - 200, 01.01.2018
Perihan Güneş
,
Özen Yıldırım
,
Miraç Yılmaz
Öz
The purpose of this study is to develop a valid and reliable measurement tool determining teachers’ self-efficacy regarding rubrics. Especially in educational environments, rubrics are measurement tools used in the assessment phase of student products usually based on higher-order thinking skills. Determination of teachers’ self-efficacy regarding rubrics can give researchers an idea on how often and how accurately teachers use such tools. For this reason, the existence of a tool accurately measuring self-efficacy variable is necessary. This study’s sample consists of 641 elementary, middle and high school teachers. To determine teachers’ self-efficacy levels regarding rubrics, 47-item draft was developed. As a result of validity and reliability analyzes, a 28-item measurement tool with a four-factor structure was obtained. The total scale’s and sub-factors’ internal consistency is quite high. Using this scale, researchers can examine the relationships between teachers’ self-efficacy and various variables that play an important role in education. In addition, comparative studies on the intended use of rubrics can be conducted by determining teachers’ self-efficacy levels regarding rubrics.
Kaynakça
- Andrade, H. G. (2005). Teaching with rubrics: The good, the bad, and the ugly. College Teaching. 53(1).
- Andrade, H. G., & Du, Y. (2005). Student perspectives on rubric-referenced assessment. Practical Assessment, Research & Evaluation, 10(3).
- Andrade, H., Wang, X., Du, Y., & Akawi, R. (2009). Rubric-referenced self-assessment and self-efficacy for writing. The Journal of Educational Research, 102(4), 287-302.
- Bandura, A. (1977). Self-efficacy: toward a unifying theory of behavioral change. Psychological Review, 84 (2), 191-215.
- Bandura, A. (1994). Self-efficacy. In V.S. Ramachaudran (Ed.), Encyclopedia of Human Behavior, (4), 71-81. New York: Academic Press.
- Brookhart, S. M. (2013). How to create and use rubrics for formative assessment and grading. Alexandria, VA: ASCD.
- Byrne, B. M. (2003). The issue of measurement invariance revisited. Journal of Cross-Cultural Psychology, 34(2), 155-175.
- Caprara, G. V., Barbaranelli, C., Steca, P., & Malone, P. S. (2006). Teachers’ self-efficacy beliefs as determinants of job satisfaction and students’ academic achievement: a study at the school level. Journal of School Psychology, 44, 473-490.
- Cronbach, L. J. (1970). Essentials of psychological testing. Harper & Row. p. 161.
- Cureton, E. E. (1966). Corrected item-test correlations. Psychometrika, 31, 93-96.
- Elias, S., & Loomis, R. (2002). Utilizing need for cognition and perceived self-efficacy to predict academic performance. Journal of Applied Social Psychology, 32(8), 1687- 1702.
- Guilford, J. P. (1953). The correlation of an item with a composite of the remaining items in a test. Educational and Psychological Measurement, 13, 87-93.
- Jerusalem, M. (2002). Theroretischer Teil - Einleitung I, Zeitschrift für Pädagogik, 44, 8-12.
- Jonsson, A. (2014). Rubrics as a way of providing transparency in assessment. Assessment & Evaluation in Higher Education, 39 (7), 840-852. doi:10.1080/02602938.2013.875117
- Kelley, T. L. (1939). The selection of upper and lower groups for the validation of test items. Journal of Educational Psychology, 30(1), 17-24.
- Likert, R. (1932). A Techniques for the measurement of attitudes. Archives of Psychology, 140, 5-53.
- Metin, M. (2013). Öğretmenlerin performans görevlerini hazırlarken ve uygularken karşılaştığı sorunlar. Kuram ve Uygulamada Eğitim Bilimleri, 13(3), 1645- 1673.
- Metin, M., & Özmen, H. (2010). Fen ve teknoloji öğretmenlerinin performans değerlendirmeye yönelik hizmet içi eğitim (HİE) ihtiyaçlarının belirlenmesi. Kastamonu Eğitim Dergisi, 18(3), 819-838.
- Moskal, B. M. (2000). Scoring rubrics: What, when and how? Practical Assesment, Research & Evaluation, 7(3),1-5.
- Özkan, Ö., Tekkaya, C., & Çakıroğlu, J. (2002). Fen bilgisi aday öğretmenlerin fen kavramlarının anlama düzeyleri, fen öğretimine yönelik tutum ve öz-yeterlik inançları. V. Ulusal Fen Bilimleri Eğitimi Kongresi, ODTÜ, Ankara.
- Panadero, E., & Jonsson, A. (2013). The use of scoring rubrics for formative assessment purposes revisited: A review. Educational Research Review, 9, 129–144. doi:10.1016/j.edurev.2013.01.002.
- Panadero, E., Jonsson, A., & Strijbos, J. W. (2016). Scaffolding self-regulated learning through selfassessment and peer assessment: Guidelines for classroom implementation. In D. Laveault & L. Allal (Eds.), Assessment for learning: Meeting the challenge of implementation (pp. 311–326). Cham: Springer International Publishing.
- Popham, W. J. (1997). What’s wrong—and what’s right—with rubrics. Educational Leadership, 55(2), 72-75.
- Popham, W. J. (2007). Classroom Assessment: What Teachers Need to Know. Pearson Education, 5th Edition, USA.
- Raykov T, Marcoulides G. A. (2006). FundamenFtals of structural equation modeling. A first course in structural equation modeling. 2nd ed. London: Lawrence Erlbaum Associates; p.1-3, 41-3.
- Reddy, Y., & Andrade, H. (2010). A review of rubric use in higher education. Assessment & Evaluation in Higher Education, 35, 435- 448. doi:10.1080/02602930902862859.
- Reynolds, J., Smith, R., Moskovitz, C., & Sayle, A. (2009). BioTAP: A Systematic Approach to Teaching Scientific Writing and Evaluating Undergraduate Theses. BioScience, 59 (10), 896–903. doi:10.1025/bio.2009.59.10.11
- Riggs, I. M. ve Enochs L. G. (1990). Toward the development of an elementary teacher’s science teaching efficacy belief instrument. Science Education, 74(6), 625-637.
- Schermelleh-Engel, K., Moosbrugger, H., & Müller, H. (2003). Evaluating the fit of structural equation models: tests of significance and descriptive goodnessof-fit measures. Methods of Psychological Research Online, 8(2), 23-74.
- Schwarzer R. (1993). General percevied self-efficacy in 14 cultures. Retrieved on 5-June 2007, at URL http://Web.Fu-Berlin.De/Gesund/Publicat/Ehpscd/Health/World14.Htm
- Tabachnick, B. G., & Fidel, L. S. (2001). Using multivariate statistics. Fourth Edition. Needham Heights, MA: Allyn & Bacon.
- Tavşancıl, E. (2005). Tutumların ölçülmesi ve SPSS ile veri analizi. Nobel Yayınları, Ankara
- Tschannen-Moran, M., Woolfolk Hoy, A., & Hoy, W. K. (1998). Teacher efficacy: Its meaning and measure. Review of Educational Research, 68, 202-248.
- Tschannen-Moran, M., & Woolfolk Hoy, A. (2001). Teacher efficacy: Capturing and elusive construct. Teaching and Teacher Education, 17, 783-805.
- Venning, J., & F. Buisman-Pijlman (2013). Integrating Assessment Matrices in Feedback Loops to Promote Research Skill Development in Postgraduate Research Projects. Assessment and Evaluation in Higher Education, 38 (5): 567–579.
- Vieira, A. L. (2011). Preparation of the analysis. Interactive LISREL in practice. 1st ed. London: Springer; p.13-4
- Wiggins, G. (1991). Standart, not standardization: Evoking quality student work. Educational Leadership. 48(5), 18-25.
- Yılmaz, M., Köseoğlu, P., Gerçek, C., Soran, H. (2004). Yabancı Dilde Hazırlanan Bir Öğretmen Öz-yeterlik Ölçeğinin Türkçeye Uyarlanması. Hacettepe Üniversitesi Eğitim Fakültesi Dergisi, 27, 260-267.
- Zimmerman, B.J. (2000). Self-Efficacy: An Essential Motive to Learn. Contemporary Educational Psychology, 25, 82–91. doi:10.1006/ceps.1999.1016
Development of the rubric self-efficacy scale
Yıl 2018,
Cilt: 5 Sayı: 1, 187 - 200, 01.01.2018
Perihan Güneş
,
Özen Yıldırım
,
Miraç Yılmaz
Öz
The
purpose of this study is to develop a valid and reliable measurement tool
determining teachers’ self-efficacy regarding rubrics. Especially in
educational environments, rubrics are measurement tools used in the assessment
phase of student products usually based on higher-order thinking skills.
Determination of teachers’ self-efficacy regarding rubrics can give researchers
an idea on how often and how accurately teachers use such tools. For this reason, the existence of a tool
accurately measuring self-efficacy variable is necessary. This study’s sample
consists of 641 elementary, middle and high school teachers. To determine
teachers’ self-efficacy levels regarding rubrics, 47-item draft was developed.
As a result of validity and reliability analyzes, a 28-item measurement tool
with a four-factor structure was obtained. The total scale’s and sub-factors’
internal consistency is quite high. Using this scale, researchers can examine
the relationships between teachers’ self-efficacy and various variables that
play an important role in education. In addition, comparative studies on the
intended use of rubrics can be conducted by determining teachers’ self-efficacy
levels regarding rubrics.
Kaynakça
- Andrade, H. G. (2005). Teaching with rubrics: The good, the bad, and the ugly. College Teaching. 53(1).
- Andrade, H. G., & Du, Y. (2005). Student perspectives on rubric-referenced assessment. Practical Assessment, Research & Evaluation, 10(3).
- Andrade, H., Wang, X., Du, Y., & Akawi, R. (2009). Rubric-referenced self-assessment and self-efficacy for writing. The Journal of Educational Research, 102(4), 287-302.
- Bandura, A. (1977). Self-efficacy: toward a unifying theory of behavioral change. Psychological Review, 84 (2), 191-215.
- Bandura, A. (1994). Self-efficacy. In V.S. Ramachaudran (Ed.), Encyclopedia of Human Behavior, (4), 71-81. New York: Academic Press.
- Brookhart, S. M. (2013). How to create and use rubrics for formative assessment and grading. Alexandria, VA: ASCD.
- Byrne, B. M. (2003). The issue of measurement invariance revisited. Journal of Cross-Cultural Psychology, 34(2), 155-175.
- Caprara, G. V., Barbaranelli, C., Steca, P., & Malone, P. S. (2006). Teachers’ self-efficacy beliefs as determinants of job satisfaction and students’ academic achievement: a study at the school level. Journal of School Psychology, 44, 473-490.
- Cronbach, L. J. (1970). Essentials of psychological testing. Harper & Row. p. 161.
- Cureton, E. E. (1966). Corrected item-test correlations. Psychometrika, 31, 93-96.
- Elias, S., & Loomis, R. (2002). Utilizing need for cognition and perceived self-efficacy to predict academic performance. Journal of Applied Social Psychology, 32(8), 1687- 1702.
- Guilford, J. P. (1953). The correlation of an item with a composite of the remaining items in a test. Educational and Psychological Measurement, 13, 87-93.
- Jerusalem, M. (2002). Theroretischer Teil - Einleitung I, Zeitschrift für Pädagogik, 44, 8-12.
- Jonsson, A. (2014). Rubrics as a way of providing transparency in assessment. Assessment & Evaluation in Higher Education, 39 (7), 840-852. doi:10.1080/02602938.2013.875117
- Kelley, T. L. (1939). The selection of upper and lower groups for the validation of test items. Journal of Educational Psychology, 30(1), 17-24.
- Likert, R. (1932). A Techniques for the measurement of attitudes. Archives of Psychology, 140, 5-53.
- Metin, M. (2013). Öğretmenlerin performans görevlerini hazırlarken ve uygularken karşılaştığı sorunlar. Kuram ve Uygulamada Eğitim Bilimleri, 13(3), 1645- 1673.
- Metin, M., & Özmen, H. (2010). Fen ve teknoloji öğretmenlerinin performans değerlendirmeye yönelik hizmet içi eğitim (HİE) ihtiyaçlarının belirlenmesi. Kastamonu Eğitim Dergisi, 18(3), 819-838.
- Moskal, B. M. (2000). Scoring rubrics: What, when and how? Practical Assesment, Research & Evaluation, 7(3),1-5.
- Özkan, Ö., Tekkaya, C., & Çakıroğlu, J. (2002). Fen bilgisi aday öğretmenlerin fen kavramlarının anlama düzeyleri, fen öğretimine yönelik tutum ve öz-yeterlik inançları. V. Ulusal Fen Bilimleri Eğitimi Kongresi, ODTÜ, Ankara.
- Panadero, E., & Jonsson, A. (2013). The use of scoring rubrics for formative assessment purposes revisited: A review. Educational Research Review, 9, 129–144. doi:10.1016/j.edurev.2013.01.002.
- Panadero, E., Jonsson, A., & Strijbos, J. W. (2016). Scaffolding self-regulated learning through selfassessment and peer assessment: Guidelines for classroom implementation. In D. Laveault & L. Allal (Eds.), Assessment for learning: Meeting the challenge of implementation (pp. 311–326). Cham: Springer International Publishing.
- Popham, W. J. (1997). What’s wrong—and what’s right—with rubrics. Educational Leadership, 55(2), 72-75.
- Popham, W. J. (2007). Classroom Assessment: What Teachers Need to Know. Pearson Education, 5th Edition, USA.
- Raykov T, Marcoulides G. A. (2006). FundamenFtals of structural equation modeling. A first course in structural equation modeling. 2nd ed. London: Lawrence Erlbaum Associates; p.1-3, 41-3.
- Reddy, Y., & Andrade, H. (2010). A review of rubric use in higher education. Assessment & Evaluation in Higher Education, 35, 435- 448. doi:10.1080/02602930902862859.
- Reynolds, J., Smith, R., Moskovitz, C., & Sayle, A. (2009). BioTAP: A Systematic Approach to Teaching Scientific Writing and Evaluating Undergraduate Theses. BioScience, 59 (10), 896–903. doi:10.1025/bio.2009.59.10.11
- Riggs, I. M. ve Enochs L. G. (1990). Toward the development of an elementary teacher’s science teaching efficacy belief instrument. Science Education, 74(6), 625-637.
- Schermelleh-Engel, K., Moosbrugger, H., & Müller, H. (2003). Evaluating the fit of structural equation models: tests of significance and descriptive goodnessof-fit measures. Methods of Psychological Research Online, 8(2), 23-74.
- Schwarzer R. (1993). General percevied self-efficacy in 14 cultures. Retrieved on 5-June 2007, at URL http://Web.Fu-Berlin.De/Gesund/Publicat/Ehpscd/Health/World14.Htm
- Tabachnick, B. G., & Fidel, L. S. (2001). Using multivariate statistics. Fourth Edition. Needham Heights, MA: Allyn & Bacon.
- Tavşancıl, E. (2005). Tutumların ölçülmesi ve SPSS ile veri analizi. Nobel Yayınları, Ankara
- Tschannen-Moran, M., Woolfolk Hoy, A., & Hoy, W. K. (1998). Teacher efficacy: Its meaning and measure. Review of Educational Research, 68, 202-248.
- Tschannen-Moran, M., & Woolfolk Hoy, A. (2001). Teacher efficacy: Capturing and elusive construct. Teaching and Teacher Education, 17, 783-805.
- Venning, J., & F. Buisman-Pijlman (2013). Integrating Assessment Matrices in Feedback Loops to Promote Research Skill Development in Postgraduate Research Projects. Assessment and Evaluation in Higher Education, 38 (5): 567–579.
- Vieira, A. L. (2011). Preparation of the analysis. Interactive LISREL in practice. 1st ed. London: Springer; p.13-4
- Wiggins, G. (1991). Standart, not standardization: Evoking quality student work. Educational Leadership. 48(5), 18-25.
- Yılmaz, M., Köseoğlu, P., Gerçek, C., Soran, H. (2004). Yabancı Dilde Hazırlanan Bir Öğretmen Öz-yeterlik Ölçeğinin Türkçeye Uyarlanması. Hacettepe Üniversitesi Eğitim Fakültesi Dergisi, 27, 260-267.
- Zimmerman, B.J. (2000). Self-Efficacy: An Essential Motive to Learn. Contemporary Educational Psychology, 25, 82–91. doi:10.1006/ceps.1999.1016