The use of open-ended items for giving feedback during the formative assessment process

Abstract

Feedback plays an important role in classroom learning and teaching process. This study focuses on how feedback can be more effectively used in the formative assessment process. According to this purpose, the study first discusses the concept of student achievement and presents its changing nature in the 21st century. Subsequently, the study addresses higher-order thinking skills, the use of open-ended items in improving student achievement in the classroom, rubrics, formative assessment, and feedback. The study aims to present an exemplary measurement and assessment model that will contribute to the development of student achievement. Additionally, it examines the use of a feedback approach that will improve the power of using the knowledge of the students learned in lessons in daily life by associating it with basic life skills in the formative assessment process. Accordingly, teachers are provided with a unique means that they can easily use in improving classroom success. In the study, an open-ended item has been developed that has a real-life counterpart is used to provide information on the improving of student achievement, while a rubric used in scoring the answers to the item is also developed. The answer categories in the rubric show the place of the student in the distribution of success. Thus, teachers will be able to see what students can and cannot do, as well as be able to give accurate and realistic feedback on what needs to be done for the development of student achievement.

Keywords

• Student achievement
• Formative assessment
• Feedback
• Open-ended items
• Classroom assessment
• Scoring rubric

İzlemeye dayalı durum belirleme sürecinde açık uçlu maddelerin geribildirim verme amaçlı kullanımı

Öz

Geribildirim, sınıf içi öğrenme ve öğretme sürecinde önemli bir rol oynamaktadır. Bu çalışma, geribildirimin izlemeye dayalı durum belirleme sürecinde nasıl daha etkin kullanılabileceğine odaklanmaktadır. Bu amaçla öncelikle, öğrenci başarısı kavramı ele alınmış, öğrenci başarısının 21. yüzyılda değişen anlayışı sunulmuştur. Daha sonra üst düzey düşünme becerileri, sınıf içi öğrenci başarısının geliştirilmesinde açık uçlu maddelerin kullanımı, dereceli puanlama anahtarı, izlemeye dayalı durum belirleme ve geribildirim üzerinde durulmuştur. Çalışmanın temel amacı öğrenci başarısının gelişimine katkı sağlayacak örnek bir ölçme ve durum belirleme modeli sunmaktır. Çalışmada derste öğrenilen bilgilerin, temel yaşam becerileriyle ilişkilendirilerek günlük yaşamda kullanma gücünü geliştirecek bir geribildirim verme yaklaşımının izlemeye dayalı durum belirleme sürecinde kullanımı ele alınmıştır. Bu yolla öğretmenlere sınıf içi başarının geliştirilmesinde kolaylıkla kullanabilecekleri özgün bir yol sunulmuş olacaktır. Çalışmada öğrenci başarısının gelişimi için bilgi verecek ve gerçek yaşamda karşılığı bulunan bir açık uçlu madde ile maddeye verilen yanıtların puanlanmasında kullanılan bir dereceli puanlama anahtarı da geliştirilmiştir. Puanlama anahtarındaki yanıt kategorileri öğrencinin başarı dağılımındaki yerini göstermektedir. Bu yolla öğretmenler, öğrencilerin hem neleri yaptıklarını ve yapamadıklarını görebilecekler hem de yapılması gerekenler hakkında doğru ve gerçekçi geribildirim verebileceklerdir.

Anahtar Kelimeler

• Öğrenci başarısı
• İzlemeye dayalı durum belirleme
• Geribildirim
• Açık uçlu maddeler
• Sınıf içi durum belirleme
• Dereceli puanlama anahtarı

References

1. Airasian, P.W. (2001). Classroom assessment: Concepts and applications (4th Edition). McGraw-Hill.
2. Aslanoğlu, E.A. (2022). Üst düzey zihinsel beceriler ve ölçülmesi [Higher-order thinking skills and their measurement]. In İ. Karakaya (Ed.), Açık uçlu soruların hazırlanması, uygulanması ve değerlendirilmesi [Preparation, implementation and evaluation of open-ended items] (pp. 2-25). Pegem Academy Publishing.
3. Attali, Y., & Powers, D. (2009). Immediate feedback and opportunity to revise answers to open-ended questions. Educational and Psychological Measurement, 70(1), 22 35. https://doi.org/10.1177/0013164409332231
4. Aydın, S. (2011). İlköğretim 5. sınıf matematik dersinde dereceli puanlama anahtarı kullanılarak verilen geribildirimin öğrenci başarısına etkisi [Student achievement effect of the feedback through the use of scoring rubric at the primary education fifth grade mathematics course]. [Unpublished of master's thesis, Ankara University Institute of Educational Sciences]. Publication No.: 302020. https://tez.yok.gov.tr/UlusalTezMerkezi/tezDetay.jsp?id=wjXtJlYgGAsLE 4DXujy5g&no=136vh6_P4eKb8uXAkFDqnQ
5. Badger, E., & Thomas, B. (1992). Open-ended questions in reading. Practical Assessment, Research & Evaluation, 3(4), 03-12. https://www.ericdigests.org/1993/open.htm
6. Bangert-Drowns, R.L., Kulik, C-L.C., Kulik, J.A., & Morgan, M.T. (1991). The instructional effect of feedback in test-like events. Review of Educational Research, 61(2), 213-238. https://doi.org/10.3102/00346543061002213
7. Biggs, J.B., & Watkins, D. (1996). Classroom learning: Educational psychology for the Asian teacher. Prentice Hall.
8. Black, P., & William, D. (1998). Assessment and classroom learning, assessment in education. Principles, Policy & Practice, 5(1), 7-75. http://dx.doi.org/10.1080/0969595980050102

9. Black, P., & William, D. (2002). Improved standards achieved by transforming assessment for learning. Kings College London.
10. Bloom, B.S. (1976). Human characteristics and school learning. McGraw-Hill
11. Bloom, B.S., Hastings, J.T., & Madaus, G.F. (1971). Handbook on formative and summative evaluation of student learning. Mc Graw-Hill.
12. Brookhart, S.M. (2010). How to assess higher-order thinking skills in your classroom. ASCD.
13. Brookhart, S.M. (2014). How to design questions and tasks to assess student thinking. ASCD.
14. Brookhart, S.M. (2015). Making the most of multiple choice. Educational Leadership, 73(1), 36-39. https://eric.ed.gov/?id=EJ1075062
15. Clarke, S. (2001). Unlocking formative assessment: Practical strategies for enhancing pupil’s learning in the primary classroom. Hodder & Stoughton Educational.
16. Crooks, T.J. (1988). The impact of classroom evaluation practices on students. Review of Educational Research, 58(4), 438-481. https://doi.org/10.3102/00346543058004438
17. Cutting, L.E., & Scarborough, H.S. (2006). Prediction of reading comprehension: Relative contributions of word recognition, language proficiency, and other cognitive skills can depend on how comprehension is measured. Scientific Studies of Reading, 10(1), 277-299. https://doi.org/10.1207/s1532799xssr1003_5
18. De Cecco, J.P. (1968). The psychology of learning and instruction: Educational psychology. Prentice Hull.
19. Gedye, S. (2010). Formative assessment and feedback: A review. Planet, 23(1), 40 45. https://doi.org/10.11120/plan.2010.00230040
20. Gerberich, J.R., Greene, H.A., & Jorgensen, A.N. (1962). Measurement and evaluation in the modern school. David McKay Company, Inc.
21. Goodrich, H. (1997). Understanding rubrics. Educational Leadership, 54(4), 14 17. http://www.educontinua.fciencias.unam.mx
22. Haladyna, T.M. (1997). Writing test items to evaluate higher order thinking. Viacom Company.
23. Harlen, W. (2003). Enhancing inquiry through formative assessment. Exploratorium.
24. Harlen, W. (2007). Assessment of learning. Sage Publications.
25. Harlen, W., & James, M. (1997). Assessment and learning: Differences and relationships between formative and summative assessment. Assessment in Education: Principles, Policy & Practice, 4(3), 365-379. https://doi.org/10.1080/0969594970040304
26. Jonsson A., & Svingby, G. (2007). The use of scoring rubrics: Reliability, validity and educational consequences. Educational Research Review, 2(2), 130 144. https://doi.org/10.1016/j.edurev.2007.05.002
27. Karakaya, İ., & Şata, M. (2022). Açık uçlu maddeler [Open-ended items]. In İ. Karakaya (Ed.), Açık uçlu soruların hazırlanması, uygulanması ve değerlendirilmesi [Preparation, implementation and evaluation of open-ended items] (pp. 28-37). Pegem Academy Publishing.
28. Kintsch, W., & Yarbrough, J.C. (1982). Role of rhetorical structure in text comprehension. Journal of Educational Psychology, 74(1), 828 834. https://doi.org/10.1037/0022 0663.74.6.828
29. Koç, N. (1978). Liselerde öğrencilerin akademik başarılarının değerlendirilmesi uygulamalarının etkinliğine ilişkin bir araştırma [A research on the effectiveness of the applications of evaluating the academic achievement of students in high schools]. Education and Science, 3(14), 28-36. http://egitimvebilim.ted.org.tr/index.php/EB/article/view/5629
30. Kubiszyn, T., & Borich, G. (2003). Educational testing and measurement: Classroom application and practice (7th Edition). John Wiley & Sons, Inc.
31. Kuh, G.D., Kinzie, J., Buckley, J.A., Bridges, B.K., & Hayek, J.C. (2006). What matters to student success: A review of the literature. Commissioned Report for the National Symposium on Postsecondary Student Success: Spearheading a Dialog on Student Success. National Postsecondary Education Cooperative. https://nces.ed.gov/npec/pdf/kuh_team_report.pdf
32. Kulhavy, R.W. (1977). Feedback in written instruction. Review of Educational Research, 47(1), 211-232. https://doi.org/10.3102/00346543047002211
33. Kulhavy, R.W., & Stock, W.A. (1989). Feedback in written instruction: The place of response certitude. Educational Psychology Review, 1, 279 308. https://doi.org/10.1007/BF01320096
34. Kulhavy, R.W., Yekovich, F.R., & Dyer, J.W. (1976). Feedback and response confidence. Journal of Educational Psychology, 68(5), 522 528. https://doi.org/10.1037/0022 0663.68.5.522
35. Kutlu, Ö. (2004). Tek soruyla öğrenci performansının belirlenmesi [Assessing student performance with a single question]. Eğitimde İyi Örnekler Konferansı. Sabancı Üniversitesi, İstanbul.
36. Kutlu, Ö., Yalçın, S., & Pehlivan, E.B. (2010). İlköğretim programında yer alan kazanımlara dayalı soru yazma ve puanlama çalışması [A study on writing and scoring open-ended questions based on the primary school curriculum objectives]. Elementary Education Online, 9(3), 1201-1215. https://dergipark.org.tr/tr/pub/ilkonline/issue/8594/106904
37. Kutlu, Ö., Doğan, C.D., & Karakaya, İ. (2017). Ölçme ve değerlendirme: Performansa ve portfolyoya dayalı durum belirleme [Measurement and evaluation: Performance and portfolio-based assessment] (5th Edition). Pegem Academy Publishing.
38. Kutlu Ö., & Kula-Kartal, S. (2018). The prominent student competencies of the 21st-century education and the transformation of classroom assessment. International Journal of Progressive Education 14(6), 70-82. https://doi.org/10.29329/ijpe.2018.179.6
39. Kutlu, Ö., Altıntaş, Ö., Özyeter, N.T., Alpayar, Ç., & Kula-Kartal, S. (2019). Okuduğunu anlama becerisinin ölçülmesi ve değerlendirilmesi. [Measurement and evaluation of reading comprehension skills]. Ankara University Printing House.
40. Kutlu, Ö., & Altıntaş, Ö. (2021). Psikolojik ölçmelerin kısa tarihi ve 21. yüzyılda sınıf içi durum belirleme anlayışı [A brief history of psychological measurements and an approach of classroom assessment in the 21st century]. Trakya Journal of Education, 11(3), 1599-1620. https://doi.org/10.24315/tred.896121
41. Marzano, R.J. (1992). A different kind of classroom: Teaching with dimensions of learning. The Association for Supervision and Curriculum Development.
42. McMillan, J.H. (2007). Classroom assessment: Principles and practice for effective standards-based instruction (4th Edition). Pearson Education, Inc.
43. Metin, M., & Özmen, H. (2010). Biçimlendirici değerlendirmeye yönelik öğretmen adaylarının düşünceleri [Prospective teachers’ views about formative assessment]. Milli Eğitim, 187, 293-310. https://dergipark.org.tr/tr/download/article-file/442743
44. Miller, D.M., Linn, R.L., & Gronlund N.E. (2008). Measurement and assessment in teaching (10th Edition). Prentice-Hall Inc.
45. Nitko, A.J. (2001). Educational assessment of students (3rd Edition). Upper Saddle River.
46. Özçelik, D.A. (2014). Eğitim programları ve öğretim: Genel öğretim yöntemi [Curriculum and teaching: General teaching method] (3rd Edition). Pegem Academy Publishing.
47. Popham, W.J. (2000). Modern educational measurement: Practical guidelines for educational leaders (3rd Edition). Allyn and Bacon.
48. Popham, W.J. (2008). Classroom assessment. Allyn and Bacon.
49. Reiner, C.M., Bothell, T.W., Sudweeks, R.R., & Wood, B. (2002). Preparing effective essay questions: A self directed workbook for educators. New Forums Press. https://testing.byu.edu/handbooks/WritingEffectiveEssayQuestions.pdf
50. Sabilah, I., & Manoy, J.T. (2018). The use of open-ended questions with giving feedback (OEQGF) for effective mathematic learning. Journal of Physics: Conference Series, 947 012032. https://doi.org/10.1088/1742-6596/947/1/012032
51. Shute, V.J. (2008). Focus on formative feedback. Review of Educational Research, 78(1), 153-189. https://doi.org/10.3102/0034654307313795
52. Stiggins, R.J. (1994). Student centered classroom assessment. Macmillan Publishing Company.
53. Stiggins, R.J. (2002). Assessment crisis: The absence of assessment for learning. Phi Delta Kappan, 83(10), 758-765. https://doi.org/10.1177/003172170208301010
54. Stiggins, R.J. (2005). From formative assessment to assessment for learning: A path to success in standards based schools. The Phi Delta Kappan, 87(4), 324 328. https://doi.org/10.1177/003172170508700414
55. Stiggins, R.J., & Conklin, N. (1992). In teachers’ hands: Investigating the practices of classroom assessment. State University of New York Press.
56. Şahin, E. (2019). Sosyal Bilgiler 6 ders kitabı [Social Studies 6th grade textbook]. Anadol Publishing.
57. TDK. (n.d.). Türk Dil Kurumu sözlükleri [Turkish Language Association dictionaries]. https://sozluk.gov.tr
58. Thorndike, R.M. (2005). Measurement and evaluation in psychology and education (7th Edition). Pearson Education, Inc.
59. Torrance, H., & Pryor, J. (1998). Investigating formative assessment: Teaching, learning, and assessment in the classroom. Open University Press.
60. Wolman, B. (1973). Dictionary of behavioral science. Van Nostrand Company.
61. York, T.T., Gibson, C., & Rankin, S. (2015). Defining and measuring academic success. Practical Assessment, Research, and Evaluation, 20(5), 1-20. https://doi.org/10.7275/hz5x-tx03