From measurement to meaning: Reconsidering test-based accountability and educational quality

Abstract

This paper systematically reviews and synthesizes the existing literature on the effects of test-based accountability systems on educational quality, student achievement, and instructional practices. The study defines the theoretical framework of educational accountability, explains the functioning of various accountability models, and discusses the role of international large-scale assessments, particularly PISA, within these processes. Findings from the literature indicate that test-based accountability has contributed to greater transparency and measurability in education systems and has stimulated student achievement. However, it has also raised significant concerns, including curriculum narrowing, teaching to the test, increased pressure on teachers, and the exacerbation of educational inequalities. Moreover, many studies emphasize that test results are strongly influenced by socioeconomic factors, which limits their validity as measures of school and teacher effectiveness. In this regard, adopting value-added accountability models may offer a more balanced approach by supporting intellectual development, creativity, and student-centered learning. Equally important is the active involvement of teachers in decision-making processes, which can reduce workload-related stress while enhancing instructional quality. In conclusion, this review consolidates fragmented research to provide a comprehensive understanding of test-based accountability. It highlights both the strengths and limitations of such systems and offers recommendations for policymakers and practitioners seeking to design more balanced, inclusive, and sustainable accountability frameworks in education.

Keywords

• Test based accountability
• Educational accountability
• Large-scale assessment
• PISA

References

1. Acar, M. (2013). Eğitim yönetiminde kuram ve uygulama [Theory and practice in educational administration]. In S. Özdemir, F. Sezgin, & S. Koşar (Eds.), Eğitimde hesap verebilirlik [Accountability in education] (pp. 385-413). Pegem Akademi.
2. Ambrosio, J. (2013). Changing the subject: Neoliberalism and accountability in public education. Educational Studies, 49(4), 316-333. https://doi.org/10.1080/00131946.2013.783835
3. Anderson, J.A. (2005). Accountability in education. International Institute for Educational Planning.
4. Au, W. (2022). Unequal by design: High-stakes testing and the standardization of inequality. Routledge. https://doi.org/10.4324/9781003005179
5. Aydoğdu, Ü.R., Karamustafaoğlu, O., & Bülbül, M.Ş. (2017). Akademik araştırmalarda araştırma yöntemleri ile örneklem ilişkisi: Doğrulayıcı doküman analizi örneği [The relationship between research methods and sampling in academic research: An example of confirmatory document analysis]. Dicle University Journal of Ziya Gökalp Education Faculty, 30(1), 556 565. https://doi.org/10.14582/DUZGEF.1803
6. Berberoğlu, G., & Kalender, İ. (2005). Öğrenci başarısının yıllara, okul türlerine, bölgelere göre incelenmesi: ÖSS ve PISA analizi [Examination of student achievement by years, school types, and regions: ÖSS and PISA analysis]. Eğitim Bilimleri ve Uygulama, 4(7), 21-35.
7. Bilgin, K.U. (2007). Kamuda ölçülebilir denetime hazırlık: Performans yönetimi [Preparing for measurable audit in the public sector: Performance management]. Sayıştay Dergisi, 65(1), 53 87. https://dergi.sayistay.gov.tr/files/4392_der65m9.pdf
8. Black, P., & Wiliam, D. (2010). Inside the black box: Raising standards through classroom assessment. Phi Delta Kappan, 92(1), 81-90. https://doi.org/10.1177/003172171009200119

9. Bozkurt, E., & Karabıyık, İ. (2003). Türk milli eğitiminde denetim sistemi sorunları ve çözüm önerileri: Türk milli eğitim teftiş sisteminde yapılanma sorunu [Problems in the supervision system of Turkish national education and proposed solutions: Structural issues in the Turkish national education inspection system]. Temsen.
10. Carnoy, M., & Loeb, S. (2002). Does external accountability affect student outcomes? A cross-state analysis. Educational Evaluation and Policy Analysis, 24(4), 305 331. https://doi.org/10.3102/01623737024004305
11. Catterall, J.S. (2012). The arts and achievement in at-risk youth: Findings from four longitudinal studies (Research Report No. 55). National Endowment for the Arts. https://www.arts.gov/sites/default/files/Arts-At-Risk-Youth.pdf
12. Chiu, M.M. (2010). Effects of inequality, family and school on mathematics achievement: Country and student differences. Social Forces, 88(4), 1645-1676. https://doi.org/10.1353/sof.2010.0019
13. Cole, S., Paulson, A., & Shastry, G.K. (2016). High school curriculum and financial outcomes: The impact of mandated personal finance and mathematics courses. Journal of Human Resources, 51(3), 656-698. https://doi.org/10.3368/jhr.51.3.0113-5410R1
14. Cook-Harvey, C.M., Darling-Hammond, L., Lam, L., Mercer, C., & Roc, M. (2016). Equity and ESSA: Leveraging educational opportunity through the Every Student Succeeds Act. Learning Policy Institute. https://learningpolicyinstitute.org/media/63/download
15. Curran, B. (1999). State accountability issues, challenges, and strategies. National Governors Association.
16. Çağlar, M., & Kılıç, A. (2017). Standart testler ile öğretmen yapımı testlerinin karşılaştırılması [Comparison of standardized tests and teacher made tests]. Eğitime Bakış, 13(40), 60 65. https://www.ebs.org.tr/storage/publication/FXxs6OkKAHhn3F1IDDmbANjYFYyZOHObxGZ0PSIv.pdf
17. Daigle, S.L., & Cuocco, P. (2002). Public accountability and higher education: Soul mates or strange bedfellows?. EDUCAUSE Center for Applied Research Bulletin, 2002(9), 1 14. https://er.educause.edu/~/media/files/articles/2004/1/erb0209.pdf
18. Darling-Hammond, L. (2006). No Child Left Behind and high school reform. Harvard Educational Review, 76(4), 642-667. https://doi.org/10.17763/haer.76.4.d8277u8778245404
19. Darling-Hammond, L. (2010). The flat world and education: How America’s commitment to equity will determine our future. Teachers College Press.
20. Dee, T.S., & Jacob, B. (2011). The impact of No Child Left Behind on student achievement. Journal of Policy Analysis and Management, 30(3), 418-446. https://doi.org/10.1002/pam.20586
21. Duke, D.L., Grogan, M., & Tucker, P.D. (2003). Educational leadership in an age of accountability. In W.F. Heinecke (Ed.), Educational leadership in an age of accountability: The Virginia experience (pp. 198-214). State University of New York Press.
22. Erwin, B., & Bloomquist, L. (2024). 50-state comparison: School accountability systems. Education Commission of the States. https://www.ecs.org/50-state-comparison-school-accountability-systems-2024/
23. Froese-Germain, B. (2010). The OECD, PISA and the impacts on educational policy. Canadian Teachers' Federation. https://files.eric.ed.gov/fulltext/ED532562.pdf
24. Fullan, M. (2011). Choosing the wrong drivers for whole system reform. Centre for Strategic Education.
25. Furman, G.C. (1994). Outcome-based education and accountability. Education and Urban Society, 26(4), 417-437. https://doi.org/10.1177/0013124594026004008
26. Gallagher, C.W. (2007). Reclaiming assessment: A better alternative to the accountability agenda. ENCOUNTER: Education for Meaning and Social Justice, 20(4), 107-112.
27. Gaertner, M.N., Kim, J., DesJardins, S.L., & McClarty, K.L. (2014). Preparing students for college and careers: The causal role of Algebra II. Research in Higher Education, 55(2), 143 165. https://doi.org/10.1007/s11162-013-9322-7
28. Gong, B. (2002). Designing school accountability systems: Towards a framework and process. Council of Chief State School Officers & Accountability Systems and Reporting. https://www.govinfo.gov/content/pkg/ERIC-ED464412/pdf/ERIC-ED464412.pdf
29. Haertel, E., & Herman, J. (2005). A historical perspective on validity: arguments for accountability testing. Yearbook of the National Society for the Study of Education, 104(2), 1 34. https://doi.org/10.1111/j.1744-7984.2005.00023.x
30. Hamilton, L.S., Stecher, B.M., & Klein, S.P. (Eds.). (2002). Making sense of test-based accountability in education. RAND Education. https://www.rand.org/content/dam/rand/pubs/monograph_reports/2002/MR1554.pdf
31. Hanushek, E.A., & Raymond, M.E. (2005). Does school accountability lead to improved student performance? Journal of Policy Analysis and Management, 24(2), 297 327. https://doi.org/10.3386/w10591
32. Harland, J., Kinder, K., Lord, P., Stott, A., Schagen, I., Haynes, J., & Paola, R. (2000). Arts education in secondary schools: Effects and effectiveness. National Foundation for Educational Research.
33. Herdman, E.A. (2006). Derleme makale yazımında, konferans ve bildiri sunumu hazırlamada pratik bilgiler [Guidelines for conducting a literature review and presenting conference papers]. Journal of Education and Research in Nursing, 3(1), 2-4.
34. Hesapçıoğlu, M., Bakioğlu, A., & Baltacı, R. (2001). Öğretmen eğitiminde sorumluluk ve akreditasyon [Responsibility and accreditation in teacher education]. Journal of Theory and Practice in Education, 1(1), 143-160.
35. Hetland, L., & Winner, E. (2001). The arts and academic achievement: What the evidence shows. Arts Education Policy Review, 102(5), 3-6. https://doi.org/10.1080/10632910109600008
36. The Council of Chief State School Officers (CCSSO). (2008). An implementer’s guide to growth models. https://www.isbe.net/Documents_GMWG/Implementers_guide_growth_models.pdf
37. Joensen, J.S., & Nielsen, H.S. (2009). Is there a causal effect of high school math on labor market outcomes? Journal of Human Resources, 44(1), 171-198. https://doi.org/10.3368/jhr.44.1.171
38. Kalman, M., & Gedikoğlu, T. (2014). Okul yöneticilerinin hesap verebilirliği ile örgütsel adalet arasındaki ilişkinin incelenmesi [An investigation of the relationship between school administrators’ accountability and organizational justice]. Hacettepe University Journal of Education, 29(2), 115-128.
39. Kim, J., Kim, J., DesJardins, S. L., & McCall, B. P. (2015). Completing Algebra II in high school: Does it increase college access and success? The Journal of Higher Education, 86(4), 628 662. https://doi.org/10.1080/00221546.2015.11777377
40. Lane, S. (2020). Test‐based accountability systems: The importance of paying attention to consequences. ETS Research Report Series, 2020(1), 1-22. https://doi.org/10.1002/ets2.12283
41. Leckie, G., & Goldstein, H. (2019). The importance of adjusting for pupil background in school value added models: A study of Progress 8 and school accountability in England. British Educational Research Journal, 45(3), 515-539. https://doi.org/10.1002/berj.3511
42. Leckie, G., & Prior, L. (2022). A comparison of value-added models for school accountability. School Effectiveness and School Improvement, 33(3), 431 455. https://doi.org/10.1080/09243453.2022.2032763
43. Linn, R.L. (2005). Issues in the design of accountability systems. Yearbook of the National Society for the Study of Education, 104(2), 78-98. https://doi.org/10.1111/j.1744-7984.2005.00026.x
44. Merryman, A., & Bronson, P. (2010). Nurtureshock: Why everything we thought about children is wrong. Random House.
45. Ministry of National Education. (2016). PISA 2015 ulusal raporu [PISA 2015 national report]. https://odsgm.meb.gov.tr/meb_iys_dosyalar/2023_10/09155512_PISA_2015.pdf
46. Montez, J.K., Hummer, R.A., & Hayward, M.D. (2012). Educational attainment and adult mortality in the United States: A systematic analysis of functional form. Demography, 49(1), 315 336. https://doi.org/10.1007/s13524-011-0082-8
47. Mulford, B. (2002). The global challenge: A matter of balance. Educational Management & Administration, 30(2), 123-138. https://doi.org/10.1177/02611X02030002505
48. Muñoz-Chereau, B., & Thomas, S.M. (2016). Educational effectiveness in Chilean secondary education: Comparing different ‘value added’ approaches to evaluate schools. Assessment in Education: Principles, Policy & Practice, 23(1), 26-52. https://doi.org/10.1080/0969594X.2015.1066307
49. National Research Council. (2010). Getting value out of value-added: Report of a workshop. The National Academies Press. https://doi.org/10.17226/12820
50. Nichols, S.L., & Berliner, D.C. (2007). Collateral damage: How high-stakes testing corrupts America’s schools. Harvard Education Press. https://doi.org/10.1080/15434300701776393
51. OECD. (2010). Accountability and transparency: A guide for state ownership. https://doi.org/10.1787/9789264056640-en
52. OECD. (2014). How has student performance evolved over time? (PISA in focus, No. 47). https://doi.org/10.1787/5js7q3kbkklt-en
53. OECD. (2015). A review of international large-scale assessments in education: Assessing component skills and collecting contextual data. https://doi.org/10.1787/9789264248373-en
54. Ohio Department of Education. (2009). Guide to understanding Ohio’s accountability system 2009-2010. https://www.rrcs.org/Downloads/StateReportCardGuide0910.pdf
55. Özdemir, S., Acar, M., & Bülbül, M. (2018). Eğitimde hesap verebilirlik [Accountability in education]. Pegem Akademi.
56. Özçelik, D.A. (2016). Ölçme ve değerlendirme [Measurement and evaluation]. Pegem Akademi.
57. Parsad, B. (2012). Arts education in public elementary and secondary schools: 1999-2000 and 2009-10. DIANE Publishing.
58. Phelps, R. (2000). Trends in large-scale testing outside the United States. Educational Measurement: Issues and Practice, 19(1), 11-21. https://doi.org/10.1111/j.1745-3992.2000.tb00018.x
59. Popham, W.J. (2007). Instructional insensitivity of tests: Accountability’s dire drawback. Phi Delta Kappan, 89(2), 146-150. https://doi.org/10.1177/003172170708900211
60. Popham, W.J. (2016). The ABCs of educational testing: Demystifying the tools that shape our schools. Corwin Press. https://doi.org/10.4135/9781506351520
61. Ravitch, D., & Stoehr, L.A. (2017). The death and life of the great American school system: How testing and choice are undermining education. In E. S. Shaffer (Ed.), Early learning (pp. 125-128). Routledge. https://doi.org/10.4324/9781315429977
62. Reeves, D.B. (2004). Accountability for learning: How teachers and school leaders can take charge. Association for Supervision & Curriculum Development.
63. Rolling, J.H. (2006). The arts and the creation of mind. Journal of Curriculum Studies, 38(1), 113-125. https://doi.org/10.1080/00220270500122604
64. Rudd, K., & Gillard, J. (2008). Quality education: The case for an education revolution in our schools. Australian Politics. https://australianpolitics.com/2008/08/27/education-revolution-rudd-npc.html
65. Sabol, R.F. (2013). Seismic shifts in the education landscape: What do they mean for arts education and arts education policy? Arts Education Policy Review, 114(1), 33 45. https://doi.org/10.1080/10632913.2013.744250
66. Schleicher, A. (2021). PISA gibi büyük ölçekli değerlendirmeler nasıl bir fark yaratabilir? [How can large-scale assessments like PISA make a difference?] (Ç. Çetin & S. Aslan Mutlu, Trans.). İstanbul Measurement and Evaluation Journal, 2(2), 10 19. https://istanbul.meb.gov.tr/dergi/istanbul_olcme_degerlendirme_2/mobile/index.html
67. Sahlberg, P. (2021). Finnish lessons 3.0: What can the world learn from educational change in Finland? Teachers College Press.
68. Sheridan, K.M., Veenema, S., Winner, E., & Hetland, L. (Eds.). (2022). Studio thinking 3: The real benefits of visual arts education. Teachers College Press.
69. Stiggins, R. (2005). From formative assessment to assessment for learning: A path to success in standards based schools. Phi Delta Kappan, 87(4), 324 328. https://doi.org/10.1177/003172170508700414
70. Tansel, A. (2015). Inequality of opportunities of educational achievement in Turkey over time (IZA Discussion Paper No. 9005). Institute for the Study of Labor. https://www.econstor.eu/handle/10419/110732
71. Thomas, K., Singh, P., & Klopfenstein, K. (2015). Arts education and the high school dropout problem. Journal of Cultural Economics, 39(4), 327-339. https://doi.org/10.1007/s10824-014-9238-x
72. Thompson, G. (2013). NAPLAN, MySchool and accountability: Teacher perceptions of the effects of testing. The International Education Journal: Comparative Perspectives, 12(2), 62 84. https://files.eric.ed.gov/fulltext/EJ1017709.pdf
73. Torres, R. (2021). Does test-based school accountability have an impact on student achievement and equity in education?: A panel approach using PISA (OECD Education Working Paper No. 250). OECD Publishing. https://doi.org/10.1787/0798600f-en
74. Turgut, M.F., & Baykul, Y. (2010). Eğitimde ölçme ve değerlendirme [Measurement and evaluation in education] (2nd ed.). Pegem Akademi.
75. TÜSİAD, & TÖDER (2012). PISA 2012 Değerlendirmesi: Türkiye için veriye dayalı eğitim reformu önerileri [PISA 2012 Assessment: Evidence-based education reform recommendations for Turkey]. TÜSİAD.
76. UNESCO Institute for Statistics. (2018). The impact of large-scale assessments on education policy: A synthesis of evidence from 13 country case studies. UNESCO. https://uis.unesco.org/sites/default/files/documents/impact-large-scale-assessments-2018-en.pdf
77. Ülkü, S., & Atar, B. (2023). Investigation of measurement invariance of Turkish subtest on ABIDE 2016 in relation to characteristics of teachers: Sub-sampling method. Journal of Measurement and Evaluation in Education and Psychology, 14(2), 154-170. https://doi.org/10.21031/epod.1084985
78. Volante, L. (2006). An alternative vision for large-scale assessment in Canada. Journal of Teaching and Learning, 4(1). https://doi.org/10.22329/jtl.v4i1.89
79. Winner, E., Hetland, L., Veenema, S., Sheridan, K., & Palmer, P. (2006). Studio thinking: How visual arts teaching can promote disciplined habits of mind. In P. Locher, C. Martindale, & L. Dorfman (Eds.), New directions in aesthetics, creativity, and the arts (pp. 189-206). Routledge.
80. Woods, C.S., Park, T., Hu, S., & Bertrand Jones, T. (2018). How high school coursework predicts introductory college level course success. Community College Review, 46(2), 176 196. https://doi.org/10.1177/0091552118759419
81. Watts, J.A., Gaines, G.F., & Creech, J.D. (1998). Getting results: A fresh look at school accountability. Southern Regional Education Board.
82. Yalçın, K. (2011). Almanya ve Türkiye’de 2003-2006-2009 PISA araştırma sonuçlarına göre alınan önlemler ve uygulamalar [Precautions and applications according to 2003-2006-2009 PISA research results in Germany and Turkiye]. Türk Kütüphaneciliği, 25(4), 494-508.
83. Yıldırım, Ö. (2021). Geniş ölçekli testlerde madde yapıları ve hazırlanmasında dikkat edilmesi gerekenler (PISA ve TIMSS) örnekleri [Considerations in the construction and preparation of item structures in large-scale assessments (examples from PISA and TIMSS)]. İstanbul Ölçme Değerlendirme Dergisi, 2, 50 59. https://istanbul.meb.gov.tr/dergi/istanbul_olcme_degerlendirme_2/mobile/index.html
84. Zahm, K. (2020). Teacher accountability and professional stress: A policy analysis. Educational Policy Journal, 34(3), 245-263.
85. Zülfüoğlu, Ö., & Koçak, H. (2017). Need for education reforms in Turkey: An assessment of PISA results. In A.M. Çilingirtürk, A.A.-Słocińska, & B.B. Bali (Eds.), Economics, management, and econometrics: Education systems and reform (pp. 55-76). IJOPEC Publication.