A comparison of Turkish and European English language teachers’ language assessment knowledge levels and perceptions

Abstract

Language assessment knowledge, the capacity of language instructors to skillfully design, construct, and assess language evaluations, is pivotal for effective language education. This study investigates the language assessment knowledge, encompassing both general and skill-specific aspects, of in-service language educators from Europe and Türkiye. The primary objective is to contrast the language assessment knowledge of these two groups, highlighting potential differences in their assessment knowledge in terms of general and four language skills. Employing a mixed-methods approach, data were gathered sequentially via quantitative scale and qualitative online interviews. A total of 94 language teachers, 48 from Turkey and 46 from diverse European countries took part in this research. They completed the Language Assessment Knowledge Scale, and eight instructors engaged in semi-structured online interviews. The participants were selected using convenience sampling. The results indicated that while both groups scored above the average and were considered assessment literate, European language teachers had a significantly higher level of LAK compared to Turkish language teachers. This suggests that European teachers possess greater proficiency and competence in language assessment, potentially influencing the quality of the assessments they create and assess. Considering the importance of assessment knowledge mentioned in numerous studies, despite the limited sample size of this study, its results are important for the professional development of language educators. These outcomes can inform the development of teacher training programs, particularly for Turkish educators. The Ministry of National Education may consider prioritizing assessment-related subjects, such as assessing the four language skills, in future in-service teacher training initiatives.

Keywords

• Language assessment knowledge
• Language assessment literacy
• Assessing language skills
• EFL teachers

References

1. Altan, M.Z. (2017). Globalization, English language teaching & Türkiye. International Journal of Languages’ Education, 5(4), 764–776. https://doi.org/10.18298/ijlet.2238
2. Bachman, L.F. (1990). Fundamental considerations in language testing. Oxford University Press.
3. Bachman, L.F. (2004). Statistical analyses for language assessment book (Cambridge Language Assessment). Cambridge University Press.
4. Bonnet, G. (2007). The CEFR and education policies in Europe. The Modern Language Journal, 91(4), 669–672. https://doi.org/10.1111/j.1540-4781.2007.00627_7.x
5. Boyles, P. (2005). Assessment literacy. In M. Rosenbusch (Ed.), National assessment summit papers (pp. 18–23). Iowa State University.
6. Brown, H.D. (2000). Principles of language learning and teaching. Longman.
7. Büyükkarcı, K. (2014). Assessment beliefs and practices of language teachers in primary education. International Journal of Instruction, 7(1), 107-120.
8. Büyükkarcı, K. (2016). Identifying the areas for English language teacher development: A study of assessment literacy. Pegem Journal of Education and Instruction, 6(3), 333–346. https://doi.org/10.14527/pegegog.2016.017

9. Cheng, L., & Fox, J. (2017). Assessment in the language classroom: Teachers supporting student learning (Applied linguistics for the language classroom) (1st ed. 2017). Springer.
10. Cheng, L., Rogers, T., & Hu, H. (2004). ESL/EFL instructors’ classroom assessment practices: Purposes, methods, and procedures. Language Testing, 21(3), 360 389. https://doi.org/10.1191/0265532204lt288oa
11. Clapham, C. (2000). Assessment and testing. Annual Review of Applied Linguistics, 20, 147–161. https://doi.org/10.1017/s0267190500200093
12. Cohen, L., Manion, L., & Morrison, K. (2018). Research methods in education. Routledge.
13. Colby, D.C. (2010). Using “Assessment for learning” practices with pre-university level ESL students: A mixed methods study of teacher and student performance and beliefs [PhD Dissertation]. McGill University, Montreal.
14. Coombe, C. (2018). An A to Z of second language assessment: How language teachers understand assessment concepts. British Council.
15. Cowan, J. (1998). On becoming an innovative university teacher. RHE & Open University Press.
16. Creswell, J.W. (2014). Research design: Qualitative, quantitative, and mixed methods approaches. SAGE Publications.
17. Creswell, J.W., & Clark, V.L.P. (2007). Designing and conducting mixed methods research. SAGE Publications.
18. Çakır, N. (2020). A comparative analysis of teachers’ beliefs and practices on the assessment of 4th grade-EFL students in Türkiye, Italy and Finland [MA thesis]. Uludağ University, Bursa.
19. Çetin-Argün, B. (2020). Language assessment knowledge of preservice teachers of English as a foreign language [MA Thesis]. Çağ University, Mersin.
20. Davies, A. (2008). Textbook trends in teaching language testing. Language Testing 25(3), 327–347. https://doi.org/10.1177/0265532208090156
21. DeLuca, C., & Klinger, D.A. (2010). Assessment literacy development: Identifying gaps in teacher candidates’ learning. Assessment in Education: Principles, Policy & Practice, 17(4), 419–438. https://doi.org/10.1080/0969594X.2010.516643
22. DeLuca, C., LaPointe-McEwan, D., & Luhanga, U. (2015). Teacher assessment literacy: A review of international standards and measures. Educational Assessment, Evaluation and Accountability, 28(3), 251–272. https://doi.org/10.1007/s11092-015-9233-6
23. Douglas, D. (2009). Understanding language testing (1st ed.). Routledge.
24. EF EPI (2022). EF English Proficiency Index. The world’s largest ranking of countries and regions by English skills. https://www.ef.com/wwen/epi/
25. Fox, J. (2016). Using portfolios for assessment/alternative assessment. In E. Shohamy, I. Or, & S. May (Eds.), Language testing and assessment. Encyclopedia of language and education (3rd ed., pp. 135-147). Springer. https://doi.org/10.1007/978-3-319- 02261-1_9
26. Fulcher, G. (2012). Assessment literacy for the language classroom. Language Assessment Quarterly, 9(2), 113–132. https://doi.org/10.1080/15434303.2011.642041
27. Genç, E., Çalışkan, H., & Yüksel, D. (2020). Language assessment literacy level of EFL teachers: A focus on writing and speaking assessment knowledge of the teachers. Sakarya University Journal of Education, 10(2), 274-291. https://doi.org/10.19126/suje.626156
28. Giraldo, F. (2018). Language assessment literacy: Implications for language teachers. Profile: Issues in Teachers´ Professional Development, 20(1), 179 195. https://doi.org/10.15446/profile.v20n1.62089
29. Giraldo, F. (2021). A reflection on initiatives for teachers’ professional development through language assessment literacy. Profile: Issues in Teachers’ Professional Development, 23(1), 197–213. https://doi.org/10.15446/profile.v23n1.83094
30. Gkogkou, E., & Kofou, I. (2021). A toolkit for the investigation of Greek EFL teachers’ assessment literacy. Languages, 6(188), 1-27. https://doi.org/10.3390/languages6040188
31. Gotch, C.M., & French, B.F. (2014). A systematic review of assessment literacy measures. Educational Measurement: Issues and Practice, 33(2), 14 18. https://doi.org/10.1111/emip.12030
32. Green, A. (2013). Exploring language assessment and testing: Language in action. Routledge.
33. Harding, L., & Kremmel, B. (2016). Teacher assessment literacy and professional development. Handbook of Second Language Assessment, 413 428. https://doi.org/10.1515/9781614513827-027
34. Hatipoğlu, Ç. (2010). Summative evaluation of an English language testing and evaluation course for future English language teachers in Türkiye. English Language Teacher Education and Development (ELTED), 13, 40 51. http://www.elted.net/uploads/7/3/1/6/7316005/v13_5hatipoglu.pdf.
35. Hatipoğlu, Ç. (2015). English language testing and evaluation (ELTE) training in Türkiye: expectations and needs of pre-service English language teachers. ELT Research Journal, 4(2), 111–128. https://dergipark.org.tr/en/download/article-file/296302
36. Heaton, J.B. (1989). Writing English language tests (Longman handbooks for language teachers). Longman Pub Group.
37. Herrera, L. & Macías, D. (2015). A call for language assessment literacy in the education and development of teachers of English as a foreign language. Colombian Applied Linguistics Journal, 17(2), 302-312. https://doi.org/10.14483/udistrital.jour.calj.2015.2.a09
38. Hughes, A. (2003). Testing for language teachers (2nd ed.). Cambridge University Press.
39. Inbar-Lourie, O. (2008). Constructing a language assessment knowledge base: A focus on language assessment courses. Language Testing, 25(3), 385 402. https://doi.org/10.1177/0265532208090158
40. Inbar-Lourie, O. (2017). Language assessment literacy. In E. Shohamy, L. Or, & S. May (Eds.), Language testing and assessment (pp. 257-270). Springer International Publishing AG. https://doi.org/10.1007/978-3-319-02261-1_19
41. Jannati, S. (2015). ELT teachers’ language assessment literacy: Perceptions and practices. The International Journal of Research in Teacher Education, 6(2), 26-37.
42. Jones, N.D., & Saville, N. (2009). European language policy: Assessment, learning, and the CEFR. Annual Review of Applied Linguistics, 29, 51 63. https://doi.org/10.1017/s0267190509090059
43. Kaya, T., & Mede, E. (2015). Exploring language assessment literacy of EFL instructors in language preparatory programs. İstanbul Aydın University Journal of Education Faculty, 7(1), 163–189. https://doi.org/10.17932/iau.efd.2015.013/efd_v07i008
44. Kırkgöz, Y., Babanoğlu, M.P., & Ağçam, R. (2018). Turkish EFL teachers’ perceptions and practices of foreign language assessment in primary education. Journal of Education and E-learning Research, 4(4), 163–170.
45. Kim, A.A. (2014). Examining how teachers’ beliefs about communicative language teaching affect their instructional and assessment practices: A qualitative study of EFL University instructors in Colombia. RELC Journal, 45(3), 337 354. https://doi.org/10.1177/0033688214555396
46. Krajka, J. (2019). L1 use in language tests: Investigating cross-cultural dimensions of language assessment. Journal of Intercultural Management, 11(2), 107 133. https://doi.org/10.2478/joim-2019-0011
47. Lam, R. (2015). Language assessment training in Hong Kong: Implications for language assessment literacy. Language Testing, 32(2), 169 197. https://doi.org/10.1177/0265532214554321
48. Lor, P. (2019). International and comparative librarianship: Concepts and methods for global studies. De Gruyter Saur. https://doi.org/10.1515/9783110267990
49. Malone, M. (2011). Assessment literacy for language educators. CALDigest, October, pp. 1-2.
50. Mede, E., & Atay, D. (2017). English language teachers’ assessment literacy: The Turkish context. Dil Dergisi, 168(1), 43–60. https://doi.org/10.1501/dilder_0000000237
51. Mertler, C.A. (2003). Pre-service versus in-service teachers’ assessment literacy: Does classroom experience make a difference? [Paper Presentation]. Annual Meeting of the Mid‐Western Educational Research Association, Columbus, OH, USA.
52. Mertler, C.A., & Campbell, C. (2005). Measuring teachers' knowledge & application of classroom assessment concepts: Development of the "Assessment Literacy Inventory" [Paper Presentation]. Annual Meeting of the American Educational Research Association, Montreal, Quebec, Canada.
53. Mohan, R. (2022). Measurement, evaluation and assessment in education (1st ed.). PHI Learning PVT. LTD.
54. Nagai, N., Birch, G.C., Bower, J.V., & Schmidt, M.G. (2020). CEFR-informed learning, teaching and assessment: A practical guide (Springer Texts in Education) (1st ed. 2020 ed.). Springer.
55. O’Loughlin, K. (2006). Learning about second language assessment: Insights from a postgraduate student on-line subject forum. University of Sydney Papers in TESOL, 1, 71–85.
56. Ölmezer-Öztürk, E., & Aydin, B. (2018). Toward measuring language teachers’ assessment knowledge: Development and validation of Language Assessment Knowledge Scale (LAKS). Language Testing in Asia, 8(1). https://doi.org/10.1186/s40468-018-0075-2
57. Ölmezer-Öztürk, E., & Aydın, B. (2019). Voices of EFL teachers as assessors: Their opinions and needs regarding language assessment. Journal of Qualitative Research in Education, 7(1), 373-390. doi:10.14689/issn.21482624.1.7c1s.17m
58. Popham, W.J. (2011). Assessment literacy overlooked: A teacher educator's confession. The Teacher Educator, 46(4), 265-273.
59. Rogier, D. (2014). Assessment literacy: Building a base for better teaching and learning. English Teaching Forum 3 (pp. 3-13).
60. Sarıyıldız, G. (2018). A study into language assessment literacy of preservice English as a foreign language teachers in Turkish context [MA thesis]. Hacettepe University, Ankara.
61. Scarino, A. (2013). Language assessment literacy as self-awareness: Understanding the role of interpretation in assessment and in teacher learning. Language Testing, 30(3), 309–327. https://doi.org/10.1177/0265532213480128
62. Sevimel-Şahin, A. (2019). Exploring foreign language assessment literacy of pre-service English language teachers [Doctoral dissertation]. Anadolu University, Eskişehir, Türkiye.
63. Sevimel-Sahin, A., & Subaşı, G. (2021). Exploring foreign language assessment literacy training needs of pre-service English language teachers. International Online Journal of Education and Teaching (IOJET), 8(4), 2783-2802.
64. Shepard, L.A. (2000). The role of assessment in a learning culture. Educational Researcher, 29(7), 4–14.
65. Siegel, M.A., & Wissehr, C. (2011). Preparing form the plunge: Preservice teachers’ assessment literacy. Journal of Science Teacher Education, 22(4), 371 391. https://doi.org/10.1007/978-3-319-02261-1_19
66. Stiggins, R. (1995). Assessment literacy for the 21st century. Phi Delta Kappan, 77(3), 238– 245.
67. Şahin, S. (2009). An analysis of English language testing and evaluation course in English language teacher education programs in Turkey: Developing language assessment literacy of pre-service EFL teachers [Master's Thesis]. Middle East Technical University.
68. Tamerer, R.B. (2019). An investigation of Turkish pre-service EFL teachers’ language assessment literacy [MA thesis]. Kocaeli University, Kocaeli.
69. Taylor, L. (2013). Communicating the theory, practice and principles of language testing to test stakeholders: Some reflections. Language Testing, 30(3), 403 412. https://doi.org/10.1177/0265532213480338
70. Thomas, J., Allman, C., & Beech, M. (2004). Assessment for the diverse classroom: A handbook for teachers. Tallahassee, FL: Florida Department of Education, Bureau of Exceptional Education and Student Services.
71. Turkish Ministry of Education. (2018). High-school English language teaching program. [Curriculum]. https://mufredat.meb.gov.tr/ProgramDetay.aspx?PID=342
72. Ünlücan-Tosun, F., & Glover, P. (2020). How do school teachers in Turkey perceive and use the CEFR? International Online Journal of Education and Teaching (IOJET), 7(4), 1731-1739.
73. Vogt, K., Guerin, E., Sahinkaraks, S., Pavlou, P., Tsagari, D. & Afiri, Q. (2008). Assessment literacy of foreign language teachers in Europe. Poster session presented at the 5th Annual meeting of EALTA, Athens, Greece.
74. Vogt, K., & Tsagari, D. (2014). Assessment literacy of foreign language teachers: Findings of a European study. Language Assessment Quarterly, 11(4), 374 402. https://doi.org/10.1080/15434303.2014.960046
75. Wardani, W.O., Sukyadi, D., & Purnawarman, P. (2021). Exploring teacher assessment literacy in EFL classroom. Proceedings of the 2nd International Conference on Progressive Education, ICOPE 2020, 16–17 October 2020, Universitas Lampung, Bandar Lampung, Indonesia. https://doi.org/10.4108/eai.16-10-2020.2305253
76. Wiliam, D. (2011). What is assessment for learning? Studies in Educational Evaluation, 37(1), 3–14. https://doi.org/10.1016/j.stueduc.2011.03.001
77. Xu, Y., & Brown, G.T.L. (2016). Teacher assessment literacy in practice: A reconceptualization. Teaching and Teacher Education, 58(1), 149 162. https://doi.org/10.1016/j.tate.2016.05.010
78. Xu, Y., & Brown, G.T.L. (2017). University English teacher assessment literacy: A survey-test report from China. Papers in Language Testing and Assessment, 6(1), 133–158.
79. Yetkin, C. (2015). An investigation on ELT teacher candidates’ assessment literacy [MA thesis]. Cag University, Mersin.