Uncovering the Language Assessment Literacy of ESP Teachers in a Turkish EFL Context

Öz

This study examines the perceptions, practices and challenges faced by English for Specific Purposes (ESP) teachers in Turkish vocational high schools regarding ESP assessment. The study revealed that communication skills and using professional language and field-specific terminology in ESP assessment were prioritized in assessment processes. Some participants mainly used performance-based ESP assessment tools while others relied on traditional tests and informal criteria. Educational background also influenced their assessment practices. Moreover, the main challenges included large classes, limited training, scarce resources, weak collaboration with content teachers, and a lack of professional development on ESP assessment. The study suggests that training courses should focus on ESP assessment to improve assessment practices.

Anahtar Kelimeler

• ESP
• language assessment literacy
• assessment practices
• professional development

Türk İngilizce Öğretimi Bağlamında Mesleki İngilizce Dersi Veren İngilizce Öğretmenlerinin Dil Değerlendirme Okuryazarlığının Ortaya Çıkartılması

Öz

Bu çalışma Türkiye’deki meslek liselerinde mesleki İngilizce dersi veren İngilizce öğretmenlerinin mesleki İngilizce ölçme değerlendirme uygulamalarına ilişkin, algılarını, uygulamalarını ve karşılaştıkları güçlükleri incelemektedir. Çalışma, mesleki İngilizce ölçme değerlendirme süreçlerinde iletişim becerileri ile mesleki dil ve alanla ilgili terminolojiyi kullanmanın öncelikli olduğunu ortaya koymuştur. Bazı katılımcılar ağırlıklı olarak performansa dayalı mesleki İngilizce ölçme değerlendirme araçlarını kullanırken, bazıları geleneksel testler ve gayri resmi ölçütlere başvurmuştur. Eğitim geçmişi de ölçme değerlendirme uygulamalarını etkilemiştir. Ayrıca, başlıca zorluklar arasında kalabalık sınıflar, sınırlı eğitim, kısıtlı kaynaklar, alan öğretmenleriyle zayıf iş birliği ve mesleki İngilizce ölçme değerlendirmesi konusunda mesleki gelişim eksikliği yer almaktadır. Çalışma, ölçme değerlendirme uygulamalarını geliştirmek amacıyla eğitim programlarının mesleki İngilizce ölçme değerlendirmesine odaklanması gerektiğini önermektedir.

Anahtar Kelimeler

• Mesleki İngilizce
• Dil değerlendirme okuryazarlığı
• değerlendirme uygulamaları
• mesleki gelişim

Kaynakça

1. Adnan, N. H., & Sayadi, S. S. (2021). ESL students’ readiness for self-directed learning in improving English writing skills. Arab World English Journal, 12(4), 503–520. https://doi.org/10.24093/awej/vol12no4.33
2. Ahmed, S., Awadelkarim, A. O., & Majed, A. (2024). The challenges of ESP teaching: The case of Majmaah University. https://doi.org/10.5455/CSLL.243020
3. Alase, A. (2017). The interpretative phenomenological analysis (IPA): A guide to a good qualitative research approach. International Journal of Education & Literacy Studies, 5(2), 9–19. https://doi.org/10.7575/aiac.ijels.v.5n.2p.9
4. Alghamdi, A. (2022). ESP teachers’ beliefs about their roles in teaching technical vocabulary. International Journal of Social Science and Human Research, 5(10), 4750–4755. https://doi.org/10.47191/ijsshr/v5-i10-47
5. Altmişdört, G. (2017). A study on students’ and teachers’ needs and expectations in English for specific purposes programs. Science Journal of Turkish Military Academy, 27(1), 53–78.
6. American Federation of Teachers, National Council on Measurement in Education, & National Education Association. (1990). Standards for teacher competence in educational assessment of students. https://buros.org/standards-teacher-competence-educational-assessment-students/.
7. Arnó-Macià, E., Aguilar-Pérez, M., & Tatzl, D. (2020). Engineering students’ perceptions of the role of ESP courses in internationalized universities. English for Specific Purposes, 58, 58–74. https://doi.org/10.1016/j.esp.2019.12.001
8. Başara, S., & Güngör, M. N. (2024). Instructors’ beliefs about ESP assessment: A case study. Gazi Üniversitesi Gazi Eğitim Fakültesi Dergisi, 44(2), 1023–1047. https://doi.org/10.17152/gefad.1444003

9. Bayat, K., & Rezaei, A. (2015). Importance of teachers’ assessment literacy. International Journal of English Language Education, 3(1), 139–146.
10. Bayram, İ., & Canaran, Ö. (2020). Identifying the perceived professional development needs of English for specific purposes (ESP) teachers. Ilkogretim Online - Elementary Education Online, 19(3), 1647–1659. https://doi.org/10.17051/ilkonline.2020.734559
11. Bocanegra-Valle, A., & Baştürkmen, H. (2019). Investigating the teacher education needs of experienced ESP teachers in Spanish universities. Ibérica, 38, 127–150
12. Brown, H. D. (2003). Language assessment, principles, and classroom practices. New York: Pearson Longman.
13. Brown, H. D. (2013). Language assessment: Principles and classroom practices (2nd ed.). New York: Pearson Longman.
14. Cenaj, M. (2015). Pedagogical challenges of ESP teachers in Albania. Academic Journal of Interdisciplinary Studies, 4(3 S1), 490–495.
15. Campbell, C., & Collins, V. L. (2007). Identifying essential topics in general and special education introductory assessment textbooks. Educational Measurement: Issues and Practice, 26(1), 9–18.
16. Chapelle, C. A., & Brindley, G. (2002). Assessment. In N. Schmitt (Ed.), An introduction to applied linguistics (pp. 267–288). Oxford University Press.
17. Creswell, J. W. (2014). Research design: Qualitative, quantitative, and mixed methods approaches (4th ed.). London: SAGE.
18. Crusan, D., Plakans, L., & Gebril, A. (2016). Writing assessment literacy: Surveying second language teachers' knowledge, beliefs, and practices. Assessing Writing, 28, 43–56.
19. Cui, Y., Liu, Y., Yu, H., & Gao, Y. (2022). Developing English teachers’ language assessment literacy in an EAP reform context through test design: A case study. System, 109, 102866. https://doi.org/10.1016/j.system.2022.102866
20. Davies, A. (2008). Textbook trends in teaching language testing. Language Testing, 25(3), 327–347.
21. Davies, M. & Taras, M. (2018). Coherence and disparity in assessment literacies among higher education staff. London Review of Education, 16 (3), 474–90
22. DeLuca, C. (2012). Preparing teachers for the age of accountability: Toward a framework for assessment education. Action in Teacher Education, 34(5/6), 576–591.
23. DeLuca, C., & Johnson, S. (2017). Developing assessment capable teachers in this age of accountability. Assessment in Education: Principles, Policy, and Practice, 24(2), 121–126.
24. Demirdöken, G. (2021). The constructivist approach towards identifying the challenges of ESP teachers: The case of aviation English. International Journal of Aviation, Aeronautics, and Aerospace, 8(2). https://doi.org/10.15394/ijaaa.2021.1571
25. Denzin, N. K. (2017). The research act: A theoretical introduction to sociological methods. Routledge.
26. Dinçay, T. (2010). Designing a learner-centered ESP course for adults based on evidence from a questionnaire and incorporating the learners’ aims into a situational-based syllabus. Dil Dergisi, 150, 7–21.
27. Dissanayake, K. M., & Harun, R. N. S. R. (2016). Perception of students and teachers over ESP curriculum design for a business management programme in the Sri Lankan context. Proceedings of EEIC, 1(2), 302–309.
28. Dudley-Evans, T., & St John, M. J. (1998). Developments in ESP: A multi-disciplinary approach. Cambridge University Press.
29. Elder, C. (2016). Exploring the limits of authenticity in language testing: The case of a specific purpose language test for health professionals. Language Testing, 33(2), 147–152.
30. Farhady, H. (2018). History of language testing and assessment. In J. I. Liontas, T. International Association, & M. DelliCarpini (Eds.), The TESOL encyclopedia of English language teaching (pp. 1–7). Wiley Blackwell.
31. Filges, T., Torgerson, C., Gascoine, L., Dietrichson, J., Nielsen, C., & Viinholt, B. A. (2019). Effectiveness of continuing professional development training of welfare professionals on outcomes for children and young people: A systematic review. Campbell Systematic Reviews, 15(4), 1-31. https://doi.org/10.1002/cl2.1060
32. Fitriyah, I., & Jannah, M. (2021). Online assessment effect in EFL classroom: An investigation on students and teachers' perceptions. Indonesian Journal of English Language Teaching and Applied Linguistics, 5(2), 265-284.
33. Gottheiner, D. M., & Siegel, M. A. (2012). Experienced middle school science teachers’ assessment literacy: Investigating knowledge of students’ conceptions in genetics and ways to shape instruction. Journal of Science Teacher Education, 23, 531–557.
34. Herrera, L., & Macías, D. (2015). A call for language assessment literacy in the education and development of teachers of English as a foreign language. Colombian Applied Linguistics Journal, 17(2), 302–312.
35. Hutchinson, T., & Waters, A. (1987). English for specific purposes, a learning centered approach. Cambridge: Cambridge University Press
36. Hyland, K. (2016). English for specific purposes: What is it and where is it taking us? ESP Today, 10(2), 202–220.
37. Inbar-Lourie, O. (2008). Constructing a language assessment knowledge base: A focus on language assessment courses. Language Testing, 25, 385-402. https://doi.org/10.1177/0265532208090158
38. Inbar-Lourie, O. (2013). Language assessment literacy. In C. A. Chapelle (Ed.), The encyclopedia of applied linguistics (pp. 1-9). Blackwell Publishing Ltd. doi:10.1002/9781405198431.wbeal0605
39. Iswati, L., & Triastuti, A. (2021). Voicing the challenges of ESP teaching: Lessons from ESP in non-English departments. Studies in English Language and Education, 8(1), 276–293. https://doi.org/10.24815/siele.v8i1.17301
40. Kern, R., & Liddicoat, A. J. (2010). From the learner to the speaker/social actor. In G. Zarate, D. Lévy, & C. Kramsch (Eds.), Handbook of multilingualism and multiculturalism (pp. 17–23). Éditions des Archives Contemporaines, Ltd.
41. Kırkgöz, Y. (2019). ESP in teacher education: A case study. In S. Papadima-Sophocleous, E. Kakoulli Constantinou, & C. N. Giannikas (Eds.), ESP teaching and teacher education: Current theories and practices (pp. 13–26). Research- publishing.net. https://doi.org/10.14705/rpnet.2019.33.923
42. Kremmel, B., & Harding, L. (2020). Towards a comprehensive, empirical model of language assessment literacy across stakeholder groups: Developing the Language Assessment Literacy Survey. Language Assessment Quarterly, 17(1), 100–120.
43. Knoch, U., & Macqueen, S. (2019). Assessing English for professional purposes (1st ed.). Routledge. https://doi.org/10.4324/9780429340383
44. Külünk, A. (2023). A case study of the professional development needs of English for specific purposes instructors (Master’s thesis). TED University, Ankara.
45. Leung, C., & Scarino, A. (2016). Reconceptualizing the nature of goals and outcomes in language/s education. The Modern Language Journal, 100(1), 81–95.
46. López Mendoza, A. A., & Bernal Arandia, R. (2009). Language testing in Colombia: A call for more teacher education and teacher training in language assessment. Profile: Issues in Teachers' Professional Development, 11(2), 55–70.
47. Lukin, L. E., Bandalos, D. L., Eckhout, T. J., & Mickelson, K. (2004). Facilitating the development of assessment literacy. Educational Measurement: Issues and Practice, 23(2), 26–32.
48. Mannong, A. B. M., Setiawan, S., & Munir, A. (2024). Teachers’ voices: Challenges in designing ESP assessment. International Journal of Multicultural and Multireligious Understanding, 11(1), 310–317. https://doi.org/10.18415/ijmmu.v11i1.5304
49. Marwan, A. (2017). ESP teaching challenges in an Indonesian vocational higher institution. The English Teacher, 38(1), 1-12.
50. Mejri, S. (2024). EFL teachers’ beliefs and challenges about ESP teaching. Qeios. https://doi.org/10.32388/UCD48C
51. Merriam, S. B. (2009). Qualitative research: A guide to design and implementation revised and expanded. San Francisco CA: Jossey- Bass.
52. Merriam, S.B., & Tisdell, E. J. (2015). Qualitative research: A guide to design and implementation (4th ed.). San Francisco, CA: Jossessy- Bass.
53. Mertler, C. A. (2009). Action research: Teachers as researchers in the classroom (2nd ed.). Thousand Oaks, CA: SAGE.
54. Miles, M. B., & Huberman, A. M. (1994). Qualitative data analysis: An expanded Sourcebook. (2nd ed). Thousand Oaks, CA: Sage
55. Millî Eğitim Bakanlığı. (2016). Mesleki ve teknik ortaöğretim okul/kurumlarında okutulan mesleki yabancı dil dersi etki analizi raporu. https://mtegm.meb.gov.tr/meb_iys_dosyalar/2016_11/23014751_mesleki_yabanci_dil_raporu.pdf
56. Nguyen, B. H., Haworth, P., & Hansen, S. (2019). Challenging ESP teacher beliefs about active learning in a Vietnamese university. Teacher Development, 23(3), 345–365.
57. Nguyen, H. B., & Nguyen, T. (2017). English for specific purposes (ESP): Perceptions of students and teachers of learning needs at a Vietnamese school. International Journal of Advanced Research, 5(4), 793–803. https://doi.org/10.21474/IJAR01/3877
58. Pastore, S., & Andrade, H. L. (2019). Teacher assessment literacy: A three-dimensional model. Teaching and Teacher Education, 84, 128–138.
59. Popham, W. J. (2009). Assessment literacy for teachers: Faddish or fundamental? Theory into Practice, 48(4), 4–11.
60. Popham, W. J. (2011). Assessment literacy overlooked: A teacher educator’s confession. The Teacher Educator, 46(4), 265–273.
61. Rad, R. M. (2019). The impact of EFL teachers' assessment literacy on their assessment efficiency in classroom. Journal of Britain International of Linguistics Arts and Education (BIoLAE), 1(1), 9–17.
62. Rajabi, Y. (2017). Investigating ESP Instructors’ beliefs and attitudes and their classroom practices. International Journal of Applied Linguistics and English Literature, 7, 218-222.
63. Safa, A. M., & Nasiri, B. (2025). Fairness in language classroom assessment practices: What do EFL teachers underscore? Language Testing in Asia, 15(1), 1–21. https://doi.org/10.1186/s40468-024-00336-7
64. Safarzadeh, M., & Bazargani, T. D. (2023). Exploring Iranian ESP teachers’ assessment practices in online contexts. International Journal of Research in English Education, 8(4), 50–60.
65. Scarino, A. (2013). Language assessment literacy as self-awareness: Understanding the role of interpretation in assessment and in teacher learning. Language Testing, 30(3), 309–327.
66. Shahahmadi, M.R., & Ketabi, S. (2019). Features of language assessment literacy in Iranian English language teachers' perceptions and practices. Journal of Teaching Language Skills (JTLS), 38 (1), 191-223.
67. Shobeiry, M., & Baktash, N. (2022). ESP teachers’ language assessment literacy and their perception of formative classroom assessment in online courses. International Journal of Foreign Language Teaching and Research, 10(41), 103–115.
68. Shohamy, E., & Or, I. G. (2017). Editors’ introduction. In E. Shohamy& I. G. Or (Eds.), Encyclopedia of language and education (3rd ed., S. May (Ed.). Language testing and assessment (pp. ix–xviii). Cham, Switzerland: Springer Science.
69. Szymańska-Tworek, A., & Makowska-Songin, J. (2019). Teacher quality as a prerequisite for quality education: Needs and expectations of ESP teachers towards professional development in Polish tertiary education context. In D. Gabryś-Barker & R. Kalamarz (Eds.), Quality in language teaching: Theoretical considerations and practical solutions. Katowice: University of Silesia Press.
70. Sukying A., Supunya, N., & Phusawisot, P. (2023). ESP teachers: Insights, challenges and needs in the EFL context. The Asian ESP Journal, 19(2), 396–406. https://doi.org/10.17507/tpls.1302.14
71. Šliogerienė, J. (2018). Is ESP standardized assessment feasible? The Journal of Teaching English for Specific and Academic Purposes, 6(3), 525–534. https://doi.org/10.22190/JTESAP1803525S
72. Sündüz Erk, M. (2021). An investigation of English language needs of students at tourism and hotel management program: A mixed method study (Master’s thesis). Dokuz Eylül University, İzmir.
73. Stiggins, R. J. (1991). Assessment Literacy. The Phi Delta Kappan, 72, 534-539.
74. Stiggins, R. J. (2002). Assessment crisis: The absence of assessment for learning. Phi Delta Kappan, 83(10), 758-765.
75. Stiggins, R. (2005). From formative assessment to assessment for learning: A path to success in standards-based schools. The Phi Delta Kappan, 87(4), 324–328.
76. Taylor, L. (2013). Communicating the theory, practice and principles of language testing to test stakeholders: Some reflections. Language Testing, 30(3), 403–412.
77. Tsagari, D., & Vogt, K. (2017). Assessment literacy of foreign language teachers around Europe: Research, challenges and future prospects. Papers in Language Testing and Assessment, 6(1), 41–63.
78. Tunaz, M., & Aksu Ataç, B. (2023). Preparatory school students’ perceptions of learning English for specific purposes (ESP) for international relations. Bartın University Journal of Faculty of Education, 12(3), 594–603. https://doi.org/10.14686/buefad.1219345
79. Türkmen Çiçek, Ş., & Yavuz, A. (2024). Coursebook evaluation and development in a vocational college: A pilot study. International Journal of Educational Spectrum, 6(2), 238–263. https://doi.org/10.47806/ijesacademic.1448270
80. Wang, Y., Derakhshan, A., Pan, Z., & Ghiasvand, F. (2023). Chinese EFL teachers' writing assessment feedback literacy: A scale development and validation study. Assessing Writing, 56, 100726. https://doi.org/10.1016/j.asw.2023.100726
81. Xu, Y., & Brown, G. T. L. (2017). University English teacher assessment literacy: A survey-test report from China. Papers in Language Testing and Assessment, 6(1), 133–157.
82. Zhang, Y., & Wildemuth, B. M. (2009). Qualitative analysis of content. In B. M. Wildemuth (Ed.), Applications of social research methods to questions in information and library science (pp. 1–12). Libraries Unlimited.