A Systematic Review of Program Evaluation Studies in EFL: The Turkish Case

Abstract

English language education has been provided at all levels of education for a long time in Turkey as well as in the rest of the world. In order to assess the objectives, content, expected target outputs, effectiveness or weakness of the language education given, program evaluation studies are carried out. In this study, a systematic review study was conducted in order to determine English as a foreign language (EFL) teaching program evaluation studies in Turkey published between 2017-2020, and to investigate the levels of these studies, research patterns and focus of the published articles. For systematic review, ERIC and Google Scholar databases were searched and the key words such as "program evaluation, EFL, Turkey" were used. When the results are examined, a total of 23 studies were found between the mentioned years, and most of the studies were conducted on university programs, and the majority of them were conducted as qualitative research. Based on the results, it was revealed that the program evaluation studies were not evenly distributed equally in terms of education level, and it was understood that the subfields of the program were studied rather than the general content. This undesired state revealed the need for more research on the general program content and lower education levels in program evaluation studies.

Keywords

• English as a foreign language
• Program Evaluation
• Systematic review
• Language Education
• Turkey.

İngilizcenin Yabancı Dil Olarak Öğretiminde Program Değerlendirme Çalışmalarının Sistematik Bir İncelemesi: Türkiye Örneği

Öz

İngilizce dili eğitimi bütün dünyada olduğu gibi, Türkiye’de de uzun suredir eğitimin bütün kademelerinde yoğun olarak verilmektedir. Verilen dil eğitiminin hedeflerini, içeriğini, beklenen hedef çıktılarını, etkililiğini değerlendirmek için program değerlendirme çalışmaları kapsamlı olarak yapılmaktadır. Bu çalışmada, 2017-2020 yılları arasında Türkiye’de İngilizce dili öğretimi program değerlendirme çalışmalarını belirlemek ve bu çalışmaların hangi seviyelerde yapıldığı, araştırma desenleri ve çalışma odak noktalarını belirlemek amacıyla sistematik inceleme çalışması yapılmıştır. Sistematik inceleme için ERIC ve Google Scholar veri tabanları taranmış olup, anahtar kelimeler olarak "program değerlendirme, EFL, Türkiye" kelimeleri kullanılmıştır. Sonuçlar incelendiğinde, belirtilen yıllar arasında toplam 23 çalışma bulunmuştur ve çalışmaların büyük çoğunluğu üniversite programları üzerine yapılmış olup birçoğunda nitel araştırma yöntemi kullanıldığı tespit edilmiştir. Araştırma sonucuna dayanarak, program değerlendirme çalışmalarının eğitim seviyesi olarak eşit dağılmadığı ortaya çıkmış olup program değerlendirmenin genel içeriğinden çok, alt-baslıklarının çalışıldığı anlaşılmıştır. Bu durum, program değerlendirme çalışmalarında genel program içeriğine ve alt kademe eğitim seviyelerine yönelik daha fazla araştırma yapılması ihtiyacını ortaya koymuştur.

Anahtar Kelimeler

• Yabancı dil olarak İngilizce
• Program değerlendirme
• Sistematik inceleme
• Dil Eğitimi
• Türkiye.

Kaynakça

1. Ağçam, R., & Babanoğlu, M. P. (2018). The Solo Analysis of Efl Teaching Programmes: Evidence from Turkey. Turkish Studies, 13(27), 1-18.
2. Ağçam, R., & Babanoğlu, M. P. (2020). Evaluation of the Learning Outcomes in the Revised EFL Curriculum: A research on Outcome Verbs. International Journal of Curriculum and Instruction, 12(1), 127-142.
3. Akpur, U., Alci, B., & Karatas, H. (2016). Evaluation of the Curriculum of English Preparatory Classes at Yildiz Technical University Using CIPP Model. Educational research and Reviews, 11(7), 466-473.
4. Aktaş, C. K., & Gündoğdu, K. (2020). An Extensive Evaluation Study Of The English Preparatory Curriculum of a Foreign Language School. Pegem Journal of Education and Instruction, 10(1), 169-214.
5. Aksoy, E. (2020). Evaluation Of The 2017 Updated Secondary School English Curriculum Of Turkey By Means Of Theory-Practice Link. Turkish Journal of Education, 9(1), 1-21.
6. Ali, A. D. (2020). Implementing Action Research in EFL/ESL Classrooms: A Systematic Review of Literature 2010–2019. Systematic Practice and Action Research, 33(3), 341-362.
7. Alsowat, H. H. (2017). A Systematic Review of Research On Teaching English Language Skills For Saudi EFL Students. Advances in Language and Literary Studies, 8(5), 30-45.
8. Ansary, H., & Babaii, E. (2002). Universal Characteristics Of EFL/ESL Textbooks: A Step Towards Systematic Textbook Evaluation. The Internet TESL Journal, 8(2), 1-9.

9. Arslan, A. (2020). A Systematic Review On Flipped Learning İn Teaching English As A Foreign Or Second Language. Journal Of Language And Linguistic Studies, 16(2), 775-797.
10. Astramovich, R.L. & Coker, K.J. (2007). Program Evaluation: The Accountability Bridge Model for Counselors. Journal Of Counseling & Development, 85, 162-172.
11. Bayram, I., & Canaran, Ö. (2019). Evaluation Of an English Preparatory Program at a Turkish Foundation University. Journal of Language and Linguistic Studies, 15(1), 48-69.
12. Bearman, M., Smith, C. D., Carbone, A., Slade, S., Baik, C., Hughes-Warrington, M., & Neumann, D. L. (2012). Systematic review methodology in higher education. Higher Education Research & Development, 31(5), 625–640. https://www.doi.org/10.1080/07294360.2012.702735
13. Borich, G. D., & Jemelka, R. P. (1981). Definitions Of Program Evaluation and Their Relation to Instructional Design. Educational Technology, 21(8), 31-38.
14. Cesur, K., & Cinkavuk, E. Ç. (2018). An Evaluation of Second Grade English Language Teaching Program Of Primary School: Tokat Case. Erzincan Üniversitesi Eğitim Fakültesi Dergisi, 20(3), 749-766.
15. Chan, V. (2001). Determining Students’ Language Needs in A Tertiary Setting. English Teaching Forum. July. 16-27.
16. Chang, J. Y., Kim, W. 6 Lee, H. (2015). A Language Support Program for English- Medium Instruction Courses: Its Development and Evaluation In An EFL Setting. International Journal of Bilingual Education And Bilingualism, 20(5), 510-528.
17. Chyung, S. Y. (2015). Foundational Concepts for Conducting Program Evaluations. Performance Improvement Quarterly, 27(4), 77‐96.
18. Coşkun Demirpolat, B. (2015). Türkiye’nin Yabancı Dil Öğretimiyle Imtihanı Sorunlar&Çözüm Önerileri. Ankara: SETA.
19. Efeoglu, G., Ilerten, F., & Basal, A. (2018). A Utilization Focused Evaluation of The Preparatory School of An ELT Program. International Online Journal Of Educational Sciences, 10(4), 149-163.
20. EPI (2020). English Proficiency Index. Retrieved From Http://Www.Ef.Co.Uk/Epi/
21. Erarslan, A., & Topkaya, E. Z. (2019). Developing A Scale to Evaluate Turkish Primary School Second Grade English Language Teaching Program. Avrasya Uluslararası Araştırmalar Dergisi, 7(20), 12-34.
22. Erarslan, A. (2018). Strengths And Weaknesses of Primary School English Language Teaching Programs in Turkey: Issues Regarding Program Components. Eurasian Journal of Applied Linguistics, 4(2), 325-347.
23. Erarslan, A. (2019). Progressive Vs Modular System in Preparatory School English Language Teaching Program: A Case of System Change at A State University In Turkey. Journal Of Language and Linguistic Studies, 15(1), 83-97.
24. Evişen, N., Akyilmaz, Ö., & Torun, Y. (2020). A Case Study of University EFL Preparatory Class Students’ Attitudes Towards Online Learning During Covid-19 In Turkey. Gaziantep Üniversitesi Eğitim Bilimleri Dergisi, 4(2), 73-93.
25. Genç, G., & Kulusakli, E. (2019). The Evaluation of Language Teaching Program Applied in The School of Foreign Languages. International Online Journal of Education and Teaching, 6(3), 658-670.
26. Gerede, D. (2005). A Curriculum Evaluation Through Needs Analysis: Perceptions of Intensive English Program Graduates At Anadolu University. (Unpublished Master’s Thesis). Anadolu University, Eskişehir, Turkey
27. Gough, D., Oliver, S. & Thomas, J. (2017). Introducing Systematic Reviews. In D. Gough, S. Oliver & J. Thomas (Eds.), An Introduction to Systematic Reviews (2nd Edition, Pp. 1–18). London: Sage
28. Güleçoğlu, G. Y., & Öztürk, G. (2021). Research Perspectives On English As A Foreign Language (EFL) Learning Motivation in Turkish Context: A Systematic Review Of Studies Between 2010 And 2021. Language Teaching And Educational Research, 4(2), 161-180.
29. Hart, C. (2018). Doing A Literature Review: Releasing the Research Imagination. London. SAGE.
30. Hsieh, H. F., & Shannon, S. E. (2005). Three Approaches to Qualitative Content Analysis. Qualitative Health Research, 15(9), 1277-1288.
31. İlerten, F., & Efeoglu, G. (2021). Utilization Focused Evaluation of An ELT Prep Program: A Longitudinal Approach. Pegem Journal of Education And Instruction, 11(2), 27-31.
32. Jia, C., & Hew, K. F. (2021). Toward A Set Of Design Principles For Decoding Training: A Systematic Review Of Studies Of English As A Foreign/Second Language Listening Education. Educational Research Review, 100392.
33. Kaliisa, R., & Picard, M. (2017). A Systematic Review on Mobile Learning In Higher Education: The African Perspective. Turkish Online Journal of Educational Technology-TOJET, 16(1):1-18.
34. Kitchenham, B., & Charters, S. (2007). Guidelines For Performing Systematic Literature Reviews in Software Engineering. In EBSE Technical Report.
35. Kondracki, N. L., & Wellman, N. S. (2002). Content Analysis: Review of Methods and Their Applications in Nutrition Education. Journal of Nutrition Education and Behavior, 34, 224-230.
36. Lin, J. J., & Lin, H. (2019). Mobile-Assisted ESL/EFL Vocabulary Learning: A Systematic Review And Meta-Analysis. Computer Assisted Language Learning, 32(8), 878-919.
37. Lo, C. K. (2020). Systematic Reviews on Flipped Learning In Various Education Contexts. Systematic Reviews in Educational Research, 129-143.
38. Macaro, E., Curle, S., Pun, J., An, J., & Dearden, J. (2018). A Systematic Review Of English Medium İnstruction in Higher Education. Language Teaching, 51(1), 36-76.
39. Manion C.L, & Morrison, K. (2011). Planning Educational Research. Research Methods in Education. New York: Routledge Editors.
40. Mutlu, G. (2018). A Program Evaluation Study of The Main Course at A Preparatory Program: A Case Study. Turkish Online Journal of Qualitative Inquiry, 9(3), 202-239.
41. Newman, M., & Gough, D. (2020). Systematic Reviews in Educational Research: Methodology, Perspectives and Application. Systematic Reviews in Educational Research, 3-22.
42. Öztürk, E. (2019). An Evaluation of The 9th Grade English Program In Terms Of Developing Ict Literacy. Uluslararası Avrasya Sosyal Bilimler Dergisi, 10(36), 659-668.
43. Peacock, M. (2009). The Evaluation of Foreign-Language-Teacher Education Programmes. Language Teaching Research, 13(3), 259-78.
44. Patton, M. Q. (2002). Qualitative Research And Evaluation Methods. Thousand Oaks, CA: Sage. Petticrew, M., & Roberts, H. (2008). Systematic Reviews in The Social Sciences: A Practical Guide. John Wiley & Sons.
45. Polat, M. & Erdem, C. (2019) A Thematic Review of Foreign Language Curriculum Evaluation Studies. Proceeding Book of 7th International Conference on Curriculum and Instruction. (p. 389-390). Ankara, Turkey.
46. Polat, M. & Erişti, B. Otantik Videoların Farklı Ingilizce Yeterlik Düzeylerinde Yabancı Dilde Dinleme Becerisinin Geliştirilmesi&Yabancı Dilde Dinleme Kaygısı Üzerindeki Etkisi (Yayımlanmamış Doktora Tezi). Anadolu Üniversitesi Eğitim Bilimleri Enstitüsü, Eskişehir.
47. Polat, N., Mahalingappa, L., & Mancilla, R. L. (2020). Longitudinal Growth Trajectories of Written Syntactic Complexity: The Case of Turkish Learners in an Intensive English Program. Applied Linguistics, 41(5), 688-711. Sahlan, N. A. I. B. M., Osman, Z., Sarudin, A., & Redzwan, H. F. M. (2020). A Systematic Review of Second Language Learning: Trends and Suggestions. Palarch's Journal of Archaeology of Egypt/Egyptology, 17(6), 12082-12099.
48. Selvaraj, M., & Aziz, A. A. (2019). Systematic Review: Approaches in Teaching Writing Skill in ESL Classrooms. International Journal of Academic Research in Progressive Education And Development, 8(4), 450-473.
49. Sanders, J. R. (1994). The Program Evaluation Standards: How to Assess Evaluations Of Educational Programs. Sage.
50. Şahin, V. (2006). Evaluation of the In-Service Teacher Training Program “The Certificate for Teachers Of English” At The Middle East Technical University School Of Foreign Languages. (Unpublished Master Thesis). Middle East Technical University, Ankara.
51. Tercan, G. (2018). Evaluating The Modular System of Preparatory Class Program. ELT Research Journal, 7(1), 2-23.
52. Topçu, T. (2005). An Investigation of The Effectiveness Of The Theme-Based Curriculum In The 2003-2004 Academic Year At The Department Of Basic English At Middle East Technical University. (Unpublished Master Thesis). Middle East Technical University, Ankara.
53. Turan, Z., & Akdag-Cimen, B. (2020). Flipped Classroom İn English Language Teaching: A Systematic Review. Computer Assisted Language Learning, 33(5-6), 590-606.
54. Usun, S. (2016). A Review on The Program Evaluation Strategies in Distance Education. International Journal on New Trends in Education & Their Implications (IJONTE), 7(3), 33-45.
55. Yang, X., Kuo, L. J., Eslami, Z. R., & Moody, S. M. (2021). Theoretical Trends Of Research On Technology And L2 Vocabulary Learning: A Systematic Review. Journal of Computers in Education, 1-19.
56. Yastibas, A. E. (2020a). Evaluating The New English Language Teaching Program of Turkey For Primary Schools Anthropocentrically. Journal Of Language and Linguistic Studies, 16(4), 1821-1832.
57. Yastibas, A. E. (2020b). Evaluating An English Language Teaching Program in Terms f Peace Education. Shanlax International Journal of Education, 8(4), 11-19.
58. Yükselir, C. (2018). Students’ Perceptions of Optional English Preparatory Program: A Case Study In A Turkish University. The Literacy Trek, 4(1), 37-48.
59. Yuvayapan, F., & Yükselir, C. (2020). A Systematic Review Of Corpus-Based Studies On Academic Writing in The Turkish Context. Journal Of Theoretical Educational Science, 13(4), 630-645.