A Bird’s-eye View of the Errors Turkish EFL Learners Make in Cambridge ESOL Exams: A Corpus-Based Error Analysis

Year 2023, Volume: 174 Issue: 1, 31 - 64, 17.07.2023

Sibel Aybek , Cem Can

https://doi.org/10.33690/dilder.1217990

Abstract

The Cambridge ESOL (English for Speakers of Other Languages) Exams consist of a series of language proficiency tests developed and administered by the Department of English Language Assessment at the University of Cambridge. It assesses four language skills based on A1-C2 proficiency bands. Main database of the study is the Cambridge Learner Corpus (CLC) compiled from the student essays of all English as a Foreign Language exams of the institution containing 42-million-words of more than 200,000 students from 173 countries. This study aims to reveal the errors that Turkish EFL learners who took PET, PETfS, KET, KETfS, FCE, FCEfS, CAE and CPE exams between 1993 and 2013 made by examining the sections that measure their writing skills in exam papers using corpus-based error analysis tools available on SketchEngine platform and classifying them according to the A2-C2 language proficiency levels of the Common European Framework of Reference for Languages (Council of Europe, 2001). When the distribution of errors is examined according to the A2-C2 language proficiency levels, while the variety of error taxonomies increases, the frequency of errors decreases. The similarities in the error patterns observed from A2 to C2 proficiency levels are significant. Although there are fluctuations in the frequency of errors, the persistency of error taxonomies is observable. In addition, the study also compares the errors of L1 Turkish students with the errors made by learners from other mother tongue backgrounds available in the corpus. This comparison revealed twelve out of top 14 error taxonomies detected in the subcorpus of Turkish L1 learners overlaps with the ones observed in the subcorpora of other learners available in CLC.

Keywords

Corpus Linguistics, Error Analysis, Interlanguage Errors of Turkish EFL Learners, Learner Corpus, Cambridge Learner Corpus, ESOL, Turkish EFL Learners

Yabancı Dil Olarak İngilizce Öğrenen Türk Öğrencilerin Cambridge ESOL Sınavlarında Yaptıkları Yanlışlara Genel Bir Bakış: Derlem Tabanlı Bir Yanlış Çözümlemesi

Abstract

Cambridge ESOL (English for Speakers of Other Languages) Sınavları, Cambridge Üniversitesi İngiliz Dili Değerlendirme Bölümü tarafından oluşturulan ve gerçekleştirilen bir dizi dil yeterlilik sınavından oluşmaktadır. Dört dil becerisini A1-C2 yeterlilik ölçütlerini temel alarak değerlendirmektedir. Çalışmanın ana veri tabanını oluşturan Cambridge Öğrenci Derlemi (Cambridge Learner Corpus-CLC), kurumun hazırladığı tüm yabancı dil olarak İngilizce sınavlarına giren 173 ülkeden 200,000'den fazla öğrencinin cevap kağıtlarından derlenmiştir ve 42 milyon sözcüğü içermektedir. Bu çalışma 1993-2013 yılları arasında, PET, PETfS, KET, KETfS, FCE, FCEfS, CAE ve CPE sınavlarına giren anadili Türkçe olan öğrencilerin sınav kağıtlarında yazma becerilerini ölçen bölümleri SketchEngine kullanarak derlembilim tabanlı yanlış çözümleme yöntemleri ile incelemekte ve Avrupa Dilleri Ortak Çerçeve Programı’nın (Council of Europe, 2001) A2-C2 dil yeterlilik seviyelerine göre sınıflayarak, öğrencilerin sıklıkla yaptıkları yanlışları ortaya koymaktadır. A2-C2 dil yetkinlik düzeyine göre yanlışların dağılımına bakıldığında, yanlış çeşitliliğinin arttığı ve buna karşın yapılan yanlış sıklıklarının azaldığı görülmektedir. A2 yetkinliğinden süregelen yanlış örgüsündeki benzerlik dikkat çekmektedir. Her ne kadar yanlış sayılarında dalgalanmalar görülse de bazı yanlış ulamlarının kalıcılığı devam etmektedir. Ayrıca, bu çalışma, anadili Türkçe olan öğrencilerin yanlışlarını derlemde bulunan diğer anadili artalanlarından gelen öğrencilerin yaptıkları yanlışlarla karşılaştırmaktadır. Bu karşılaştırma sonucunda CLC’nin bütünsel genel yanlış çözümlemesi, anadili Türkçe olan öğrencilerin alt derlemlerinde en sık karşılaşılan 14 yanlış ulamından 12’si ile örtüşmektedir.

Keywords

Derlembilim, Yanlış Çözümlemesi, Türk Öğrencilerin Aradil Yanlışları, Öğrenici Derlemleri, Cambridge Öğrenici Derlemleri, Cambridge Sınavları

References

• Aydemir, S., & Duran, E. (2019). Vocabulary errors of Turkish EFL learners. Journal of Language and Linguistic Studies, 15(3), 1053-1066.
• Bardovi-Harlig, K., & Bofman, T. (1989). Attainment of syntactic and morphological accuracy by Advanced Language Learners. Studies in Second Language Acquisition, 11, 17-34.
• Başak, N. (2019). An analysis of Turkish EFL learners’ preposition errors. Journal of Language and Linguistic Studies, 15(2), 641-654.
• Biber, D., S. Conrad, & R. Reppen (1998). Corpus linguistics: Investigating language structure and use. Cambridge University Press.
• Can, C. (2017). A Learner Corpus-Based Study on Verb Errors of Turkish EFL Learners. Journal of Education and Training Studies, (5), 167-175.
• Chamot, A. U. (1987). The learning strategies of ESL students. In A. Wenden & J. Rubin (Eds.), Learner strategies in language learning (pp. 71-83). Englewood Cliffs, NJ: Prentice-Hall.
• Corder, S. P. (1967). The significance of learner's errors. [Washington, D.C.]: ERIC Clearinghouse.
• Corder, S. P. (1973). Introducing applied linguistics. Harmondsworth [Eng.]: Baltimore: Penguin Education.
• Council of Europe. (2001). Common European framework of reference for languages: Learning, teaching, assessment. Cambridge, U.K: Press Syndicate of the University of Cambridge.
• Dagneaux, E., Denness, S., & Granger, S. (1998). Computer-aided error analysis. Elsevier, 26(2), 163-174.
• Dede, M. (1985). Yabancı Dil Öğretiminde Karşılaştırmalı Dilbilim ve Yanlış Çözümlemesinin Yeri, Türk Dili Dergisi Dil Öğretimi Özel Sayısı, C:XLVII, S. 379-380, s. 123-135.
• Demir, M., & Kılıç, E. (2019). An analysis of Turkish EFL learners’ tense errors. Journal of Language and Linguistic Studies, 15(3), 990-1004.
• Doğan, N. (2018). An analysis of Turkish EFL learners’ grammar errors. Journal of Language and Linguistic Studies, 14(2), 126-139.
• Dulay, H., Burt, M., & Krashen, S. D. (1982) Language Two. Newbury House, Rowley.
• Ellis, R. (1994). The Study of Second Language Acquisition. Oxford University Press.
• Ellis, R. (1997). Second Language Acquisition. Oxford University Press.
• Engber, C. A. (1995). The relationship of lexical proficiency to the quality of ESL compositions. Journal of Second Language Writing, 4(2), 139–155. https://doi.org/10.1016/1060-3743(95)90004-7.
• Granger, S. (1996). From CA to CIA and back: An integrated approach to computerized bilingual and learner corpora. Languages in Contrast: Text-based cross-linguistic studies, Lund Studies in English 88, Lund University Press, 37–51.
• Granger, S. (2003). The International Corpus of Learner English: A New Resource for Foreign Language Learning and Teaching and Second Language Acquisition Research. TESOL Quarterly, 37(3).
• Grant, L. & Ginther, A. (2000). Using computer-tagged linguistic features to describe L2 writing differences. Journal of Second Language Writing, 9, 123–145. https://doi.org/10.1016/S1060-3743(00)00019-9.
• Gilquin, G. (2007). To err is not all. What corpus and elicitation can reveal about the use of collocations by learners. Zeitschrift für Anglistik und Amerikanistik, 55(3), 273-291.
• Gilquin, G., Granger, S. & Paquot, M. (2007). Writing sections. In M. Rundell (Editor in chief) Macmillan English Dictionary for Advanced Learners (second edition) (s. IW1-IW29). Oxford: Macmillan Education
• Gilquin, G., & Granger, S. (2015). From design to collection of learner corpora. The Cambridge Handbook of Learner Corpus Research, 3(1), 9-34.
• Heift, T., & Schulze, M. (2007). Errors and intelligence in computer-assisted language learning parsers and pedagogues. New York: Routledge.
• Kellerman, E. (1983). Now you see it, now you don’t. In Susan M. Gass & Larry Selinker (Eds.), Language Transfer in Language Learning, 112–134. Rowley, MA: Newbury House.
• Kızıl, A. Ş., & Kilimci, A. (2014b). Recurrent phrases in Turkish EFL learners’ spoken interlanguage: A corpus-driven structural and functional analysis. Journal of Language and Linguistic Studies, 10(1), 195–210.
• Lado, R. (1957). Linguistics across cultures: Applied linguistics for language teachers. Ann Ardor: University of Michigan Press.
• Odlin, T. (1989). Language transfer: Cross-linguistic influence in language learning. Cambridge University Press.
• Olsen, K. A. (1999). An international perspective authors. Journal of the Association for Information Science and Technology.
• Sheen, R. (1996). The Advantage of Exploiting Contrastive Analysis in Teaching and Learning a Foreign Language, 34(3), 183-198.
• Sinclair, J. (2001). (Eds.) Collins COBUILD English Dictionary for Advanced Learners. London: Harper Collins.
• Swan, M., & Smith, B. (2001). Learner English: A teacher's guide to interference and other problems. Cambridge University Press.
• Swan, M. (2007) 'Grammar, meaning and pragmatics: sorting out the muddle', TESLEJ 11(2).
• Taylor, B. (1975). The use of overgeneralization and transfer learning strategies by elementary and intermediate students of ESL. Language Learning, 25(1), 73-107. https://doi.org/10.1111/j.1467-1770.1975.tb00110.x