YDS AS A BENCHMARK IN TURKEY: THE DIFFICULTY LEVELS OF READING COMPREHENSION QUESTIONS
Öz
The ability to speak a language covers all skills, namely reading, writing, speaking, and listening, together with a reasonable degree of performance and competence knowledge. Specializing over a single skill by overlooking the others may hinder speaker proficiency. In other words, all skills equally weigh; hence, the tests that aim to measure language proficiency should be able to gauge all skills in a good balance. In spite of that reality, YDS (Foreign Language Exam) in Turkey scores test-takers only through reading questions, and accordingly, this test may not be a good benchmark for Turkey because reading questions do not seem to have a stable difficulty level. The exam is composed of different kinds of questions which are vocabulary, grammar, comprehension, dialogue, and reading. The reading questions take up the biggest portion in the exam -20 out of 80 questions-; therefore, they highly determine the test-takers’ scores. This study investigated eleven YDS tests held in the last 5 years. In total eleven YDS tests (220 reading questions) were analysed. Coleman-Liau Index was used to measure how difficult each test is. This study aims to reveal whether reading questions of YDS have a similar difficulty level by calculating the Coleman-Liau Index. This study is of great importance because YDS is a crucial benchmark test in Turkey that determines the English proficiency level of those who take it, and any discrepancy in difficulty levels may negatively affect the reliability of the test. The results showed that the reading questions are in a large range of difficulty, and do not follow a stable track of difficulty.
Anahtar Kelimeler
Kaynakça
- Akpinar, K. D., & Cakildere, B. (2013). Washback effects of high-stakes language tests of Turkey (KPDS and ÜDS) on productive and receptive skills of academic personnel. Journal of Language and Linguistic Studies, 9(2), 81-94.
- Aşkaroğlu, V. (2013). 2013 YDS ile 2012 KPDS ve ÜDS Sınavlarının Karşılaştırılması. Karadeniz Uluslararası Dergi, 162-173.
- Carlson, S. E., Seipel, B., & McMaster, K. (2014). Development of a new reading comprehension assessment: Identifying comprehension differences among readers. Learning and Individual Differences, 31, 40-53.
- Deacon, S. H., Kieffer, M. J., & Laroche, A. (2014). The relation between morphological awareness and reading comprehension:Evidence frommediation and longitudinal models. Scientific Studies of Reading, 18, 432–451, DOI:10.1080/10888438.20 14.926907.
- Frosini, G., Lazzerini, B., & Marcelloni, F. (1998). Performing automatic exams. Computers & Education, 281-300.
- Gür, Ö. (2013). Ölçme, değerlendirme ve kamu personeli dil sinavı (KPDS) – Bu sinav neyi ölçüyor? Sakarya University Journal of Education, 23-32.
- Kıray, G. (2015). Macro-structure Analysis of Reading Comprehension Paragraphs of KPDS and YDS Exams within Years 2003-2013. Hasan Ali Yücel Eğitim Fakültesi Dergisi, 219-233.
- Lam, R. (2015). Language assessment training in Hong Kong: Implications for language assessment literacy. Language Testing, 32(2), 169–197.
- Nagy, W. E. (2007). Metalinguistic awareness and the vocabulary-comprehension connection. In R. K. Wagner,A. E. Muse, & K. R. (Eds.), Vocabulary acquisition: Implications for reading comprehension (pp. 52-77). New York: Guilford Press.
- Nation, K. (1997). Assessing reading difficulties: the validity and utility of current measures of reading skill. British Journal of Educational Psychology, 67(3): 359-370 doi.org/10.1111/j.2044-8279.1997.tb01250.x.