Psychology in Testing: Constructional and Conceptual Discrepancy in Language Tests

Year 2013, Volume: 33 Issue: 2, 193 - 210, 01.06.2013

Mehmet Özcan

Abstract

This study investigates deficiencies in foreign language tests that stem from the discrepancy between test writers\' assumptions and the test takers\' approach to test items with a qualitative perspective. English language tests administered to elementary school students were analyzed. The analysis revealed that there are five types of common deficiencies. The deficiencies stem from the test items\' requiring cognitive skills, general knowledge and higher developmental potential instead of linguistic abilities. Visual aids provided in the test items are not always useful for test takers and some test items require explicit grammatical knowledge which is not suggested by current teaching models.

Keywords

Foreign language testing, Constructional and conceptual discrepancy, Test item deficiencies, Validity, Reliability

SınavlardakiPsikolojik Unsurlar: Soru Yazma ve Soruyu Algılamadaki Uyuşmazlıklar

Abstract

Bu çalışma, yabancı dil sınavı hazırlayanların, soruları yazarken sahip oldukları varsayımlar ile adayların bu sorulara yaklaşımlarında ortaya çıkan uyuşmazlıkları, nitel bir bakış açısıyla araştırmıştır. Ortaöğretim seviyesinde uygulanmış yabancı dil sınav soruları incelenmiş, bu sorularda, genel olarak, beş tür hata tespit edilmiştir. Bu hataların, soruların öğrencilerden, dil becerisi yerine, bilişsel beceriler, genel bilgi ve yüksek düzeyde gelişimsel birikim istemelerinden kaynaklandığı tespit edilmiş, bazı sorulardaki görsel ögelerin adaya katkısının olmadığı, bazı soruların ise güncel yabancı dil öğretim kuram ve yöntemleriyle çeliştiği gözlenmiştir.

Keywords

Yabancı dil sınavı, Soru yazma-algılama uyuşmazlığı, Sınav hataları, Geçerlik, Güvenirlik.

References

• Bachman, L. F. (1990). Fundamental considerations in language testing. Oxford: OUP Bachman, L. F. and Palmer, A. S. (1996). Language testing in practice: designing and developing useful language tests. Oxford: OUP.
• Baghaei, P. (2011). Optimal number of gaps in C-test passages. International Educational Studies, 4(1), 166-171.
• Bakhtin, M. M. (1981). The Dialogic Imagination: Four Essays. Ed. Michael Holquist. Trans. Caryl Emerson & Michael Holquist. Austin and London: University of Texas Press.
• Benedetti, K. D. (2006). Language testing: Some problems and solutions. MEXTESOL Journal, 30(1), 25-40.
• Brown, J. D. (1996). Testing in language programs. New Jersey: Prentice Hall.
• Cunning-Wilson, C. (2001). Choosing EFL/ESL visual assessments: image and picture selection on foreign and second language exams. ERIC. Document code: ED 452 70
• Currie, M. and Chiramanee, T. (2010). The effect of the multiple-choice item format on the measurement of knowledge of language structure. Language Testing, 27(4), 471-4
• Fazeli, S. H. (2010). The Impact analysis of psychological reliability of population pilot study for selection of particular reliable multi-choice item test in foreign language. Journal of Language and Linguistic Studies, 6(2), 7-21.
• Fulcher, G. and Davidson, F. (2007). Language testing and assessment: An advanced resource book. London: Routledge.
• Gershkoff-Stowe, L., Thal, D. J., Smith, L. B. and Namy, L. L. (1997). Categorization and its developmental relation to early language. Child Development, 68(5), 8438
• Gershkoff-stowe, L., Connell, B. and Smith, L. (2006). Priming overgeneralizations in two- and four-year-old children. Journal of Child Language, 461-486.