Review

Charting the trajectory of cognitive diagnostic assessment in language assessment: A systematic literature review

Volume: 12 Number: 3 September 4, 2025
EN

Charting the trajectory of cognitive diagnostic assessment in language assessment: A systematic literature review

Abstract

The education system has relied on conventional single-score assessments, which provide limited insights into students' cognitive abilities. Cognitive diagnostic assessment (CDA) offers a promising alternative by providing detailed information on students' cognitive processes. The review aims to explore the recent trends of cognitive diagnostic assessment publications in language assessment by examining the years of publications, geographical locations, research methodologies, focused skills, and research samples. It further investigates the implementation of CDA studies in language assessment and identifies proposed future research directions in this field. Findings show a surge in CDA studies since 2019, with China and Iran leading, predominantly focusing on receptive skills and retrofitting methods over true CDA. The review shows that CDA accentuates cognitive model design, Q-matrix construction, item development, comparison of cognitive diagnostic models (CDMs), data analysis, and mastery profile generation. Previous research has proposed recommendations related to item and instrument development, attribute selection, sample selection, and the effectiveness of CDA. The study limitations include potential biases from publication trends and the reliance on existing literature, possibly excluding unpublished works. Future efforts should focus on developing comprehensive cognitive models, balancing the assessment of receptive and productive skills, and expanding the analysis of item parameters. The review's findings imply that practitioners must align existing tests with diagnostic needs and incorporate various item parameters to enhance assessment accuracy. It also underscores the implication that educational policymakers should support refined cognitive models and that teachers must be trained to use advanced diagnostic tools for effective instructional strategies.

Keywords

Supporting Institution

The study was funded by Faculty of Education, Universiti Kebangsaan Malaysia, Ganjaran Penerbitan GP-KO21854 and TAP-KO21854 Universiti Kebangsaan Malaysia.

Project Number

GP-KO21854 and TAP-KO21854

Thanks

The authors wish to express their sincere gratitude to the Kumpulan Penyelidikan Universiti, Penilaian Pendidikan, Faculty of Education, Universiti Kebangsaan Malaysia, Bangi, for their invaluable support and contributions to this research.

References

  1. Akbay, L. (2021). Impact of retrofitting and item ordering on DIF. Journal of Measurement and Evaluation in Education and Psychology, 12(2), 212 225. https://doi.org/10.21031/epod.886920
  2. Alallo, H.M.I., Mohammed, A., Hamid, Z.K., Hassan, A.Y., & Kadhim, Q.K. (2023). Examining attribute relationship using Diagnostic Classification Models: A mini review. International Journal of Language Testing, 13 (Special Issue), 21 30. https://doi.org/10.22034/IJLT.2022.368468.1212
  3. Alavi, M., & Ranjbaran, F. (2018). Constructing and validating a Q-Matrix for cognitive diagnostic analysis of a reading comprehension test battery. Journal of English Language Teaching and Learning, 21(12), 1 15. https://elt.tabrizu.ac.ir/article_17207_d9a9150ba8996ecfe90af3e07b905503.pdf
  4. Aryadoust, V. (2011). Application of the fusion model to while-listening performance tests. JALT Testing & Evaluation SIG Newsletter, 15(2), 2–9.
  5. Aryadoust, V. (2018). A cognitive diagnostics assessment study of the listening test of the Singapore–Cambridge General Certificate of Education O-Level: Application of DINA, DINO, G-DINA, HO-DINA, and RRUM. International Journal of Listening, 35(1), 29-52. https://doi.org/10.1080/10904018.2018.1500915
  6. Askari, M., & Karami, H. (2024). On the relationship between sensory learning styles and reading subskill profiles: An application of Fusion Model. Language Related Research, 15(3), 245–274. https://doi.org/https://doi.org/10.29252/LRR.15.3.10
  7. Boori, A.A., Ghazanfari, M., Ghonsooly, B., & Baghaei, P. (2023). The construction and validation of a Q-matrix for cognitive diagnostic analysis: The case of the reading comprehension section of the IAUEPT. International Journal of Language Testing, 13(Special Issue), 31–53. https://doi.org/10.22034/IJLT.2023.383112.1227
  8. Boori, A.A., Ghazanfari, M., Ghonsooly, B., & Baghaei, P. (2024). A cognitive diagnostic modeling analysis of the reading comprehension section of an Iranian high-stakes language proficiency test. International Journal of Language Testing, 14(1), 17 33. https://doi.org/10.22034/IJLT.2023.399561.1256

Details

Primary Language

English

Subjects

Measurement Theories and Applications in Education and Psychology

Journal Section

Review

Early Pub Date

July 21, 2025

Publication Date

September 4, 2025

Submission Date

August 15, 2024

Acceptance Date

June 21, 2025

Published in Issue

Year 2025 Volume: 12 Number: 3

APA
Mohd Noh, M. F., Mohd Matore, M. E. E., & Sulaiman, N. A. (2025). Charting the trajectory of cognitive diagnostic assessment in language assessment: A systematic literature review. International Journal of Assessment Tools in Education, 12(3), 843-870. https://doi.org/10.21449/ijate.1533622

Cited By

23823             23825             23824