Journal of Measurement and Evaluation in Education and Psychology

Call for Papers: Special Issue on "Measurement Principles in the Age of AI-based Test Generation and Scoring: Validity, Fairness, and Beyond"

Special Issue Editors: Burak Aydın, Ph.D., Okan Bulut, Ph.D. & Walter L. Leite, Ph.D.

The rise of advanced AI models has triggered a paradigm shift in educational and psychological measurement. Through AI-powered technological capabilities, automatic test generation (AIG) and automated scoring (AS) of written responses have been advancing rapidly. However, as the engineering of these tools accelerates, the field of educational and psychological measurement must ensure that the foundational principles of measurement science are not left behind.
This special issue aims to reclaim the construct by critically analyzing AI-based measurement and evaluation (AIME) approaches from an educational assessment perspective. An AI system’s capacity to imitate human test developers or raters is not enough if the validity evidence is weak. As editors of this special issue, we invite our colleagues to join us in bringing greater attention to measurement principles for incorporating AI into test generation and scoring. Our ultimate goal is to ensure that AI-powered technological innovation enhances measurement practices while also promoting educational equity and assessment quality.

Topics of Interest
This special issue invites methodological, empirical, and theoretical submissions that bridge the gap between AI-based assessment research and the core principles underlying educational and psychological measurement. We encourage authors to explore, but not limit themselves to, the following topics:
Validity of AIME: Investigating the validity of assessments generated entirely or partially by AI.
Psychometric Evaluation of Automated Scoring: Moving beyond traditional Natural Language Processing (NLP) agreement metrics by applying advanced psychometric models—such as Structural Equation Models, Item Response Theory, or Many-Facet Rasch Measurement —to evaluate AI raters for consistency, severity, and fit.
Fairness, Bias, and Algorithmic Equity in AIME: Scrutinizing AI-generated items and scoring algorithms for Differential Item Functioning and systemic biases across diverse demographic, linguistic, and cultural subgroups to ensure fairness in testing.
Meta-analyses for AIME: Systematically investigating quantitative outputs of AI-based Test Generation and Scoring. For example, meta-analyses of performance metrics such as correlations and agreement coefficients.
Human-AI Collaboration in AIME: Examining "human-in-the-loop" assessment models, such as the impact of AI-augmented scoring on rater behavior.
Methodological Innovations for AIME: Adapting or developing new quantitative methods (e.g., multilevel models, SEM) to analyze the complex data structures produced in AIME research.
Ethical Standards and Explainable AIME: Addressing the ethical imperatives, transparency, and pedagogical responsibilities required when deploying "black-box" models for AIME.
Other Related Topics: Additional research focused on the innovative use of AIME, such as feedback generation, course evaluation, open-source software, AIME for handwritten responses, personalized AIME, etc.

Submission Guidelines:
STEP 1. Prospective authors are invited to fill in the Article Proposal in the link below and wait for a response from the Special Issue Editors.
https://eptlab.com/submit/

STEP 2. After the notification of acceptance for submission Prospective authors are invited to submit their manuscripts following the journal's guidelines. https://dergipark.org.tr/en/pub/epod/writing-rules. All submissions will undergo a rigorous peer-review process.

IMPORTANT NOTE: Manuscripts should be submitted through the journal's online submission system, indicating that they are intended for the special issue on "Measurement Principles in the Age of AI-based Test Generation and Scoring: Validity, Fairness, and Beyond".

Important Dates:
Proposal Submission Deadline: September 15, 2026
Notification of Acceptance for Submissions: November 1, 2026
Full Manuscript Submission Deadline: February 1, 2027 (Articles can still be submitted even if a proposal was not submitted)
Reviews: February 1, 2027 - April 1, 2027
Decisions to be Sent: April 1, 2027
Revisions: April 1, 2027 - May 15, 2027
Revised Manuscript Submission: May 15, 2027
Final Decisions: July, 2027
Publication of Special Issue: August, 2027

Guest Editors:
Burak Aydın, Ph.D., burak.aydin@ege.edu.tr & burak.aydin@leuphana.de
Ege University, School of Education, Department of Measurement and Evaluation in Education & Leuphana University, Department of Educational Sciences.

Okan Bulut, Ph.D., bulut@ualberta.ca
University of Alberta, Faculty of Education, Measurement, Evaluation, and Data Science & Centre for Research in Applied Measurement and Evaluation.

Walter L. Leite, Ph.D., walter.leite@coe.ufl.edu
University of Florida, School of Human Development and Organizational Studies in Education, Research and Evaluation Methodology Program & The Virtual Learning Lab (VLL).

Inquiries:
For any inquiries regarding the special issue, please contact Burak Aydın.

Burak Aydın, Ph.D., Okan Bulut Ph.D. & Walter L. Leite, Ph.D.
Special Issue Editors
Journal of Measurement and Evaluation in Education and Psychology