Yıl 2019, Cilt 10 , Sayı 3, Sayfalar 266 - 301 2019-09-04

Automated Test Assembly (ATA) plays important role in test development, especially in large scale test administrations. However, there is a lack of tutorials showing how to solve ATA problems. This tutorial aims to show to how build on-demand test forms easily for researchers and practitioners, and share the R codes for their use. The study presents the annotated R codes for thirty-nine unique examples. The examples include building one form, multiple forms and more complex ones under different constraint conditions across equal or different form lengths. All examples were solved by using “xxIRT” R package. The graphical depictions of the form-level information functions for all examples were also provided. Some important notes about the codes were also provided at the end of the paper in case one did not find a solution. The thirty-six examples were provided in the main body of the paper, the other three complex examples were given in the Supplementary material.

On-demand test forms, automated test assembly, xxIRT, R
  • Berkelaar, M., & others (2015). R Package ‘lpSolve’. CRAN. URL https://cran.r-project.org/web/packages/lpSolve/lpSolve.pdf
  • Berkelaar, M., Eikland, K., & Notebaert, P. (2004). Lp solve 5.5, open source (mixed-integer) linear programming system. URL http://lpsolve.sourceforge.net/5.5/
  • Birnbaum, A. (1968). Some latent trait models and their use in inferring an examinee’s ability. In F. M. Lord & M. R. Novick. In statistical theories of mental test scores (pp. 397–479). Reading, MA: Addison-Wesley.
  • Cor, K., Alves, C., & Gierl, M. (2008). Conducting automated test assembly using the Premium Solver Platform Version 7.0 with Microsoft Excel and the large-Scale LP/QP solver engine add-in. Applied Psychological Measurement, 32, 652-663.
  • Cor, K., Alves, C., & Gierl, M. (2009). Three applications of automated test assembly within a user-friendly modeling environment. Practical Assessment, Research, & Evaluation, 14(14). URL http://pareonline.net/getvn.asp?v=14%26n=14
  • Diao, Q., & van der Linden, W. J. (2011). Automated test assembly using lp_solve version 5.5 in R. Applied Psychological Measurement, 35(5), 398-409.
  • Donoghue, J. R. (2015). Comparison of integer programming (IP) solvers for automated test assembly (ATA). ETS Research Report Series, 2015(1), 1-12.
  • Gierl, M.J., Daniels, L., & Zhang, X. (2017). Creating Parallel Forms to Support On-Demand Testing for Undergraduate Students in Psychology. Journal of Measurement and Evaluation in Education and Psychology, 8, 288-302.
  • Han, K. T., & Rudner, L. M. (2014). Item Pool Construction Using Mixed Integer Quadratic Programming (MIQP). GMAC® Research Report RR-14-01. Graduate Management Admission Council. URL https://files.eric.ed.gov/fulltext/ED558455.pdf
  • ILOG. (2006). ILOG CPLEX 10.0 [User’s manual]. Paris, France: ILOG SA.
  • Konis, K., & Konis, M. K. (2016). Package ‘lpSolveAPI’. URL https://cran.r-project.org/web/packages/lpSolveAPI/lpSolveAPI.pdf
  • Luecht, R. M. (1998). Computer-assisted test assembly using optimization heuristics. Applied Psychological Measurement, 22, 224-236.
  • Luo, X. (2018). R Package ‘xxIRT’. CRAN. URL https://cran.r-project.org/web/packages/xxIRT/xxIRT.pdf
  • Van der Linden, W. J. (2006). Linear models for optimal test design. Springer Science & Business Media.
Birincil Dil tr
Konular Sosyal
Bölüm Makaleler
Yazarlar

Orcid: 0000-0001-7506-9000
Yazar: Halil İbrahim SARI (Sorumlu Yazar)
Kurum: KILIS 7 ARALIK UNIVERSITY
Ülke: Turkey


Tarihler

Yayımlanma Tarihi : 4 Eylül 2019

Bibtex @araştırma makalesi { epod521330, journal = {Journal of Measurement and Evaluation in Education and Psychology}, issn = {1309-6575}, eissn = {1309-6575}, address = {}, publisher = {Eğitimde ve Psikolojide Ölçme ve Değerlendirme Derneği}, year = {2019}, volume = {10}, pages = {266 - 301}, doi = {10.21031/epod.521330}, title = {Building On-Demand Test Forms in R}, key = {cite}, author = {SARI, Halil İbrahim} }
APA SARI, H . (2019). Building On-Demand Test Forms in R. Journal of Measurement and Evaluation in Education and Psychology , 10 (3) , 266-301 . DOI: 10.21031/epod.521330
MLA SARI, H . "Building On-Demand Test Forms in R". Journal of Measurement and Evaluation in Education and Psychology 10 (2019 ): 266-301 <https://dergipark.org.tr/tr/pub/epod/issue/48297/521330>
Chicago SARI, H . "Building On-Demand Test Forms in R". Journal of Measurement and Evaluation in Education and Psychology 10 (2019 ): 266-301
RIS TY - JOUR T1 - Building On-Demand Test Forms in R AU - Halil İbrahim SARI Y1 - 2019 PY - 2019 N1 - doi: 10.21031/epod.521330 DO - 10.21031/epod.521330 T2 - Journal of Measurement and Evaluation in Education and Psychology JF - Journal JO - JOR SP - 266 EP - 301 VL - 10 IS - 3 SN - 1309-6575-1309-6575 M3 - doi: 10.21031/epod.521330 UR - https://doi.org/10.21031/epod.521330 Y2 - 2019 ER -
EndNote %0 Eğitimde ve Psikolojide Ölçme ve Değerlendirme Dergisi Building On-Demand Test Forms in R %A Halil İbrahim SARI %T Building On-Demand Test Forms in R %D 2019 %J Journal of Measurement and Evaluation in Education and Psychology %P 1309-6575-1309-6575 %V 10 %N 3 %R doi: 10.21031/epod.521330 %U 10.21031/epod.521330
ISNAD SARI, Halil İbrahim . "Building On-Demand Test Forms in R". Journal of Measurement and Evaluation in Education and Psychology 10 / 3 (Eylül 2019): 266-301 . https://doi.org/10.21031/epod.521330
AMA SARI H . Building On-Demand Test Forms in R. Journal of Measurement and Evaluation in Education and Psychology. 2019; 10(3): 266-301.
Vancouver SARI H . Building On-Demand Test Forms in R. Journal of Measurement and Evaluation in Education and Psychology. 2019; 10(3): 301-266.