Araştırma Makalesi
BibTex RIS Kaynak Göster

Computer Adaptive Testing Simulations in R

Yıl 2019, Cilt: 6 Sayı: 5, 44 - 56, 30.12.2019
https://doi.org/10.21449/ijate.621157

Öz

Computer adaptive testing is an important research field in educational
measurement, and simulation studies play a critically important role in CAT
development and evaluation. Both Monte Carlo and Post Hoc simulations are
frequently used in CAT studies in order to investigate the effects of different
factors on test efficiency and to compare different test designs. Although
there are several softwares for CAT simulations, R is preferred since it
includes many free packages and gives researchers opportunity to write their
own functions according to their own requirements besides being free. The
purpose of this study is to make an introduction and demonstration of how to
use catR package in CAT simulations. Different examples were provided in the
context of this study and R codes were presented with explanations. Then, the
output files were briefly explained. It is thought that this paper is helpful
for the researchers who are interested in CAT simulations.

Kaynakça

  • Bulut, O. & Sünbül, Ö. (2017). R programlama dili ile madde tepki kuramında monte carlo simülasyon çalışmaları [Monte carlo simulation studies in item response theory with the R programming language]. Journal of Measurement and Evaluation in Education and Psychology, 8(3), 266-287. DOI: 10.21031/epod.305821
  • Choi, S. W. (2009). Firestar: Computerized adaptive testing simulation program for polytomous item response theory models. Applied Psychological Measurement, 33(8), 644-645.
  • Embretson, S. E. & Reise, S. P. (2000). Item response theory for psychologists. Mahwah N.J.: L. Erlbaum Associates.
  • Han, K. T. (2012). SimulCAT: Windows software for simulating computerized adaptive test administration. Applied Psychological Measurement, 36(1), 64-66.
  • Han, K. T. & Kosinski, M. (2014). Software tools for multistage testing simulations. In D. Yan, A. A. von-Davier & C. Lewis (Eds.), Computerized multistage testing: Theory and applications (p. 411–420). CRC Press: Taylor&Francis Group.
  • Hendrickson, A. (2007). An NCME instructional module on multistage testing. Educational Measurement: Issues and Practice, Summer 2007, 44-52.
  • Lee, S., Choi, Y.J., & Cohen, A. (2018). Automating simulation research for item response theory using R. International Journal of Assessment Tools in Education, 5(4), 682-700. Retrieved from http://ijate.net/index.php/ijate/article/view/596
  • Lord, F. M. (1984). Standard errors of measurement at different ability levels. ETS Research Reports, 1984(1), I 11. Retrieved from https://onlinelibrary.wiley.com/doi/epdf/10.1002/j.2330-8516.1984.tb00048.x
  • Magis D. & Raiche G. (2011). catR: An R package for computerized adaptive testing. Applied Psychological Measurement, 35, 576-577.
  • Magis, D., Yan, D. & von-Davier, A. (Eds.). (2017). Computerized adaptive and multistage testing with R: Using packages catr and mstr. Switzerland: Springer.
  • R Core Team. (2014). R: A language and environment for statistical computing [Computer software manual]. Vienna, Austria. Retrieved from http://www.R-project.org/
  • Thissen, D. & Mislevy, R. J. (2000). Testing algorithms. In H. Wainer (Ed.), Computerized adaptive testing: A primer (2. ed.). Mahwah N.J.: Lawrence Erlbaum Associates.
  • Thompson, N. A. (2007). A practitioner’s guide for variable-length computerized classification testing. Practical Assessment Research & Evaluation, 12(1). Retrieved from http://pareonline.net/getvn.asp?v=12&n=1
  • Wainer, H. (2000). Introduction and history. In H. Wainer (Ed.), Computerized adaptive testing: A primer (2.ed., p. 1–22). Mahwah N.J.: Lawrence Erlbaum Associates.
  • Wainer, H. & Mislevy, R. J. (2000). Item response theory, item calibration, and proficiency estimation. In H. Wainer (Ed.), Computerized adaptive testing: A primer (2. ed.). Mahwah N.J.: Lawrence Erlbaum Associates.
  • Wang, K. (2017). A fair comparison of the performance of computerized adaptive testing and multistage adaptive testing (Doctoral Dissertation). Michigan State University.
  • Weiss, D. J. & Kingsbury, G. G. (1984). Application of computer adaptive testing to educational problems. Journal of Educational Measurement, 21(4), 361–375. https://doi.org/10.1111/j.1745-3984.1984.tb01040.x
  • Weiss, D. J. & Guyer, R. (2010). Manual for CATSim: Comprehensive simulation of computerized adaptive testing. St. Paul MN: Assessment Systems Corporation.
  • Yan, D., von-Davier, A. A. & Lewis, C. (2014b). Overview of computerized multistage tests. In D. Yan, A. A. von-Davier & C. Lewis (Eds.), Computerized multistage testing. CRC Press: Taylor&Francis Group.

Computer Adaptive Testing Simulations in R

Yıl 2019, Cilt: 6 Sayı: 5, 44 - 56, 30.12.2019
https://doi.org/10.21449/ijate.621157

Öz

Computer adaptive testing is an important research field in educational measurement, and simulation studies play a critically important role in CAT development and evaluation. Both Monte Carlo and Post Hoc simulations are frequently used in CAT studies in order to investigate the effects of different factors on test efficiency and to compare different test designs. Although there are several softwares for CAT simulations, R is preferred since it includes many free packages and gives researchers opportunity to write their own functions according to their own requirements besides being free. The purpose of this study is to make an introduction and demonstration of how to use catR package in CAT simulations. Different examples were provided in the context of this study and R codes were presented with explanations. Then, the output files were briefly explained. It is thought that this paper is helpful for the researchers who are interested in CAT simulations.

Kaynakça

  • Bulut, O. & Sünbül, Ö. (2017). R programlama dili ile madde tepki kuramında monte carlo simülasyon çalışmaları [Monte carlo simulation studies in item response theory with the R programming language]. Journal of Measurement and Evaluation in Education and Psychology, 8(3), 266-287. DOI: 10.21031/epod.305821
  • Choi, S. W. (2009). Firestar: Computerized adaptive testing simulation program for polytomous item response theory models. Applied Psychological Measurement, 33(8), 644-645.
  • Embretson, S. E. & Reise, S. P. (2000). Item response theory for psychologists. Mahwah N.J.: L. Erlbaum Associates.
  • Han, K. T. (2012). SimulCAT: Windows software for simulating computerized adaptive test administration. Applied Psychological Measurement, 36(1), 64-66.
  • Han, K. T. & Kosinski, M. (2014). Software tools for multistage testing simulations. In D. Yan, A. A. von-Davier & C. Lewis (Eds.), Computerized multistage testing: Theory and applications (p. 411–420). CRC Press: Taylor&Francis Group.
  • Hendrickson, A. (2007). An NCME instructional module on multistage testing. Educational Measurement: Issues and Practice, Summer 2007, 44-52.
  • Lee, S., Choi, Y.J., & Cohen, A. (2018). Automating simulation research for item response theory using R. International Journal of Assessment Tools in Education, 5(4), 682-700. Retrieved from http://ijate.net/index.php/ijate/article/view/596
  • Lord, F. M. (1984). Standard errors of measurement at different ability levels. ETS Research Reports, 1984(1), I 11. Retrieved from https://onlinelibrary.wiley.com/doi/epdf/10.1002/j.2330-8516.1984.tb00048.x
  • Magis D. & Raiche G. (2011). catR: An R package for computerized adaptive testing. Applied Psychological Measurement, 35, 576-577.
  • Magis, D., Yan, D. & von-Davier, A. (Eds.). (2017). Computerized adaptive and multistage testing with R: Using packages catr and mstr. Switzerland: Springer.
  • R Core Team. (2014). R: A language and environment for statistical computing [Computer software manual]. Vienna, Austria. Retrieved from http://www.R-project.org/
  • Thissen, D. & Mislevy, R. J. (2000). Testing algorithms. In H. Wainer (Ed.), Computerized adaptive testing: A primer (2. ed.). Mahwah N.J.: Lawrence Erlbaum Associates.
  • Thompson, N. A. (2007). A practitioner’s guide for variable-length computerized classification testing. Practical Assessment Research & Evaluation, 12(1). Retrieved from http://pareonline.net/getvn.asp?v=12&n=1
  • Wainer, H. (2000). Introduction and history. In H. Wainer (Ed.), Computerized adaptive testing: A primer (2.ed., p. 1–22). Mahwah N.J.: Lawrence Erlbaum Associates.
  • Wainer, H. & Mislevy, R. J. (2000). Item response theory, item calibration, and proficiency estimation. In H. Wainer (Ed.), Computerized adaptive testing: A primer (2. ed.). Mahwah N.J.: Lawrence Erlbaum Associates.
  • Wang, K. (2017). A fair comparison of the performance of computerized adaptive testing and multistage adaptive testing (Doctoral Dissertation). Michigan State University.
  • Weiss, D. J. & Kingsbury, G. G. (1984). Application of computer adaptive testing to educational problems. Journal of Educational Measurement, 21(4), 361–375. https://doi.org/10.1111/j.1745-3984.1984.tb01040.x
  • Weiss, D. J. & Guyer, R. (2010). Manual for CATSim: Comprehensive simulation of computerized adaptive testing. St. Paul MN: Assessment Systems Corporation.
  • Yan, D., von-Davier, A. A. & Lewis, C. (2014b). Overview of computerized multistage tests. In D. Yan, A. A. von-Davier & C. Lewis (Eds.), Computerized multistage testing. CRC Press: Taylor&Francis Group.

Ayrıntılar

Birincil Dil İngilizce
Konular Eğitim Üzerine Çalışmalar
Bölüm Special Issue
Yazarlar

Basak ERDEM KARA Bu kişi benim 0000-0003-3066-2892

Yayımlanma Tarihi 30 Aralık 2019
Gönderilme Tarihi 17 Eylül 2019
Yayımlandığı Sayı Yıl 2019 Cilt: 6 Sayı: 5

Kaynak Göster

APA ERDEM KARA, B. (2019). Computer Adaptive Testing Simulations in R. International Journal of Assessment Tools in Education, 6(5), 44-56. https://doi.org/10.21449/ijate.621157

23824         23823             23825