The Effect of the Item–Attribute Relation on the DINA Model Estimations in the Presence of Missing Data
Öz
The objective of this study is to investigate the relation between the number of items and attributes and to analyze the manner in which the different rates of missing data affect the model estimations based on the simulation data. A Q-matrix contains 24 items, and data are generated using four attributes. A dataset of n = 3000 is generated by associating the first, middle, and final eight items in the Q-matrix with one, two, and three attributes, respectively, and 5%, 10%, and 15% of the data have been randomly deleted from the first, middle, and final eight-item blocks in the Q-matrix, respectively. Subsequently, imputation was performed using the multiple imputation (MI) method with these datasets, 100 replication was performed for each condition. The values obtained from these datasets were compared with the values obtained from the full dataset. Thus, it can be observed that an increase in the amount of missing data negatively affects the consistency of the DINA parameters and the latent class estimations. Further, the latent class consistency becomes less affected by the missing data as the number of attributes associated with the items increase. With an increase in the number of attributes associated with the items, the missing data in these items affect the consistency level of the g parameter (guessing) less and the s parameter (slip) more. Furthermore, it can be observed from the results that the test developers using the cognitive diagnosis models should specifically consider the item–attribute relation in items with missing data.
Anahtar Kelimeler
DINA model,missing data,latent class estimates,item–attribute relation
Kaynakça
- Başokçu, T. O. , Kalkan, Ö. K., & Öğretmen, T. (2016, September). DINA Modele Dayalı Madde Parametre Kestiriminde Kayıp Veri Ele Alma Yöntemleri Etkisinin İncelenmesi. [An Investigation of the Effect of Missing Data Handling Methods on Parameter Estimation Based on DINA Model]. Paper presented at the Fifth International Congress on Measurement and Evaluation in Education and Psychology, Antalya, Turkey. p134-135. Abstract retrieved from http://epod2016.akdeniz.edu.tr/_dinamik/333/53.pdf
- Bennett, D. A. (2001). How can i deal with missing data in my study? Australian and New Zealand journal of public health, 25(5), 464-469.
- Buuren, S. V., & Groothuis-Oudshoorn, K. (2011). mice: Multivariate imputation by chained equations in R. Journal of statistical software, 45(3), 1-67.
- Chen, J. (2017). A Residual-Based Approach to Validate Q-Matrix Specifications. Applied Psychological Measurement, (135), 014662161668602. https://doi.org/10.1177/0146621616686021de La Torre, J. (2008). An Empirically Based Method of Q‐Matrix Validation for the DINA Model: Development and Applications. Journal of educational measurement, 45(4), 343-362.
- de La Torre, J. (2009). DINA model and parameter estimation: A didactic. Journal of educational and behavioral statistics, 34(1), 115-130.
- de La Torre, J. (2011). The generalized DINA model framework. Psychometrika, 76(2), 179-199.
- de la Torre, J., & Douglas, J. A. (2008). Model evaluation and multiple strategies in cognitive diagnosis: An analysis of fraction subtraction data.Psychometrika, 73(4), 595-624.
- de La Torre, J., Hong, Y., & Deng, W. (2010). Factors affecting the item parameter estimation and classification accuracy of the DINA model. Journal of Educational Measurement, 47(2), 227-249.
- de la Torre, J., & Lee, Y. S. (2010). A Note on the Invariance of the DINA Model Parameters. Journal of Educational Measurement, 47(1), 115–127. https://doi.org/10.1111/j.1745-3984.2009.00102.x
- Dong, Y., & Peng, C. Y. J. (2013). Principled missing data methods for researchers. SpringerPlus, 2(1), 222.