Investigating Differential Item Functioning of an International Mathematics Competition Items across Gender Groups
Öz
Mathematical problem-solving competitions have existed for over a century. Scholars report the gender gap in these competitions. As a result, it is necessary to determine whether any score difference between gender groups is attributable to a genuine difference or is the result of the exam itself. Thus, the current study specifically examined bias in one of the well-known mathematics competitions: the Kangaroo Mathematics competition. Determining the fairness of Kangaroo mathematics competition items across gender groups is crucial for creating accurate comparisons and avoiding unintended construct irrelevant bias. To examine the bias, Differential Item Functioning (DIF) analyses were conducted using Logistic Regression, Mantel-Haenszel, and Item Response Theory Likelihood Ratio Test DIF detection methods. After a series of investigations, out of 336 items, it was concluded that these mathematics items were free of DIF and bias across the gender groups. Further implications were discussed in detail regarding the validity and bias.
Anahtar Kelimeler
DIF, bias, mathematical problem-solving competitions, logistic regression, Mantel-Haenszel, Item Response Theory Likelihood Ratio Test
Kaynakça
- Akveld, M., Caceres-Duque, L. F., & Geretschläger, R. (2020). Math Kangaroo. Mathematics Competitions, 33(2), 48–66.
- Akveld, M., Caceres-Duque, L. F., Nieto Said, J. H., & Sánchez Lamoneda, R. (2020). The Math Kangaroo Competition. Espacio Matemático, 1(2), 74–91.
- Allalouf, A., Hambleton, R. K., & Sireci, S. G. (1999). Identifying the causes of DIF in translated verbal items. Journal of Educational Measurement, 36(3), 185–198. https://doi.org/10.1111/j.1745-3984.1999.tb00553.x
- American Educational Research Association, American Psychological Association, & National Council on Measurement in Education (2014). Standards for educational and psychological testing. Washington, D.C: American Educational Research Association.
- Andritsch, L., Hauke, E., & Kelz, J. (2020). How to create and solve: Analysis of items from the Mathematical Kangaroo from two perspectives. In R. Geretschläger (Ed.), Engaging young students in mathematics through competitions—World perspectives and practices, Vol. II: Mathematics competitions and how they relate to research, teaching and motivation (pp. 117–136). World Scientific.
- Applebaum, M., & Leikin, R. (2019). Girls’ performance in the Kangaroo contest. In M. Nolte (Ed.), Including the Highly Gifted and Creative Students–Current Ideas and Future Directions-Proceedings of the 11th International Conference on Mathematical Creativity and Giftedness (mcg 11), (pp. 87–94). Hamburg, Germany.
- Arikan, S. (2019). Are Differentially Functioning Mathematics Items Reason of Low Achievement of Turkish Students in PISA 2015? Journal of Measurement and Evaluation in Education and Psychology, 10(1), 49–67. https://doi:10.21031/epod.466860
- Baniasadi, A., Salehi, K., Khodaie, E., Bagheri Noaparast, K., & Izanloo, B. (2023). Fairness in classroom assessment: A systematic review. The Asia-Pacific Education Researcher, 32, 91–109. https://doi.org/10.1007/s40299-021-00636-z
- Berrío, Á. I., Gomez-Benito, J., & Arias-Patiño, E. M. (2020). Developments and trends in research on methods of detecting differential item functioning. Educational Research Review, 31, 100340. https://doi.org/10.1016/j.edurev.2020.100340
- Cohen, J. (1988). Statistical power analysis for the behavioral sciences, (2nd ed.). Hillsdale, NJ: Erlbaum.