Öğrencilerin Duyuşsal Özelliklerine Göre Oluşan Gizil Sınıfların Cinsiyete Göre Farklılaşan Madde Fonksiyonu’na Etkisi

Year 2017, Volume: 16 Issue: 4, 1917 - 1931, 16.08.2017

Seher Yalçın

https://doi.org/10.17051/ilkonline.2017.364505

Abstract

Bu çalışma üç aşamada gerçekleşmiştir. İlk olarak aynı yetenek
düzeyindeki öğrencilerin cinsiyete göre, bir fen maddesini doğru ya da yanlış
yanıtlamasında oluşan farklılığı olası açıklayabilecek öğrencilerin duyuşsal
özellikleri belirlenmiştir. İkinci aşamada, belirlenen duyuşsal özelliklerin
gizil sınıf oluşturma durumları tespit edilmiştir. Son aşamada, aynı maddelerin
oluşan gizil sınıflarda farklılaşan madde fonksiyonu (FMF) gösterip
göstermediğini belirlemek amaçlanmıştır. Betimsel
tarama modelinde olan araştırmanın, çalışma grubunu 875 öğrenci oluşturmuştur.
İlk aşamada, öğrencilerin duyuşsal özelliklerine göre oluşan gizil sınıfları
belirlemek için gizil sınıf analizi kullanılmıştır. Analizlerin ikinci
aşamasında, öğrencilerin duyuşsal özelliklerine göre oluşan gizil sınıflarda ve
tüm grup için maddelerin farklı fonksiyonlaşma durumunu belirlemek için Mantel-Haenszel
yöntemi kullanılmıştır. Tüm grup için yapılan FMF analizlerine göre ele alınan maddelerin sadece
birinde FMF tespit edilmektedir. Ancak öğrenciler bazı duyuşsal özelliklerine
göre gizil sınıflara ayrıldığında, bu maddenin iki gizil sınıfta FMF
göstermediği, bir sınıfta ise farklı bir maddenin de FMF gösterdiği tespit
edilmiştir.

Keywords

Farklılaşan madde fonksiyonu, duyuşsal özelllikler, gizil sınıf analizi, TIMSS, fen bilimleri

The Effect of Latent Classes Formed According to the Affective Characteristics of Students on Differential Item Functioning Based on Sex

Abstract

This study is carried out in three stages. First,
students' affective characteristics which may possibly explain the difference
in the answering a science item correctly or wrong are determined according to
the sex of the students who are at the same level of ability. The status of
identified affective characteristics' forming latent classes is determined in
the second stage. In the last stage, it is aimed to determine whether or not
the same items display differential item functioning (DIF) in the emerged
latent classes. The study group of this research, which is in a descriptive
survey model consists of 875 students. In the first staged of data analysis, latent
class analysis is used to determine the latent classes that are formed
according to the students' affective characteristics. In
the second phase of the analysis, Mantel-Haenszel method is used in order to
determine the state of differential functioning of the items for the whole
group and in the latent classes emerged according to the students’ affective
characteristics. According to the fact that the DIF analyses are carried out
for the entire group, DIF is detected only in one of the items. However, it is
found out that when the students are classified into latent classes according
to some affective characteristics, this item did not display DIF in two latent groups
and in one class, another item also displayed DIF.

Keywords

Differential item functioning, affective characteristics, latent class analysis, TIMSS

References

• Albano, D. A., & Rodriguez, M. C. (2013). Examining differential math performance by gender and opportunity to learn. Educational and Psychological Measurement, 73(5), 836-856. Anıl, D. (2009). Uluslararası öğrenci başarılarını değerlendirme programı (PISA)'nda Türkiye'deki öğrencilerin fen bilimleri başarılarını etkileyen faktörler. Eğitim ve Bilim, 34, 87-100. Atar, B. & Aktan, D. Ç. (2013). Örtük regresyon iki parametreli lojistik modeli. Eğitim ve Bilim, 38(168), 59-68. Atar, H. Y. & Atar, B. (2012). Türk eğitim reformunun öğrencilerin TIMSS 2007 fen başarılarına etkisinin incelenmesi. Kuram ve Uygulamada Eğitim Bilimleri, 12(4), 2621-2636. Baker, D. (2002). Where is gender and equity in science education? Journal of Research in Science Teaching, 39, 659–663. Balluerka, N., Gorostiaga, A., Gómez-Benito, J., & Hidalgo, D. (2010). Use of multilevel logistic regression to identify the causes of differential item functioning. Psicothema, 22(4), 1018-1025. Bayraktar, Ş. (2011). Uluslararası fen ve matematik çalışması (TIMSS 2007) sonuçlarına göre Türkiye’de fen eğitiminin durumu: Fen başarısını etkileyen faktörler. Selçuk Üniversitesi Ahmet Keleşoğlu Eğitim Fakültesi Dergisi, 30, 249-270. Berberoğlu, G. (1996). The university entrance examinations in Turkey. Studies in Educational Evaluation, 22(4), 363-373. Beretvas, S. N., Cawthon, S. W., Lockhart, L. L., & Kaye, A. D. (2012). Assessing impact, DIF, and DFF in accommodated item scores: A comparison of multilevel measurement model parameterizations. Educational and Psychological Measurement, 72, 754-773. Bursal, M. (2013). İlköğretim öğrencilerinin 4-8. sınıf fen akademik başarılarının boylamsal incelenmesi: Sınıf düzeyi ve cinsiyet farklılıkları. Kuram ve Uygulamada Eğitim Bilimleri, 13(2), 1141-1156. Bursal, M., Buldur, S. & Dede, Y. (2015). Alt sosyo-ekonomik düzeyli ilköğretim öğrencilerinin 4-8. sınıflar fen ve matematik ders başarıları: Cinsiyet perspektifi. Eğitim ve Bilim, 40(179), 133-145. Calvert, T. (2002). Exploring differential item functioning (DIF) with the rasch model: A comparison of gender differences on eighth grade science items in the United States and Spain. Unpublished doctoral dissertation, University of Emery, Atlanta. Chaimongkol, S. (2005). Modeling differential item functionıng (DIF) using multilevel logistic regression models: A bayesian perspective. Unpublished doctoral dissertation, University of Florida State, Tallahassee. Chang, M., Singh, K., & Mo, Y. (2007). Science engagement and science achievement: Longitudinal models using NELS data. Educational Research and Evaluation, 13(4), 349-371. Chang, Y. (2008). Gender differences in science achievement, science selfconcept, and science values. Proceedings of the IRC, Chinese Taipei. Clauser, B. E., & Mazor, K. M. (1998). Using statistical procedures to identify differentially functioning test items. Educational Measurement: Issues and Practice, 17(1), 31-44. Çepni, Z. (2011). Değişen madde fonksiyonlarının SIBTEST, mantel haenszel, lojistik regresyon ve madde tepki kuramı yöntemleriyle incelenmesi. Yayımlanmamış doktora tezi, Hacettepe Üniversitesi Sosyal Bilimler Enstitüsü, Ankara. Demirtaşlı, N. & Ulutaş, S. (2015). A study on detecting differential item functioning of PISA 2006 science literacy items in Turkish and American samples. Eurasian Journal of Educational Research, 58, 41-60. http://dx.doi.org/10.14689/ejer.2015.58.3 Doğan, N. & Öğretmen, T. (2008). Değişen madde fonksiyonunu belirlemede mantel‐ haenszel, ki‐kare ve lojistik regresyon tekniklerinin karşılaştırılması. Eğitim ve Bilim, 33(148), 100-112. Dorans, N. J., & Holland, P. W. (1993). DIF detection and description: Mantel Haenszel and standardization. In P. W. Holland, ve H. Wainer, (Eds.), Differential item functioning (pp. 35–66), New Jersey: USA. Embretson, S. E., & Reise, S. P. (2000). Item response theory for psychologists. Mahwah, NJ: Lawrence Erlbaum Associates. Esen, Y. & Bağlı, M. T. (2003). İlköğretim ders kitaplarındaki kadın ve erkek resimlerine ilişkin bir inceleme. Ankara Üniversitesi Eğitim Bilimleri Fakültesi Dergisi, 35(1-2), 143-154. Eurydice. (2010). Eğitim çıktılarında cinsiyet farklılıkları: Avrupa’da alınan tedbirler ve mevcut durum. Eurydice Raporu, Brüksel. 16 Eylül 2014 tarihinde http://eacea.ec.europa.eu/education/eurydice/documents/thematic_reports/120TR.pdf adresinden erişilmiştir. Ghagar, M. N., Othman, R., & Mohammadpour, E. (2011). Multilevel analysis of achievement in mathematics of Malaysian and Singaporean students. Journal of Educational Psychology and Counseling, 2, 285-304. Guyer, R., & Thompson, N. A. (2014). User’s manual for Xcalibre item response theory calibration software, version 4.2.2 and later. Woodbury MN: Assessment Systems Corporation. Hambleton, R. K., Swaminathan, H., & Rogers, H. J. (1991). Fundamentals of item response theory. Newbury Park, CA: SAGE Publications. Holland, P. W., & Thayer, D. T. (1988). Differential item performance and the mantel-haenszel procedure. In H. Wainer, and H. I. Brown (Eds.), Test validity (pp. 129-145). Hillsdale, NJ: Lawrence Erlbaum Associates. IEA. (2016). TIMSS 2015 international database, item information tables. https://timssandpirls.bc.edu/timss2015/international-database/ Kahle, J. B., Parker, L. H., Rennie, L. J., & Riley, D. (1993). Gender differences in science education: Building a model. Educational Psychologist, 28, 379-404. Kahraman, N. (2014). Cross-grade comparison of relationship between students’ engagement and TIMSS 2011 science achievement. Education and Science, 39(172), 95-107. Kalaycıoğlu, D. B. & Kelecioğlu, H. (2011). Öğrenci seçme sınavının madde yanlılığı açısından incelenmesi. Eğitim ve Bilim, 36, 3-13. Kamata, A. (2001). Item analysis by the hierarchical generalized linear model. Journal of Educational Measurement, 38(1), 79–93. Kamata, A., & Binici, S. (2003, July). Random effect DIF analysis via hierarchical generalized linear modeling. Paper presented at the biannual International Meeting of the Psychometric Society, Sardinia, Italy. Kamata, A., Chaimongkol, S., Genc, E., & Bilir, K. (2005, April). Random-effect differential item functioning across group unites by the hierarchical generalized linear model. Paper presented at the annual meeting of the American Educational Research Association, Montreal, Canada. Karakaya, İ. & Kutlu, Ö. (2012). Seviye belirleme sınavındaki türkçe alt testlerinin madde yanlılığının incelenmesi. Eğitim ve Bilim, 37, 165. Kaya, S., & Rice, D. C. (2010). Multilevel effects of student and classroom factors on elementary science achievement in five countries. International Journal of Science Education, 32(10), 1337-1363. Kelecioğlu, H., Karabay, B. & Karabay, E. (2014). Investigation of placement test in terms of item biasness. Elementary Education Online, 13(3), 934-953. Kırbaşoğlu- Kılıç. L. & Bircan, E. (2011). İlköğretim türkçe ders kitaplarında ortaya çıkan toplumsal cinsiyet rolleri üzerine bir inceleme. Sosyal Bilimler Araştırmaları Dergisi, 6(2), 129-148. Kiamanesh, A. R. (2004, July). Self-concept, home back-ground, motivation, attribution and their effects on Iranian students’ science achievement. Paper presented at the Third International Biennial SELF Research Conference, Berlin, Germany. Kuzgun, Y. & Sevim, A. S. (2004). Kadınların çalışmasına karşı tutum ve dini yönelim arasındaki ilişki. Ankara Üniversitesi Eğitim Bilimleri Fakültesi Dergisi, 37(1), 14-27. Le, L. T. (2009). Investigating gender differential item functioning across countries and test language of PISA science items. International Journal of Testing, 9, 122-133. Lukočienė, O., Varriale, R., & Vermunt, J. K. (2010). The simultaneous decision(s) about the number of lower and higher-level classes in multilevel latent class analysis. Sociological Methodology, 40(1), 247-283. doi: 10.1111/j.1467-9531.2010.01231.x Luppescu, S. (2002, April). DIF detection in HLM item analysis. Paper presented at the annual meeting of the American Educational Research Association, New Orleans, LA. Mantel, N. & Haenszel, W. (1959) Statistical aspects of the analysis of data from retrospective studies of disease. Journal of the National Cancer Institute, 22, 719-748. Martin, M. O., Mullis, I. V. S., Foy, P. & Hooper, M. (2016). TIMSS 2015 international results in science. Retrieved from Boston College, TIMSS & PIRLS International Student Center website: http://timssandpirls.bc.edu/timss2015/international-results/wp-content/uploads/filebase/full%20pdfs/T15-International-Results-in-Science-Grade-8.pdf Mellenbergh, G. J. (1989). Item bias and item response theory. International Journal of Educational Research, 13, 127-143. Meulders, M., & Xie, Y. (2004). Person-by-item predictors. In P. De Boeck and M. Wilson (Eds.), Explanatory item response models: A generalized linear and nonlinear approach (pp. 213-240). New York: Springer-Verlag. Mo, Y. (2008). Opportunity to learn, engagement, and science achievement: Evidence form TIMSS 2003 Data. Unpublished doctoral dissertation, Virginia Polytechnic Institute and State University, Blacksburg, Virginia. Mo, Y., Singh, K., & Chang, M. (2013). Opportunity to learn and student engagement: A HLM study on eighth grade science achievement. Educational Research for Policy & Practice, 12(1), 3-19. Mohammadpour, E. (2012). A multilevel study on trends in malaysian secondary school students’ science achievement and associated school and student predictors. Science Education, 96(6), 1013-1046. Ong, Y. M., Williams, J., & Lamprianou, I. (2011). Exploring differential bundle functioning in mathematics by gender: The effect of hierarchical modelling. International Journal of Testing, 11, 271–293. Osterlind, J. S. (1983). Test item bias. London: Sage Publications. Özmen, D. T. (2014). PISA 2009 okuma testi maddelerinin yanlılığı üzerine bir çalışma. Eğitim Bilimleri ve Uygulama, 13(26), 147-165. Qian, X. (2011). A multi-level differential item functioning analysis of trends in international mathematics and science study: Potential sources of gender and minority difference among U.S. eighth graders' science achievement. Unpublished doctoral dissertation, Faculty of the University of Delaware. Socha, A., DeMars, C. E., Zilberberg, A. & Phan, H. (2015). Differential item functioning detection with the mantel-haenszel procedure: The effects of matching types and other factors. International Journal of Testing, 15(3), 193-215, DOI: 10.1080/15305058.2014.984066 Thomson, S., & Fleming, N. (2004). Examining the evidence: Science achievement in Australian schools in TIMSS 2002 (TIMSS Australia Monograph No 7). Melbourne, VIC: ACER Press Thomson, S., Wernert, N., Underwood, C., & Nicholas, M. (2008). TIMSS 2007: Taking a closer look at mathematics and science in Australia. Trends in International Mathematics and Science Study, Camberwell, Vic. Tighezza, M. (2014). Modeling relationships among learning, attitude, self-perception, and science achievement for grade 8 Saudi students. International Journal of Science and Mathematics Education, 12(4), 721-740. Turhan, A. (2006). Multilevel 2PL item response model vertical equating with the presence of differential item functioning. Unpublished doctoral dissertation, University of Florida State, Tallahassee. Vatandaş, C. (2007). Toplumsal cinsiyet ve cinsiyet rollerinin algılanışı. Sosyoloji Konferansları, 35, 29-56. Vermunt, J. K. (2003). Multilevel latent class models. Sociological Methodology, 33(1), 213-239. doi: 10.1111/j.0081-1750.2003.t01- 1-00131.x Vermunt, J. K., & Madigson, J. (2004). Local independence. In A. B. M. S. Lewis Beck (Ed.), Encyclopedia of social sciences research methods (pp. 732-733). Thousand Oaks: Sage Publications. Vermunt, J. K., & Magidson, J. (2013a). Latent GOLD 5.0 upgrade manual. Belmont, MA: Statistical Innovations Inc. Vermunt, J. K., & Magidson, J. (2013b). LG-syntax user’s guide: Manual for latent GOLD 5.0 syntax module. Belmont, MA: Statistical Innovations Inc. Williams, N. J., & Beretvas, S. N. (2006). DIF identification using HGLM for polytomous items. Applied Psychological Measurement, 30, 22-42. Wong, K. Y. (2012). Gender differences in scientific literacy of HKPISA 2006: A multidimensional differential item functioning and multilevel mediation study. Unpublished doctoral dissertation, The Chinese University of Hong Kong, Hong Kong. Yalçın, S., & Tavşancıl, E. (2015). The factors explaining the differential item functioning in the administration of TIMSS 2011 science test according to gender. Educational Sciences and Practice, 14(27), 1-21. Yıldırım, A., Özgürlük, B., Parlak, B., Gönen, E., & Polat, M. (2016). TIMSS 2015 ulusal matematik ve fen bilimleri ön raporu 4. ve 8. sınıflar. MEB: Ölçme, Değerlendirme ve Sınav Hizmetleri Genel Müdürlüğü. Yip, D. Y., Chiu, M. M., & Ho, S. C. (2004). Hong Kong student achievement in OECD-PISA study: Gender differences in science content, literacy skills and test item formats. International Journal of Science and Mathematics Education, 2(1), 91-106. Yung, B. H. W. (2006). Learning from TIMSS implications for teaching and learning science at the junior secondary level. Education and Manpower Bureau, Hong Kong (China): Government Logistics Department. Zheng, X. (2009). Multilevel item response modeling: Applications to large-scale assessment of academic achievement. Unpublished doctoral dissertation, University of California, Berkeley. Zumbo, B. D. (2007). Three generations of DIF analyses: Considering where it has been, where it is now, and where it is going. Language Assessment Quarterly, 4(2), 223–233. Zumbo, B. D., & Gelin, M. N. (2005). A matter of test bias in educational policy research: Bringing the context into picture by investigating sociological/community moderated (or mediated) test and item bias. Journal of Educational Research and Policy Studies, 5, 1-2. Zwick, R. (2012). A review of ets differential item functioning assessment procedures: Flagging rules, minimum sample size requirements, and criterion refinement. ETS, Research Report. https://www.ets.org/Media/Research/pdf/RR-12-08.pdf