Item Response Theory-Based Psychometric Investigation of SWLS for University Students

Year 2021, Volume: 8 Issue: 2, 27 - 37, 21.04.2021

Akif Avcu

Abstract

Life satisfaction is an important factor for mental health and has many positive effects on people. Considering its importance, different measurement tools were developed over the last 5 years. Among these tools, the Satisfaction with Life Scale (SWLS) is the most prominent and adapted to diverse populations, including university students. On the other hand, all these studies were conducted using the classical testing approach, while item response theory was rarely preferred. Regarding this gap, this study aimed to evaluate the psychometric properties of the Turkish version of SWLS by using a graded response model (GRM), which is a member of a broader family of the modern psychometric approach called Item Response Theory (IRT). For this purpose, the data were collected from 471 university students (male = 83, female = 388) aged between 17 and 37 years (M = 21.23, SD = 2.32). IRT based analysis provided satisfactory results on the psychometric properties of the SWLS. It was found that the scale's reliability was acceptable across a wide range of ability spectrums and items fit the GRM well and did not show gender-based differential item functioning. As a result, the psychometric quality of SWLS was further proved in the IRT context.

Keywords

item response theory, satisfaction with life, differential item functioning

References

• Amtmann, D., Bocell, F. D., McMullen, K., Bamer, A. M., Johnson, K. L., Wiechman, S. A., & Schneider, J. C. (2020). Satisfaction with life over time in people with burn injury: a national institute on disability, independent living, and rehabilitation research burn model system study. Archives of physical medicine and rehabilitation, 101(1), S63-S70. https://doi.org/10.1016/j.apmr.2017.09.119
• Andrich, D. (1978a). Application of a psychometric rating model to ordered categories which are scored with successive integers. Applied psychological measurement, 2(4), 581-594. https://doi.org/10.1177/014662167800200413
• Andrich, D. (1978b). A rating formulation for ordered response categories. Psychometrika, 43(4), 561-573. https://doi.org/10.1007/BF02293814
• Appleton, S., & Song, L. (2008). Life satisfaction in urban China: components and determinants. World Development, 36(11), 2325-2340. https://doi.org/10.1016/j.worlddev.2008.04.0094
• Baird, B. M., Lucas, R. E., & Donnellan, M. B. (2010). Life satisfaction across the lifespan: findings from two nationally representative panel studies. Social indicators research, 99(2), 183-203. https://doi.org/10.1007/s11205-010-9584-9
• Baker, F. B. (2001). The basics of item response theory. For full text: http://ericae. net/irt/baker..
• Birnbaum, A. (1968). Some latent trait models and their use in inferring an examinee’s ability. In: Lord, F.M. and Novick, M.R., Eds., Statistical theories of mental test scores, Addison-Wesley, Reading, 397-479. Bond, T. G., & Fox, C. M. (2001). Applying the Rasch model (2nd ed.). Lawrence Erlbaum. Meadow, H. L., Mentzer, J. T., Rahtz, D. R., & Sirgy, M. J. (1992). A life satisfaction measure based on judgment theory. Social Indicators Research, 26(1), 23-59. https://doi.org/10.1007/BF00303824
• Christensen, K. B., Makransky, G., & Horton, M. (2017). Critical values for yen’s q3: identification of local dependence in the rasch model using residual correlations. Applied Psychological Measurement, 41(3), 178-194. https://doi.org/10.1177/0146621616677520
• Cox, D. R., & Snell, E. J. (1989). Analysis of binary data (Vol. 32). CRC press.
• Crane P.K., van Belle G., & Larson E.B. (2004). Test bias in a cognitive test: differential item functioning in the CASI. Statistics in Medicine. 23(2), 241-256. https://doi.org/10.1002/sim.1713
• Cronbach, L. J., & Shavelson, R. J. (2004). My current thoughts on coefficient alpha and successor procedures. Educational and Psychological Measurement, 64(3), 391-218. https://doi.org/10.1177/0013164404266386
• Dağlı, A., & Baysal, N. (2016). Yaşam doyumu ölçeğinin türkçe’ye uyarlanmasi: geçerlik ve güvenirlik çalişmasi. Elektronik Sosyal Bilimler Dergisi, 15(59), 1250-1262. https://doi.org/10.17755/esosder.263229
• DeMars, C. (2010). Item response theory. Oxford University Press.
• Diener, E. & Suh, E. (1997). Measuring quality of life: Economic, social, and subjective indicators. Social Indicators Research, 40(1), 189-216. https://doi.org/10.1023/A:1006859511756
• Diener, E., & Seligman, M. E. P. (2004). Beyond money: toward an economy of well-being. Psychological Science in the Public Interest, 5(1), 1-31. https://doi.org/10.1111/j.0963-7214.2004.00501001.x
• Diener, E., Emmons, R.A., Larsen, R.J. & Griffin, S. (1985). The satisfaction with life scale. Journal of Personality Assessment, 49(1), 71-75. https://doi.org/10.1207/s15327752jpa4901_13
• Dorahy, M., J., Lewis, C., A., Schumaker, J., F., Akuamoah-Boateng, R., Duze, M., C. ve Sibiya, T., E. (2000). Depression and life satisfaction among Australian, Ghanaian, Nigerian, Northern Irish, and Swazi university students. Journal of Social Behavior and Personality, 15(4), 569–580.
• Durak, M., Senol-Durak, E. & Gencoz, T. (2010). Psychometric properties of the satisfaction with life scale among turkish university students, correctional officers, and elderly adults. Social Indicators Research. 99(3), 413-429. https://doi.org/10.1007/s11205-010-9589-4
• Embretson, S. E. (1996). The new rules of measurement. Psychological Assessment, 8(4), 341-349. https://doi.org/10.1037/1040-3590.8.4.341
• Funk, B. A. III, Huebner, E. S., & Valois, R. F. (2006). Reliability and validity of a brief life satisfaction scale with a high school sample. Journal of Happiness Studies: An Interdisciplinary Forum on Subjective Well-Being, 7(1), 41-54. https://doi.org/10.1007/s10902-005-0869-7
• Hambleton, R. K., Shavelson, R. J., Webb, N. M., Swaminathan, H., & Rogers, H. J. (1991). Fundamentals of item response theory (Vol. 2). Sage.
• Hattie J. (1985). Methodology review: Assessing unidimensionality of tests and items. Applied Psychological Measurement, 9(2), 139-164. https://doi.org/10.1177/014662168500900204
• Henard, D. H. (2000). Item response theory. In L. G. Grimm & P. R. Yarnold (Eds.), Reading and understanding more multivariate statistics, (67-98). American Psychological Association publications.
• Holland, P. W., & Wainer, H. (Eds.). (1993). Differential item functioning. Lawrence Erlbaum.
• Huebner, E.S. (1991). Initial development of the student’s life satisfaction scale. School Psychology International. 12(3), 231-240. https://doi.org/10.1177/0143034391123010
• Iwasa. H., , Kawaai. C., , Gondo. Y., Inagaki. H., & Suzuki. T. (2006). Subjective well being as a predictor of all-cause mortality among middle-aged and elderly people living in an urban Japanese community: A sevenyear prospective cohort study. Geriatrics & Gerontology International, 6(4), 216-222. https://doi.org/10.1111/j.1447-0594.2006.00351.x
• Kang, T., & Chen, T. T. (2007). An Investigation of the performance of the generalized s-x2 item-fit index for polytomous IRT models. ACT Research Report Series, 2007-1. ACT, Inc.
• Köker, S. (1991). Normal ve sorunlu ergenlerin yaşam doyumu düzeyinin karşılaştırılması. Master Thesis, Ankara University, Institute of Social Sciences, Ankara.
• Köker, S. (1991). Normal ve sorunlu ergenlerin yaşam doyumu düzeyinin karşılaştırılması [Master Thesis, Ankara University]. Thesis Center of Higher Education.
• López-Ortega, M., Torres-Castro, S., & Rosas-Carrasco, O. (2016). Psychometric properties of the satisfaction with life scale (swls): secondary analysis of the Mexican health and aging study. Health and Quality of Life Outcomes, 14(1), 1-7. https://doi.org/10.1186/s12955-016-0573-9
• Lubin, B., & Van Whitlock, R. (2004). Psychometric properties of the brief life satisfaction scales. Journal of clinical psychology, 60(1), 11-27. https://doi.org/10.1002/jclp.10190
• Lucas-Carrasco, R., Den Oudsten, B. L., Eser, E., & Power, M. J. (2014). Using the satisfaction with life scale in people with parkinson's disease: a validation study in different european countries. The Scientific World Journal, https://doi.org/10.1155/2014/680659
• Margolis, S., Schwitzgebel, E., Ozer, D.J. and Lyubomirsky, S. (2018). A new measure of life satisfaction: the riverside life satisfaction scale. Journal of Personality Assessment. 101(6), 621-630. https://doi.org/10.1080/00223891.2018.1464457
• Masten, A. S. (2001). Ordinary magic: Resilience processes in development. American Psychologist, 56(3), 227-238.
• Masters, G. N. (1982). A Rasch model for partial credit scoring. Psychometrika, 47(2), 149-174. https://doi.org/10.1007/BF02296272
• Matheny, K. B., Curlette, W. L., Aysan, F., Herrington, A., Gfroerer, C. A., Thompson, D., & Hamarat, E. (2002). Coping resources, perceived stress, and life satisfaction among Turkish and American university students. International Journal of Stress Management, 9(2), 81-97. https://doi.org/10.1023/A:1014902719664
• Maydeu-Olivares A, Drasgow F, Mead A.D. (1994). Distinguishing among parametric item response models for polychotomous ordered data. Applied Psychological Measurement, 18(3), 245-256. https://doi.org/10.1177/014662169401800305
• Meadow H. L., J. T. Mentzer, D. R. Rahtz and M. J. Sirgy. (1992). A life satisfaction measure based on judgment theory, Social Indicators Research, 26(1), 23-59. https://doi.org/10.1007/BF00303824
• Muraki, E. (1992). A generalized partial credit model: application of an EM algorithm. Applied psychological measurement, 16(2), 159-176. https://doi.org/10.1002/j.2333-8504.1992.tb01436.x
• Muraki, E. (1993). Information functions of the generalized partial credit model. Applied Psychological Measurement, 17(4), 351-363. https://doi.org/10.1002/j.2333-8504.1993.tb01538.x
• Muthén, L. K., & Muthén, B. O. (1998-2011). Mplus User's Guide. Sixth Edition. Muthén & Muthén.
• Nagelkerke, N. J. (1991). A note on a general definition of the coefficient of determination. Biometrika, 78(3), 691-692
• Orlando, M., & Thissen, D. (2003). Further investigation of the performance of S-X2: An item fit index for use with dichotomous item response theory models. Applied Psychological Measurement, 27(4), 289-298. https://doi.org/10.1177/0146621603027004004
• Pavot, W., & Diener, E. (1993). Review of the Satisfaction with Life Scale. Psychological Assessment, 5(2), 164- 172.
• Pavot, W., Diener, E., & Suh, E. (1998). The temporal satisfaction with life scale. Journal of personality Assessment, 70(2), 340-354. https://doi.org/10.1207/s15327752jpa7002_11
• R Core Team (2017). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. URL https://www.R-project.org/.
• Chalmers, R.P. (2012). mirt: A multidimensional item response theory package for the r environment. Journal of Statistical Software, 48(6), 1-29.
• Rasch, G. (1960). Probabilistic models for some intelligence and attainment tests, Danish Institute for Educational Research.
• Sachs, J. (2003). Validation of the satisfaction with life scale in a sample of Hong Kong university students. Psychologia. 46(4), 225-234. https://doi.org/10.2117/psysoc.2003.225
• Samejima F. (1969). Estimation of latent ability using a response pattern of graded scores. Psychometrika monograph supplement, 34(4), 139-139.
• Seung W. Choi, with contributions from Laura E. Gibbons and Paul K. Crane (2016). lordif: Logistic Ordinal Regression Differential Item Functioning using IRT. R package version 0.3-3. https://CRAN.R-project.org/package=lordif.
• Swaminathan, H., & Rogers, H. J. (1990). Detecting differential item functioning using logistic regression procedures. Journal of Educational measurement, 27(4), 361-370. https://doi.org/10.1111/j.1745-3984.1990.tb00754.x
• Vazquez, C., Duque, A., & Hervas, G. (2013). Satisfaction with life scale in a representative sample of Spanish adults: validation and normative data. The Spanish journal of psychology, 16(82), 1-15.
• Veenhoven, R. (1988). The Utility of Happiness. Social Indicators Research, 20(4), 333-354. https://doi.org/10.1007/BF00302332
• Zanon, C., Bardagi, M.P., Layous, K. et al. (2014). Validation of the satisfaction with life scale to Brazilians: evidences of measurement noninvariance across Brazil and US. Social Indicators Research, 119(1), 443-453. https://doi.org/10.1007/s11205-013-0478-5
• Zumbo, BD. (1999). A handbook on the theory and methods of differential item functioning (dif): logistic regression modeling as a unitary framework for binary and likert-type (ordinal) item scores. Directorate of Human Resources Research and Evaluation, Department of National Defense.