Item Response Theory-Based Psychometric Investigation of SWLS for University Students

Akif Avcu

Item Response Theory-Based Psychometric Investigation of SWLS for University Students

Abstract

Life satisfaction is an important factor for mental health and has many positive effects on people. Considering its importance, different measurement tools were developed over the last 5 years. Among these tools, the Satisfaction with Life Scale (SWLS) is the most prominent and adapted to diverse populations, including university students. On the other hand, all these studies were conducted using the classical testing approach, while item response theory was rarely preferred. Regarding this gap, this study aimed to evaluate the psychometric properties of the Turkish version of SWLS by using a graded response model (GRM), which is a member of a broader family of the modern psychometric approach called Item Response Theory (IRT). For this purpose, the data were collected from 471 university students (male = 83, female = 388) aged between 17 and 37 years (M = 21.23, SD = 2.32). IRT based analysis provided satisfactory results on the psychometric properties of the SWLS. It was found that the scale's reliability was acceptable across a wide range of ability spectrums and items fit the GRM well and did not show gender-based differential item functioning. As a result, the psychometric quality of SWLS was further proved in the IRT context.

Keywords

References

Amtmann, D., Bocell, F. D., McMullen, K., Bamer, A. M., Johnson, K. L., Wiechman, S. A., & Schneider, J. C. (2020). Satisfaction with life over time in people with burn injury: a national institute on disability, independent living, and rehabilitation research burn model system study. Archives of physical medicine and rehabilitation, 101(1), S63-S70. https://doi.org/10.1016/j.apmr.2017.09.119
Andrich, D. (1978a). Application of a psychometric rating model to ordered categories which are scored with successive integers. Applied psychological measurement, 2(4), 581-594. https://doi.org/10.1177/014662167800200413
Andrich, D. (1978b). A rating formulation for ordered response categories. Psychometrika, 43(4), 561-573. https://doi.org/10.1007/BF02293814
Appleton, S., & Song, L. (2008). Life satisfaction in urban China: components and determinants. World Development, 36(11), 2325-2340. https://doi.org/10.1016/j.worlddev.2008.04.0094
Baird, B. M., Lucas, R. E., & Donnellan, M. B. (2010). Life satisfaction across the lifespan: findings from two nationally representative panel studies. Social indicators research, 99(2), 183-203. https://doi.org/10.1007/s11205-010-9584-9
Baker, F. B. (2001). The basics of item response theory. For full text: http://ericae. net/irt/baker..
Birnbaum, A. (1968). Some latent trait models and their use in inferring an examinee’s ability. In: Lord, F.M. and Novick, M.R., Eds., Statistical theories of mental test scores, Addison-Wesley, Reading, 397-479. Bond, T. G., & Fox, C. M. (2001). Applying the Rasch model (2nd ed.). Lawrence Erlbaum. Meadow, H. L., Mentzer, J. T., Rahtz, D. R., & Sirgy, M. J. (1992). A life satisfaction measure based on judgment theory. Social Indicators Research, 26(1), 23-59. https://doi.org/10.1007/BF00303824
Christensen, K. B., Makransky, G., & Horton, M. (2017). Critical values for yen’s q3: identification of local dependence in the rasch model using residual correlations. Applied Psychological Measurement, 41(3), 178-194. https://doi.org/10.1177/0146621616677520

Cox, D. R., & Snell, E. J. (1989). Analysis of binary data (Vol. 32). CRC press.
Crane P.K., van Belle G., & Larson E.B. (2004). Test bias in a cognitive test: differential item functioning in the CASI. Statistics in Medicine. 23(2), 241-256. https://doi.org/10.1002/sim.1713
Cronbach, L. J., & Shavelson, R. J. (2004). My current thoughts on coefficient alpha and successor procedures. Educational and Psychological Measurement, 64(3), 391-218. https://doi.org/10.1177/0013164404266386
Dağlı, A., & Baysal, N. (2016). Yaşam doyumu ölçeğinin türkçe’ye uyarlanmasi: geçerlik ve güvenirlik çalişmasi. Elektronik Sosyal Bilimler Dergisi, 15(59), 1250-1262. https://doi.org/10.17755/esosder.263229
DeMars, C. (2010). Item response theory. Oxford University Press.
Diener, E. & Suh, E. (1997). Measuring quality of life: Economic, social, and subjective indicators. Social Indicators Research, 40(1), 189-216. https://doi.org/10.1023/A:1006859511756
Diener, E., & Seligman, M. E. P. (2004). Beyond money: toward an economy of well-being. Psychological Science in the Public Interest, 5(1), 1-31. https://doi.org/10.1111/j.0963-7214.2004.00501001.x
Diener, E., Emmons, R.A., Larsen, R.J. & Griffin, S. (1985). The satisfaction with life scale. Journal of Personality Assessment, 49(1), 71-75. https://doi.org/10.1207/s15327752jpa4901_13
Dorahy, M., J., Lewis, C., A., Schumaker, J., F., Akuamoah-Boateng, R., Duze, M., C. ve Sibiya, T., E. (2000). Depression and life satisfaction among Australian, Ghanaian, Nigerian, Northern Irish, and Swazi university students. Journal of Social Behavior and Personality, 15(4), 569–580.
Durak, M., Senol-Durak, E. & Gencoz, T. (2010). Psychometric properties of the satisfaction with life scale among turkish university students, correctional officers, and elderly adults. Social Indicators Research. 99(3), 413-429. https://doi.org/10.1007/s11205-010-9589-4
Embretson, S. E. (1996). The new rules of measurement. Psychological Assessment, 8(4), 341-349. https://doi.org/10.1037/1040-3590.8.4.341
Funk, B. A. III, Huebner, E. S., & Valois, R. F. (2006). Reliability and validity of a brief life satisfaction scale with a high school sample. Journal of Happiness Studies: An Interdisciplinary Forum on Subjective Well-Being, 7(1), 41-54. https://doi.org/10.1007/s10902-005-0869-7
Hambleton, R. K., Shavelson, R. J., Webb, N. M., Swaminathan, H., & Rogers, H. J. (1991). Fundamentals of item response theory (Vol. 2). Sage.
Hattie J. (1985). Methodology review: Assessing unidimensionality of tests and items. Applied Psychological Measurement, 9(2), 139-164. https://doi.org/10.1177/014662168500900204
Henard, D. H. (2000). Item response theory. In L. G. Grimm & P. R. Yarnold (Eds.), Reading and understanding more multivariate statistics, (67-98). American Psychological Association publications.
Holland, P. W., & Wainer, H. (Eds.). (1993). Differential item functioning. Lawrence Erlbaum.
Huebner, E.S. (1991). Initial development of the student’s life satisfaction scale. School Psychology International. 12(3), 231-240. https://doi.org/10.1177/0143034391123010
Iwasa. H., , Kawaai. C., , Gondo. Y., Inagaki. H., & Suzuki. T. (2006). Subjective well being as a predictor of all-cause mortality among middle-aged and elderly people living in an urban Japanese community: A sevenyear prospective cohort study. Geriatrics & Gerontology International, 6(4), 216-222. https://doi.org/10.1111/j.1447-0594.2006.00351.x
Kang, T., & Chen, T. T. (2007). An Investigation of the performance of the generalized s-x2 item-fit index for polytomous IRT models. ACT Research Report Series, 2007-1. ACT, Inc.
Köker, S. (1991). Normal ve sorunlu ergenlerin yaşam doyumu düzeyinin karşılaştırılması. Master Thesis, Ankara University, Institute of Social Sciences, Ankara.
Köker, S. (1991). Normal ve sorunlu ergenlerin yaşam doyumu düzeyinin karşılaştırılması [Master Thesis, Ankara University]. Thesis Center of Higher Education.
López-Ortega, M., Torres-Castro, S., & Rosas-Carrasco, O. (2016). Psychometric properties of the satisfaction with life scale (swls): secondary analysis of the Mexican health and aging study. Health and Quality of Life Outcomes, 14(1), 1-7. https://doi.org/10.1186/s12955-016-0573-9
Lubin, B., & Van Whitlock, R. (2004). Psychometric properties of the brief life satisfaction scales. Journal of clinical psychology, 60(1), 11-27. https://doi.org/10.1002/jclp.10190
Lucas-Carrasco, R., Den Oudsten, B. L., Eser, E., & Power, M. J. (2014). Using the satisfaction with life scale in people with parkinson's disease: a validation study in different european countries. The Scientific World Journal, https://doi.org/10.1155/2014/680659
Margolis, S., Schwitzgebel, E., Ozer, D.J. and Lyubomirsky, S. (2018). A new measure of life satisfaction: the riverside life satisfaction scale. Journal of Personality Assessment. 101(6), 621-630. https://doi.org/10.1080/00223891.2018.1464457
Masten, A. S. (2001). Ordinary magic: Resilience processes in development. American Psychologist, 56(3), 227-238.
Masters, G. N. (1982). A Rasch model for partial credit scoring. Psychometrika, 47(2), 149-174. https://doi.org/10.1007/BF02296272
Matheny, K. B., Curlette, W. L., Aysan, F., Herrington, A., Gfroerer, C. A., Thompson, D., & Hamarat, E. (2002). Coping resources, perceived stress, and life satisfaction among Turkish and American university students. International Journal of Stress Management, 9(2), 81-97. https://doi.org/10.1023/A:1014902719664
Maydeu-Olivares A, Drasgow F, Mead A.D. (1994). Distinguishing among parametric item response models for polychotomous ordered data. Applied Psychological Measurement, 18(3), 245-256. https://doi.org/10.1177/014662169401800305
Meadow H. L., J. T. Mentzer, D. R. Rahtz and M. J. Sirgy. (1992). A life satisfaction measure based on judgment theory, Social Indicators Research, 26(1), 23-59. https://doi.org/10.1007/BF00303824
Muraki, E. (1992). A generalized partial credit model: application of an EM algorithm. Applied psychological measurement, 16(2), 159-176. https://doi.org/10.1002/j.2333-8504.1992.tb01436.x
Muraki, E. (1993). Information functions of the generalized partial credit model. Applied Psychological Measurement, 17(4), 351-363. https://doi.org/10.1002/j.2333-8504.1993.tb01538.x
Muthén, L. K., & Muthén, B. O. (1998-2011). Mplus User's Guide. Sixth Edition. Muthén & Muthén.
Nagelkerke, N. J. (1991). A note on a general definition of the coefficient of determination. Biometrika, 78(3), 691-692
Orlando, M., & Thissen, D. (2003). Further investigation of the performance of S-X2: An item fit index for use with dichotomous item response theory models. Applied Psychological Measurement, 27(4), 289-298. https://doi.org/10.1177/0146621603027004004
Pavot, W., & Diener, E. (1993). Review of the Satisfaction with Life Scale. Psychological Assessment, 5(2), 164- 172.
Pavot, W., Diener, E., & Suh, E. (1998). The temporal satisfaction with life scale. Journal of personality Assessment, 70(2), 340-354. https://doi.org/10.1207/s15327752jpa7002_11
R Core Team (2017). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. URL https://www.R-project.org/.
Chalmers, R.P. (2012). mirt: A multidimensional item response theory package for the r environment. Journal of Statistical Software, 48(6), 1-29.
Rasch, G. (1960). Probabilistic models for some intelligence and attainment tests, Danish Institute for Educational Research.
Sachs, J. (2003). Validation of the satisfaction with life scale in a sample of Hong Kong university students. Psychologia. 46(4), 225-234. https://doi.org/10.2117/psysoc.2003.225
Samejima F. (1969). Estimation of latent ability using a response pattern of graded scores. Psychometrika monograph supplement, 34(4), 139-139.
Seung W. Choi, with contributions from Laura E. Gibbons and Paul K. Crane (2016). lordif: Logistic Ordinal Regression Differential Item Functioning using IRT. R package version 0.3-3. https://CRAN.R-project.org/package=lordif.
Swaminathan, H., & Rogers, H. J. (1990). Detecting differential item functioning using logistic regression procedures. Journal of Educational measurement, 27(4), 361-370. https://doi.org/10.1111/j.1745-3984.1990.tb00754.x
Vazquez, C., Duque, A., & Hervas, G. (2013). Satisfaction with life scale in a representative sample of Spanish adults: validation and normative data. The Spanish journal of psychology, 16(82), 1-15.
Veenhoven, R. (1988). The Utility of Happiness. Social Indicators Research, 20(4), 333-354. https://doi.org/10.1007/BF00302332
Zanon, C., Bardagi, M.P., Layous, K. et al. (2014). Validation of the satisfaction with life scale to Brazilians: evidences of measurement noninvariance across Brazil and US. Social Indicators Research, 119(1), 443-453. https://doi.org/10.1007/s11205-013-0478-5
Zumbo, BD. (1999). A handbook on the theory and methods of differential item functioning (dif): logistic regression modeling as a unitary framework for binary and likert-type (ordinal) item scores. Directorate of Human Resources Research and Evaluation, Department of National Defense.

Details

Primary Language

English

Subjects

Other Fields of Education

Journal Section

Research Article

Authors

Akif Avcu This is me
0000-0003-1977-7592
Türkiye

Publication Date

April 21, 2021

Submission Date

December 2, 2020

Acceptance Date

March 26, 2021

Published in Issue

Year 2021 Volume: 8 Number: 2

IZ

https://izlik.org/JA77FS35YH

Cite

RIS / Bibtex

APA

Avcu, A. (2021). Item Response Theory-Based Psychometric Investigation of SWLS for University Students. International Journal of Psychology and Educational Studies, 8(2), 27-37. https://izlik.org/JA77FS35YH