Adaptation and psychometric evaluation of the COVID-19 stress scales in Turkish sample

Abstract

This study aimed to adapt the COVID-19 Stress Scales (CSS) into Turkish and provide evidence for construct validity. For this purpose, firstly, Confirmatory factor analysis (CFA) was applied for the 5-factor model obtained during the development of CSS and the theoretically expected 6-factor model with total of 546 respondents. The findings revealed that the 6-factor model of CSS had a better fit in the Turkish sample. Factor loadings varied between .62 - .95 and correlations between subscales were between .44 - .76. Cronbach's Alpha and McDonald’s ω coefficients for each subscale indicated good-to-excellent internal consistency. To evaluate the criterion-related validity, the Turkish version of The Fear of COVID-19 Scale (FCV-19S) was administered to the participants and the correlation coefficients between this scale and the six subscale of CSS were calculated. We also conducted the Rasch analysis with related items to provide psychometric evidence for their unidimensional structure of each of the six subscales. Lastly, Differential item functioning (DIF) analysis was performed across subgroups by gender, having COVID-19, and being a student. Overall, the results of both CFA and Rasch analyses provided evidence to support the substantive aspect of validity and the appropriateness of the CSS as a measure of COVID-19 stress level in a Turkish sample.

Keywords

• Covid related stress
• Scale adaptation
• Confirmatory factor analysis
• Rasch analysis

References

1. Abbady, A. S., El-Gilany, A. H., El-Dabee, F. A., Elsadek, A. M., ElWasify, M., & Elwasify, M. (2021). Psychometric characteristics of the of COVID Stress Scales-Arabic version (CSS-Arabic) in Egyptian and Saudi university students. Middle East Current Psychiatry, 28(1). https://doi.org/10.1186/s43045-021-00095-8
2. Ahorsu, D. K., Lin, C. Y., Imani, V., Saffari, M., Griffiths, M. D., & Pakpour, A. H. (2020). The Fear of COVID-19 Scale: Development and Initial Validation. International Journal of Mental Health and Addiction. https://doi.org/10.1007/s11469-020-00270-8
3. Andrich, D. (1978). A rating formulation for ordered response categories. Psychometrika, 43(4), 561–573. https://doi.org/10.1007/BF02293814
4. Asmundson, G. J. G., Paluszek, M. M., Landry, C. A., Rachor, G. S., McKay, D., & Taylor, S. (2020). Do pre-existing anxiety-related and mood disorders differentially impact COVID-19 stress responses and coping? Journal of Anxiety Disorders, 74(June). https://doi.org/10.1016/j.janxdis.2020.102271
5. Baenas, I., Caravaca-Sanz, E., Granero, R., Sánchez, I., Riesco, N., Testa, G., Vintró-Alcaraz, C., Treasure, J., Jiménez-Murcia, S., & Fernández-Aranda, F. (2020). COVID-19 and eating disorders during confinement: Analysis of factors associated with resilience and aggravation of symptoms. European Eating Disorders Review, 28(6), 855–863. https://doi.org/10.1002/erv.2771
6. Bernardo, A. B. I., & Mendoza, N. B. (2020). Measuring hope during the COVID-19 outbreak in the Philippines: development and validation of the state locus-of-Hope scale short form in Filipino. Current Psychology. https://doi.org/10.1007/s12144-020-00887-x
7. Biçer, İ., Çakmak, C., & Demir, H. (2020). Coronavirus Anxiety Scale Short Form: Turkish Validity and Reliability Study. Anadolu Kliniği Tıp Bilimleri Dergisi, 216–225. https://doi.org/10.21673/anadoluklin.731092
8. Bond, T. G., & Fox, C. M. (2015). Applying the Rasch model: Fundamental measurement in the human sciences. Routledge.

9. Boyraz, G., & Legros, D. N. (2020). Coronavirus Disease (COVID-19) and Traumatic Stress: Probable Risk Factors and Correlates of Posttraumatic Stress Disorder. Journal of Loss and Trauma, 25(6–7), 503–522. https://doi.org/10.1080/15325024.2020.1763556
10. Bueno-Notivol, J., Gracia-García, P., Olaya, B., Lasheras, I., López-Antón, R., & Santabárbara, J. (2021). Prevalence of depression during the COVID-19 outbreak: A meta-analysis of community-based studies. International Journal of Clinical and Health Psychology, 21(1). https://doi.org/10.1016/j.ijchp.2020.07.007
11. Crocker, L., & Algina, J. (1986). Introduction to classical and modern test theory. Holt, Rinehart and Winston.
12. Evren, C., Evren, B., Dalbudak, E., Topcu, M., & Kutlu, N. (2020). Measuring anxiety related to COVID-19: A Turkish validation study of the Coronavirus Anxiety Scale. Death Studies, 0(0), 1–7. https://doi.org/10.1080/07481187.2020.1774969
13. Gallagher, M. W., Zvolensky, M. J., Long, L. J., Rogers, A. H., & Garey, L. (2020). The Impact of COVID-19 Experiences and Associated Stress on Anxiety, Depression, and Functional Impairment in American Adults. Cognitive Therapy and Research, 44(6), 1043–1051. https://doi.org/10.1007/s10608-020-10143-y
14. Gavin, B., Lyne, J., & McNicholas, F. (2020). Mental health and the COVID-19 pandemic. Irish Journal of Psychological Medicine, 37(3), 156–158. https://doi.org/10.1017/ipm.2020.72
15. Hu, L., & Bentler, P. M. (1998). Fit indices in covariance structure modeling: Sensitivity to underparameterized model misspecifcation. Psychological Methods, 3, 424–453.
16. Hu, L., & Bentler, P. M. (1999). Cutoff criteria for ft indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1–55.
17. Janmaat, J. G., & Keating, A. (2019). Are today’s youth more tolerant? Trends in tolerance among young people in Britain. Ethnicities, 19(1), 44–65. https://doi.org/10.1177/1468796817723682
18. Khosravani, V., Asmundson, G. J. G., Taylor, S., Sharifi Bastan, F., & Samimi Ardestani, S. M. (2021). The Persian COVID stress scales (Persian-CSS) and COVID-19-related stress reactions in patients with obsessive-compulsive and anxiety disorders. Journal of Obsessive-Compulsive and Related Disorders, 28(September 2020), 100615. https://doi.org/10.1016/j.jocrd.2020.100615
19. Lee, S. A. (2020). Coronavirus Anxiety Scale: A brief mental health screener for COVID-19 related anxiety. Death Studies, 44(7), 393–401. https://doi.org/10.1080/07481187.2020.1748481
20. Lee, S. A., Jobe, M. C., Mathis, A. A., & Gibbons, J. A. (2020). Incremental validity of coronaphobia: Coronavirus anxiety explains depression, generalized anxiety, and death anxiety. Journal of Anxiety Disorders, 74(June), 6–9. https://doi.org/10.1016/j.janxdis.2020.102268
21. Linacre, J. M. (1999). Investigating rating scale category utility. Journal of Outcome Measurement, 3(2), 103-122.
22. Linacre, J. M. (2004). Rasch model estimation: Further topics. Journal of Applied Measurement, 5(1), 95-110.
23. Linacre, J. M. (2009). Winsteps (Version 3.68.2) [Computer software].
24. Liu, S., Lithopoulos, A., Zhang, C. Q., Garcia-Barrera, M. A., & Rhodes, R. E. (2021). Personality and perceived stress during COVID-19 pandemic: Testing the mediating role of perceived threat and efficacy. Personality and Individual Differences, 168(August 2020), 110351. https://doi.org/10.1016/j.paid.2020.110351
25. Mazza, C., Ricci, E., Biondi, S., Colasanti, M., Ferracuti, S., Napoli, C., & Roma, P. (2020). A nationwide survey of psychological distress among italian people during the COVID-19 pandemic: Immediate psychological responses and associated factors. International Journal of Environmental Research and Public Health [revista en Internet] 2020 [acceso. International Journal of Environmental Research and Public Health, 17, 1–14. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7246819/pdf/ijerph-17-03165.pdf
26. Mertens, G., Gerritsen, L., Duijndam, S., Salemink, E., & Engelhard, I. M. (2020). Fear of the coronavirus (COVID-19): Predictors in an online study conducted in March 2020. Journal of Anxiety Disorders, 74(April), 102258. https://doi.org/10.1016/j.janxdis.2020.102258
27. Pakpour, A. H., Griffiths, M. D., & Lin, C. Y. (2020). Assessing Psychological Response to the COVID-19: The Fear of COVID-19 Scale and the COVID Stress Scales. International Journal of Mental Health and Addiction. https://doi.org/10.1007/s11469-020-00334-9
28. Porcelli, P. (2020). Perspective article Fear, anxiety and health-related consequences after the COVID-19 epidemic Piero Porcelli. Clinical Neuropsychiatry, 103–111.
29. Psychology of Pandemics Network (2020). URL: https://coronaphobia.org/
30. Qiu, J., Shen, B., Zhao, M., Wang, Z., Xie, B., & Xu, Y. (2020). A nationwide survey of psychological distress among Chinese people in the COVID-19 epidemic: Implications and policy recommendations. General Psychiatry, 33(2), 1–4. https://doi.org/10.1136/gpsych-2020-100213
31. Satici, B., Gocet-Tekin, E., Deniz, M. E., & Satici, S. A. (2020). Adaptation of the Fear of COVID-19 Scale: Its Association with Psychological Distress and Life Satisfaction in Turkey. International Journal of Mental Health and Addiction. https://doi.org/10.1007/s11469-020-00294-0
32. Seçer, İ., & Ulaş, S. (2020). An Investigation of the Effect of COVID-19 on OCD in Youth in the Context of Emotional Reactivity, Experiential Avoidance, Depression and Anxiety. International Journal of Mental Health and Addiction. https://doi.org/10.1007/s11469-020-00322-z
33. Sick, J. (2010). Assumptions and requirements of Rasch measurement. SHIKEN: JALT Testing & Evaluation SIG Newsletter, 14(2), 23–29.
34. Şimşir, Z., Koç, H., Seki, T., & Griffiths, M. D. (2021). The relationship between fear of COVID-19 and mental health problems: A meta-analysis. Death Studies, 0(0), 1–9. https://doi.org/10.1080/07481187.2021.1889097
35. Taylor, S., Landry, C. A., Paluszek, M. M., Fergus, T. A., McKay, D., & Asmundson, G. J. G. (2020a). COVID stress syndrome: Concept, structure, and correlates. Depression and Anxiety, 37(8), 706–714. https://doi.org/10.1002/da.23071
36. Taylor, S., Landry, C. A., Paluszek, M. M., Fergus, T. A., McKay, D., & Asmundson, G. J. G. (2020b). Development and initial validation of the COVID Stress Scales. Journal of Anxiety Disorders, 72(April), 102232. https://doi.org/10.1016/j.janxdis.2020.102232
37. Turkish Statistical Institute. (2020). Hanehalkı Bilişim Teknolojileri (BT) Kullanım Araştırması, 2020 [Household Information Technologies (IT) Usage Survey, 2020]. Retrieved from https://data.tuik.gov.tr/Bulten/Index?p=Hanehalki-Bilisim-Teknolojileri-(BT)-Kullanim-Arastirmasi-2020-33679
38. Valiente, C., Contreras, A., Peinado, V., Trucharte, A., Martínez, A. P., & Vázquez, C. (2021). Psychological Adjustment in Spain during the COVID-19 Pandemic: Positive and Negative Mental Health Outcomes in the General Population. Spanish Journal of Psychology, 1–13. https://doi.org/10.1017/SJP.2021.7
39. Wang, C., Pan, R., Wan, X., Tan, Y., Xu, L., McIntyre, R. S., Choo, F. N., Tran, B., Ho, R., Sharma, V. K., & Ho, C. (2020). A longitudinal study on the mental health of general population during the COVID-19 epidemic in China. Brain, Behavior, and Immunity, 87(April), 40–48. https://doi.org/10.1016/j.bbi.2020.04.028
40. Wang, Y., Shi, L., Que, J., Lu, Q., Liu, L., Lu, Z., Xu, Y., Liu, J., Sun, Y., Meng, S., Yuan, K., Ran, M., Lu, L., Bao, Y., & Shi, J. (2021). The impact of quarantine on mental health status among general population in China during the COVID-19 pandemic. Molecular Psychiatry. https://doi.org/10.1038/s41380-021-01019-y
41. WHO. (2020). Mental Health and Psychosocial Considerations During COVID-19 Outbreak. World Health Organization, January, 1–6. file:///C:/Users/muled/Downloads/COVID referances/Mental health and psychosocial considerations during the.pdf
42. Wright, B. D., & Linacre, M. (1994). Reasonable mean-square fit values. Rasch Measurement Transactions, 8, 370.