The Psychometric Properties of the Positive Mental Health Scale: Evidence from Measurement Invariance and ROC Analyses

Abstract

The aim of this study was to examine the psychometric properties of the Turkish form of the Positive Mental Health Scale (PMHS). The study sample consisted of 607 (305 + 302) adult participants. The construct validity of the scale was examined through exploratory and confirmatory factor analyses. Exploratory factor analysis yielded a single factor with an eigenvalue above 1, accounting for 51% of the total variance. In confirmatory factor analysis, the model reached acceptable fit indices (χ²/df = 3.06, RMSEA = .080, CFI = .954). Regarding criterion-related validity, significant positive correlations were found between the PMHS and the Spiritual Well-Being Scale (r = .55, p < .01). Item analysis revealed statistically significant differences between the lower and upper 27% group means for all items. Reliability analyses yielded a Cronbach’s α of .87, McDonald’s ω of .88, and Guttman’s ʎ6 of .88. Measurement invariance analyses indicated that the PMHS demonstrated at least metric invariance across gender, marital status, and age groups. Receiver operating characteristic (ROC) curve analysis showed that the scale did not have statistically significant diagnostic power in discriminating individuals with a psychiatric diagnosis (AUC = .525, p = .559). Taken together, these findings indicate that the PMHS is a unidimensional, valid, and reliable measurement instrument; however, it is more appropriate for use as a screening tool to assess positive mental health levels in the general population rather than for clinical diagnostic purposes.

Keywords

• Positive mental health
• scale development
• validity
• reliability
• measurement invariance

Project Number

Yok

Pozitif Ruh Sağlığı Ölçeğinin Psikometrik Özellikleri: Ölçme Değişmezliği ve Alıcı İşletim Karakteristiği Kanıtları

Abstract

Bu araştırmanın amacı, Pozitif Ruh Sağlığı Ölçeği’nin (PRSÖ) Türkçe formunun psikometrik özelliklerini incelemektir. Araştırmanın çalışma grubunu 607 (305 + 302) yetişkin katılımcı oluşturmuştur. Ölçeğin yapı geçerliği açımlayıcı ve doğrulayıcı faktör analizleri ile incelenmiş; açımlayıcı faktör analizi sonucunda özdeğeri 1’in üzerinde tek bir faktör elde edilmiş, bu faktörün toplam varyansın %51’ini açıkladığı belirlenmiştir. Doğrulayıcı faktör analizinde, modelin kabul edilebilir uyum indekslerine ulaştığı görülmüştür (χ²/sd = 3,06, RMSEA = ,080, CFI = ,954). Ölçüt bağıntılı geçerlik kapsamında PRSÖ ile Düşünsel İyi Olma Ölçeği arasında pozitif yönde anlamlı ilişkiler saptanmıştır (r = ,55, p < ,01). Madde analizinde, alt-üst %27 grup ortalamaları arasındaki farkların tüm maddeler için istatistiksel olarak anlamlı olduğu bulunmuştur. Güvenirlik analizlerinde Cronbach α = ,87, McDonald ω = ,88 ve Guttman ʎ6 = ,88 olarak hesaplanmıştır. Ölçme değişmezliği analizleri, PRSÖ’nün cinsiyet, medeni durum ve yaş değişkenlerine göre en az metrik düzeyde değişmezliğe sahip olduğunu göstermiştir. AİK (ROC) eğrisi analizinde, ölçeğin psikiyatrik tanı durumunu ayırt etmede istatistiksel olarak anlamlı bir tanısal güce sahip olmadığı belirlenmiştir (EAKA/AUC = ,525, p = ,559). Elde edilen bulgular bir bütün olarak değerlendirildiğinde, PRSÖ’nün tek boyutlu, geçerli ve güvenilir bir ölçme aracı olduğu, ancak klinik tanı amacıyla değil, genel popülasyonda pozitif ruh sağlığı düzeyini değerlendirmeye yönelik bir tarama aracı olarak kullanılabileceği sonucuna varılmıştır.

Keywords

• Pozitif ruh sağlığı
• ölçek geliştirme
• geçerlik
• güvenirlik
• ölçme değişmezliği

Project Number

Yok

References

1. Allman, J. M., Tetreault, N. A., Hakeem, A. Y., Manaye, K. F., Semendeferi, K., Erwin, J. M., Park, S., Goubert, V., & Hof, P. R. (2011). The von Economo neurons in the frontoinsular and anterior cingulate cortex. Annals of the New York Academy of Sciences, 1225, 59–71. https://doi.org/10.1111/j.1749-6632.2011.06011.x
2. Almubaddel, A. (2022). Psychometric properties of a Saudi Arabian version of the Positive Mental Health (PMH) scale. Psicologia: Reflexão e Crítica, 35, 29. https://doi.org/10.1186/s41155-022-00232-0
3. American Psychiatric Association. (1994). Diagnostic and statistical manual of mental Disorders (4th ed.) American Psychiatric Association.
4. Bohlmeijer, E. T., & Westerhof, G. J. (2021). A new model for sustainable mental health: Integrating well-being into psychological treatment. In J. N. Kirby & P. Gilbert (Eds.), Making an impact on mental health: The applications of psychological research (pp. 153–188). Routledge/Taylor & Francis Group. https://doi.org/10.4324/9780429244551-7
5. Boufellous, S., Sánchez-Teruel, D., Robles-Bello, M. A., Lorabi, S., & Mendoza-Bernal, I. (2023). Psychometric Properties of the Positive Mental Health Scale in a Spanish Population. Sage Open, 13(2). https://doi.org/10.1177/21582440231172743
6. Brown, T. A. (2015). Confirmatory factor analysis for applied research (2nd ed.). Guilford Press.
7. Buecker, S., Simacek, T., Ingwersen, B., Terwiel, S., & Simonsmeier, B. A. (2021). Physical activity and subjective well-being in healthy individuals: A meta-analytic review. Health Psychology Review, 15(4), 574–592. https://doi.org/10.1080/17437199.2020.1760728
8. Byrne, B. M. (2010). Structural equation modeling with AMOS: Basic concepts, applications, and programming (2nd ed.). Routledge/Taylor & Francis Group.

9. Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9(2), 233–255. https://doi.org/10.1207/S15328007SEM0902_5
10. COVID-19 Mental Disorders Collaborators. (2021). Global prevalence and burden of depressive and anxiety disorders in 204 countries and territories in 2020 due to the COVID-19 pandemic. The Lancet, 398(10312), 1700–1712. https://doi.org/10.1016/S0140-6736(21)02143-7
11. Çeçen, A. R., & Vatandaşlar, S. E. (2021). Psychometric properties of the Positive Mental Health Scale (PMH-Scale) among Turkish university students. European Journal of Health Psychology, 28(2), 71–78. https://doi.org/10.1027/2512-8442/a000071
12. Daaleman, T. P., & Frey, B. B. (2004). The Spirituality Index of Well-Being: A new instrument for health-related quality-of-life research. The Annals of Family Medicine, 2(5), 499–503. https://doi.org/10.1370/afm.89
13. Diener, E. (2000). Subjective well-being: The science of happiness and a proposal for a national index. American Psychologist, 55(1), 34–43. https://doi.org/10.1037/0003-066X.55.1.34
14. Diener, E., Suh, E. M., Lucas, R. E., & Smith, H. L. (1999). Subjective well-being: Three decades of progress. Psychological Bulletin, 125(2), 276–302. https://doi.org/10.1037/0033-2909.125.2.276
15. Falissard, B. (2016). Positive mental health—what is it, how is it recognized, and can it be achieved? In M. Hodes and S. Gau (Eds), Positive mental health, fighting stigma and promoting resiliency for children and adolescents (pp.3-13). Academic Press. https://doi.org/10.1016/B978-0-12-804394-3.00001-2
16. Fredrickson, B. L. (2001). The role of positive emotions in positive psychology: The broaden-and-build theory of positive emotions. American Psychologist, 56(3), 218–226. https://doi.org/10.1037/0003-066X.56.3.218
17. Galderisi, S., Heinz, A., Kastrup, M., Beezhold, J., & Sartorius, N. (2015). Toward a new definition of mental health. World Psychiatry, 14(2), 231–233. https://doi.org/10.1002/wps.20231
18. Horwitz, A. V. (2010). How an age of anxiety became an age of depression. The Milbank Quarterly, 88(1), 112–138. https://doi.org/10.1111/j.1468-0009.2010.00591.x
19. Horwitz, A. V., & Wakefield, J. C. (2007). The loss of sadness: How psychiatry transformed normal sorrow into depressive disorder. Oxford University Press.
20. Jahoda, M. (1958). Current concepts of positive mental health. Basic Books.
21. Jiang, F., & Tang, Y.-L. (2025). Promoting mental health and preventing mental disorders: Adopting a proactive health approach. Alpha Psychiatry, 26(2), Article 39495. https://doi.org/10.31083/AP39495
22. Keldal, G. (2015). Warwick-Edinburgh Mental İyi Oluş Ölçeği’nin Türkçe Formu: Geçerlik ve güvenirlik çalışması. The Journal of Happiness & Well-Being, 3(1), 103–115. Erişim: https://jhwbjournal.com/makale/54
23. Keyes, C. L. M. (2002). The Mental health continuum: from languishing to flourishing in life. Journal of Health and Social Behavior, 43(2), 207–222. https://doi.org/10.2307/3090197
24. Keyes, C. L. M. (2003). Complete mental health: An agenda for the 21st century. In C. L. M. Keyes & J. Haidt (Eds.), Flourishing: Positive psychology and the life well-lived (pp. 293–312). American Psychological Association. https://doi.org/10.1037/10594-013
25. Keyes, C. L. M. (2004). The nexus of cardiovascular disease and depression revisited: the complete mental health perspective and the moderating role of age and gender. Aging & Mental Health, 8(3), 266–274. https://doi.org/10.1080/13607860410001669804
26. Keyes, C. L. M. (2005a). Mental illness and/or mental health? Investigating axioms of the complete state model of health. Journal of Consulting and Clinical Psychology, 73(3), 539–548. https://doi.org/10.1037/0022-006X.73.3.539
27. Keyes, C. L. M. (2005b). Chronic physical conditions and aging: Is mental health a potential protective factor? Ageing International, 30(1), 88–104. https://doi.org/10.1007/BF02681008
28. Keyes, C. L. M. (2007). Promoting and protecting mental health as flourishing: A complementary strategy for improving national mental health. American Psychologist, 62(2), 95–108. https://doi.org/10.1037/0003-066X.62.2.95
29. Keyes, C. L. M., & Grzywacz, J. G. (2005). Health as a complete state: The added value in work performance and healthcare costs. Journal of Occupational and Environmental Medicine, 47(5), 523–532. https://doi.org/10.1097/01.jom.0000161737.21198.3a
30. Kong, F., Zhao, J., You, X., & Xiang, Y. (2020). Gratitude and the brain: Trait gratitude mediates the association between structural variations in the medial prefrontal cortex and life satisfaction. Emotion, 20(6), 917–926. https://doi.org/10.1037/emo0000617
31. Lukat, J., Becker, E. S., Lavallee, K. L., van der Veld, W. M., & Margraf, J. (2017) Predictors of ıncidence, remission and relapse of axis ı mental disorders in young women: a transdiagnostic approach. Clinical Psychology & Psychotherapy, 24(2), 322–331. https://doi.org/10.1002/cpp.2026
32. Lukat, J., Margraf, J., Lutz, R., van der Veld, W. M., & Becker, E. S. (2016). Psychometric properties of the Positive Mental Health Scale (PMH-scale). BMC Psychology, 4, 8. https://doi.org/10.1186/s40359-016-0111-x
33. Margraf, J., Zhang, X. C., Lavallee, K. L., & Schneider, S. (2020). Longitudinal prediction of positive and negative mental health in Germany, Russia, and China. PLoS ONE 15(6), e0234997. https://doi.org/10.1371/journal.pone.0234997
34. Naghavi A., Teismann T., Asgari Z., Eizadifard R., & Brailovskaia J. (2021). Validation of the Persian version of the Positive Mental Health Scale. BMC Psychiatry, 21(1), 472. https://doi.org/10.1186/s12888-021-03487-6
35. Novak, L., Malinakova, K., Mikoska, P., van Dijk, J. P., & Tavel, P. (2022). Neural correlates of compassion – An integrative systematic review. International Journal of Psychophysiology, 172, 46–59. https://doi.org/10.1016/j.ijpsycho.2021.12.004
36. Perry, J. C., Beck, S. M., Constantinides, P., & Foley, J. E. (2009). Studying change in defensive functioning in psychotherapy using the defense mechanism rating scales: Four hypotheses, four cases. In R. A. Levy & J. S. Ablon (Eds.), Handbook of evidence-based psychodynamic psychotherapy: Bridging the gap between science and practice (pp. 121–153). Humana Press/Springer Nature. https://doi.org/10.1007/978-1-59745-444-5_6
37. Prakash, J., Chatterjee, K., Srivastava, K., Chauhan, V. S., & Chail, A. (2020). Role of various lifestyle and behavioral strategies in positive mental health across a preventive to therapeutic continuum. Industrial Psychiatry Journal, 29(2), 185–190. https://doi.org/10.4103/ipj.ipj_126_20
38. Putnick, D. L., & Bornstein, M. H. (2016). Measurement invariance conventions and reporting: The state of the art and future directions for psychological research. Developmental Review, 41, 71–90. https://doi.org/10.1016/j.dr.2016.06.004
39. Salama–Younes, M. (2011). Positive mental health, subjective vitality, and satisfaction with life for French physical education students. World Journal of Sport Sciences, 4(2), 90–97. https://idosi.org/wjss/wjss4(2)11.htm
40. Sarıçam, H. (2014, Eylül). Düşünsel (Manevi) İyi Olma Ölçeğinin Türkçeye uyarlanması ve psikometrik özellikleri [Öz]. YILDIZ International Conference on Educational Research and Social Sciences (YICER-2014). Yıldız Teknik Üniversitesi, İstanbul.
41. Sarıçam, H. (2018). Önleyici psikolojik danışma açısından koruyucu faktörler. F. Savi ÇAKAR (Ed), Önleyici Psikolojik Danışma Kuram ve Uygulamaları içinde (ss.77-118). Pegem Akademi.
42. Sarıçam, H. (2025). Gelişimsel psikopatolojide değerlendirme. H. Sarıçam (Ed.), Gelişimsel psikopatoloji içinde (ss. 333–364). Vizetek.
43. Sariçam, H. (2015). Subjective happiness and hope. Universitas Psychologica, 14(2), 685–694. https://doi.org/10.11144/Javeriana.upsy14-1.shah
44. Seligman, M. E. P. (2011). Flourish. Free Press.
45. Seligman, M. E. P., & Csikszentmihalyi, M. (2000). Positive psychology: An introduction. American Psychologist, 55(1), 5–14. https://doi.org/10.1037/0003-066X.55.1.5
46. Seligman, M. E., & Csikszentmihalyi, M. (2014). Positive psychology: An introduction. In Flow and the foundations of positive psychology: The collected works of Mihaly Csikszentmihalyi (pp. 279–298). Dordrecht: Springer Netherlands. https://doi.org/10.1007/978-94-017-9088-8_18
47. Siahpush, M., Spittal, M., & Singh, G. K. (2008). Happiness and life satisfaction prospectively predict self-rated health, physical health, and the presence of limiting, long-term health conditions. American Journal of Health Promotion, 23(1), 18–26. https://doi.org/10.4278/ajhp.061023137
48. Slade, M. (2010). Mental illness and well-being: The central importance of positive psychology and recovery approaches. BMC Health Services Research, 10, Article 26. https://doi.org/10.1186/1472-6963-10-26
49. Teke, C., & Baysan Arabacı, L. (2018). Pozitif Ruh Sağlığı Ölçeğinin Türkçe geçerlilik ve güvenilirliği. Anadolu Psikiyatri Dergisi, 19(Özel sayı 1), 21–28. https://doi.org/10.5455/apd.284116
50. Ünlütürk, E., Topaloğlu, İ., & Morsünbül, Ü. (2024). Gelişimsel psikopatoloji ve pozitif psikoloji: ruh sağlığı alanında pozitif bir buluşma. Klinik ve Ruh Sağlığı Psikolojik Danışmanlığı Dergisi, 4(2), 22–45. https://izlik.org/JA88BU58TY
51. Vaillant, G. E. (1977). Adaptation to life. Little, Brown.
52. Vaillant, G. E. (2012). Positive mental health: Is there a cross-cultural definition? World Psychiatry, 11(2), 93–99. https://doi.org/10.1016/j.wpsyc.2012.05.006
53. Vandenberg, R. J., & Lance, C. E. (2000). A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 3(1), 4–70. https://doi.org/10.1177/109442810031002
54. Velten, J., Brailovskaia, J., & Margraf, J. (2022). Positive Mental Health Scale: Validation and measurement invariance across eight countries, genders, and age groups. Psychological Assessment, 34(4), 332–340. https://doi.org/10.1037/pas0001094
55. Westerhof, G. J., & Keyes, C. L. M. (2010). Mental illness and mental health: The two continua model across the lifespan. Journal of Adult Development, 17(2), 110–119. https://doi.org/10.1007/s10804-009-9082-y
56. World Health Organization [WHO]. (2004). Promoting mental health: Concepts, emerging evidence, practice: Summary report.
57. World Health Organization [WHO]. (2025). World mental health today: Latest data. https://iris.who.int/server/api/core/bitstreams/31714489-1345-4439-8b37-6cbdc52e15ca/content
58. Yılmaz Akbaba, A., & Eldeleklioğlu, J. (2019). Adaptation of positive mental health scale into Turkish: A validity and reliability study. Journal of Family Counseling and Education, 4(1), 44–54. https://doi.org/10.32568/jfce.569976