Indonesian Version of the Short Mental Toughness Questionnaire (MTQ): Factor Structure and Measurement Invariance

Abstract

This study aims to evaluate the factor structure of the short version of the Mental Toughness Questionnaire (S-MTQ) in the Indonesian context and test measurement invariance based on gender (male vs. female) and status (athlete vs. non-athlete). A total of 710 people (Mage = 22.07 years; SD = 7.99) consisting of 490 (69.01%) males and 220 (30.99%) females; 476 (67.04%) athletes and 234 (32.96%) non-athletes were involved in the study. Confirmatory factor analysis (CFA) was used to evaluate the factor structure of the short MTQ. The results showed that the unidimensional models tested, MTQ-18 and MTQ-10, were unfit. Therefore, a revision was carried out by removing items that had low loading factor values. The results of the revised Indonesian version (MTQid-6) found CFI = .983, TLI = .969, RMSEA = .052, and SRMR = .024, which indicated that the MTQid-6 unidimensional model was very satisfactory. MTQid-6 has a loading factor category ranging from good to very good (λ = .50 to .74). This validity is strengthened by convergent validity results, which show that MTQid-6 has a significant correlation with MTI, PPI-A, and APSQ (p < .001). The reliability analysis results show high internal consistency values, namely α = .762,  = .763. Invariance testing found invariance at the configural, metric, and scalar levels (ΔCFI ≤ -.01, ΔRMSEA ≤ .015). With these results, MTQid-6 can be used to measure MT, both in athletes and non-athletes, in both males and females in the Indonesian population.

Keywords

• Mental toughness
• questionnaire (MTQ)
• Psychometrics
• Mentally tough
• Psychological stability

References

1. Andayani, T. M., Kristina, S. A., Endarti, D., Haris, R. N. H., & Rahmawati, A. (2020). Translation, Cultural Adaptation, and Validation of Short-Form 6D on the General Population in Indonesia. Value in Health Regional Issues, 21, 205–210. https://doi.org/10.1016/j.vhri.2019.11.004
2. Azwar, S. (2013). Reliabilitas dan validitas. Pustaka Pelajar.
3. Bagozzi, R. P. (2010). Structural equation models are modelling tools with many ambiguities: Comments acknowledging the need for caution and humility in their use. Journal of Consumer Psychology, 20(2), 208–214. https://doi.org/10.1016/j.jcps.2010.03.001
4. Birch, P. D. J., Crampton, S., Greenlees, I., Lowry, R., & Coffee, P. (2019). The Mental Toughness Questionniare-48: A Re-examination of Factorial Validity. International Journal of Sport Psychology, 48(3), 331–355. https://doi.org/10.7352/IJSP.2017.48.331
5. Browne, M. W., & Cudeck, R. (1992). Alternative Ways of Assessing Model Fit. Sociological Methods & Research, 21(2), 230–258. https://doi.org/10.1177/0049124192021002005
6. Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal, 14(3), 464–504. https://doi.org/10.1080/10705510701301834
7. Cherry, H. L. (2005). Psychometric Analysis of an Inventory Assessing Mental Toughness [University of Tennessee - Knoxville]. https://trace.tennessee.edu/utk_gradthes/588
8. Clough, P., Earle, K., & Sewell, D. (2002). Mental toughness: the concept and its measurement. In I. M. Cockerill (Ed.), Solutions in sport psychology. Cengage Learning, EMEA.

9. Clough, P. J., & Strycharczyk, D. (2012). Developing Mental Toughness: Improving Performance, Wellbeing and Positive Behaviour in Others. Kogan Page Limited.
10. Clough, Peter, Earle, K., Perry, J. L., & Crust, L. (2012). Comment on “Progressing measurement in mental toughness: A case example of the Mental Toughness Questionnaire 48” by Gucciardi, Hanton, and Mallett (2012). Sport, Exercise, and Performance Psychology, 1(4), 283–287. https://doi.org/10.1037/a0029771
11. Comrey, A. L., & Lee, H. B. (1992). A First Course in Factor Analysis. Lawrence Erlbaum Associates, Inc.
12. Crust, L., & Azadi, K. (2010). Mental toughness and athletes’ use of psychological strategies. European Journal of Sport Science, 10(1), 43–51. https://doi.org/10.1080/17461390903049972
13. Dagnall, N., Denovan, A., Papageorgiou, K. A., & Clough, P. J. (2019). Psychometric Assessment of Shortened Mental Toughness Questionnaires (MTQ): Factor Structure of the MTQ-18 and the MTQ-10. Frontiers in Psychology, 10(1993), 1–12. https://doi.org/10.3389/fpsyg.2019.01933
14. Denovan, A., Dagnall, N., Hill-Artamonova, E., & Musienko, T. (2021). Mental toughness questionnaire (MTQ18): A Russian version. National Security and Strategic Planning, 2021(3), 47–59. https://doi.org/10.37468/2307-1400-2021-3-47-59
15. Geisinger, K. F. (1994). Cross-Cultural Normative Assessment: Translation and Adaptation Issues Influencing the Normative Interpretation of Assessment Instruments. Psychological Assessment, 6(4), 304–312. https://doi.org/10.1037/1040-3590.6.4.304
16. Gerber, M., Best, S., Meerstetter, F., Walter, M., Ludyga, S., Brand, S., Bianchi, R., Madigan, D. J., Isoard-Gautheur, S., & Gustafsson, H. (2018). Effects of stress and mental toughness on burnout and depressive symptoms: A prospective study with young elite athletes. Journal of Science and Medicine in Sport, 21(12), 1200–1205. https://doi.org/10.1016/j.jsams.2018.05.018
17. Gjersing, L., Caplehorn, J. R., & Clausen, T. (2010). Cross-cultural adaptation of research instruments: Language, setting, time and statistical considerations. BMC Medical Research Methodology, 10. https://doi.org/10.1186/1471-2288-10-13
18. Golby, J., Sheard, M., & van Wersch, A. (2007). Evaluating the Factor Structure of the Psychological Performance Inventory. Perceptual and Motor Skills, 105(1), 309–325. https://doi.org/10.2466/pms.105.1.309-325
19. Gucciardi, D. F. (2017). Mental toughness: progress and prospects. Current Opinion in Psychology, 16(16), 17–23. https://doi.org/10.1016/j.copsyc.2017.03.010
20. Gucciardi, D. F., & Gordon, S. (2009). Development and preliminary validation of the cricket mental toughness inventory (CMTI). Journal of Sports Sciences, 27(12), 1293–1310. https://doi.org/10.1080/02640410903242306
21. Gucciardi, D. F., Gordon, S., & Dimmock, J. A. (2008). Towards an understanding of mental toughness in Australian football. Journal of Applied Sport Psychology, 20(3), 261–281. https://doi.org/10.1080/10413200801998556
22. Gucciardi, D. F., Gordon, S., & Dimmock, J. A. (2009). Development and preliminary validation of a mental toughness inventory for Australian football. Psychology of Sport and Exercise, 10(1), 201–209. https://doi.org/10.1016/j.psychsport.2008.07.011
23. Gucciardi, D. F., Hanton, S., Gordon, S., Mallett, C. J., & Temby, P. (2014). The Concept of Mental Toughness: Tests of Dimensionality, Nomological Network, and Traitness. Journal of Personality, 83(1), 26–44. https://doi.org/10.1111/jopy.12079
24. Gucciardi, D. F., Hanton, S., & Mallett, C. J. (2012). Progressing measurement in mental toughness: A case example of the Mental Toughness Questionnaire 48. Sport, Exercise, and Performance Psychology, 1(3), 194–214. https://doi.org/10.1037/a0027190
25. Gucciardi, D. F., Hanton, S., & Mallett, C. J. (2013). Progressing measurement in mental toughness: A response to Clough, Earle, Perry, and Crust. Sport, Exercise, and Performance Psychology, 2(3), 157–172. https://doi.org/10.1037/spy0000002
26. Guntoro, T. S., & Putra, M. F. P. (2022). Athletes’ religiosity: How it plays a role in athletes’ anxiety and life satisfaction. HTS Teologiese Studies/Theological Studies, 78(1), a7802. https://doi.org/10.4102/hts.v78i1.7802
27. Guntoro, T. S., Sutoro, Putra, M. F. P., Kurdi, Németh, Z., & Setiawan, E. (2023). The role of anthropometry, physical, psychological and personality for elite athletes in competitive sports. Pedagogy of Physical Culture and Sports, 27(4), 331–339. https://doi.org/10.15561/26649837.2023.0409
28. Hambleton, R. K., & de Jong, J. H. A. L. (2003). Advances in translating and adapting educational and psychological tests. Language Testing, 20(2), 127–134. https://doi.org/10.1191/0265532203lt247xx
29. ITC. (2017). ITC Guidelines for Translating and Adapting Tests (Second Edition). International Journal of Testing, 15305058. https://doi.org/10.1080/15305058.2017.1398166
30. Kawabata, M., Pavey, T. G., & Coulter, T. J. (2021). Evolving the validity of a mental toughness measure: Refined versions of the Mental Toughness Questionnaire-48. Stress and Health, 37(2), 378–391. https://doi.org/10.1002/smi.3004
31. Kerlinger, F. N. (2006). Asas-asas penelitian behavioral. Gadjah Mada Univeristy Press.
32. Kobasa, S. C. (1979). Stressful life events, personality, and health: An inquiry into hardiness. Journal of Personality and Social Psychology, 37(1), 1–11. https://doi.org/10.1037/0022-3514.37.1.1
33. Liew, G. C., Kuan, G., Chin, N. S., & Hashim, H. A. (2019). Mental toughness in sport: Systematic review and future. German Journal of Exercise and Sport Research, 49(4), 381–394. https://doi.org/10.1007/s12662-019-00603-3
34. Ohrbach, R., Bjorner, J., Metric, Q., Jezewski, M., John, M. T., & Lobbezoo, F. (2013). Guidelines for establishing cultural equivalency of Instruments. https://ubwp.buffalo.edu/
35. Papageorgiou, K. A., Malanchini, M., Denovan, A., Clough, P. J., Shakeshaft, N., Schofield, K., & Kovas, Y. (2018). Longitudinal associations between narcissism, mental toughness and school achievement. Personality and Individual Differences, 131, 105–110. https://doi.org/10.1016/j.paid.2018.04.024
36. Pennebaker, J. W., Mehl, M. R., & Niederhoffer, K. G. (2003). Psychological Aspects of Natural Language Use: Our Words, Our Selves. Annual Review of Psychology, 54, 547–577. https://doi.org/10.1146/annurev.psych.54.101601.145041
37. Putra, M. F. P., Kurdi, Syahruddin, S., Hasibuan, S., Sinulingga, A., Kamaruddin, I., Kristiyandaru, A., Mashud, Hariadi, I., Guntoro, T. S., Sutoro, S., Sinaga, E., Ibrahim, Setiawan, E., Ridwan, M., Wanena, T., Hidayat, R. R., & Hariadi, I. (2024). An Indonesian Version of Mental Toughness Index: Testing Psychometric Properties in Athletes and Non-athletes. Retos, 55, 816–824. https://doi.org/10.47197/retos.v55.106086
38. Putra, M. F. P., Rahayuni, K., Wanena, T., Larung, E. Y. P., Sinaga, E., Zainuri, A., Dwiariani, D. A., Numbery, G. K. I., Hidayat, R. R., & Wandik, Y. (2025). Psychometric Properties of the Athlete Psychological Strain Questionnaire (APSQ): Adapting and Validating Its Indonesian Version. Sport and Tourism Central European Journal, 8(1), 1–10.
39. Putra, M. F. P., Sutoro, Guntoro, T. S., Sinaga, E., Wanena, T., Rahayuni, K., Jannah, M., Warni, W. E., Juriana, Priambodo, A., Tahki, K., Hariadi, I., Hidayat, R. R., & Wandik, Y. (2024). Cross-cultural adaptation of the psychological performance inventory-alternative (PPI-A) for the Indonesian context. Retos, 56, 990–997. https://doi.org/10.47197/retos.v56.103765
40. Putra, M. F. P., Sutoro, & Sinaga, E. (2023). Mental atlet: Konstruk, pengukuran, dan arah penelitian ke depan. Multilateral : Jurnal Pendidikan Jasmani Dan Olahraga, 22(1), 63–79. https://doi.org/10.20527/multilateral.v22i1.14785
41. Rice, S. M., Parker, A. G., Mawren, D., Clifton, P., Lloyd, M., Kountouris, A., Smith, B., Mcgorry, P. D., & Purcell, R. (2019). Preliminary psychometric validation of a brief screening tool for athlete mental health among male elite athletes: the Athlete Psychological Strain Questionnaire. International Journal of Sport and Exercise Psychology, 18(1), 850–865. https://doi.org/10.1080/1612197X.2019.1611900
42. Sheard, M., Golby, J., & Van Wersch, A. (2009). Progress toward construct validation of the Sports Mental Toughness Questionnaire (SMTQ). European Journal of Psychological Assessment, 25(3), 186–193. https://doi.org/10.1027/1015-5759.25.3.186
43. Sutoro, Guntoro, T. S., & Putra, M. F. P. (2023). Development and validation mental training model: Mental Toughness Training Circle (MTTC). F1000Reserach, 12(169), 1–36. https://doi.org/10.12688/f1000research.129010.1
44. Stamatis, A., Morgan, G. B., Papadakis, Z., Mougios, V., Bogdanis, G., & Spinou, A. (2021). Cross-cultural invariance of the mental toughness index among American and Greek athletes. Current Psychology, 40, 5793-5800.
45. Tiwari, S., & Sharma, J. (2007). Development and Validation of Mental Toughness Questionnaire for Volleyball Players. Annamali University, India.
46. Vaughan, R., Hanna, D., & Breslin, G. (2018). Psychometric properties of the Mental Toughness Questionnaire 48 (MTQ48) in elite, amateur and nonathletes. Sport, Exercise, and Performance Psychology, 7(2), 128–140. https://doi.org/10.1037/spy0000114
47. Wandik, Y., Dina, Guntoro, T. S., Sutoro, Wambrauw, O. O. O., Abidjulu, C. F., Irab, S. P., Jembise, T. L., Wanena, T., Kmurawak, R. M. B., Rahayu, A. S., Manalu, J., Yektiningtyas, W., Gultom, M., Zainuri, A., J., N. J., Sinaga, E., Hidayat, R. R., Nurhidayah, D., … Putra, M. F. P. (2024). Interrelation of mental toughness, religiosity, and happiness of elite adolescent athletes based on gender, type of sport, and level of education. Retos, 56, 981–989. https://doi.org/10.47197/retos.v56.103469
48. Wang, W. C., Chen, H. F., & Jin, K. Y. (2015). Item Response Theory Models for Wording Effects in Mixed-Format Scales. Educational and Psychological Measurement, 75(1), 157–178. https://doi.org/10.1177/0013164414528209