Revisiting Quick Big Five Personality Test: Testing Measurement Invariance across Gender

Abstract

Personality is a subject that has been studied because of the social, economic, individual, and educational implications of personality. The widely used model for measuring personality is the Five-Factor Model (FFM). The robustness of the factor structure of the FFM of personality has been provided among cultures and diverse samples. The measurement tools are used to identify differences between individuals or groups. However, in order to make meaningful comparisons, it is necessary to provide the measurement equivalence among the comparison groups. Thus the current study aimed to test the measurement invariance of the Quick Big Five (QBF) items that are used in many disciplines in Turkey. For this purpose, the QBF items were investigated in terms of configural, metric, scalar and strict invariance across gender. In this research, 1114 university students aged between 17-32 years were included in the sample. Firstly, several CFAs were performed for the whole sample and then both men and women separately. The findings of the CFA revealed that the QBF model fit the data. In addition, each of the 30 items of the scale was embedded into a related latent factor in both gender groups. Secondly, sequential multiple group CFA tests to examine measurement invariance were conducted. According to the findings, full configural, partial metric and scalar invariance were fulfilled across gender. However, strict invariance could not be achieved. Imaginative and inquisitive under the openness factor were determined to cause measurement non-invariance. In conclusion, latent mean comparisons can be made by excluding these two items across gender.

Keywords

• five-factor model,personality traits, measurement invariance,partial metric invariance,early adulthood,sex

References

1. Arnett, J. J. (2000). Emerging adulthood: A theory of development from the late teens through the twenties. American Psychologist, 55(5), 469-480. doi: 10.1037//0003-066X.55.5.469
2. Barrick, M. R., & Mount, M. K. (1991). The big five personality dimensions and job performance: A meta-analysis. Personnel Psychology, 44(1), 1-26. Retrieved from http://jwalkonline.org/docs/Grad%20Classes/Fall%2007/Org%20Psy/big%205%20and%20job%20perf.pdf
3. Beauducel, A., & Wittmann, W. W. (2005). Simulation study on fit indexes in CFA based on data with slightly distorted simple structure. Structural Equation Modeling, 12(1), 41-75. doi: 10.1207/s15328007sem1201_3
4. Berings, D., De Fruyt, F., & Bouwen, R. (2004). Work values and personality traits as predictors of enterprising and social vocational interests. Personality and Individual Differences, 36(2), 349-364. doi: 10.1016/s0191-8869(03)00101-6
5. Bidjerano, T., & Dai, D. Y. (2007). The relationship between the big-five model of personality and self-regulated learning strategies. Learning and individual differences, 17(1), 69-81. doi: 10.1016/j.lindif.2007.02.001
6. Bleidorn, W., Hopwood, C. J., & Lucas, R. E. (2018). Life events and personality trait change. Journal of Personality, 86(1), 83-96. doi: 10.1111/jopy.12286
7. Bono, J. E., Boles, T. L., Judge, T. A., & Lauver, K. J. (2002). The role of personality in task and relationship conflict. Journal of Personality, 70(3), 311-344. doi: 10.1111/1467-6494.05007
8. Borghuis, J., Denissen, J. J., Oberski, D., Sijtsma, K., Meeus, W. H., Branje, S., …, & Bleidorn, W. (2017). Big Five personality stability, change, and codevelopment across adolescence and early adulthood. Journal of Personality and Social Psychology, 113(4), 641-657. doi: 10.1037/pspp0000138

9. Borkenau, P., McCrae, R. R., & Terracciano, A. (2013). Do men vary more than women in personality? A study in 51 cultures. Journal of Research in Personality, 47(2), 135-144. doi: 10.1016/j.jrp.2012.12.001
10. Bouchard, T. J., & Loehlin, J. C. (2001). Genes, evolution, and personality. Behavior Genetics, 31(3), 243-273. doi: 10.1023/A:1012294324713
11. Brown, T. A. (2006). Confirmatory factor analysis for applied research. New York, NY: Guilford Press.
12. Browne, K. R. (2006). Evolved sex differences and occupational segregation. Journal of Organizational Behavior, 27(2), 143-162. doi: 10.1002/job.349
13. Buss, D. M. (2004). Evolutionary psychology: The new science of the mind (2nd ed.). Boston, MA: Allyn & Bacon
14. Chamorro-Premuzic, T., & Furnham, A. (2003). Personality predicts academic performance: Evidence from two longitudinal university samples. Journal of Research in Personality, 37(4), 319-338. doi: 10.1016/S0092-6566(02)00578-0
15. Cheung, F. M., Cheung, S. F., Zhang, J., Leung, K., Leong, F., & Huiyeh, K. (2008). Relevance of openness as a personality dimension in Chinese culture: Aspects of its cultural relevance. Journal of Cross-Cultural Psychology, 39(1), 81-108. doi: 10.1177/0022022107311968
16. Cheung, F., Fan, W., & To, C. (2008). The Chinese Personality Assessment Inventory as a culturally relevant personality measure in applied settings. Social and Personality Psychology Compass, 2(1), 74-89. doi: 10.1111/j.1751-9004.2007.00045.x
17. Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9(2), 233-255. doi: 10.1207/S15328007SEM0902_5
18. Cole, D., & Espinoza, A. (2008). Examining the academic success of Latino students in science technology engineering and mathematics (STEM) majors. Journal of College Student Development, 49(4), 285-300. doi: 10.1353/csd.0.0018
19. Connelly, B. S., Ones, D. S., Davies, S. E., & Birkland, A. (2014). Opening up openness: A theoretical sort following critical incidents methodology and a meta-analytic investigation of the trait family measures. Journal of Personality Assessment, 96(1), 17-28. doi: 10.1080/00223891.2013.809355
20. Cooper, A., Gomez, R., & Aucote, H. (2007). The behavioural inhibition system and behavioural approach system (BIS/BAS) scales: Measurement and structural invariance across adults and adolescents. Personality and Individual Differences, 43(2), 295-305. doi: 10.1016/j.paid.2006.11.023
21. Costa Jr, P. T., Terracciano, A., & McCrae, R. R. (2001). Gender differences in personality traits across cultures: robust and surprising findings. Journal of Personality and Social Psychology, 81(2), 322-331. doi: 10.1037/0022-3514.81.2.322
22. De Raad, B., & Schouwenburg, H. C. (1996). Personality in learning and education: A review. European Journal of Personality, 10(5), 303-336. doi: 10.1002/(SICI)1099-0984(199612)10:5<303::AID-PER262>3.0.CO;2-2
23. DeYoung, C. G., Peterson, J. B., & Higgins, D. M. (2005). Sources of openness/intellect: Cognitive and neuropsychological correlates of the fifth factor of personality. Journal of Personality, 73(4), 825-858. doi: 10.1111/j.1467-6494.2005.00330.x
24. Dimitrov, D.M. (2010). Testing for factorial invariance in the context of construct validation. Measurement and Evaluation in Counseling and Development, 43(2) 121-149. doi: 10.1177/0748175610373459
25. Donnellan, M.B., Conger, R.D., & Burzette, R.G. (2007). Personality development from late adolescence to young adulthood: Differential stability, normative maturity, and evidence for the maturity-stability hypothesis. Journal of Personality, 75(2), 237-263. doi: 10.1111/j.1467-6494.2007.00438.x
26. Duckworth, A. L., & Seligman, M. E. P. (2005). Self-Discipline outdoes iq in predicting academic performance of adolescents. Psychological Science, 16(12), 939-944. Retrieved from https://www.jstor.org/stable/pdf/40064361.pdf
27. Dumfart, B., & Neubauer, A. C. (2016). Conscientiousness is the most powerful noncognitive predictor of school achievement in adolescents. Journal of Individual Differences, 37(1), 8-15. doi: 10.1027/1614-0001/a000182
28. Durbin, C. E., Hicks, B. M., Blonigen, D. M., Johnson, W., Iacono, W. G., & McGue, M. (2016). Personality trait change across late childhood to young adulthood: Evidence for nonlinearity and sex differences in change. European Journal of Personality, 30(1), 31-44. doi: 10.1002/per.2013
29. Eccles, J. (2011). Gendered educational and occupational choices: Applying the Eccles et al. model of achievement-related choices. International Journal of Behavioral Development, 35(3), 195-201. doi: 10.1177/0165025411398185
30. Fadjukoff, P., Feldt, T., Kokko, K., & Pulkkinen, L. (2019). Identity status change within personal style clusters: a longitudinal perspective from early adulthood to midlife. Identity, 19(1), 1-17. doi: 10.1080/15283488.2019.1566066
31. Falk, A., & Hermle, J. (2018). Relationship of gender differences in preferences to economic development and gender equality (IZA Discussion Papers, No. 12059). Institute of Labor Economics (IZA), Bonn. Retrieved from http://hdl.handle.net/10419/193353
32. Figueredo, A. J., Sefcek, J. A., & Jones, D. N. (2006). The ideal romantic partner personality. Personality and Individual Differences, 41(3), 431-441. doi: 10.1016/j.paid.2006.02.004
33. Fischer, A. H., & Manstead, A. S. R. (2000). The relation between gender and emotion in different cultures. In A. H. Fischer (Ed.), Studies in emotion and social interaction. Second series. Gender and emotion: Social psychological perspectives (pp. 71-94). Cambridge University Press. doi: 10.1017/CBO9780511628191.005
34. Funder, D. C. (2001). Personality. Annual Review of Psychology, 52, 197-221. Retrieved from https://intranet.newriver.edu/images/stories/library/Stennett_Psychology_Articles/Personality.pdf
35. Gasser, C. E., Larson, L. M., & Borgen, F.H. (2007). Concurrent validity of the 2005 Strong Interest Inventory: An examination of gender and major field of study. Journal of Career Assessment, 15(1), 23-43. Retrieved from http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.908.2140&rep=rep1&type=pdf
36. Guimond, S. (2008). Psychological similarities and differences between women and men across cultures. Social and Personality Psychology Compass, 2(1), 494-510. doi: 10.1111/j.1751-9004.2007.00036.x
37. Heckman, J. J., Stixrud, J., & Urzua, S. (2006). The effects of cognitive and non-cognitive abilities on labor market outcomes and social behavior. Journal of Labor Economics, 24(3), 411-482. Retrieved from https://www.nber.org/papers/w12006.pdf
38. Hu, L. T., & Bentler, P. M. (1998). Fit indices in covariance structure modeling: Sensitivity to underparameterized model misspecification. Psychological Methods, 3(4), 424-453. Retrieved from https://pdfs.semanticscholar.org/a92c/9726361d9c1d165dbf2ea781b6c48363a816.pdfRelated
39. Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1-55. doi: 10.1080/10705519909540118
40. John, O. P., & Srivastava, S. (1999). The Big Five trait taxonomy: History, measurement, and theoretical perspectives. In L. A. Pervin & O. P. John (Eds.), Handbook of personality: Theory and research (2nd ed., pp. 102-138). New York, NY: Guilford Press.
41. John, O. P., Neumann, L. P., & Soto, C. J. (2008). Paradigm shift to the integrative Big-Five trait taxonomy: History, measurement, and conceptual issues. In O. P. John, R. W. Robins, & L. A. Pervin (Eds.), Handbook of personality: Theory and research (3rd ed., pp. 114-158). New York, NY: Guilford.
42. Johnson, J. G., Cohen, P., Brown, J., Smailes, E. M., & Bernstein, D. P. (1999). Childhood maltreatment increases risk for personality disorders during early adulthood. Archives of General Psychiatry, 56(7), 600-606. doi: 10.1001/archpsyc.56.7.600
43. Josephs, R. A., Markus, H. R., & Tafarodi, R. W. (1992). Gender and self-esteem. Journal of Personality and Social Psychology, 63(3), 391-402. Retrieved from https://www.researchgate.net/profile/Robert_Josephs/publication/21751337_Gender_and_Self-Esteem/links/0912f5098177bd1614000000.pdf
44. Judge, T. A., & Ilies, R. (2002). Relationship of personality to performance motivation: A meta-analytic review. Journal of applied psychology, 87(4), 797-807. doi: 10.1037//0021-9010.87.4.797
45. Judge, T. A., Erez, A., Bono, J. E., & Thoresen, C. J. (2002). Are measures of self-esteem, neuroticism, locus of control, and generalized self-efficacy indicators of a common core construct? Journal of Personality and Social Psychology, 83(3), 693-710. doi: 10.1037//0022-3514.83.3.693
46. Kajonius, P. J., & Johnson, J. (2018). Sex differences in 30 facets of the five-factor model of personality in the large public (N=320,128). Personality and Individual Differences, 129(July), 126-130. doi: 10.1016/j.paid.2018.03.026
47. Klein, H. J., & Lee, S. (2006). The effects of personality on learning: The mediating role of goal setting. Human Performance, 19(1), 43-66. doi: 10.1207/s15327043hup1901_3 Klimstra, T. A., Luyckx, K., Branje, S., Teppers, E., Goossens, L., & Meeus, W. H. (2013). Personality traits, interpersonal identity, and relationship stability: Longitudinal linkages in late adolescence and young adulthood. Journal of Youth and Adolescence, 42(11), 1661-1673. doi: 10.1007/s10964-012-9862-8
48. Kline, R. B. (2011). Principles and practice of structural equation modeling. New York, NY: The Guilford Press.
49. Korkmaz, M., Somer, O., & Gungor, D. (2013). Measurement equivalence across gender with mean and covariance structure of five factor personality inventory for adolescent sample. Education and Science, 38(170). 121-134. Retrieved from http://egitimvebilim.ted.org.tr/index.php/EB/article/view/1532/550
50. Langen, A. V., & Dekkers, H. (2005). Cross‐national differences in participating in tertiary science, technology, engineering and mathematics education. Comparative Education, 41(3), 329-350. doi: 10.1080/03050060500211708
51. Legewie, J., & DiPrete, T. A. (2014). The high school environment and the gender gap in science and engineering. Sociology of Education, 87(4), 259-280. doi: 10.1177/0038040714547770
52. Lippa, R. A. (2010). Gender differences in personality and interests: When, where, and why? Social and Personality Psychology Compass, 4(11), 1098-1110. doi: 10.1111/j.1751-9004.2010.00320.x
53. Lounsbury, J. W., Sundstrom, E., Loveland, J. M., & Gibson, L. W. (2003). Intelligence, “Big Five” personality traits, and work drive as predictors of course grade. Personality and Individual Differences, 35(6), 1231-1239. Retrieved from http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.936.3275&rep=rep1&type=pdf
54. Low, K., & Rounds, J. (2007). Interest change and continuity from early adolescence to middle adulthood. International Journal for Educational and Vocational Guidance, 7(1), 23-36. doi: 10.1007/s10775-006-9110-4
55. Lynn, R. (1993). Sex differences in competitiveness and the valuation of money in twenty countries. Journal of Social Psychology, 133(4), 507-511.
56. Manders, W. A., Scholte, R. H., Janssens, J. M., & De Bruyn, E. E. (2006). Adolescent personality, problem behaviour and the quality of the parent–adolescent relationship. European Journal of Personality, 20(3), 237-254. doi: 10.1002/per.574
57. Matthews, G., Zeidner, M., & Roberts, R. D. (2006). Models of personality and affect for education: A review and synthesis. In P. A. Alexander & P. H. Winne (Eds.), Handbook of educational psychology (2nd ed., pp. 163-186). Mahwah, NJ: Erlbaum.
58. McAdams, D. P., & Pals, J. L. (2006). A new Big Five: fundamental principles for an integrative science of personality. American Psychologist, 61(3), 204-217. Retrieved from http://people.wku.edu/richard.miller/new%20big%20five.pdf
59. McCrae, R. R., & Costa, P. T., Jr. (1997). Conceptions and correlates of openness to experience. In R. Hogan, J. A. Johnson, & S. R. Briggs (Eds.), Handbook of personality psychology (pp. 825-847). Academic Press. doi: 10.1016/B978-012134645-4/50032-9
60. McCrae, R. R., Terracciano, A., & Pro, P. P. C. (2005). Personality profiles of cultures: Aggregate personality traits. Journal of Personality and Social Psychology, 89(3), 407-425. doi: 10.1037/0022-3514.89.3.407
61. McCrae, R. R., Yik, M. S., Trapnell, P. D., Bond, M. H., & Paulhus, D. L. (1998). Interpreting personality profiles across cultures: Bilingual, acculturation, and peer rating studies of Chinese undergraduates. Journal of Personality and Social Psychology, 74(4), 1041-1055. doi: 10.1037/0022-3514.74.4.1041
62. Milfont, T. L., & Fischer, R. (2010). Testing measurement invariance across groups: Applications in cross-cultural research. International Journal of psychological research, 3(1), 111-130. Retrieved from http://45.5.172.45/bitstream/10819/6503/1/Testing_Measurement_Invariance_Milfont_2010.pdf
63. Morizot, J. (2014). Construct validity of adolescents’ self-reported big five personality traits: Importance of conceptual breadth and initial validation of a short measure. Assessment, 21(5), 580-606. doi: 10.1177/1073191114524015
64. Morsunbul, U. (2014). The validity and reliability study of the Turkish version of quick big five personality test. Dusunen Adam The Journal of Psychiatry and Neurological Sciences, 27(4), 316-322. doi: 10.5350/DAJPN2014270405
65. Mueller, G., & Plug, E. (2006). Estimating the effect of personality on male and female earnings. Industrial and Labor Relations Review, 60(1), 3-22. Retrieved from http://www.jstor.org/stable/25067572
66. Nguyen, N. T., Allen, L. C., & Fraccastoro, K. (2005). Personality predicts academic performance: Exploring the moderating role of gender. Journal of Higher Education Policy and Management, 27(1), 105-117. doi: 10.1080/13600800500046313
67. Noftle, E. E., & Robins, R. W. (2007). Personality predictors of academic outcomes: Big five correlates of GPA and SAT scores. Journal of Personality and Social Psychology, 93(1), 116-130. doi: 10.1037/0022-3514.93.1.116
68. O’Connor, M. C., & Paunonen, S. V. (2007). Big five personality predictors of post-secondary academic performance. Personality and Individual Differences, 43(5), 971-990. doi: 10.1016/j.paid.2007.03.017
69. Ock, J., McAbee, S. T., Mulfinger, E., & Oswald, F. L. (2020). The practical effects of measurement invariance: gender invariance in two big five personality measures. Assessment, 27(4), 657-674. doi: 10.1177/1073191119885018
70. Paunonen, S. V., & Ashton, M. C. (2001). Big five factors and facets and the prediction of behavior. Journal of Personality and Social Psychology, 81(3), 524-539. doi: 10.1037/0022-3514.81.3.524
71. Poropat, A. E. (2009). A meta-analysis of the five-factor model of personality and academic performance. Psychological Bulletin, 135(2), 322-338. doi: 10.1037/a0014996
72. Poropat, A. E. (2011). The Eysenckian personality factors and their correlations with academic performance. British Journal of Educational Psychology, 81(1), 41-58. doi: 10.1348/000709910X497671
73. Poropat, A. E. (2014). Other-rated personality and academic performance: Evidence and implications. Learning and Individual Differences, 34, 24-32. doi: 10.1016/j.lindif.2014.05.013
74. Putnick, D. L., & Bornstein, M. H. (2016). Measurement invariance conventions and reporting: The state of the art and future directions for psychological research. Developmental Review, 41, 71-90. doi: 10.1016/j.dr.2016.06.004
75. Rindermann, H., & Neubauer, A. (2001). The influence of personality on three aspects of cognitive performance: Processing speed, intelligence and school performance. Personality and Individual Differences, 30(5), 829-842. Retrieved from https://pdfs.semanticscholar.org/e468/6271719ef3a12ffc1e3db46bb705cf2195a6.pdf
76. Roberts, B. W., Kuncel, N., Shiner, R. N., Caspi, A., & Goldberg, L. R. (2007). The power of personality: The comparative validity of personality traits, socio-economic status, and cognitive ability for predicting important life outcomes. Perspectives in Psychological Science, 2(4), 313-345. doi: 10.1111/j.1745-6916.2007.00047.x
77. Roberts, B. W., Walton, K. E., & Viechtbauer, W. (2006). Patterns of mean-level change in personality traits across the life course: a meta-analysis of longitudinal studies. Psychological Bulletin, 132(1), 1-25. doi: 10.1037/0033-2909.132.1.1
78. Roets, A., & Van Hiel, A. (2011). Item selection and validation of a brief, 15-item version of the need for closure scale. Personality and Individual Differences, 50(1), 90-94. doi: 10.1016/j.paid.2010.09.004
79. Rollock, D., & Lui, P. P. (2016). Measurement invariance and the five-factor model of personality: Asian international and Euro American cultural groups. Assessment, 23(5), 571-587. doi: 10.1177/1073191115590854
80. Samuel, D. B., South, S. C., & Griffin, S. A. (2015). Factorial invariance of the five-factor model rating form across gender. Assessment, 22(1), 65-75. doi: 10.1177/1073191114536772
81. Sass, D. A. (2011). Testing measurement invariance and comparing latent factor means within a confirmatory factor analysis framework. Journal of Psychoeducational Assessment, 29(4), 347-363. doi: 10.1177/0734282911406661
82. Saucier, G., & Goldberg, L. R. (1996). The language of personality: Lexical perspectives on the five- factor model. In J. S. Wiggins. (Ed.), The five-factor model of personality: Theoretical Perspective (pp. 21-50). New York, NY; Guilford.
83. Schmitt, D. P., Long, A. E., McPhearson, A., O’Brien, K., Remmert, B., & Shah, S. H. (2017). Personality and gender differences in global perspective. International Journal of Psychology, 52(1), 45-56. doi: 10.1002/ijop.12265
84. Schmitt, D. P., Realo, A., Voracek, M., & Allik, J. (2008). Why can’t a man be more like a woman? Sex differences in Big Five personality traits across 55 cultures. Journal of Personality and Social Psychology, 94(1), 168-182. doi: 10.1037/0022-3514.94.1.168
85. Shiner, R. L., Allen, T. A., & Masten, A. S. (2017). Adversity in adolescence predicts personality trait change from childhood to adulthood. Journal of Research in Personality, 67, 171-182. doi: 10.1016/j.jrp.2016.10.002
86. Soto, C. J. (2016). The little six personality dimensions from early childhood to early adulthood: Mean‐level age and gender differences in parents' reports. Journal of Personality, 84(4), 409-422. doi: 10.1111/jopy.12168
87. Tabachnick, B.G., & Fidell, L.S. (2001). Using multivariate statistics (4th ed.). Needham Heights, MA: Allyn & Bacon.
88. Triandis, H. C., & Suh, E. M. (2002). Cultural influences on personality. Annual Review of Psychology, 53(1), 133-160. doi: 10.1146/annurev.psych.53.100901.135200
89. Van de Schoot, R., Lugtig, P., & Hox, J. (2012). A checklist for testing measurement invariance. European Journal of Developmental Psychology, 9(4), 486-492. doi: 10.1080/17405629.2012.686740
90. Vandenberg, R. J. (2002). Toward a further understanding of and improvement in measurement invariance methods and procedures. Organizational Research Methods, 5(2), 139-158. doi: 10.1177/1094428102005002001
91. Vandenberg, R. J., & Lance, C. E. (2000). A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational research methods, 3(1), 4-70. doi: 10.1177/109442810031002
92. Vermults, A. A., & Gerris, J. R. M. (2005). QBF: Quick Big Five persoonlijkheidstest handleiding [Quick Big Five personality test manual]. Leeuwarden, the Netherlands: LDC Publications.
93. Wang, M. T., & Degol, J. L. (2017). Gender gap in science, technology, engineering, and mathematics (STEM): Current knowledge, implications for practice, policy, and future directions. Educational Psychology Review, 29(1), 119-140. doi: 10.1007/s10648-015-9355-x
94. Willingham, W. W., Pollack, J. M., & Lewis, C. (2002). Grades and test scores: Accounting for observed differences. Journal of Educational Measurement, 39(1), 1-37. Retrieved from https://www.jstor.org/stable/1435104?seq=1&cid=pdf-reference#references_tab_contents