Revisiting Quick Big Five Personality Test: Testing Measurement Invariance across Gender

Year 2020, Volume: 11 Issue: 2, 180 - 198, 13.06.2020

Devrim Erdem

https://doi.org/10.21031/epod.675796

Abstract

Personality is a subject that has been studied because of the social, economic, individual, and educational implications of personality. The widely used model for measuring personality is the Five-Factor Model (FFM). The robustness of the factor structure of the FFM of personality has been provided among cultures and diverse samples. The measurement tools are used to identify differences between individuals or groups. However, in order to make meaningful comparisons, it is necessary to provide the measurement equivalence among the comparison groups. Thus the current study aimed to test the measurement invariance of the Quick Big Five (QBF) items that are used in many disciplines in Turkey. For this purpose, the QBF items were investigated in terms of configural, metric, scalar and strict invariance across gender. In this research, 1114 university students aged between 17-32 years were included in the sample. Firstly, several CFAs were performed for the whole sample and then both men and women separately. The findings of the CFA revealed that the QBF model fit the data. In addition, each of the 30 items of the scale was embedded into a related latent factor in both gender groups. Secondly, sequential multiple group CFA tests to examine measurement invariance were conducted. According to the findings, full configural, partial metric and scalar invariance were fulfilled across gender. However, strict invariance could not be achieved. Imaginative and inquisitive under the openness factor were determined to cause measurement non-invariance. In conclusion, latent mean comparisons can be made by excluding these two items across gender.

Keywords

five-factor model, personality traits, measurement invariance, partial metric invariance, early adulthood, sex

References

• Arnett, J. J. (2000). Emerging adulthood: A theory of development from the late teens through the twenties. American Psychologist, 55(5), 469-480. doi: 10.1037//0003-066X.55.5.469
• Barrick, M. R., & Mount, M. K. (1991). The big five personality dimensions and job performance: A meta-analysis. Personnel Psychology, 44(1), 1-26. Retrieved from http://jwalkonline.org/docs/Grad%20Classes/Fall%2007/Org%20Psy/big%205%20and%20job%20perf.pdf
• Beauducel, A., & Wittmann, W. W. (2005). Simulation study on fit indexes in CFA based on data with slightly distorted simple structure. Structural Equation Modeling, 12(1), 41-75. doi: 10.1207/s15328007sem1201_3
• Berings, D., De Fruyt, F., & Bouwen, R. (2004). Work values and personality traits as predictors of enterprising and social vocational interests. Personality and Individual Differences, 36(2), 349-364. doi: 10.1016/s0191-8869(03)00101-6
• Bidjerano, T., & Dai, D. Y. (2007). The relationship between the big-five model of personality and self-regulated learning strategies. Learning and individual differences, 17(1), 69-81. doi: 10.1016/j.lindif.2007.02.001
• Bleidorn, W., Hopwood, C. J., & Lucas, R. E. (2018). Life events and personality trait change. Journal of Personality, 86(1), 83-96. doi: 10.1111/jopy.12286
• Bono, J. E., Boles, T. L., Judge, T. A., & Lauver, K. J. (2002). The role of personality in task and relationship conflict. Journal of Personality, 70(3), 311-344. doi: 10.1111/1467-6494.05007
• Borghuis, J., Denissen, J. J., Oberski, D., Sijtsma, K., Meeus, W. H., Branje, S., …, & Bleidorn, W. (2017). Big Five personality stability, change, and codevelopment across adolescence and early adulthood. Journal of Personality and Social Psychology, 113(4), 641-657. doi: 10.1037/pspp0000138
• Borkenau, P., McCrae, R. R., & Terracciano, A. (2013). Do men vary more than women in personality? A study in 51 cultures. Journal of Research in Personality, 47(2), 135-144. doi: 10.1016/j.jrp.2012.12.001
• Bouchard, T. J., & Loehlin, J. C. (2001). Genes, evolution, and personality. Behavior Genetics, 31(3), 243-273. doi: 10.1023/A:1012294324713
• Brown, T. A. (2006). Confirmatory factor analysis for applied research. New York, NY: Guilford Press.
• Browne, K. R. (2006). Evolved sex differences and occupational segregation. Journal of Organizational Behavior, 27(2), 143-162. doi: 10.1002/job.349
• Buss, D. M. (2004). Evolutionary psychology: The new science of the mind (2nd ed.). Boston, MA: Allyn & Bacon
• Chamorro-Premuzic, T., & Furnham, A. (2003). Personality predicts academic performance: Evidence from two longitudinal university samples. Journal of Research in Personality, 37(4), 319-338. doi: 10.1016/S0092-6566(02)00578-0
• Cheung, F. M., Cheung, S. F., Zhang, J., Leung, K., Leong, F., & Huiyeh, K. (2008). Relevance of openness as a personality dimension in Chinese culture: Aspects of its cultural relevance. Journal of Cross-Cultural Psychology, 39(1), 81-108. doi: 10.1177/0022022107311968
• Cheung, F., Fan, W., & To, C. (2008). The Chinese Personality Assessment Inventory as a culturally relevant personality measure in applied settings. Social and Personality Psychology Compass, 2(1), 74-89. doi: 10.1111/j.1751-9004.2007.00045.x
• Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9(2), 233-255. doi: 10.1207/S15328007SEM0902_5
• Cole, D., & Espinoza, A. (2008). Examining the academic success of Latino students in science technology engineering and mathematics (STEM) majors. Journal of College Student Development, 49(4), 285-300. doi: 10.1353/csd.0.0018
• Connelly, B. S., Ones, D. S., Davies, S. E., & Birkland, A. (2014). Opening up openness: A theoretical sort following critical incidents methodology and a meta-analytic investigation of the trait family measures. Journal of Personality Assessment, 96(1), 17-28. doi: 10.1080/00223891.2013.809355
• Cooper, A., Gomez, R., & Aucote, H. (2007). The behavioural inhibition system and behavioural approach system (BIS/BAS) scales: Measurement and structural invariance across adults and adolescents. Personality and Individual Differences, 43(2), 295-305. doi: 10.1016/j.paid.2006.11.023
• Costa Jr, P. T., Terracciano, A., & McCrae, R. R. (2001). Gender differences in personality traits across cultures: robust and surprising findings. Journal of Personality and Social Psychology, 81(2), 322-331. doi: 10.1037/0022-3514.81.2.322
• De Raad, B., & Schouwenburg, H. C. (1996). Personality in learning and education: A review. European Journal of Personality, 10(5), 303-336. doi: 10.1002/(SICI)1099-0984(199612)10:5<303::AID-PER262>3.0.CO;2-2
• DeYoung, C. G., Peterson, J. B., & Higgins, D. M. (2005). Sources of openness/intellect: Cognitive and neuropsychological correlates of the fifth factor of personality. Journal of Personality, 73(4), 825-858. doi: 10.1111/j.1467-6494.2005.00330.x
• Dimitrov, D.M. (2010). Testing for factorial invariance in the context of construct validation. Measurement and Evaluation in Counseling and Development, 43(2) 121-149. doi: 10.1177/0748175610373459
• Donnellan, M.B., Conger, R.D., & Burzette, R.G. (2007). Personality development from late adolescence to young adulthood: Differential stability, normative maturity, and evidence for the maturity-stability hypothesis. Journal of Personality, 75(2), 237-263. doi: 10.1111/j.1467-6494.2007.00438.x
• Duckworth, A. L., & Seligman, M. E. P. (2005). Self-Discipline outdoes iq in predicting academic performance of adolescents. Psychological Science, 16(12), 939-944. Retrieved from https://www.jstor.org/stable/pdf/40064361.pdf
• Dumfart, B., & Neubauer, A. C. (2016). Conscientiousness is the most powerful noncognitive predictor of school achievement in adolescents. Journal of Individual Differences, 37(1), 8-15. doi: 10.1027/1614-0001/a000182
• Durbin, C. E., Hicks, B. M., Blonigen, D. M., Johnson, W., Iacono, W. G., & McGue, M. (2016). Personality trait change across late childhood to young adulthood: Evidence for nonlinearity and sex differences in change. European Journal of Personality, 30(1), 31-44. doi: 10.1002/per.2013
• Eccles, J. (2011). Gendered educational and occupational choices: Applying the Eccles et al. model of achievement-related choices. International Journal of Behavioral Development, 35(3), 195-201. doi: 10.1177/0165025411398185
• Fadjukoff, P., Feldt, T., Kokko, K., & Pulkkinen, L. (2019). Identity status change within personal style clusters: a longitudinal perspective from early adulthood to midlife. Identity, 19(1), 1-17. doi: 10.1080/15283488.2019.1566066
• Falk, A., & Hermle, J. (2018). Relationship of gender differences in preferences to economic development and gender equality (IZA Discussion Papers, No. 12059). Institute of Labor Economics (IZA), Bonn. Retrieved from http://hdl.handle.net/10419/193353
• Figueredo, A. J., Sefcek, J. A., & Jones, D. N. (2006). The ideal romantic partner personality. Personality and Individual Differences, 41(3), 431-441. doi: 10.1016/j.paid.2006.02.004
• Fischer, A. H., & Manstead, A. S. R. (2000). The relation between gender and emotion in different cultures. In A. H. Fischer (Ed.), Studies in emotion and social interaction. Second series. Gender and emotion: Social psychological perspectives (pp. 71-94). Cambridge University Press. doi: 10.1017/CBO9780511628191.005
• Funder, D. C. (2001). Personality. Annual Review of Psychology, 52, 197-221. Retrieved from https://intranet.newriver.edu/images/stories/library/Stennett_Psychology_Articles/Personality.pdf
• Gasser, C. E., Larson, L. M., & Borgen, F.H. (2007). Concurrent validity of the 2005 Strong Interest Inventory: An examination of gender and major field of study. Journal of Career Assessment, 15(1), 23-43. Retrieved from http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.908.2140&rep=rep1&type=pdf
• Guimond, S. (2008). Psychological similarities and differences between women and men across cultures. Social and Personality Psychology Compass, 2(1), 494-510. doi: 10.1111/j.1751-9004.2007.00036.x
• Heckman, J. J., Stixrud, J., & Urzua, S. (2006). The effects of cognitive and non-cognitive abilities on labor market outcomes and social behavior. Journal of Labor Economics, 24(3), 411-482. Retrieved from https://www.nber.org/papers/w12006.pdf
• Hu, L. T., & Bentler, P. M. (1998). Fit indices in covariance structure modeling: Sensitivity to underparameterized model misspecification. Psychological Methods, 3(4), 424-453. Retrieved from https://pdfs.semanticscholar.org/a92c/9726361d9c1d165dbf2ea781b6c48363a816.pdfRelated
• Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1-55. doi: 10.1080/10705519909540118
• John, O. P., & Srivastava, S. (1999). The Big Five trait taxonomy: History, measurement, and theoretical perspectives. In L. A. Pervin & O. P. John (Eds.), Handbook of personality: Theory and research (2nd ed., pp. 102-138). New York, NY: Guilford Press.
• John, O. P., Neumann, L. P., & Soto, C. J. (2008). Paradigm shift to the integrative Big-Five trait taxonomy: History, measurement, and conceptual issues. In O. P. John, R. W. Robins, & L. A. Pervin (Eds.), Handbook of personality: Theory and research (3rd ed., pp. 114-158). New York, NY: Guilford.
• Johnson, J. G., Cohen, P., Brown, J., Smailes, E. M., & Bernstein, D. P. (1999). Childhood maltreatment increases risk for personality disorders during early adulthood. Archives of General Psychiatry, 56(7), 600-606. doi: 10.1001/archpsyc.56.7.600
• Josephs, R. A., Markus, H. R., & Tafarodi, R. W. (1992). Gender and self-esteem. Journal of Personality and Social Psychology, 63(3), 391-402. Retrieved from https://www.researchgate.net/profile/Robert_Josephs/publication/21751337_Gender_and_Self-Esteem/links/0912f5098177bd1614000000.pdf
• Judge, T. A., & Ilies, R. (2002). Relationship of personality to performance motivation: A meta-analytic review. Journal of applied psychology, 87(4), 797-807. doi: 10.1037//0021-9010.87.4.797
• Judge, T. A., Erez, A., Bono, J. E., & Thoresen, C. J. (2002). Are measures of self-esteem, neuroticism, locus of control, and generalized self-efficacy indicators of a common core construct? Journal of Personality and Social Psychology, 83(3), 693-710. doi: 10.1037//0022-3514.83.3.693
• Kajonius, P. J., & Johnson, J. (2018). Sex differences in 30 facets of the five-factor model of personality in the large public (N=320,128). Personality and Individual Differences, 129(July), 126-130. doi: 10.1016/j.paid.2018.03.026
• Klein, H. J., & Lee, S. (2006). The effects of personality on learning: The mediating role of goal setting. Human Performance, 19(1), 43-66. doi: 10.1207/s15327043hup1901_3 Klimstra, T. A., Luyckx, K., Branje, S., Teppers, E., Goossens, L., & Meeus, W. H. (2013). Personality traits, interpersonal identity, and relationship stability: Longitudinal linkages in late adolescence and young adulthood. Journal of Youth and Adolescence, 42(11), 1661-1673. doi: 10.1007/s10964-012-9862-8
• Kline, R. B. (2011). Principles and practice of structural equation modeling. New York, NY: The Guilford Press.
• Korkmaz, M., Somer, O., & Gungor, D. (2013). Measurement equivalence across gender with mean and covariance structure of five factor personality inventory for adolescent sample. Education and Science, 38(170). 121-134. Retrieved from http://egitimvebilim.ted.org.tr/index.php/EB/article/view/1532/550
• Langen, A. V., & Dekkers, H. (2005). Cross‐national differences in participating in tertiary science, technology, engineering and mathematics education. Comparative Education, 41(3), 329-350. doi: 10.1080/03050060500211708
• Legewie, J., & DiPrete, T. A. (2014). The high school environment and the gender gap in science and engineering. Sociology of Education, 87(4), 259-280. doi: 10.1177/0038040714547770
• Lippa, R. A. (2010). Gender differences in personality and interests: When, where, and why? Social and Personality Psychology Compass, 4(11), 1098-1110. doi: 10.1111/j.1751-9004.2010.00320.x
• Lounsbury, J. W., Sundstrom, E., Loveland, J. M., & Gibson, L. W. (2003). Intelligence, “Big Five” personality traits, and work drive as predictors of course grade. Personality and Individual Differences, 35(6), 1231-1239. Retrieved from http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.936.3275&rep=rep1&type=pdf
• Low, K., & Rounds, J. (2007). Interest change and continuity from early adolescence to middle adulthood. International Journal for Educational and Vocational Guidance, 7(1), 23-36. doi: 10.1007/s10775-006-9110-4
• Lynn, R. (1993). Sex differences in competitiveness and the valuation of money in twenty countries. Journal of Social Psychology, 133(4), 507-511.
• Manders, W. A., Scholte, R. H., Janssens, J. M., & De Bruyn, E. E. (2006). Adolescent personality, problem behaviour and the quality of the parent–adolescent relationship. European Journal of Personality, 20(3), 237-254. doi: 10.1002/per.574
• Matthews, G., Zeidner, M., & Roberts, R. D. (2006). Models of personality and affect for education: A review and synthesis. In P. A. Alexander & P. H. Winne (Eds.), Handbook of educational psychology (2nd ed., pp. 163-186). Mahwah, NJ: Erlbaum.
• McAdams, D. P., & Pals, J. L. (2006). A new Big Five: fundamental principles for an integrative science of personality. American Psychologist, 61(3), 204-217. Retrieved from http://people.wku.edu/richard.miller/new%20big%20five.pdf
• McCrae, R. R., & Costa, P. T., Jr. (1997). Conceptions and correlates of openness to experience. In R. Hogan, J. A. Johnson, & S. R. Briggs (Eds.), Handbook of personality psychology (pp. 825-847). Academic Press. doi: 10.1016/B978-012134645-4/50032-9
• McCrae, R. R., Terracciano, A., & Pro, P. P. C. (2005). Personality profiles of cultures: Aggregate personality traits. Journal of Personality and Social Psychology, 89(3), 407-425. doi: 10.1037/0022-3514.89.3.407
• McCrae, R. R., Yik, M. S., Trapnell, P. D., Bond, M. H., & Paulhus, D. L. (1998). Interpreting personality profiles across cultures: Bilingual, acculturation, and peer rating studies of Chinese undergraduates. Journal of Personality and Social Psychology, 74(4), 1041-1055. doi: 10.1037/0022-3514.74.4.1041
• Milfont, T. L., & Fischer, R. (2010). Testing measurement invariance across groups: Applications in cross-cultural research. International Journal of psychological research, 3(1), 111-130. Retrieved from http://45.5.172.45/bitstream/10819/6503/1/Testing_Measurement_Invariance_Milfont_2010.pdf
• Morizot, J. (2014). Construct validity of adolescents’ self-reported big five personality traits: Importance of conceptual breadth and initial validation of a short measure. Assessment, 21(5), 580-606. doi: 10.1177/1073191114524015
• Morsunbul, U. (2014). The validity and reliability study of the Turkish version of quick big five personality test. Dusunen Adam The Journal of Psychiatry and Neurological Sciences, 27(4), 316-322. doi: 10.5350/DAJPN2014270405
• Mueller, G., & Plug, E. (2006). Estimating the effect of personality on male and female earnings. Industrial and Labor Relations Review, 60(1), 3-22. Retrieved from http://www.jstor.org/stable/25067572
• Nguyen, N. T., Allen, L. C., & Fraccastoro, K. (2005). Personality predicts academic performance: Exploring the moderating role of gender. Journal of Higher Education Policy and Management, 27(1), 105-117. doi: 10.1080/13600800500046313
• Noftle, E. E., & Robins, R. W. (2007). Personality predictors of academic outcomes: Big five correlates of GPA and SAT scores. Journal of Personality and Social Psychology, 93(1), 116-130. doi: 10.1037/0022-3514.93.1.116
• O’Connor, M. C., & Paunonen, S. V. (2007). Big five personality predictors of post-secondary academic performance. Personality and Individual Differences, 43(5), 971-990. doi: 10.1016/j.paid.2007.03.017
• Ock, J., McAbee, S. T., Mulfinger, E., & Oswald, F. L. (2020). The practical effects of measurement invariance: gender invariance in two big five personality measures. Assessment, 27(4), 657-674. doi: 10.1177/1073191119885018
• Paunonen, S. V., & Ashton, M. C. (2001). Big five factors and facets and the prediction of behavior. Journal of Personality and Social Psychology, 81(3), 524-539. doi: 10.1037/0022-3514.81.3.524
• Poropat, A. E. (2009). A meta-analysis of the five-factor model of personality and academic performance. Psychological Bulletin, 135(2), 322-338. doi: 10.1037/a0014996
• Poropat, A. E. (2011). The Eysenckian personality factors and their correlations with academic performance. British Journal of Educational Psychology, 81(1), 41-58. doi: 10.1348/000709910X497671
• Poropat, A. E. (2014). Other-rated personality and academic performance: Evidence and implications. Learning and Individual Differences, 34, 24-32. doi: 10.1016/j.lindif.2014.05.013
• Putnick, D. L., & Bornstein, M. H. (2016). Measurement invariance conventions and reporting: The state of the art and future directions for psychological research. Developmental Review, 41, 71-90. doi: 10.1016/j.dr.2016.06.004
• Rindermann, H., & Neubauer, A. (2001). The influence of personality on three aspects of cognitive performance: Processing speed, intelligence and school performance. Personality and Individual Differences, 30(5), 829-842. Retrieved from https://pdfs.semanticscholar.org/e468/6271719ef3a12ffc1e3db46bb705cf2195a6.pdf
• Roberts, B. W., Kuncel, N., Shiner, R. N., Caspi, A., & Goldberg, L. R. (2007). The power of personality: The comparative validity of personality traits, socio-economic status, and cognitive ability for predicting important life outcomes. Perspectives in Psychological Science, 2(4), 313-345. doi: 10.1111/j.1745-6916.2007.00047.x
• Roberts, B. W., Walton, K. E., & Viechtbauer, W. (2006). Patterns of mean-level change in personality traits across the life course: a meta-analysis of longitudinal studies. Psychological Bulletin, 132(1), 1-25. doi: 10.1037/0033-2909.132.1.1
• Roets, A., & Van Hiel, A. (2011). Item selection and validation of a brief, 15-item version of the need for closure scale. Personality and Individual Differences, 50(1), 90-94. doi: 10.1016/j.paid.2010.09.004
• Rollock, D., & Lui, P. P. (2016). Measurement invariance and the five-factor model of personality: Asian international and Euro American cultural groups. Assessment, 23(5), 571-587. doi: 10.1177/1073191115590854
• Samuel, D. B., South, S. C., & Griffin, S. A. (2015). Factorial invariance of the five-factor model rating form across gender. Assessment, 22(1), 65-75. doi: 10.1177/1073191114536772
• Sass, D. A. (2011). Testing measurement invariance and comparing latent factor means within a confirmatory factor analysis framework. Journal of Psychoeducational Assessment, 29(4), 347-363. doi: 10.1177/0734282911406661
• Saucier, G., & Goldberg, L. R. (1996). The language of personality: Lexical perspectives on the five- factor model. In J. S. Wiggins. (Ed.), The five-factor model of personality: Theoretical Perspective (pp. 21-50). New York, NY; Guilford.
• Schmitt, D. P., Long, A. E., McPhearson, A., O’Brien, K., Remmert, B., & Shah, S. H. (2017). Personality and gender differences in global perspective. International Journal of Psychology, 52(1), 45-56. doi: 10.1002/ijop.12265
• Schmitt, D. P., Realo, A., Voracek, M., & Allik, J. (2008). Why can’t a man be more like a woman? Sex differences in Big Five personality traits across 55 cultures. Journal of Personality and Social Psychology, 94(1), 168-182. doi: 10.1037/0022-3514.94.1.168
• Shiner, R. L., Allen, T. A., & Masten, A. S. (2017). Adversity in adolescence predicts personality trait change from childhood to adulthood. Journal of Research in Personality, 67, 171-182. doi: 10.1016/j.jrp.2016.10.002
• Soto, C. J. (2016). The little six personality dimensions from early childhood to early adulthood: Mean‐level age and gender differences in parents' reports. Journal of Personality, 84(4), 409-422. doi: 10.1111/jopy.12168
• Tabachnick, B.G., & Fidell, L.S. (2001). Using multivariate statistics (4th ed.). Needham Heights, MA: Allyn & Bacon.
• Triandis, H. C., & Suh, E. M. (2002). Cultural influences on personality. Annual Review of Psychology, 53(1), 133-160. doi: 10.1146/annurev.psych.53.100901.135200
• Van de Schoot, R., Lugtig, P., & Hox, J. (2012). A checklist for testing measurement invariance. European Journal of Developmental Psychology, 9(4), 486-492. doi: 10.1080/17405629.2012.686740
• Vandenberg, R. J. (2002). Toward a further understanding of and improvement in measurement invariance methods and procedures. Organizational Research Methods, 5(2), 139-158. doi: 10.1177/1094428102005002001
• Vandenberg, R. J., & Lance, C. E. (2000). A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational research methods, 3(1), 4-70. doi: 10.1177/109442810031002
• Vermults, A. A., & Gerris, J. R. M. (2005). QBF: Quick Big Five persoonlijkheidstest handleiding [Quick Big Five personality test manual]. Leeuwarden, the Netherlands: LDC Publications.
• Wang, M. T., & Degol, J. L. (2017). Gender gap in science, technology, engineering, and mathematics (STEM): Current knowledge, implications for practice, policy, and future directions. Educational Psychology Review, 29(1), 119-140. doi: 10.1007/s10648-015-9355-x
• Willingham, W. W., Pollack, J. M., & Lewis, C. (2002). Grades and test scores: Accounting for observed differences. Journal of Educational Measurement, 39(1), 1-37. Retrieved from https://www.jstor.org/stable/1435104?seq=1&cid=pdf-reference#references_tab_contents