Psychometric Properties of Turkish Version of Aggression Questionnaire Short Form: Measurement Invariance and Differential Item Functioning across Sex and Age

Abstract

The aim of the present study was to test the psychometric properties of the Aggression Questionnaire Short Form for adolescents and adults in Turkish. The adaptation study was conducted with 778 adolescents aged between 15-18 and 1067 adults aged between 19 and 44. The construct validity of the questionnaire was tested via Parallel Analysis, Exploratory Factor Analysis and Confirmatory Factor Analysis. Furthermore, item-total correlations, test-retest score correlation, and internal consistency (Cronbach Alpha and McDonald’s Omega) were calculated as reliability analyses. The Measurement Invariance test and Differential Item Functioning in male and female, adolescent and adult samples were also conducted. The results yielded that the Turkish version of the Aggression Questionnaire Short Form is a reliable questionnaire with four-factors, and without sex and age differences, it can be used to measure aggression among Turkish adolescents and adults.

Keywords

• agression questionnaire short form
• measurement invariance
• differential item functioning

References

1. Abd-El-Fattah, S. M. (2013). A cross-cultural examination of the Aggression Questionnaire–Short Form among Egyptian and Omani Adolescents. Journal of Personality Assessment, 95(5), 539-548.
2. Adıgüzel, V., Özdemir, N., & Şahin, Ş. K. (2019). Childhood traumas in euthymic bipolar disorder patients in Eastern Turkey and its relations with suicide risk and aggression. Nordic Journal of Psychiatry, 73(8), 490-496.
3. Akbaş, U., Karabay, E., Yıldırım-Seheryeli, M., Ayaz, A., ve Demir, Ö. O. (2019). Türkiye ölçme araçları dizininde yer alan açımlayıcı faktör analizi çalışmalarının paralel analiz sonuçları ile karşılaştırılması. Kuramsal Eğitimbilim Dergisi, 12(3), 1095-1123.
4. Aksu, G., Eser, M. T., & Güzeller, C. O. (2017). Açımlayıcı ve doğrulayıcı faktör analizi ile yapısal eşitlik modeli uygulamaları. Detay Yayıncılık.
5. Ang, R. P. (2007). Factor structure of the 12-item aggression questionnaire: Further evidence from Asian adolescent samples. Journal of Adolescence, 30(4), 671-685.
6. Bernstein, I. H., & Gesn, P. R. (1997). On the dimensionality of the Buss/Perry Aggression Questionnaire. Behaviour Research and Therapy, 35(6), 563-568.
7. Björkqvist, K., Österman, K., & Lagerspetz, K. M. (1994). Sex differences in covert aggression among adults. Aggressive Behavior, 20(1), 27-33.
8. Björkqvist, K. (2018). Gender differences in aggression. Current Opinion in Psychology, 19, 39-42.

9. Borders, A., Earleywine, M., & Jajodia, A. (2010). Could mindfulness decrease anger, hostility, and aggression by decreasing rumination? Aggressive Behavior: Official Journal of the International Society for Research on Aggression, 36(1), 28-44.
10. Bryant, F. B., & Smith, B. D. (2001). Refining the architecture of aggression: A measurement model for the Buss–Perry Aggression Questionnaire. Journal of Research in Personality, 35(2), 138-167.
11. Buss, A. H., & Durkee, A. (1957). An inventory for assessing different kinds of hostility. Journal of Consulting Psychology, 21(4), 343.
12. Buss, A. H., & Perry, M. (1992). The Aggression Questionnaire. Journal of Personality and Social Psychology, 63(3), 452.
13. Büyüköztürk, Ş. (2007). Sosyal bilimler için veri analizi el kitabı. Ankara: Pegem A Yayıncılık.
14. Carver, C. S., Sinclair, S., & Johnson, S. L. (2010). Authentic and hubristic pride: Differential relations to aspects of goal regulation, affect, and self-control. Journal of Research in Personality, 44(6), 698-703.
15. Chang, L., Schwartz, D., Dodge, K. A., & McBride-Chang, C. (2003). Harsh parenting in relation to child emotion regulation and aggression. Journal of Family Psychology, 17(4), 598.
16. Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodnessof-fit indexes for testing measurement invariance. Structural Equation Modeling, 9(2), 233–255.
17. Coie, J. D., & Dodge, K. A. (1998). Aggression and antisocial behavior. In W. Damon & N. Eisenberg (Ed.), Handbook of child psychology: Social, Emotional, and Personality Development (pp. 779-862). Hoboken, NJ, US: John Wiley & Sons Inc.
18. D’Zurilla, T. J., Nezu, A. M. & Maydeu-Olivares, A. (2002). Manual for the Social Problem Solving Inventory-revised (SPSI-R). North Tonawanda: Multi-Health Systems.
19. De Zavala, A. G., Cichocka, A., Eidelson, R., & Jayawickreme, N. (2009). Collective narcissism and its social consequences. Journal of Personality and Social Psychology, 97(6), 1074.
20. Diamond, P. M., & Magaletta, P. R. (2006). The short-form Buss-Perry Aggression Questionnaire (BPAQ-SF) a validation study with federal offenders. Assessment, 13(3), 227-240.
21. Diamond, P. M., Wang, E. W., & Buffington-Vollum, J. (2005). Factor structure of the Buss-Perry Aggression Questionnaire (BPAQ) with mentally ill male prisoners. Criminal Justice and Behavior, 32(5), 546-564.
22. Doğan, N., & Öğretmen, T. (2008). Degisen madde fonksiyonunu belirlemede mantel - Haenszel, ki-kare ve lojistik regresyon tekniklerinin karsilastirilmasi. Egitim ve Bilim, 33(148), 100–112.
23. Emerson, S. D., Guhn, M., & Gadermann, A. M. (2017). Measurement invariance of the Satisfaction with Life Scale: reviewing three decades of research. Quality of Life Research, 26(9), 2251-2264.
24. Erkuş, A. (2012). Psikolojide ölçme ve ölçek geliştirme. Ankara: Pegem Akademi Yayınları.
25. Eron, L. D., Huesmann, L. R., Dubow, E., Romanoff, R., & Yarmel, P. W. (1987). Aggression and its correlates over 22 years. Childhood Aggression and Violence, 249–262.
26. Eskin, M., & Aycan, Z. (2009). The adaptation of the revised social problem solving inventory into Turkish: A reliability and validity analysis. Turkish Journal of Psychology, 12(23), 11–13.
27. Evren, C., Çınar, Ö., Güleç, H., Çelik, S., & Evren, B. (2011). The validity and reliability of the Turkish version of the Buss-Perry’s Aggression Questionnaire in male substance dependent inpatients. The Journal of Psychiatry and Neurological Sciences, 24(4), 283-295.
28. Ferrando, P. J., & Lorenzo-Seva, U. (2017). 10 años del programa FACTOR: Una revisión crítica de sus orígenes, desarrollo y líneas futuras. Psicothema, 29(2), 236–240. Field, A. (2013). Discovering statistics using IBM SPSS statistics. Sage.
29. Fraenkel, J.R., Wallen, N.E., & Hyun, H.H. (2012). How to design and evaluate research in education (Eight Edition). New York: McGraw-Hill
30. Franklin, S. B., Gibson, D. J., Robertson, P. A., Pohlmann, J. T., & Fralish, J. S. (1995). Parallel Analysis: a method for determining significant principal components. Journal of Vegetation Science, 6(1), 99–106.
31. Gök, B., Kelecioglu, H., & Dogan, N. (2010). The Comparison of Mantel-Haenszel and Logistic Regression Techniques in Determining the Differential Item Functioning. Egitim ve Bilim-Education and Science, 35(156), 3–16.
32. García-León, A., Reyes, G. A., Vila, J., Pérez, N., Robles, H., & Ramos, M. M. (2002). The Aggression Questionnaire: A validation study in student samples. The Spanish Journal of Psychology, 5(1), 45-53.
33. Gerevich, J., Bácskai, E., & Czobor, P. (2007). The generalizability of the Buss–Perry Aggression Questionnaire. International Journal of Methods in Psychiatric Research, 16(3), 124-136.
34. Guo, B., Kaylor-Hughes, C., Garland, A., Nixon, N., Sweeney, T., Simpson, S., ... & Morriss, R. (2017). Factor structure and longitudinal measurement invariance of PHQ-9 for specialist mental health care patients with persistent major depressive disorder: Exploratory Structural Equation Modelling. Journal of Affective Disorders, 219, 1-8.
35. Gustavsson, J. P., Eriksson, A. K., Hilding, A., Gunnarsson, M., & Östensson, C. G. (2008). Measurement invariance of personality traits from a five-factor model perspective: multi-group confirmatory factor analyses of the HP5 inventory. Scandinavian Journal of Psychology, 49(5), 459–467.
36. Harris, J. A. (1995). Confirmatory factor analysis of the Aggression Questionnaire. Behaviour Research and Therapy, 33(8), 991-993.
37. Harris, J. A. (1997). A further evaluation of the aggression questionnaire: Issues of validity and reliability. Behaviour Research and Therapy, 35(11), 1047-1053.
38. Hinshaw, S. P. (1987). On the distinction between attentional deficits/hyperactivity and conduct problems/aggression in child psychopathology. Psychological Bulletin, 101(3), 443.
39. Horn, J. L. (1965). A rationale and test for the number of factors in factor analysis. Psychometrika, 30(2), 179-185.
40. Hornsveld, R. H., Muris, P., Kraaimaat, F. W., & Meesters, C. (2009). Psychometric properties of the aggression questionnaire in Dutch violent forensic psychiatric patients and secondary vocational students. Assessment, 16(2), 181-192.
41. Huesmann, L. R., Eron, L. D., & Dubow, E. F. (2002). Childhood predictors of adult criminality: are all risk factors reflected in childhood aggressiveness?. Criminal Behaviour and Mental Health, 12(3), 185-208.
42. Huesmann, L. R., Eron, L. D., Lefkowitz, M. M., & Walder, L. O. (1984). Stability of aggression over time and generations. Developmental Psychology, 20(6), 1120–1134.
43. Iurino, K., & Saucier, G. (2020). Testing measurement invariance of the Moral Foundations Questionnaire across 27 countries. Assessment, 27(2), 365-372.
44. Johnson, S. L., Carver, C. S., & Joormann, J. (2013). Impulsive responses to emotion as a trans diagnostic vulnerability to internalizing and externalizing symptoms. Journal of Affective Disorders, 150(3), 872-878.
45. Jöreskog, K. G., & Sörbom, D. (1993). LISREL 8: Structural equation modeling with the SIMPLIS command language. Scientific Software International Inc, Chicago.
46. Kang, J. H., Lim, C. H., Suh, Y. I., Gang, A. C., & Pedersen, P. M. (2020). Establishing a web-based measurement of aggression (WTCRTT): Examining the validity of a modified Taylor's competitive reaction time test. International Journal of Applied Sports Sciences, 32(1), 37-48.
47. Kline, R. B. (2015). Principles and practice of structural equation modeling. Guilford Publications.
48. Koyuncu, İ., Aksu, G., & Kelecioğlu, H. (2018). Mantel-Haenszel, Lojistik Regresyon ve Olabilirlik Oranı Değişen Madde Fonksiyonu İnceleme Yöntemlerinin Farklı Yazılımlar Kullanılarak Karşılaştırılması. Elementary Education Online, 17(2), 909–925.
49. Kožený, J., Tišanská, L., & Csémy, L. (2017). A Rasch Analysis of The Buss-Perry Aggression Questionnaire-Short Form: An evidence from Czech adolescents’ sample. Ceskoslovenska Psychologie, 61(3), 257-266.
50. Kuzucu, Y. (2016). Do anger control and social problem-solving mediate relationships between difficulties in emotion regulation and aggression in adolescents? Educational Sciences: Theory & Practice, 16(3).
51. Kühn, S., Kugler, D. T., Schmalen, K., Weichenberger, M., Witt, C., & Gallinat, J. (2019). Does playing violent video games cause aggression? A longitudinal intervention study. Molecular Psychiatry, 24(8), 1220-1234.
52. Lansford, J. E., Skinner, A. T., Sorbring, E., Giunta, L. D., Deater‐Deckard, K., Dodge, K. A., ... & Uribe Tirado, L. M. (2012). Boys’ and girls’ relational and physical aggression in nine countries. Aggressive Behavior, 38(4), 298-308.
53. Ledesma, R. D., & Valero-Mora, P. (2007). Determining the number of factors to retain in EFA: An easy-to-use computer program for carrying out parallel analysis. Practical Assessment, Research & Evaluation, 12(2), 1-11.
54. Liu, J., Lewis, G., & Evans, L. (2013). Understanding aggressive behaviour across the lifespan. Journal of psychiatric and mental health nursing, 20(2), 156-168.
55. Madran, H. A. D. (2012). Buss-Perry Saldırganlık Ölçeği’nin Türkçe formunun geçerlik ve güvenirlik çalışması. Türk Psikoloji Dergisi, 24(2), 1-6.
56. Maslow, A. H. (1943). A theory of human motivation. Psychological Review, 50(4), 370.
57. Maxwell, J. P. (2007). Development and preliminary validation of a Chinese version of the Buss–Perry Aggression Questionnaire in a population of Hong Kong Chinese. Journal of Personality Assessment, 88(3), 284-294.
58. McKay, M. T., Perry, J. L., & Harvey, S. A. (2016). The factorial validity and reliability of three versions of the Aggression Questionnaire using Confirmatory Factor Analysis and Exploratory Structural Equation Modelling. Personality and Individual Differences, 90, 12-15.
59. Meredith, W. (1993). Measurement invariance, factor analysis and factorial invariance. Psychometrika, 58(4), 525–543.
60. Meyer, J. P. (2018). JMETRİK ile Ölçme Uygulamaları. (Çev. C. O. Güzeller, M. T. Eser, G. Aksu). Maya Akademi (Orijinal yayın tarihi 2014).
61. Milfont, T. L., & Fischer, R. (2015). Testing measurement invariance across groups: Applications in cross- cultural research. International Journal of Psychological Research, 3(1), 111–130.
62. Morales-Vives, F., Codorniu-Raga, M. J., & Vigil-Colet, A. (2005). Características psicométricas de las versiones reducidas del cuestionario de agresividad de Buss y Perry. Psicothema, 17(1), 96-100.
63. Moyer, K. E. (1982). The origins of aggression in child nurturance (pp. 243-260). Springer, Boston, MA.
64. Orpinas, P., & Frankowski, R. (2001). The Aggression Scale: A self-report measure of aggressive behavior for young adolescents. The Journal of Early Adolescence, 21(1), 50-67.
65. Önen, E. (2016). Saldırganlık Ölçeği’nin Psikometrik Niteliklerinin Türk Ergenleri İçin İncelenmesi. Türk Psikolojik Danışma ve Rehberlik Dergisi, 4(32).
66. Özer, A. K. (1994). Sürekli öfke ve öfke ifade tarzı ölçekleri ön çalışması. Türk Psikoloji Dergisi, 9(31), 26-35.
67. Özdemir, Y., Vazsonyi, A. T., & Cok, F. (2017). Parenting processes, self-esteem, and aggression: A mediation model. European Journal of Developmental Psychology, 14(5), 509-532.
68. Palmstierna, T., & Wistedt, B. (1987). Staff observation aggression scale, SOAS: presentation and evaluation. Acta Psychiatrica Scandinavica, 76(6), 657-663.
69. Podubinski, T., Lee, S., Hollander, Y., & Daffern, M. (2017). Patient characteristics associated with aggression in mental health units. Psychiatry Research, 250, 141-145.
70. Raine, A., Dodge, K., Loeber, R., Gatzke‐Kopp, L., Lynam, D., Reynolds, C., ... & Liu, J. (2006). The reactive–proactive aggression questionnaire: Differential correlates of reactive and proactive aggression in adolescent boys. Aggressive Behavior: Official Journal of the International Society for Research on Aggression, 32(2), 159-171.
71. Reyna, C., Sanchez, A., Ivacevich, M. G. L., & Brussino, S. (2011). The Buss-Perry Aggression Questionnaire: construct validity and gender invariance among Argentinean adolescents. International Journal of Psychological Research, 4(2), 30-37.
72. Revelle, W. (2018). Psych: procedures for personality and psychological research. Northwestern University, Evanston.
73. Sexton, M. B., Davis, A. K., Buchholz, K. R., Winters, J. J., Rauch, S. A. M., Yzquibell, M., . . . Chermack, S. T. (2019). Veterans with recent substance use and aggression: PTSD, substance use, and social network behaviors. Psychological Trauma: Theory, Research, Practice, and Policy, 11(4), 424-433.
74. Singh, S. (2017). Understanding aggression among youth in the context of mindfulness. Indian Journal of Health and Wellbeing, 8(11), 1377-1379.
75. Sorsdahl, K., Stein, D. J., & Myers, B. (2017). Psychometric properties of the Social Problem Solving Inventory‐Revised Short‐Form in a South African population. International Journal of Psychology, 52(2), 154-162.
76. Spielberger, C. D. (1985). The experience and expression of anger: Construction and validation of an anger expression scale. Anger and hostility in cardiovascular and behavioral disorders, 5-30.
77. Spielberger, C. D. (1988). Manual for the State-Trait Anger Expression Scale (STAX). 1988. Odessa, FL: Psychological Assessment Resources.
78. Spielberger, C. D, Johnson E.H, Russell SF, Crane RJ, Jacobs GA, & Worden TJ. (1985). The experience and expression of anger: construction and validation of an anger expression scale. In: Chesney MA, Rosenman R.H, eds. Anger and Hostility in Cardiovascular and Behavioral Disorders. New York, NY: Hemisphere, 5-30.
79. Şahin, C. (2018). Bireyi tanıma teknikleri: Psikolojik testler, test dışı teknikler. Ankara: Pegem Akademi.
80. Surís, A., Borman, P. D., Lind, L., & Kashner, T. M. (2007). Aggression, impulsivity, and health functioning in a veteran population: equivalency and test–retest reliability of computerized and paper-and-pencil administrations. Computers in Human Behavior, 23(1), 97-110.
81. Tabachnick, B. G., & Fidell, L. S. (2013). Using multivariate statistic (6th ed.). USA: Pearson.
82. Torregrosa, M. S., Gómez-Núñez, M. I., Inglés, C. J., Ruiz-Esteban, C., Sanmartín, R., & García-Fernández, J. M. (2020). Buss and Perry Aggression Questionnaire-Short Form in Spanish Children. Journal of Psychopathology and Behavioral Assessment, 1-16.
83. Vandenberg, R. J., & Lance, C. E. (2000). A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 3(1), 4–70.
84. Vitoratou, S., Ntzoufras, I., Smyrnis, N., & Stefanis, N. C. (2009). Factorial composition of the Aggression Questionnaire: A multi-sample study in Greek adults. Psychiatry Research, 168(1), 32–39.
85. Wang, X., Yang, L., Yang, J., Gao, L., Zhao, F., Xie, X., & Lei, L. (2018). Trait anger and aggression: A moderated mediation model of anger rumination and moral disengagement. Personality and Individual Differences, 125, 44-49.
86. Webster, G. D., DeWall, C. N., Pond Jr, R. S., Deckman, T., Jonason, P. K., Le, B. M., ... & Smith, C. V. (2014). The brief aggression questionnaire: Psychometric and behavioral evidence for an efficient measure of trait aggression. Aggressive Behavior, 40(2), 120-139.
87. Webster, S. D., Mann, R. E., Thornton, D., & Wakeling, H. C. (2007). Further validation of the Short Self-esteem Scale with sexual offenders. Legal and Criminological Psychology,12(2), 207-216.
88. Wu, A. D., Li, Z. & Zumbo, B. D. (2007). Decoding the meaning of factorial invariance and updating the practice of multi-group confirmatory factor analysis: A demonstration with TIMSS data. Practical Assessment, Research & Evaluation, 12(1), 1-26.
89. Zumbo, B. (1999). A handbook on the theory and methods of differential item functioning (DIF). Ottawa: National Defense Headquarters, June, 1–57.