Teachers’ perceptions of organizational dissent management in schools: Scale development and psychometric evaluation

Öz

This study aimed to develop and psychometrically evaluate a scale measuring teachers’ perceptions of organizational dissent management in schools. The item pool created as a result of a literature review conducted by researchers was subjected to expert evaluation for content validity. The research was carried out using a correlational research design. Exploratory and confirmatory factor analyses were conducted on two independent samples (n = 271; n = 223). The exploratory factor analysis supported a two-factor model consisting of 13 items, namely supportive management and suppressive management, which accounted for 59.55% of the total variance. CFA supported the two-factor structure of the organizational dissent management scale, consisting of 12 items—7 items in the suppressive management dimension and 5 items in the supportive management dimension—with excellent model fit indices. Additionally, measurement invariance across gender was examined. The changes in CFI values for the configural, metric, scalar, and strict invariance models (ΔCFI < .010) indicated that the scale functioned equivalently for male and female participants. The Differential Item Functioning (DIF) analysis based on ordinal logistic regression indicated that only two items exhibited uniform DIF with low effect sizes, while all other items functioned equivalently across gender groups, indicating that the scale generally meets measurement invariance. Furthermore, reliability analyses demonstrated high internal consistency, with Cronbach’s alpha and McDonald’s values ranging from .90 to .93 and Composite Reliability values between .87 and .93 for the sub-dimensions. These findings provide strong evidence for the validity, reliability, and fairness of the organizational dissent management scale.

Anahtar Kelimeler

• Organizational dissent management
• Validity
• Reliability

References

1. Anthoine, E., Moret, L., Regnault, A., Sébille, V., & Hardouin, J.B. (2014). Sample size used to validate a scale: A review of publications on newly-developed patient reported outcomes measures. Health and Quality of Life Outcomes, 12(1), 176. https://doi.org/10.1186/s12955-014-0176-2
2. Ataç, L., & Köse, S. (2017). Örgütsel demokrasi ve örgütsel muhalefet ilişkisi: Beyaz yakalılar üzerine bir araştırma [The relationship between organizational democracy and organizational dissent: a study on white-collar employees]. Journal of Istanbul University Faculty of Business Administration, 46(1), 117 132. https://dergipark.org.tr/en/download/article file/342742
3. Ayre, C., & Scally, A.J. (2014). Critical values for Lawshe's content validity ratio: Revisiting the original methods of calculation. Measurement and Evaluation in Counseling and Development, 47(1), 79-86. https://doi.org/10.1177/0748175613513808
4. Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), 77-101. https://doi.org/10.1191/1478088706qp063oa
5. Brown, T.A. (2015). Confirmatory factor analysis for applied research. Guilford publications.
6. Bryman, A., & Cramer, D. (2001). Quantitative data analysis with SPSS release 10 for windows: A guide for social scientists. Routledge
7. Burns, T., & Wagner, C. (2013). Organizational dissent. Principal Leadership, 14(4), 28-32.
8. Büyüköztürk, Ş. (2004). Sosyal bilimler için veri analizi el kitabı [Data analysis handbook for social sciences]. Pegem Akademi.

9. Byrne, B.M. (2016). Structural equation modeling with AMOS: Basic concepts, applications, and programming (3rd ed.). Routledge
10. Chen, F.F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling, 14(3), 464 504. https://doi.org/10.1080/10705510701301834
11. Cheung, G.W., & Rensvold, R.B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9(2), 233 255. https://doi.org/10.1207/S15328007SEM0902_5
12. Clark, L.A., & Watson, D. (1995). Constructing validity: Basic issues in objective scale development. Psychological Assessment, 7(3), 309 319. https://psycnet.apa.org/doi/10.1037/pas0000626
13. Clark, L.A., & Watson, D. (2019). Constructing validity: New developments in creating objective measuring instruments. Psychological Assessment, 31(12), 1412 1427. https://doi.org/10.1037/pas0000626
14. Cohen, J. (1988). The analysis of variance and covariance. Statistical power analysis for the behavioural sciences. Routledge
15. Cohen, R.J., & Swerdlik, M.E. (2005). Psychological testing and assessment: An introduction to tests and measurement (6th ed.). McGraw-Hill.
16. Cortina, J.M. (1993). What is coefficient alpha? An examination of theory and applications. Journal of Applied Psychology, 78(1), 98-104. https://doi.org/10.1037/0021-9010.78.1.98
17. Çokluk, Ö., Şekercioğlu, G., & Büyüköztürk, Ş. (2010). Sosyal bilimler için çok değişkenli istatistik: SPSS ve LISREL uygulamaları [Multivariate statistics for the social sciences: SPSS and LISREL applications]. Pegem Akademi.
18. Dağlı, A. (2015). Örgütsel muhalefet ölçeğinin Türkçeye uyarlanması: Geçerlik ve güvenirlik çalışması. [Adaptation of Organizational Dissent Scale into Turkish: A validity and reliability study]. Electronic Journal of Social Sciences, 14(53), 198 218. https://doi.org/10.17755/esosder.45359
19. De Dreu, C.K.W, de Vries, N.K., Franssen, H., & Altink, W.M. (2000). Minority dissent in organizations: Factors influencing willingness to dissent. Journal of Applied Social Psychology, 30(12), 2451-2466. https://doi.org/10.1111/j.1559-1816.2000.tb02445.x
20. De Dreu, C.K.W., & West, M.A. (2001). Minority dissent and team innovation: The importance of participation in decision making. Journal of Applied Psychology, 86(6), 1191 1201. https://doi.org/10.1037/0021-9010.86.6.1191
21. Detert, J.R., & Burris, E.R. (2007). Leadership behavior and employee voice: Is the door really open? Academy of Management Journal, 50(4), 869 884. https://doi.org/10.5465/amj.2007.26279183
22. DeVellis, R.F. (2003). Scale development: Theory and applications (2nd ed.). Sage.
23. Field, A. (2009). Discovering statistics using SPSS: Introducing statistical method. (3rd ed.). Sage.
24. Finney, S.J., & DiStefano, C. (2006). Non-normal and categorical data in structural equation modeling. Structural Equation Modeling: A Second Course, 10(6), 269-314.
25. Fraenkel, J., Wallen, N., & Hyun, H. (2018). How to design and evaluate research in education (10th ed.). McGraw-Hill Education.
26. Fornell, C., & Larcker, D.F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18(1), 39-50
27. Garner, J.T. (2009). When things go wrong at work: an exploration of organizational dissent messages. Communication Studies, 60(2), 197 218. https://doi.org/10.1080/10510970902834916
28. Garner, J.T. (2013). Dissenters, managers, and coworkers: The process of co-constructing organizational dissent and dissent effectiveness. Management Communication Quarterly, 27(3), 373 395. https://doi.org/10.1177/0893318913488946
29. Garner, J.T. (2014). Open doors and iron cages: Supervisors’ responses to employee dissent. International Journal of Business Communication, 53(1), 27 54. https://doi.org/10.1177/2329488414525466
30. Garner, J.T. (2015). Different ways to disagree: A study of organizational dissent to explore connections between mixed methods research and engaged scholarship. Journal of Mixed Methods Research, 9(2), 178-195. https://doi.org/10.1177/1558689813515333
31. Gold, A.H., Malhotra, A., & Segars, A.H. (2001). Knowledge management: An organizational capabilities perspective. Journal of Management Information Systems, 18(1), 185 214. https://doi.org/10.1080/07421222.2001.11045669
32. Graham, J.W. (1986). Principled organizational dissent: A theoretical essay. Research in Organizational Behavior, 8, 1-52.
33. Gruman, J.A., & Saks, A.M. (2014). Being psychologically present when speaking up: Employee voice engagement. In A.J. Donaghey, T. Dundon & R.B. Freeman (Eds.), Handbook of research on employee voice (pp. 455 476). Edward Elgar Publishing. https://doi.org/10.4337/9780857939272.00038
34. Güntekin, M., & Önder, E. (2023). Okullarda örgütsel muhalefetin yönetimi [Managing organizational dissent in schools]. Mehmet Akif Ersoy University Journal of Education Faculty, 68, 108 127. https://doi.org/10.21764/maeuefd.1335443
35. Hair, J.F., Black, W.C., Babin, B.J., & Anderson, R.E. (2019). Multivariate data analysis (8th ed.). Cengage.
36. Harlos, K.P. (2001). When organizational voice systems fail: More on the deaf-ear syndrome and frustration effects. Journal of Applied Behavioral Science, 37(3), 324 342. https://doi.org/10.1177/0021886301373005
37. Harlos, K.P. (2016). Employee silence in the context of unethical behavior at work: A commentary. German Journal of Human Resource Management, 30(3 4), 345 355. https://doi.org/10.1177/2397002216649856
38. Hegstrom, T.G. (1995). Focus on organizational dissent: A functionalist response to criticism. In J. Lehtonen (Ed.), Critical perspectives on communication research and pedagogy (pp. 83-94). Rohrig University Press.
39. Henseler, J., Ringle, C.M., & Sarstedt, M. (2015). A new criterion for assessing discriminant validity in variance-based structural equation modeling. Journal of the Academy of Marketing Science, 43(1), 115-135. https://doi.org/10.1007/s11747-014-0403-8
40. Horn, J.L. (1965). A rationale and test for the number of factors in factor analysis. Psychometrika, 30(2), 179-185. https://doi.org/10.1007/BF02289447
41. Jodoin, M.G., & Gierl, M.J. (2001). Evaluating type I error and power rates using an effect size measure with the logistic regression procedure for DIF detection. Applied Measurement in Education, 14(4), 329-349. https://doi.org/10.1207/S15324818AME1404_2
42. Kadı, A., & Beytekin, O.F. (2015). Okul kültürü ve örgütsel muhalefet davranışları arasındaki ilişkinin mesleki değerler aracılığıyla araştırılması [A research on the partial mediating effect of professional values in the relationship between organizational dissent behaviors and school culture]. Kalem Journal of Education and Human Sciences,5(1), 71 97. http://dx.doi.org/10.23863/kalem.2017.45
43. Kavak, B., & Vatansever, N. (2007). Hizmet sektöründe örgüt içi iletişim bileşenleri ve işgören verimliliği üzerindeki etkileri: Ankara'daki beş yıldızlı otel işgörenlerinin düşünceleri [The components of organizational communication, and their effects on employee productivity: The opinions of employees of 5 stars hotels in Ankara]. Gazi University Journal of the Faculty of Commerce and Tourism Education, 2, 120 140. https://izlik.org/JA83XY38NJ
44. Kassing, J.W. (1997). Articulating, antagonizing, and displacing: A model of employee dissent. Communication Studies, 48(4), 311 332. https://doi.org/10.1080/10510979709368510
45. Kassing, J.W. (1998). Development and validation of the organizational dissent scale. Management Communication Quarterly, 12(2), 183 229. https://doi.org/10.1177/0893318998122002
46. Kassing, J.W. (2000). Exploring the relationship between workplace freedom of speech, organizational identification, and employee dissent. Communication Research Reports, 17(4), 387 396. https://doi.org/10.1080/08824090009388787
47. Kassing, J.W. (2001). From the looks of things: Assessing perceptions of organizational dissenters. Management Communication Quarterly, 14(3), 442 470. https://doi.org/10.1080/08824096.2011.586075
48. Kassing, J.W. (2002). Speaking up: Identifying employees’ upward dissent strategies. Management Communication Quarterly, 16(2), 187 209. https://doi.org/10.1177/089331802237234
49. Kassing, J.W. (2011). Stressing out about dissent: Examining the relationship between coping strategies and dissent expression. Communication Research Reports, 28(3), 225 234. https://doi.org/10.1080/08824096.2011.586075
50. Kassing, J.W., Piemonte, N.M., Goman, C.C., & Mitchell, C.A. (2012). Dissent expression as an indicator of work engagement and intention to leave. The Journal of Business Communication (1973), 49(3), 237-253. https://doi.org/10.1177/0021943612446751
51. Kline, R.B. (2019). Yapısal eşitlik modellemesinin ilkeleri ve uygulaması [Principles and practice of structural equation modeling] (4th ed.) (S. Şen, Trans.). Nobel Akademik Yayıncılık. (Original work published 2016)
52. Lawshe, C.H. (1975). A quantitative approach to content validity. Personnel Psychology, 28(4), 563-575.
53. Lynn, M.R. (1986). Determination and quantification of content validity. Nursing Research, 35(6), 382-385. https://doi.org/10.1097/00006199-198611000-00017
54. MacCallum, R.C., Widaman, K.F., Zhang, S., & Hong, S. (1999). Sample size in factor analysis. Psyhological Methods, 4(1), 84. https://doi.org/10.1037/1082-989X.4.1.84
55. Mirzeoğlu, N. (2005). Örgütsel çatışma ve yönetimi: spor eğitimi veren yükseköğretim kurumlarında bir uygulama [Organizational conflict and management: A study at the schools of physical education and sport]. Spormetre Journal of Physical Education and Sports Sciences, 3(2), 51 56. https://doi.org/10.1501/Sporm_0000000046
56. Morrison, E.W., & Milliken, F.J. (2000). Organizational silence: A barrier to change and development in a pluralistic world. Academy of Management Review, 25(4), 706 725. https://doi.org/10.5465/amr.2000.3707697
57. Nunnally, J.C. (1978). An overview of psychological measurement. In B.B. Wolman (Ed), Clinical diagnosis of mental disorders: A handbook (pp. 97 146). Springer. https://doi.org/10.1007/978 1 4684-2490-4_4
58. O’Connor, B.P. (2000). SPSS and SAS programs for determining the number of components using parallel analysis and Velicer’s MAP test. Behavior Research Methods, Instruments, & Computers, 32(3), 396-402. https://doi.org/10.3758/BF03200807
59. Pallant, J. (2020). SPSS survival manual: A step by step guide to data analysis using IBM SPSS. Routledge.
60. Perlow, L.A., & Repenning, N.P. (2009). The dynamics of silencing conflict. Research in Organizational Behavior, 29, 195-223. https://doi.org/10.1016/j.riob.2009.06.007
61. Polit, D.F., & Beck, C.T. (2006). The content validity index: Are you sure you know what's being reported? Critique and recommendations. Research in Nursing & Health, 29(5), 489 497. https://doi.org/10.1002/nur.20147
62. Putnick, D.L., & Bornstein, M.H. (2016). Measurement invariance conventions and reporting: The state of the art and future directions for psychological research. Developmental review, 41, 71 90. https://doi.org/10.1016/j.dr.2016.06.004
63. Sarstedt, M., Hair, J.F., Pick, M., Liengaard, B.D., Radomir, L., & Ringle, C.M. (2022). Progress in partial least squares structural equation modeling use in marketing research in the last decade. Psychology & Marketing, 39(5), 1035 1064. https://doi.org/10.1002/mar.21640
64. Scherer, R.F., Luther, D.C., Wiebe, F.A., & Adams, J.S. (1988). Dimensionality of coping: Factor stability using the ways of coping questionnaire. Psychological reports, 62(3), 763 770. https://doi.org/10.2466/pr0.1988.62.3.763
65. Schermelleh-Engel, K., Moosbrugger, H., & Müller, H. (2003). Evaluating the fit of structuralequation models: Tests of significance and descriptive goodness-of-fit measures. Methods of Psychological Research Online, 8(2), 23 74. https://www.stats.ox.ac.uk/~snijders/mpr_Schermelleh.pdf
66. Sortheix, F.M., & Weber, W. (2023). Comparability and reliability of the positive and negative affect scales in the European Social Survey. Frontiers in Psychology, 14, Article 1034423. https://doi.org/10.3389/fpsyg.2023.1034423
67. Tabachnick, B.G., & Fidell, L.S. (2013). Using multivariate statistics (6th ed.). Pearson.
68. Tavakol, M., & Dennick, R. (2011). Making sense of Cronbach's alpha. International Journal of Medical Education, 2, 53-55. https://doi.org/10.5116/ijme.4dfb.8dfd
69. Tavşancıl, E., & Keser, H. (2002). Development of a Likert type attitude scale towards internet usage. Journal of Educational Sciences & Practices, 1(1).
70. Teo, T., Srivastava, S.C., & Jiang, L. (2008). Trust and electronic government success: An empirical study. Journal of Management Information Systems, 25(3), 99 132. https://doi.org/10.2753/MIS0742-1222250303
71. Tutar, H., & Sadykova, G. (2014). Örgütsel demokrasi ve örgütsel muhalefet arasındaki ilişki üzerine bir inceleme [A Study on the relationship between organizational democracy and organizational dissent]. Journal of Business Science, 2(1), 1 16. https://dergipark.org.tr/en/download/article file/213311
72. Vandenberg, R.J., & Lance, C.E. (2000). A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 3(1), 4-70. https://doi.org/10.1177/109442810031002
73. Velicer, W.F. (1976). Determining the number of components from the matrix of partial correlations. Psychometrika, 41(3), 321-327. https://doi.org/10.1007/BF02293557
74. Watson, D., Clark, L.A., & Tellegen, A. (1988). Development and validation of brief measures of positive and negative affect: The PANAS scales. Journal of Personality and Social Psychology, 54(6), 1063-1070. https://doi.org/10.1037/0022-3514.54.6.1063
75. Zumbo, B.D. (1999). A handbook on the theory and methods of differential item functioning (DIF). National Defense Headquarters.