Validity and Reliability Evidence of Professional Obsolescence Scale According to Different Test Theories

Abstract

This study aims to develop a scale that will determine the factors causing professional obsolescence in the field of education. In this context, the Professional Obsolescence Scale (POS) has been developed to determine the professional and organizational obsolescence of primary, secondary and high school administrators. In this scale development process, steps were followed in line with the suggestions of Crocker and Algina (2006) and Cronbach (1984). Firstly, 63 items were prepared and 991 school principals participated the study. R (version 4.0.1) software was used to analyze the data. Item and test parameters and information functions have been estimated using Samejima’s Graded Response Model based on Item Response Theory. Principal Axis Analysis was performed for the construct validity of the scale, and four-dimensions structure with 47 items has been obtained. These dimensions are named as “Being Open to Professional Development”, “Job-Ability Harmony in Profession”, “Organizational Support in Professional Development”, “Professional Burnout”. The scores obtained from each dimension are evaluated within themselves. It has been observed that each dimension fulfills the conditions of unidimensionality, local independence, model-data fit and parameter invariance. According to the Classical Test Theory, Cronbach Alpha coefficients are between 0.807 and 0.945. The Stratified Alpha coefficient calculated for the whole scale is 0.94. According to the Item Response Theory, the marginal reliability coefficients were between 0.857 and 0.936 and the empirical reliability coefficients were found between 0.854 and 0.938.

Keywords

• school principals
• professional obsolescence
• scale development
• professional development activities

References

1. Akbaş, U., Karabay, E., Yıldırım-Seheryeli, M., Ayaz, A., & Demir, Ö. O. (2019). Comparison of Exploratory Factor Analysis Studies in Turkish Measurement Tools Index According to Parallel Analysis Results. Journal of Theoretical Educational Science, 12(3), 1095-1123. https://doi.org/10.30831/akukeg.453786
2. Baker, F. B. (2016). Madde Tepki Kuramının Temelleri [Fundamentals of Item Response Theory]. (N. Güler, Ed., & M. İlhan, Çev.) Pegem Akademi.
3. Başaran, İ.E. (2008). Örgütsel Davranış [Organizational Behavior]. Ekinoks Yayınları.
4. Burke, R.J. (1969). Effects of aging on engineer’s satisfactions and mental health: Skill obsolescence, Academy of Management Journal, 12(4), 479 486. https://doi.org/10.5465/254736
5. Büyüköztürk, Ş. (2019). Sosyal Bilimler İçin Veri Analizi El Kitabı [Manual of Data Analysis for Social Sciences] (26. baskı). Pegem Akademi.
6. Chauhan, S.P., & Chauhan, D. (2004). Professional Obsolescence: Causes and Preventive Measures. Indian Journal of Industrial Relations, 39(3), 347 363. http://www.jstor.org/stable/27767911
7. Chauhan, S.P., & Chauhan, D. (2005). Overcoming Managerial Obsolescence: The key to human development. Pritam Singh, Ajay Singh, and Daisy Chauhan, (Eds.), in Creating Value Through People (pp. 321-38). Excel Books.
8. Chauhan, S.P., & Chauhan, D. (2008). Human Obsolescence: A Wake-up Call to Avert a Crisis. Global Business Review, 9(1), 85-100. https://doi.org/10.1177/097215090700900106

9. Chauhan, S.P., & Chauhan, D. (2009). Are you on the verge of obsolescence? Indian Journal of Industrial Relations, 44(4), 646-659.
10. Crocker, L., & Algina, J. (2006). Introduction to Classical and Modern Test Theory. Cengage Learning.
11. Cronbach, L. J., Schonemann, P., & McKie, D. (1965). Alpha coefficients for stratified-paralel tests. Educational and Psychological Measurement, 25, 291 312. https://doi.org/10.1177/001316446502500201
12. Cronbach, L. J. (1984). Essentials of Psychological Testing (4th ed). Harper Row.
13. Çokluk, Ö., Şekercioğlu, G., & Büyüköztürk, Ş. (2014). Sosyal Bilimler İçin Çok Değişkenli İstatistik SPSS ve LISREL Uyglamaları [Multivariate Statistics for Social Sciences: SPSS and LISREL Applications]. Pegem Akademi.
14. DeMars, C. (2010). Item Response Theory. Oxford University Press.
15. Embretson, S.E., & Reise, S.P. (2000). Item Response Theory for Psychologists. Lawrence Erlbaum Associates.
16. Field, A. (2009). Discovering Statistics Using SPSS (3rd ed.). Sage Publications Ltd.
17. Fossum, J. A., Arvey, R.D., Paradise, C.A., & Robbins, N. E. (1986). Modeling the Skills Obsolescence Process: A Psychological/Economic Integration, Academy of Management Review, 11(2), 362-374.
18. Hambleton, R. K., & Swaminathan, H. (1985). Item Response Theory: Principles and Applications. Kluwer Nijhoff Publishing.
19. Jones, E., Chonko, L.B., & Roberts, J.A. (2003). Sales for obsolescence: Perceptions from sales and marketing executives of individual, organizational, and enviornmental factors. Industrial Marketing Management, 33, 439-456.
20. Knight, P. (1998). Professional obsolescence and continuing professional development in higher education, Innovations in Education and Teaching International, 35(3), 248-256. https://doi.org/10.1080/1355800980350309
21. MacNeill, N., & Cavanagh, R. (2006). Principals’ pedagogic obsolescence: re-assessing what is important in schools. Curriculum and Leadership Journal, 4(29). http://www.curriculum.edu.au/leader/principals_pedagogic_obsolescence:_re assessing_wh,15968.html?issueID=10421
22. Millî Eğitim Bakanlığı (MEB) Eğitim Kurumları Yöneticilerinin Atama ve Yer Değiştirmelerine İlişkin Yönetmelik. [Regulation on Appointment and Relocation of Educational Institutions Administrators.] (2009, Ağustos 3). Resmi Gazete (Sayı 27318). https://www.resmigazete.gov.tr/eskiler/2009/08/20090813-2.htm
23. Mohan, V., Chauhan, S.P., & Chauhan, D. (2001). Are you aware how your personality effects your behavior? Global Business Review, 2(2), 289 304. https://doi.org/10.1177/097215090100200209
24. Murillo, P. (2011). Human capital obsolescence: some evidence for Spain, International Journal of Manpower, 32(4), 426-445. https://doi.org/10.1108/01437721111148540
25. Pazy, A. (1994). Cognitive Schemata of Professional Obsolescence, Human Relations, 47(10), 1167.
26. Pazy, A. (1996). Concept and career-stage differentiation in obsolescence research. Journal of Organizational Behavior, 17(1), 59-78.
27. Rothman, R.A., & Perrucci, R. (1971). Vulnerability to Knowledge Obsolescence: Among Professinals, The Sociological Quarterly, 12, 147-138.
28. Shaffer, J. D. (1969). On institutional obsolescence and innovation- Background for Professional dialogue on public policy. American Journal of Agricultureal Economics, 51(2), 245-267.
29. Shearer, R., & Steger, J. A. (1975). Manpower Obsolescence: A New Definition and Emprical Investigation of Personal Variables, Academy of Managment Journal, 18, 263- 275.
30. Sorensen, J. B., & Stuart, T. E. (2000). Aging, obsolescence, and organizational innovation. Administrative Science Quarterly, 45(1), 81-112.
31. Tan, Ş. (2009). Misuses of KR-20 and Cronbach’s alpha reliability coefficients. Journal of Education and Science, 34(152), 101-112.
32. Tang, K. (1996). Polytomous Item Response Theory (IRT) Models and Their Applications in Large-Scale Testing Programs: Review of Literature. Educational Testing Service.
33. Todman, J., & Dugard, P. (2007). Approaching multivariate statistics: an introduction for psychology. Psychology Press.
34. Toner, P. (2011), Workforce Skills and Innovation: An Overview of Major Themes in the Literature, OECD Science, Technology and Industry Working Papers, 2011/1. OECD Publishing. https://doi.org/10.1787/5kgkdgdkc8tl-en
35. van Loo, J., Grip, A., & Steur, M. (2001). Skills obsolescence: causes and cures. International Journal of Manpower, 22(1/2), 121-138.
36. Wandera, D. B. (2014). The threat of obsolescence: teaching and learning responding to technology. Technology, Pedagogy and Education, 24(2), 279 281. https://doi.org/10.1080/1475939X.2014.913533
37. Warmington, A. (1974). Obsolescence As An Organızational Phenomenon, The Journal of Management Studies, 11 (2), 96-114.
38. Yürekli, H. (2010). The Relationship Between Parameters from Some Polytomous Item Response Theory Models. (Unpublished Master Thesis). The Florida State University, USA. http://purl.flvc.org/fsu/fd/FSU_migr_etd-1104