Validity and Reliability of the Nurse Manager Performance Assessment Scale

Abstract

Background: The performance of nurse managers is significantly important in providing quality and safe patient care services in hospitals, as well as in retaining the nurse workforce. There are limited number of measurement instruments for which validity and reliability have been tested in order to assess nurse managers' level of performance. Objective: This study was conducted to examine the psychometric testing of the “Nurse Manager Performance Assessment Scale,” which is used to assess the annual performance of nurse managers working in a private chain hospital group in Turkey. Method: The sample of this methodological study was composed of 165 nurse managers. The data were obtained from the Hospital Information Management System, retrospectively. Results: The average score of the eight-item scale items ranged between 3.3 (0.8) and 3.7 (0.8). The Cronbach's alpha coefficient, indicating the internal consistency, was found to be 0.943, while the Spearman-Brown coefficient, indicating intraclass consistency, was found to be 0.910. The two-factor scale obtained using exploratory factor analysis was examined using confirmatory factor analysis, and the model was found to be significant. Conclusion: In this study, the results of psychometric analysis of the “Nurse Manager Performance Assessment Scale,” which is used to assess the annual performance of nurse managers, indicated that the scale is a valid and reliable instrument. It is recommended that the scale be applied in different institutions and that it be tested in practice based on pilot application results.

Keywords

• Nurse manager
• Performance Assessment
• reliability
• scale
• validity

References

1. American Organization of Nurse Executives (AONE), American Organization for Nursing Leadership (AONL). (2015a). AONL nurse manager competencies. Chicago, IL: AONE, AONL. https://www.aonl.org/system/files/media/file/2019/06/nurse-manager-competencies.pdf
2. American Organization of Nurse Executives (AONE), American Organization for Nursing Leadership (AONL). (2015b). AONL nurse executive competencies. Chicago, IL: AONE, AONL. https://www.aonl.org/system/files/media/file/2019/06/nec.pdf
3. Bolarinwa, O. A. (2015). Principles and methods of validity and reliability testing of questionnaires used in social and health science researches. Nigerian Postgraduate Medical Journal, 22(4), 195–201. ,
4. Çokluk, Ö., Şekercioğlu, G. & Büyüköztürk, Ş. (2021). Sosyal bilimler için çok değişkenli istatistik SPSS ve LISREL uygulamaları. (6. baskı). Ankara: Pegem Akademi.
5. DeVon, H. A., Block, M. E., Moyle‐Wright, P., Ernst, D. M., Hayden, S. J., Lazzara, D. J., ... & Kostas‐Polston, E. (2007). A psychometric toolbox for testing validity and reliability. Journal of Nursing Scholarship, 39(2), 155-164.
6. Ekici, Z. & Türkmen, E. (2020). Yüksek Performanslı Çalışma Sistemleri Ölçeği’nin Türkçeye uyarlanması: geçerlik ve güvenirlik çalışması. Sağlık ve Hemşirelik Yönetim Dergisi, 7(1), 1-16.
7. Goktepe, N., Turkmen, E., Badir, A., Hayta, O., Yakar, H. K. & Buyukgonenc, L. A. (2018). Development of managerial competencies for first-level nurse managers in Turkey. International Journal of Caring Sciences, 11(2), 1096-1102.
8. Gunawan, J., Marzilli, C. & Aungsuroch, Y. (2021). Establishing appropriate sample size for developing and validating a questionnaire in nursing research. Belitung Nursing Journal, 7(5), 356-360.

9. Güdük, Ö. & Önder, E. (2020). Sağlık hizmetlerinde kurumsal performans yönetimi ve bir uygulama. Uluslararası Sağlık Yönetimi ve Stratejileri Araştırma Dergisi, 6(3), 426-442.
10. Kim, S. & Lim, J. Y. (2022). Development and evaluation of the “high-up” program for enhancing the nursing-management competency of mid-career hospital nurses: a quasi-experimental study. International Journal of Environmental Research and Public Health, 19(7), 4392.
11. Li, N., Huang, J. & Feng, Y. (2020). Construction and confirmatory factor analysis of the core cognitive ability index system of ship C2 system operators. PloS One, 15(8), e0237339.
12. Liou, Y. F., Liaw, J. J., Chang, Y. C., Kao, J. H. & Feng, R. C. (2021). Psychometric properties and development of the competency inventory for Taiwanese nurse managers across all levels. Journal of Nursing Management, 29(7), 2092-2101.
13. McConnell, K. J., Chang, A. M., Maddox, T. M., Wholey, D. R. & Lindrooth, R. C. (2014). An exploration of management practices in hospitals. Healthcare, 2(2), 121-129
14. Needleman, J. & Hassmiller, S. (2009). The role of nurses in improving hospital quality and efficiency: real-world results: nurses have key roles to play as hospitals continue their quest for higher quality and better patient safety. Health Affairs, 28(Suppl3), w625-w633.
15. Patton, D., Fealy, G., McNamara, M., Casey, M., Connor, T., Doyle, L. & Quinlan, C. (2013). Individual-level outcomes from a national clinical leadership development programme. Contemporary Nurse, 45(1), 56-63.
16. Phillips, J., Malliaris, P. & Bakerjian, D. (April 21, 2021). Nursing and patient safety. https://psnet.ahrq.gov/primer/nursing-and-patient-safety
17. Pugesek, B. H., Tomer, A. & Von Eye, A. (2003). Structural equation modeling. Cambridge, UK: Cambridge University Press.
18. Sivey, P. & Chen, Y. (2019). Competition and quality in healthcare. Oxford Research Encyclopedia of Economics and Finance. https://oxfordre.com/economics/view/10.1093/acrefore/9780190625979.001.0001/acrefore-9780190625979-e-60
19. Sökmen S. (2005). İstanbul’daki kamu hastanelerinde görevli alt kademe yönetici hemşirelerin eğitim ihtiyacının analizi ve yönetici eğitim programı önerisi (Doktora Tezi). İstanbul Üniversitesi Sağlık Bilimleri Enstitüsü. İstanbul, Türkiye. YOKTEZ https://tez.yok.gov.tr/UlusalTezMerkezi/tezSorguSonucYeni.jsp
20. Steiger, J. H. (2007). Understanding the limitations of global fit assessment in structural equation modeling. Personality and Individual Differences, 42(5), 893-898.
21. Titzer, J. L., Shirey, M. R. & Hauck, S. (2014) A nurse manager succession planning model with associated empirical outcomes. Journal of Nursing Administration, 44(1), 37–46.