The effect of alternative measurement and evaluation techniques on safety performance in employee training

Year 2024, Volume: 42 Issue: 4, 1016 - 1022, 01.08.2024

Orkun Dalyan , Hatice Dalyan , Mehmet Pişkin , Ömer Faruk Öztürk , Erdal Canpolat

Abstract

Occupational health and safety training constitutes an important implementation step of the proactive employee welfare, health, and safety approach. In occupational health and safety train-ing, measurement and evaluation methods should be applied accurately, efficiently, and effec-tively to evaluate whether learning and behavioral goals are achieved. In this research, a survey consisting of thirty questions was applied to a sample of 140 employees to determine the effect of alternative assessment tools on safety performance in occupational health and safety training. The obtained data were analyzed using the Statistical Package for Social Sciences 22 software program for reliability and exploratory factor analysis, and the Analysis of Moment Structures and Structural Equation Model 21 software program for confirmatory factor analysis, respec-tively. It was determined that the average score of the experimental group subjected to hazard detection poster exams using alternative assessment tools exceeded the average score of the con-trol group taking traditional multiple-choice exams and that the level of participation in occupa-tional health and safety regulations had a moderate positive effect on safety performance. The importance of both compulsory occupational health and safety training for primary school graduates and customized training programs for this group was emphasized. There was a positive and significant correlation between occupational health and safety compliance and safety performance. It was strongly suggested that interventions be tailored to optimum effectiveness according to training levels and that businesses also take proactive approaches to increase compliance with occupational health and safety regulations, such as organizing incentive activities and providing ongoing occupational health and safety training. A safer workplace environment should be promoted by effectively transforming the knowledge and skills acquired in occupational health and safety training into observable behaviors.

Keywords

Alternative Evaluation, Alternative Measurement, Employee Training, Safety Performance

References

• REFERENCES
• [1] Baran H. Assessment and evaluation in open and distance education. AUAd 2020;6:28-40.
• [2] Endroyo B, Yuwono BE, Mardapi D, Soenarto. Model of learning/training of occupational safety & health (OSH) based on industry in the construction industry. Procedia Eng 2015;125:83-88.
• [3] Dalyan O, Canpolat E, Pişkin M. Effects of occupational health and safety training on the perception of hazard. Int J Adv Eng Pure Sci 2021;33:670676.
• [4] Kim NK, Abdul Rahim NF, Iranmanesh M, Foroughi B. The role of the safety climate in the successful implementation of safety management systems. Saf Sci 2019;118:4856.
• [5] Dalyan H, Dalyan O, Öztürk ÖF, Pişkin M. Comparison of face-to-face and distance education systems in occupational health and safety. Karaelmas J Occup Health Saf 2021;5:219228.
• [6] Xu S, Sun M, Fang W, Chen K, Luo H, Zou P. A Bayesian-based knowledge-tracing model for improving safety-training outcomes in construction: An adaptive learning framework. Dev Built Env 2023;13:100111.
• [7] Rokooei S, Shojaei A, Alvanchi A, Azad R, Didehvar N. Virtual reality application for construction safety training. Saf Sci 2023;157:105925.
• [8] Ceylan H. Occupational health and safety education in Turkey problems and solution suggestions. Ejovoc 2012;2:94104.
• [9] Christian MS, Bradley-Geist JC, Wallace JC, Burke M. Workplace safety: A meta-analysis of the roles of person and situation factors. J Appl Psychol 2009;94:11031127.
• [10] Burke M, Signal DeBose S. Workplace safety: A multilevel, interdisciplinary perspective. Res Pers Hum Resour Manag 2010;29:147.
• [11] Lingard H, Wakefield R, Cashin P. The development and testing of a hierarchical measure of project OHS performance. Eng Constr Archit Manag 2011;18:3049.
• [12] Neal A, Griffin MA, Hart PM. The impact of organizational climate on safety climate and individual behavior. Saf Sci 2020;34:99109.
• [13] Ayyıldız F, Çam Dİ. The moderator role of safety climate in the relationship between job stress and safety performance: An investigation in the health sector. Stud Psychol 2020;40:451475.
• [14] Sawacha E, Naoum S, Fong D. Factors affecting safety performance on construction sites. Int J Proj Manag 1999;17:309315.
• [15] Wu TC, Chen CH, Li CC. A correlation among safety leadership, safety climate, and safety performance. J Loss Prev Process Ind 2008;21:307318.
• [16] Karasar N. Bilimsel araştırma yöntemleri. Ankara: Nobel Publishing; 2012. [Turkish]
• [17] Krejcie VR, Morgan WD. Determining sample size for research activities. Educ Psychol Meas 1970;30:607610.
• [18] Üngüren E, Koç TS. Occupational health and safety application performance evaluation scale: Validity and reliability study. Soc Secur J 2015;5:124144.
• [19] Olcay ZF. Occupational health and safety culture scale; Validity and reliability study. EJOSAT 2021;23:678685.
• [20] Ekingen E. Adaptation of occupational safety performances scale into Turkish. BANU J Health Sci Res 2021;2:110117.
• [21] Yılmaz Ö, Tuncer M. The importance of pilot study in experimental research: The effect of teaching on academic success according to Dale’s cone of experience. Electron J Educ Sci 2020;9:8996.
• [22] In J. Introduction of a pilot study. Korean J Anesthesiol 2017;70:601605.
• [23] Whitehead AL, Julious SA, Cooper CL, Campbell MJ. Estimating the sample size for a pilot randomized trial to minimize the overall trial sample size for the external pilot and main trial for a continuous outcome variable. Stat Methods Med Res 2016;25:10571073.
• [24] Hertzog MA. Considerations in determining sample size for pilot studies. Res Nurs Health 2008;31:180191.
• [25] Eldridge SM, Costelloe CE, Kahan BC, Lancaster GA, Kerry SM. How big should the pilot study for my cluster randomized trial be?. Stat Methods Med Res 2016;25:10391056.
• [26] Sallis JE, Gripsrud G, Olsson UH, Silkoset R. Research methods and data analysis for business decisions. Berlin: Springer; 2022.
• [27] Muijs D. Doing quantitative research in education with IBM SPSS statistics. New York: SAGE Publications Inc.; 2022.
• [28] Metsämuuronen J. Artificial systematic attenuation in eta squared and some related consequences: attenuation-corrected eta and eta squared, negative values of eta, and their relation to Pearson correlation. Behaviormetrika 2023;50:2761.
• [29] Schober P, Boer C, Schwarte LA. Correlation coefficients: Appropriate use and interpretation. Anesth Analg 2018;126:17631768.
• [30] Mukaka MM. Statistics Corner: A guide to the appropriate use of correlation coefficient in medical research. Malawi Med J 2012;24:6971.
• [31] Akoğlu H. User's guide to correlation coefficients. Turk J Emerg Med 2018;18:9193.
• [32] Tavşancıl E. Tutumların ölçülmesi ve SPSS ile veri analizi. Ankara: Nobel Publishing; 2019. [Turkish]
• [33] Büyüköztürk Ş. Factor analysis: Basic concepts and using to development scale. Educ Manag Theory Pract 2002;32:470483.
• [34] Kalaycı Ş. Factor Analysis: Applied multivariate statistical techniques with SPSS. Ankara: Asil Publishing; 2005.
• [35] Büyüköztürk Ş. Handbook of data analysis for social sciences. Ankara: Pegem Academy Publishing; 2023.
• [36] Tabachnick GB, Fidell LS. Using multivariate statistics. London: Pearson; 2013.
• [37] Kline RB. Principles and practice of structural equation modeling. New York: The Guilford Press; 1998.
• [38] Sümer N. Structural equation modeling: Basic concepts and applications. Turk Psy Artic 2000;3:4974.
• [39] Hu LT, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Struct Equ Modeling 1999;6:155.
• [40] Hair J, Black W, Babin B, Anderson R, Tatham R. Multivariate data analysis. Upper Saddle River: Pearson Prentice Hall; 2006.
• [41] Sullivan GM, Feinn R. Using effect size-or why the p value is not enough. J Grad Med Educ 2012;4:279282.
• [42] Dalyan O, Dalyan H, Ünal E, Pişkin M. Comparison of classic and alternative measurement- evaluation system in occupational health and safety training given to employees. J Labour Relat 2022;1(Suppl):114129.
• [43] Xia N, Griffin MA, Wang X, Liu X, Wang D. Is there agreement between worker self and supervisor assessment of worker safety performance? An examination in the construction industry. J Saf Res 2018;65:2937.
• [44] Okezie EO, Nwaogazie IL, Chinemerem P. Influence of organizational factors on safety performance in oil and gas industry in the Niger Delta Region. Nigeria. Arch Curr Res Int 2023;23:1523.
• [45] Awolusi I, Marks E, Hainen A, Alzarrad A. Incident analysis and prediction of safety performance on construction sites. Civil Eng 2022;3:669686.
• [46] Pourmazaherian M, Musonda I. Worker competence and safety performance the mediation role of safety orientation in the construction industry. Cogent Public Health 2022;9:2145702.
• [47] Bayram M. Safety training and competence, employee participation and involvement, employee satisfaction, and safety performance: An empirical study on occupational health and safety management system implementing manufacturing firms. Alphanumeric J 2019;7:301318.
• [48] Ashour AM, Hassan Z, Alekam JME. A Conceptual Framework for upgrading safety performance by influence safety training, management commitment to Safety and work environment: Jordanian Hospitals. Int J Bus Soc Res 2018;8:2535.
• [49] Eyiah AK, Kheni NA, Quartey PD. An Assessment of occupational health and safety regulations in Ghana: A study of the construction industry. J Build Cons Plan Res 2019;7:1131.
• [50] Mayanja LN, Ddamulira C, Katamba P, Mutekanga DR. Determinants of compliance to occupational health and safety measures in construction sites in Kampala Central Division, Kampala city, Uganda. World J Adv Res Rev 2022;14:475491.
• [51] Mojapelo J, Mafini C, Dhurup M. Employee perceptions of occupational health and safety standards in the steel industry. Int J Soc Sci Hum Stud. 2016;8:106121.