Assessment of an In-Service Training Activity Transformed into an E-Learning Environment Using the Kirkpatrick Model

Veysel Bilal Arslankara; Elif Arslankara; İlyas Asan; Mehmet Külekçi; Ertuğrul Usta

doi:10.51535/tell.1441595

EN

Assessment of an In-Service Training Activity Transformed into an E-Learning Environment Using the Kirkpatrick Model

Abstract

The aim of this study is to evaluate an in-service training program transformed into an e-learning environment using the Kirkpatrick evaluation model. A single-group experimental design was employed in the research. Thirty teachers who participated in the in-service training program were included in the study. The program was adapted to the e-learning platform and presented to the participants. Data were collected through surveys. 90% of the participants expressed satisfaction with the program, finding the e-learning format beneficial, and liking the content and presentation of the program, stating that it helped reinforce their knowledge. They mentioned a more flexible and comfortable learning experience compared to face-to-face training and acquired the targeted knowledge and skills by the end of the program. The findings indicate that an in-service training program delivered face-to-face can be successfully transformed into an e-learning environment and evaluated using the Kirkpatrick evaluation model. The e-learning format provided participants with a more flexible and comfortable learning experience. The program significantly improved participants’ knowledge, skills, and behaviors. Adapting the program to similar professional groups can offer various benefits, such as enhancing professional skills, increasing workplace productivity, and improving professional satisfaction.

Keywords

In-service training , e-learning , Kirkpatrick evaluation model , knowledge , skills , behavior , performance.

References

Akbaş, O. (2023). Planning curriculum with backward design: Understanding by design and learning outcome-based design. Gazi University Journal of Gazi Educational Faculty, 43(3), 1931- 1962.
Alliger, G. M., Tannenbaum, S. I., Bennett, W., Traver, H. & Shotland, A. (1997). A meta-analysis of the relations among training criteria, Personnel Psychology, 50, 1997.
Alsalamah, A. & Callinan, C. (2021). Adaptation of Kirkpatrick’s four-level model of training criteria to evaluate training programmes for head teachers. Education Sciences, 11(3), 116.
Bandura, A. (1977). Social learning theory. Englewood Cliffs, NJ: Prentice Hall.
Brinkerhoff, R. O. (2006). Increasing impact of training investments: an evaluation strategy for building organizational learning capability. Industrial and Commercial Training, 38(6), 302-307. https://doi.org/10.1108/00197850610685824
Cahapay, M. (2021). Kirkpatrick model: Its limitations as used in higher education evaluation. International Journal of Assessment Tools in Education, 8(1), 135-144.
Clark, R. C. & Mayer, R. E. (2011). E-learning and the science of instruction (3rd ed.). San Francisco: Pfeiffer.
Deci, E. L. & Ryan, R. M. (2000). The ‘what’ and ‘why’ of goal pursuits: Human needs and the self-determination of behavior. Psychological Inquiry, 11, 227-268. https://psycnet.apa.org/doi/10.1207/S15327965PLI1104_01
Dick, W., Carey, L. & Carey, J. O. (2009). The systematic design of instruction (7th ed.). New York: Pearson.
Dillenbourg, P. (1999). What do you mean by collaborative learning? In P. Dillenbourg (Ed.), Collaborative-learning: Cognitive and computational approaches (pp. 1-19). Oxford, UK: Elsevier.

Driscoll, M. P. (2005). Psychology of learning for instruction (4th ed.). Boston: Allyn & Bacon.
Dziuban, C. D., Hartman, J.L. & Moskal, P. D. (2004). Blended learning. EDUCAUSE Central for Applied Research, 2004(7).
Ergün, E. & Kurnaz, F. B. (2019). Investigating the relationship between learning styles and academic achievement in e-learning environments. Journal of Theoretical Educational Science, 12(2), 532-549. https://doi.org/10.30831/akukeg.407029
Gagné, R. M. (1985). The conditions of learning (4th ed.). New York: Holt, Rinehart & Winston.
Garrison, D. R. (2003). E-learning in the 21st century: A framework for research and practice. London: RoutledgeFalmer.
Gunawardena, C. (1995). Social presence theory and implications for interaction and collaborative learning in computer conferences. International Journal of Educational Telecommunications, 1(2–3), 147–166. https://www.learntechlib.org/primary/p/15156/
Gustafson, K. L. & Branch, R. M. (2002). Survey of instructional development models (4th Edition). Syracuse, NY: ERIC Clearinghouse on Information & Technology.
Hara, N. (2000). Students’ distress with a web-based distance education course: An exploratory study. Computers & Education, 35(2), 129-148. http://dx.doi.org/10.1080/13691180010002297
Herrington, J. & Oliver, R. (2000). An instructional design framework for authentic learning environments. Educational Technology Research and Development, 48(3), 23–48. https://doi.org/10.1007/BF02319856
Horton, W. K. (2011). E-learning by design (2nd ed.). San Francisco: Pfeiffer.
Hudak, M. (2013). Professional development plus: rethinking professional learning. Doctoral dissertation, Arizona State University, Arizona.
Jonassen, D. H. & Rohrer-Murphy, L. (1999). Activity theory as a framework for designing constructivist learning environments. Educational Technology Research and Development, 47(1), 61–79.
Keegan, D. (1996). Foundations of distance education (3rd ed.). London: Routledge.
Kirkpatrick, D. & Kirkpatrick, J. (2006). Evaluating training programs: The four levels. Berrett-Koehler Publishers, California.
Kirkpatrick, D. L. (1994). Evaluating training programs: The four levels. San Francisco, CA: Berrett-Koehler.
Kumar, R. (2011) Research Methodology: A Step-by-Step Guide for Beginners. 3rd Edition. Sage, New Delhi.
Malik, S. & Asghar, M. Z. (2020). In-service early childhood education teachers’ training program evaluation through kirkpatrick model. Journal of Research and Reflections in Education, 14(2), 259-270.
Mankan, T. (2019). Evaluation of hand hygiene education given to nursing students supported by hand hygiene products according to the Kirkpatrick model. Doctoral dissertation, İnönü University, Türkiye.
Moore, M. G. & Anderson, W. G. (2003). Handbook of distance education. Mahwah, N.J.: Lawrence Erlbaum Associates.
Moore, M. G. (1989). Three types of interaction. American Journal of Distance Education, 3(2), 1-6.
Moore, M. G. (1993). Theory of transactional distance. In D. Keegan (Ed.), Theoretical principles of distance education (pp. 22-38). London: Routledge.
Moore, M. G. (1997). Distance education: A system view. Belmont, CA: Wadsworth Publishing Company.
Parry, S. B. (1997). Evaluating the impact of training. Association for Talent Development; 1st edition (September 1, 1997).
Paul, T. (2012). The impact of age and education on the level of satisfaction and motivation among employees. The IUP Journal of Management Research, 11, 1, 29-37.
Peterson, C. (2003). Bringing ADDIE to life: Instructional design at its best. Journal of Educational Multimedia and Hypermedia, 12(3), 227–241.
Phillips, P. P. (2003). Training evaluation in the public sector. Doctoral dissertation, The University of Southern Mississippi, USA.
Pintrich, P. R. & Zusho, A. (2002). The development of academic self-regulation: The role of cognitive and motivational factors. In A. Wigfield & J. S. Eccles (Eds.), Development of achievement motivation (pp. 249--284). San Diego, CA: Academic Press.
Popham, W. J. (2009). Classroom assessment: What teachers need to know (5th ed.). Boston: Allyn & Bacon.
Prochaska, J. O. & DiClemente, C. C. (1983). Stages and processes of self-change. In P. C. Kendall & S. D. Hollon (Eds.), Cognitive-behavioral interventions: Theory, research, and procedures (pp. 315-342). New York: Academic Press.
Reeves, T. C. (2000). Enhancing the worth of instructional technology research through “design experiments” and other development research strategies. Paper presented on April 27, 2000 at Session 41.29, “International Perspectives on Instructional Technology Research for the 21st Century,”, New Orleans, LA, USA.
Reiser, R. A. & Dempsey, J. V. (2012). Trends and issues in instructional design and technology (3rd ed.). New York: Pearson.
Richey, R.C., Klein, J.D. & Tracey, M.W. (2010). The instructional design knowledge base: Theory, research, and practice (1st ed.). Routledge.
Robertson, R.F. (1996). Develop a performance-focused organization. Hdrocarbon Processing Dec., 75, 12, 81 86.
Rovai, A. P. (2002). Development of an instrument to measure classroom community. Internet and Higher Education, 5 197-211.
Salmon G. (2002). E-tivities: The key to active online learning. London; Sterling, VA: Kogan Page Limited.
Seels, B. B. & Richey, R. C. (1994). Instructional design models and learning theory. In C. M. Reigeluth (Ed.), Instructional design theories and models: An overview of their current status (pp. 19-39). Hillsdale, NJ: Erlbaum.
Simonson, M., Schlosser, C. & Orellana, A. (2011). Distance education research: A review of the literature. Journal of Computing in Higher Education, 23(2), 124-142. https://psycnet.apa.org/doi/10.1007/s12528-011-9045-8
Simonson, M., Smaldino, S. E. & Zvacek, S. M. (2011). Teaching and learning at a distance: Foundations of distance education (6th ed.). New York: Pearson.
Smith, P. L. & Ragan, T. J. (2005). Instructional design (3rd ed.). New York: John Wiley & Sons.
Soprano, K. & Yang, L-L. (2012). Inquiring into my science teaching through action research: A case study on one pre-service teacher’s inquiry-based science teaching and self-efficacy. International Journal of Science and Mathematics Education, December 2012. http://dx.doi.org/10.1007/s10763-012-9380-x
Stiggins, R. J. (2005). Classroom assessment for learning: A handbook for educators (2nd ed.). New York: Pearson.
Thorndike, E. L. (1913). Educational psychology. New York: Teachers College, Columbia University.
Wenger, E. (1998). Communities of practice: Learning, meaning, and identity. Cambridge, UK: Cambridge University Press.
Yardibi, N. (2018). The Effect of Teachers' Satisfaction Levels with Administrators on Their Job Performance. Mersin University Journal of Faculty of Education, 14(1), 426-435. https://doi.org/10.17860/mersinefd.401087
Zhetpisbayeva, B., Sarzhanova, G. & Seilkhanova, A. (2020). Using the Kirkpatrick evaluation model for pre-service teacher education course. Collection of Scientific Works, 68-73. http://dx.doi.org/10.36074/11.12.2020.v4.24

Details

Primary Language

English

Subjects

Curriculum Evaluation in Education , Instructional Design , Instructional Technologies , Teacher Education and Professional Development of Educators

Journal Section

Research Article

Authors

Veysel Bilal Arslankara ^*
0000-0002-9062-9210
Türkiye

Elif Arslankara
0000-0002-6949-9175
Türkiye

İlyas Asan
0009-0009-4024-0416
Türkiye

Mehmet Külekçi
0009-0004-4062-1378
Türkiye

Ertuğrul Usta
0000-0001-6112-9965
Türkiye

Early Pub Date

June 10, 2024

Publication Date

June 30, 2024

Submission Date

February 22, 2024

Acceptance Date

June 10, 2024

Published in Issue

Year 2024 Volume: 6 Number: 1

DOI

https://doi.org/10.51535/tell.1441595

IZ

https://izlik.org/JA84NA54UY

APA

Arslankara, V. B., Arslankara, E., Asan, İ., Külekçi, M., & Usta, E. (2024). Assessment of an In-Service Training Activity Transformed into an E-Learning Environment Using the Kirkpatrick Model. Journal of Teacher Education and Lifelong Learning, 6(1), 207-221. https://doi.org/10.51535/tell.1441595

Cited By

Milli Eğitim Bakanlığı Tarafından Kullanılan Elektronik Belge Yönetim Sistemi’ne Yönelik Bir Hizmet İçi Eğitim Programının Kirkpatrick Modeli ile Değerlendirilmesi

Turk Kutuphaneciligi - Turkish Librarianship

https://doi.org/10.24146/tk.1639300

26172 20107

Assessment of an In-Service Training Activity Transformed into an E-Learning Environment Using the Kirkpatrick Model

Abstract

Keywords

Öz

References

Details

Primary Language

Subjects

Journal Section

Authors

Early Pub Date

Publication Date

Submission Date

Acceptance Date

Published in Issue

DOI

IZ

Cite

Cited By

Milli Eğitim Bakanlığı Tarafından Kullanılan Elektronik Belge Yönetim Sistemi’ne Yönelik Bir Hizmet İçi Eğitim Programının Kirkpatrick Modeli ile Değerlendirilmesi