The evaluation of the processes of problem based learning tutorials: Online or face-to-face?

Abstract

Objective: The purpose of this research is to evaluate e-PBL tutorials and compare these sessions with face-to-face PBL sessions. Patients and Methods: This research is a program evaluation study in which quantitative methods were used. In the research, four 90-minute e-PBL sessions held between April and June 2020 were evaluated. Sessions conducted online were realised using the sevenstep approach in groups of 13-14 students and a tutor. Video recordings were analysed with the thin slicing method. In addition, various quantitative data on evaluation were analysed using multiple tools and materials, including the end-of-program evaluation form. Friedman test and Mann-Whitney U test were used in the analyses of quantitative data. Results: Upon evaluating the analyses of the feedback received from the students about the structure, content and process of the program regarding the e-PBL tutorials, the students gave a positive opinion of 80% or more. In regards with the cases, the students had positive opinions of over 80% in terms of “motivation for learning and researching”, “daily life and its relation to their individual development”, “suitability to their levels of knowledge and skills”, “reinforcement of topics”. Support, guidance and feedback received from the tutor as a group and individually during online tutorials were statistically significantly higher than the face-to-face PBL tutorials (P<0.05). Conclusion: Research on the effectiveness of e-PBL tutorials, including ours, point out that e-PBL practices may constitute a viable alternative besides face-to face ones. However, for a sounder framing and better results, the subject should be studied in different aspects and more evidences be gathered in this area. These studies will provide evidence to educational institutions and practitioners on how to adapt and modify educational practices, including PBL.

Keywords

• Evaluation
• Problem-based learning
• Tutorial
• Online
• Face-to-face

References

1. Ellaway R, Masters K. AMEE Guide 32: e-Learning in Medical Education Part 1: Learning, teaching and assessment. Med Teach 2008; 30:455-73. doi: 10.1080/014.215.90802108331
2. Archuleta Moon M. The inclusion of preassigned roles in online problem-based learning to increase social presence and student achievement. Doctoral dissertation, Capella University, 2014.
3. Gill D, Whitehead C, Wondimagegn D. Challenges to medical education at a time of physical distancing. Lancet 2020; 396:77-9. doi: 10.1016/ S0140-6736(20)31368-4
4. Coiado OC, Yodh J, Galvez R, Ahmad K. How COVID-19 transformed problem-based learning at Carle Illinois College of Medicine. Med Sci Educ 2020;30:1353-4. https://doi. org/10.1007/s40670.020.01063-3
5. Dochy F, Segers M, Van den Bossche P, Gijbels D. Effects of problem-based learning: A metaanalysis. Learn Instr 2003; 13: 533-68. doi: 10.1016/S0959-4752(02)00025-7
6. Dolmans DH, Schmidt HG. What do we know about cognitive and motivational effects of small group tutorials in problembased learning? Adv Health Sci Educ 2006;11:321-36. doi: 10.1007/s10459.006.9012-8
7. Schmidt HG, Rotgans JI, Yew EH. The process of problembased learning: what works and why. Med Edu 2011; 45: 792- 806. doi:10.1111/j.1365-2923.2011.04035.x
8. Lee GH, Lin CS, Lin YH. How experienced tutors facilitate tutorial dynamics in PBL groups. Med Teach 2013; 35:e935-e942. doi: 10.3109/0142159X.2012.714883

9. Bate E, Hommes J, Duvivier R, Taylor DCM. Problem-based learning (PBL): Getting the most out of your students–Their roles and responsibilities: AMEE Guide No. 84. Med Teach 2014; 36:1-12. doi: 10.3109/0142159X.2014.848269
10. Gülpınar MA, Isoglu-Alkaç Ü, Yegen BC. Integrated and contextual basic science instruction in preclinical education: Problem-based learning experience enriched with brain/mind learning principles. Educational Sciences: Theory Pract 2015; 15:1215-28. doi 10.12738/estp.2015.5.0095
11. Jawaid M, Aly SM. Learning environment in undergraduate institutes in Pakistan: Determining factors and suggestions. J Postgrad Med Inst 2014; 28:319-23.
12. Vasiliou C, Ioannou A, Arh T, Zaphiris P, Klobučar T. Technology enhanced problem based learning. 32nd International Conference on Organizational Science Development, Portorož Slovenija. 2013; 1-10.
13. Budakoglu I İ, Coskun Ö, Özeke V. Problem based learning: present situation, issues and technology supported solution recommendations. J Theor Educ Sci 2018;11:894-921. doi: 10.30831/akukeg.396968
14. Til Van C, Heijden van der F. PBL Study Skills an overview. Maastricht University. 2003-2010. Accessed:https://www. academia.edu/38281660/PBL_Study_skills_van_Til_and_ van_der_Heijden
15. Krupat E, Richards JB, Sullivan AM, Fleenor TJ, Schwartzstein RM. Assessing the effectiveness of case-based collaborative learning via randomized controlled trial. Acad Med 2016; 91:723-9. doi: 10.1097/ACM.000.000.0000001004
16. Feng G, Joe J, Kitchen C, Mao L, Roohr KC, Chen L. A Proofof- concept study on scoring oral presentation videos in higher education (Research Report No. RR-19-22). Princeton, NJ: Educational Testing Service ETS Research Report Series 2019; 1-28. doi: 10.1002/ets2.12256
17. Foster TS. The reliability and validity of the thin slice technique: observational research on video recorded medical ınteractions. Doctoral Dissertation. Detroid: Wayne State University, 2014; 1-84.
18. De Grave WS, Dolmans DHJM, Van der Vleuten CPM. Student perspectives on critical incidents in the tutorial group. Adv Health Sci Educ 2002; 7:201-9.
19. Moust J, Roebertsen H, Savelberg H, De Rijk A. Revitalizing PBL groups: Evaluating PBL with study teams. Educ Health 2005; 18:62-73. doi: 10.1080/135.762.80500042705
20. Spinello EF, Fischbach R. Using a web-based simulation as a problem-based learning experience: Perceived and actual performance of undergraduate public health students. Public Health Rep 2008; 123 (Suppl 2):78-84. doi:10.1177/003.335.49081230S211
21. Onan A. The effect of problem-based networked learning on the medical students’ transfer skills and self-effıcacy belief. Master Thesis. Ankara University Department of Computer Education and Instructional Technology Educational Technology Master Programme. 2011; 1-94.
22. Kim KY, Kee C. Evaluation of an e-PBL model to promote individual reasoning. Med Teach 2013; 35:e978-e983. doi:10. 3109/0142159X.2012.717185
23. Şendağ S, Odabaşı HF. Effects of an online problem based learning course on content knowledge acquisition and critical thinking skills. Comput Educ 2009; 53: 132-41. doi:10.1016/j. compedu.2009.01.008
24. Maldonado R. The use of multimedia clinical case scenario software in a problem-based learning course: impact on faculty workload and student learning outcomes. J Physician Assist Educ 2011; 22:51-5. DOI: 10.1097/01367.895.201122030- 00009
25. Gavgani VZ, Hazrati H, Ghojazadeh M. The efficacy of digital case scenario versus paper case scenario on clinical reasoning in problem-based learning: A systematic review and metaanalysis. Res Dev Med Educ 2015; 4:17-22. doi:10.15171/ rdme.2015.003
26. Valaitis RK, Sword WA, Jones B, Hodges A. Problem-based learning online: Perceptions of health science students. Adv Health Sci Educ 2005; 10:231-52. doi: 10.1007/ s10459.005.6705-3
27. Günbatar MS, Çavuş H. Student’s attitudes relating to web mediated problem based learning. Ankara Univ J Fac Educ Sci 2011; 44:119-40. doi:10.1501/Egifak_000.000.1227
28. Rahman S, Gidener S. Perspectives of students and tutors on e-pbl sessions implemented in the Covid-19 pandemic; example of a medical school. Tıp Eğitimi Dünyası 2021;20:115- 22. https://doi.org/10.25282/ted.955327
29. Dennis JK. Problem-based learning in online vs. face-toface environments. Educ Health 2003; 16:198-209. doi: 10.1080/135.762.8031000116907
30. Karahan S, Ağadayı E, Karagöz N. Evaluation of e-problembased learning (e-PBL) sessions in the Faculty of Medicine during the pandemic period. Cumhuriyet Med J 2022; 44: 144-9. doi: 10.7197/cmj.1066704
31. Budakoğlu İ, Özeke V, Coşkun Ö. Medical undergraduates’ CORE performance scores and opinions towards e-PBL. The 7th European Conference on Education (ECE2019), July 19th- 21th, 2019, London, UK.