A Broad View of the Problem-Based Learning Field Based on Machine Learning: A Large-Scale Study Based on Topic Modeling

Year 2023, , 608 - 626, 21.10.2023

Özcan Özyurt , Alper Aslan

https://doi.org/10.31458/iejes.1320491

Abstract

The aim of the study is to examine Problem Based Learning (PBL) studies in terms of descriptive and semantic content analysis by using topic modeling. For this purpose, descriptive and topic modeling analyzes were used together in the research. In order to include the highest number of articles on Scopus, the term "problem based learning" was searched in the title, abstract and keywords and only journal articles (research and review) were selected. Thus, 7289 articles in 1987-2021 were included in the study. Firstly, the subject area, author and country distributions are listed. In addition, it showed that the most studied topics were education curriculum (39.15%), teaching strategies (14.90%), critical thinking skill (12.29%) and patient simulation (8.88%). When examined in seven five-year periods between 1987 and 2021, it was determined that the most voluminous topic was education curriculum, and the most accelerated topic was clinical education. Considering the number of publications in five-year periods, it was determined that the topics of critical thinking skills and teaching strategies accelerated more in the percentages calculated according to the topics. It is expected that the results obtained will be important reference points for the studies to be carried out in the field of PBL

Keywords

Problem based learning, latent dirichlet allocation, topic modeling, research trends

Ethical Statement

Due to the scope and method of the study, ethics committee permission was not required.

References

• Aggarwal, C. C., & Zhai, C. X. (2013). Mining text data. In Mining Text Data (Vol. 9781461432). https://doi.org/10.1007/978-1-4614-3223-4
• Aksoy, B. (2011). Sosyal bilgiler programındaki coğrafya konularının öğretiminde probleme dayalı öğrenme yaklaşımı [Problem-based learning approach in teaching geography topics in social studies program]. Turan, R. Sünbül, A. M. Akdağ, H. (Ed) Sosyal Bilgiler Öğretiminde Yeni Yaklaşımlar-II, 232-249. Ankara: Pegem Yayıncılık.
• Al-Azri, H., & Ratnapalan, S. (2014). Problem-based learning in continuing medical education: Review of randomized controlled trials. Canadian Family Physician, 60(2), 157-165.
• Albanese, M. A., & Mitchell, S. (1993). Problem-based learning: A review of literature on its outcomes and implementation issues. Academic Medicine-Philadelphia, 68, 52-81.
• Alfonseca, E., Carro, R. M., Martín, E., Ortigosa, A., & Paredes, P. (2006). The impact of learning styles on student grouping for collaborative learning: A case study. User Modeling and User-Adapted Interaction, 16(3-4), 377-401.
• Azer, S. A., & Azer, D. (2015). Group interaction in problem‐based learning tutorials: A systematic review. European Journal of Dental Education, 19(4), 194-208.
• Barrows, H. S., & Kelson, A. M. (1993). Problem-based learning: A total approach to education. Monograph. Southern Illinois University School of Medicine, Springfield, Illinois.
• Barrows, H. S., & Tamblyn, R. M. (1980). Problem-based learning: An approach to medical education (Vol. 1). Springer Publishing Company.
• Blei, D. M. (2012). Probabilistic topic models. Communications of the ACM, 55(4), 77–84.
• Blei, D. M., & Lafferty, J. D. (2007). Correction: A correlated topic model of Science. The Annals of Applied Statistics, 1(2). https://doi.org/10.1214/07-aoas136
• Blei, D. M., Ng, A. Y., & Jordan, M. I. (2003). Latent dirichlet allocation. Journal of Machine Learning Research, 3, 993-1022.
• Blumenfeld, P. C., Marx, R. W., Soloway, E., & Krajcik, J. (1996). Learning with peers: From small group cooperation to collaborative communities. Educational Researcher, 25(8), 37-39.
• Bransford, J. D., & McCarrell, N. S. (1977). A sketch of a cognitive approach to comprehension: Some thoughts about understanding what it means to comprehend. In Johnson-Laird, P. N., and Wason, P. C. (eds.), Thinking: Readings in Cognitive Science, Cambridge University Press, Cambridge, UK, pp. 377-399.
• Brown, G. (2022). Proposing problem-based learning for teaching future forensic speech scientists. Science & Justice.
• Carey, L., & Whittaker, K. A. (2002). Experiences of problem-based learning: issues for community specialist practitioner students. Nurse Education Today, 22(8), 661-668.
• Cash, C. B., Letargo, J., Graether, S. P., & Jacobs, S. R. (2017). An analysis of the perceptions and resources of large university classes. CBE-Life Sciences Education, 16(2), 1-12.
• Chan, T., Chen, C. M., Wu, Y. L., Jong, B. S., Hsia, Y. T., & Lin, T. W. (2010). Applying the genetic encoded conceptual graph to grouping learning. Expert Systems with Applications, 37(6), 4103-4118.
• Chao, C. T., Tsai, C. L., Lin, M. W., Yang, C. W., Ho, C. C., Chen, H. L., ... & Sheu, B. C. (2021). Fully digital problem-based learning for undergraduate medical students during the COVID-19 period: Practical considerations. Journal of the Formosan Medical Association, 121(10), 2130-2134.
• Cohen, L., Lawrence, M., & Morrison, K. (2017). Research methods in education. 6th ed. In Research Methods in Education. Routledge Taylor & Francis Group.
• Dolmans, D., & Gijbels, D. (2013). Research on problem‐based learning: Future challenges. Medical Education, 47(2), 214-218.
• Evia, C., Sharp, M. R., & Perez-Quinones, M. A. (2015). Teaching structured authoring and dita through rhetorical and computational thinking. IEEE Transactions on Professional Communication, 58(3), 328–343.
• Galvao, T. F., Silva, M. T., Neiva, C. S., Ribeiro, L. M., & Pereira, M. G. (2014). Problem-based learning in pharmaceutical education: A systematic review and meta-analysis. The Scientific World Journal.
• Ghani, A. S. A., Rahim, A. F. A., Yusoff, M. S. B., & Hadie, S. N. H. (2021). Effective learning behavior in problem-based learning: a scoping review. Medical Science Educator, 31(3), 1199-1211.
• Goodnough, K., & Cashion, M. (2006). Exploring problem‐based learning in the context of high school science: Design and implementation issues. School Science and Mathematics, 106(7), 280-295.
• Gurcan, F., & Cagiltay, N. E. (2019). Big data software engineering: analysis of knowledge domains and skill sets using lda-based topic modeling. IEEE Access, 7, 82541–82552. https://doi.org/10.1109/ACCESS.2019.2924075
• Gürcan, F., & Özyurt, Ö. (2020). Emerging trends and knowledge domains in e-learning researches: Topic modeling analysis with the articles published between 2008. Journal of Computer and Education Research, 8(16), 738-756. https://doi.org/10.18009/jcer.769349
• Gurcan, F., & Cagiltay, N. E. (2020). Research trends on distance learning: a text mining-based literature review from 2008 to 2018. In Interactive Learning Environments. https://doi.org/10.1080/10494820.2020.1815795
• Gurcan, F., & Cagiltay, N. E. (2022). Exploratory analysis of topic interests and their evolution in bioinformatics research using semantic text mining and probabilistic topic modeling. IEEE Access, 10, 31480-31493.
• Gurcan, F., Cagiltay, N. E., & Cagiltay, K. (2021). Mapping human–computer interaction research themes and trends from its existence to today: a topic modeling-based review of past 60 years. International Journal of Human-Computer Interaction, 37(3), 267–280. https://doi.org/10.1080/10447318.2020.1819668
• Gurcan, F., Ozyurt, O., & Cagiltay, N. E. (2021). Investigation of emerging trends in the e-learning field using latent dirichlet allocation. International Review of Research in Open and Distance Learning, 22(2), 1–18. https://doi.org/10.19173/irrodl.v22i2.5358
• Hallinger, P. (2021). Tracking the Evolution of the Knowledge Base on Problem-based Learning: A Bibliometric Review, 1972-2019. Interdisciplinary Journal of Problem-Based Learning, 15(1).
• Hallinger, P., & Lu, J. (2011). Implementing problem-based learning in higher education in Asia: challenges, strategies and effect. Journal of Higher Education Policy and Management, 33(3), 267-285.
• Haymana, B., & Dağhan, G. (2020). Kitlesel açık çevrimiçi derslerle ilgili yapılan araştırmaların incelenmesi: Tematik içerik analizi çalışması [Investigation of research about massive open online courses (MOOCs): A thematic content analysis study]. Journal of Computer and Education Research, 8(16), 787-820. https://doi.org/10.18009/jcer.772010
• Hilton, S., & Phillips, F. (2010). Instructor-assigned and student-selected groups: A view from inside. Issues in Accounting Education, 25(1), 15-33.
• Hmelo-Silver, C. E. (2004). Problem-based learning: What and how do students learn? Educational Psychology Review,16(3), 235-266.
• Hoffman, B. (1998). Integrating the disciplines in the elementary grades with problem‐based learning. The Delta Kappa Gamma Bulletin, 64(3), 9‐14.
• Hu, Y., Boyd-Graber, J., Satinoff, B., & Smith, A. (2014). Interactive topic modeling. Machine Learning, 95(3), 423-469. https://doi.org/10.1007/s10994-013-5413-0
• Huxland, M., & Land, R. (2000). Assigning students in group work projects: Can we do better than random? Innovations in Education and Training International, 37(1), 17-22.
• Jin, J., & Bridges, S. M. (2014). Educational technologies in problem-based learning in health sciences education: a systematic review. Journal of Medical Internet Research,16(12), e3240.
• Jonassen, D. H. (2000). Toward a design theory of problem solving. Educational Technology Research and Development, 48(4), 63-85.
• Karami, M., Karami, Z., & Attaran, M. (2013). Integrating problem-based learning with ICT for developing student-teachers’ content knowledge and teaching skill. International Journal of Education and Development using ICT, 9(1), 36-49.
• Koh, G. C. H., Khoo, H. E., Wong, M. L., & Koh, D. (2008). The effects of problem-based learning during medical school on physician competency: a systematic review. Cmaj, 178(1), 34-41.
• Kong, L. N., Qin, B., Zhou, Y. Q., Mou, S. Y., & Gao, H. M. (2014). The effectiveness of problem-based learning on development of nursing students’ critical thinking: A systematic review and meta-analysis. International Journal of Nursing Studies, 51(3), 458-469.
• Lei, S. A., Kuestermeyer, B. N., & Westmeyer, K. A. (2010). Group composition affecting student interaction and achievement: instructors' perspectives. Journal of Instructional Psychology, 37(4), 317.
• Lewis, A., & Smith, D. (1993). Defining higher order thinking. Theory into Practice, 32(3), 131-137.
• Li, Y., Wang, X., Zhu, X. R., Zhu, Y. X., & Sun, J. (2019). Effectiveness of problem-based learning on the professional communication competencies of nursing students and nurses: A systematic review. Nurse Education in Practice, 37, 45-55.
• Majeski, R., & Stover, M. (2005). Interdisciplinary problem-based learning in gerontology: A plan of action. Educational Gerontology, 31(10), 733–43.
• Manalo, F., & Chua, E. (2020). Collaborative inquiry approaches and level of thinking and reasoning skills: basis for sustainable science education. IOER International Multidisciplinary Research Journal, 2(2), 91–98.
• Merisier, S., Larue, C., & Boyer, L. (2018). How does questioning influence nursing students' clinical reasoning in problem-based learning? A scoping review. Nurse education today, 65, 108-115.
• Mimno, D., Wallach, H. M., Talley, E., Leenders, M., & McCallum, A. (2011). Optimizing semantic coherence in topic models. EMNLP 2011- Conference on Empirical Methods in Natural Language Processing, Proceedings of the Conference, 262-272.
• Newman, M. (2003). A pilot systematic review and meta-analysis on the effectiveness of problem based learning. http://www.medev.ac.uk/static/uploads/resources/pbl_report.pdf
• Nicholl, T. A., & Lou, K. (2012). A model for small-group problem-based learning in a large class facilitated by one instructor. American Journal of Pharmaceutical Education, 76(6), 1-6.
• Ozyurt, O., & Ayaz, A. (2022). Twenty-five years of education and information technologies: Insights from a topic modeling based bibliometric analysis. Education and Information Technologies, (2022), https://doi.org/10.1007/s10639-022-11071-y
• Ozyurt, O., & Ozyurt, H. (2022). A large-scale study based on topic modeling to determine the research interests and trends on computational thinking. Education and Information Technologies, (2022), https://doi.org/10.1007/s10639-022-11325-9
• Peterson, T. O. (2004). So you’re thinking of trying problem based learning? Three critical success factors for implementation. Journal of Management Education, 28(5), 630-647.
• Phungsuk, R., Viriyavejakul, C., & Ratanaolarn, T. (2017). Development of a problem-based learning model via a virtual learning environment. Kasetsart Journal of Social Sciences, 38(3), 297-306.
• Polyzois, I., Claffey, N., & Mattheos, N. (2010). Problem‐based learning in academic health education. A systematic literature review. European Journal of Dental Education, 14(1), 55-64.
• Prabhakaran, S. (2018). Topic modeling with gensim (Python). Machine Learning Plus.
• Ram, P. (1999). Problem-based learning in undergraduate education. Journal of Chemical Education, 76, 1122-1126.
• Savery, J. R. (2015). Overview of problem-based learning: Definitions and distinctions. Essential readings in problem-based learning: Exploring and extending the legacy of Howard S. Barrows, 9(2), 5-15.
• Savery, J. R. (2006). Overview of problem-based learning: Definitions and distinctions. The Interdisciplinary Journal of Problem-Based Learning 1(1), 9–20.
• Sayyah, M., Shirbandi, K., Saki-Malehi, A., & Rahim, F. (2017). Use of a problem-based learning teaching model for undergraduate medical and nursing education: a systematic review and meta-analysis. Advances in Medical Education and Practice, 8, 691.
• Schmidt, H. G. (1983). Problem‐based learning: Rationale and description. Medical Education, 17(1), 11-16.
• Scopus. (2022). Content coverage. https://www.elsevier.com/solutions/scopus/how-scopus-works/content?dgcid=RN_AGCM_Sourced_300005030
• Shen, V. R., Wang, Y. Y., Yang, C. Y., and Yeh, S. T. (2012). Verification of problem-based learning systems using modified petri nets. Expert Systems with Applications, 39(16), 12636-12649.
• Song, H. D., Grabowski, B. L., Koszalka, T. A., & Harkness, W. L. (2006). Patterns of instructional-design factors prompting reflective thinking in middle-school and college level problem-based learning environments. Instructional Science, 34(1), 63-87.
• Stentoft, D. (2017). From saying to doing interdisciplinary learning: Is problem-based learning the answer? Active Learning in Higher Education, 18(1), 51-61.
• Taylor, D. C., & Hamdy, H. (2013). Adult learning theories: Implications for learning and teaching in medical education: AMEE Guide No. 83. Medical Teacher, 35(11), 1561-1572.
• Tiwari, A., Lam, D., Yuen, K. H., Chan, R., Fung, T., & Chan, S. (2005). Student learning in clinical nursing education: Perceptions of the relationship between assessment and learning. Nurse Education Today, 25(4), 299-308.
• Trilling, B., & Fadel, C. (2009). 21st century skills: Learning for life in our times. John Wiley & Sons.
• Uden, L., & Beaumont, C. (2006). Why problem-based learning. In Technology and problem-based learning (pp. 44-64). IGI Global.
• Voogt, J., & Roblin, N. P. (2012). A comparative analysis of international frameworks for 21st century competences: Implications for national curriculum policies. Journal of Curriculum Studies, 44(3), 299-321.
• Wilder, S. (2015). Impact of problem-based learning on academic achievement in high school: a systematic review. Educational Review, 67(4), 414-435.
• Williams, A. F. (1999). An antipodean evaluation of problem-based learning by clinical educators. Nurse Education Today, 19(8), 659-667.
• Williams, S. M., & Beattie, H. J. (2008). Problem based learning in the clinical setting–A systematic review. Nurse Education Today, 28(2), 146-154.
• Yang, X. L., Lo, D., Xia, X., Wan, Z. Y., & Sun, J. L. (2016). What security questions do developers ask? a large-scale study of stack overflow posts. Journal of Computer Science and Technology, 31(5), 910–924. https://doi.org/10.1007/s11390-016-1672-0
• Yuan, H., Williams, B. A., & Fan, L. (2008). A systematic review of selected evidence on developing nursing students’ critical thinking through problem-based learning. Nurse Education Today, 28(6), 657-663.
• Zhang, F., Wang, H., Bai, Y., & Zhang, H. (2022). A bibliometric analysis of the landscape of problem-based learning research (1981–2021). Frontiers in Psychology, 13.