The Effect of STEM Applications on Mathematics Achievement: A Meta-Analysis Study

Abstract

This study aims to determine the effect of STEM applications on mathematics achievement using the meta-analysis method. For this purpose, postgraduate theses in Türkiye were analysed. As a result of the review, 25 postgraduate theses related to the topic were initially identified, and data from 14 theses that met the inclusion criteria were included in the meta-analysis. Data analyses were carried out using the Comprehensive Meta-Analysis statistical program. While applying the meta-analysis method, homogeneity test was performed by calculating the effect sizes of the studies. Since the studies showed a heterogeneous structure as a result of the homogeneity test, the random effects model was used to calculate the overall effect size. Hedges's g coefficient was used to determine the effect sizes. Funnel plot and Rosenthal's safe N statistic were used to examine publication bias. The classification of Thalheimer and Cook (2002) was used to interpret the effect sizes obtained as a result of the analyses. In the study, it was determined that the effect sizes of all studies included in the meta-analysis were positive. Only two of the studies had a small effect, while the other studies showed at least a medium effect. The overall effect size value for mathematics achievement was found to be 0.901. Based on these results, it can be said that STEM activities have a positive and large effect on increasing mathematics achievement.

Keywords

• mathematics
• meta-analysis
• academic achievement
• STEM

References

1. (* Sources marked with an asterisk were used for meta-analysis.)
2. Ademoğlu, E., Emre, F. B., & Akyürek, S. T. (2021). Effectiveness of STEM education on students' science course success: A Meta-analysis study. Journal of Academic Social Science Studies, 14(88), 45-60.
3. Anderson, N. (2021). A systematic review of STEAM education research: Comparing American and Korean studies. Academia Letters, Article 1039. https://doi.org/10.20935/AL1039.
4. Akgündüz, D. (2018). Okul öncesinden üniversiteye kuram ve uygulamada STEM eğitimi (2. baskı) [STEM education from pre-school to university in theory and practice (2nd edition)]. Anı publishing
5. Arshad, A. M., Halim, L., & Nasri, N. M. (2020). Impact of integrating science and engineering teaching approach on students' achievement: A meta-analysis. Jurnal Pendidikan IPA Indonesia, 9(2), 139–148. https://doi.org/10.15294/jpii.v9i2.29839
6. *Atay, Ü. (2024). STEM etkinliklerinin 4. sınıf öğrencilerinin STEM tutumlarına ve matematik başarılarına etkisi [The impact of STEM activities on 4th grade students' STEM attitudes and mathematics achievements]. Master's thesis, Yıldız Teknik University.
7. *Aydın, T. (2022). STEAM (STEM + SANAT) eğitiminde mandala etkinliklerinin 6. sınıf öğrencilerinin matematik başarısı ve yaratıcı düşünmelerine etkisi [The effects of mandala activities in STEAM (STEM + art) education on the mathematic achievement and creative thinking of 6th grade students]. Master's thesis, Dokuz Eylül University.
8. Bakan, G. (2024). STEM etkinliklerinin ilkokul öğrencilerinin STEM tutumlarına, STEM kariyer ilgilerine ve 21. yüzyıl becerilerine etkisi [The effects of STEM activities on elementary school students' STEM attitudes, STEM career interests, and 21st century skills]. Master's thesis, Cumhuriyet University.

9. Bicer, A., & Capraro, R. M. (2019). Mathematics achievement in the secondary high school context of STEM and non-STEM schools. School Science and Mathematics, 119(2), 61–71.
10. Boz, S. (2023). STEM eğitiminin öğrencilerin fen başarısına etkisi: Bir meta-analiz çalışması [The effect of STEM education on students' science achievement: A meta-analysis study]. Master's thesis, Aksaray University.
11. Bybee, R. W. (2011). Scientific and engineering practices in K-12 classrooms. Science Teacher, 78(9), 34-4.
12. *Cengiz, B. (2024). STEM kapsamında yapılan bir uygulamanın öğrencilerin matematik başarı düzeyleri ve tutumlarına etkisinin incelenmesi [Examining the effect of an application within the scope of STEM on students' mathematics achievement levels and attitudes]. Master's thesis, Marmara University.
13. Christensen, R., Knezek, G., & Tyler-Wood, T. (2015). Alignment of hands-on STEM engagement activities with positive STEM dispositions in secondary school students. Journal of Science Education and Technology. 24(6), 898–909.
14. Çalışkan, A., & Okuşluk, F. (2021). Türkiye’de STEM alanında ve eğitim-öğretim konusunda yapılmış olan lisansüstü tezlerin içerik analizi. [The content analysis of graduate thesis on education and in field STEM]. Academia Journal of Educational Research, 6(1), 124-136.
15. Çavaş, P., Ayar, A., & Gürcan, G. (2020). Türkiye’de STEM eğitimi üzerine yapılan araştırmaların durumu üzerine bir çalışma [A study on the status of STEM education research in Turkey]. YYU Journal of Education Faculty, 17(1), 823-854.
16. Çınar, S., & Terzi, S. Y. (2021). STEM eğitimi almış öğretmenlerin STEM öğretimi hakkındaki görüşleri. [Views of teachers taken STEM in-service training on STEM education]. YYU Journal of Education Faculty, 18(2), 213-245.
17. Çiftçi, M. (2018). Geliştirilen STEM etkinliklerinin ortaokul öğrencilerinin bilimsel yaratıcılık düzeylerine, STEM disiplinlerini anlamalarına ve STEM mesleklerini fark etmelerine etkisi [Effects of developed STEM activities on differential creative levels of students in middle school of students, differentials of STEM disciplinary and differances of STEM professions STEM profession]. Master's thesis, Recep Tayyip Erdoğan University.
18. Değerli, M., & Yapıcı, Ü. (2022). The effect of STEM approach in science education on academic success: A meta-analysis study. Necatibey Faculty of Education Electronic Journal of Science and Mathematics Education, 16(1), 17-48.
19. Demir, M. (2022). Türkiye’de STEM ile ilgili yapılmış tez çalışmalarının eğilimleri [The tendencies of the theses on STEM which were done in Turkey]. Master's thesis, Aydın Adnan Menderes University.
20. Dinçer, S. (2014). Applied meta-analysis in educational sciences. Pegem Akademi Publishing.
21. *Dumlupınar, M. (2021). FETEMM yaklaşımıyla işlenen 6. sınıf çarpanlar ve katlar konusunun öğrenci kazanımlarına etkisi [The effect of 6th grades factors and multiples which is proceeded with STEM approach to student's accusations]. Master's thesis, Uşak University.
22. Ecevit, T., Yıldız, M., & Balcı, N. (2022). Türkiye’deki STEM eğitimi çalışmalarının içerik analizi [Content analysis of STEM education studies in Turkey]. Bolu Abant Izzet Baysal University Journal of Faculty of Education, 22(1), 263-286.
23. Eshaq, H. A. (2024). The effect of using STEM education on students’ mathematics achievement. Journal of Pedagogical Research, 8(1), 75-82. https://doi.org/10.33902/JPR.202423476
24. Genç, R. A. (2023). Ortaöğretim fen eğitiminde STEM araştırmaları: Meta-sentez çalışması [STEM research in secondary science education: A meta-synthesis study]. Master's thesis, Atatürk University.
25. *Gül, H. (2023). Kavram karikatürü destekli FETEMM etkinliklerinin 7. sınıf matematik dersi sayılar ve işlemler ünitesinin öğretimi üzerindeki etkileri [The effects of concept cartoon supported FeTeMM activities on the teaching of the 7th grade mathematics lesson numbers and operations unit]. Master's thesis, Erciyes University.
26. *Gülbahar, N. (2023). Matematik ağırlıklı STEM eğitiminin ilkokul öğrencilerinin matematik başarısına ve matematik tutumlarına etkisi [The effect of mathematics-headly stem education on math success and attempts of primary school students]. Master's thesis, Kocaeli University.
27. *Güler, E. (2024). STEM temelli geometri etkinliklerinin öğrencilerin akademik başarılarına ve matematik tutumlarına etkisi [The effect of STEM-based geometry activities on students' academic achievements and mathematics attitudes]. Master's thesis, Kahramanmaraş Sütçü İmam University.
28. Gülhan, F. (2022). Türkiye’de yapılmış STEAM/[STEM+ A (Sanat)] araştırmalarındaki eğilimlerin analizi [Analysis of trends in researches on STEAM (STEM + Art) made in Turkey]. Turkish Journal of Educational Studies, 9(1), 23-46.
29. Gümüş, B., & Eroğlu, E. (2024). Fen eğitiminde gerçekleştirilen STEM uygulamalarının farklı değişkenler açısından incelenmesi: bir meta analiz çalışması [Examination of STEM practices in science education in terms of different variables: A meta-analysis study]. Trakya Journal of Education, 14(1), 54-74.
30. Günbatar, S. A., & Tabar, V. (2019). Türkiye’de gerçekleştirilen STEM araştırmalarının içerik analizi [Content analysis of science, technology, engineering and mathematics (STEM) research conducted in Turkey], YYU Journal of Education Faculty, 16(1), 1054-1083.
31. Herdem, K., & Ünal, İ. (2018). STEM eğitimi üzerine yapılan çalışmaların analizi: Bir meta-sentez çalışması [Analysis of studies about STEM education: A Meta-synthesis study]. Marmara University Atatürk Faculty of Education Journal of Educational Sciences, 48(48), 145-163.
32. Hyacinth, E. (2019). The effect of STEM and non-STEM education on student mathematics ability in third grade (Doctoral dissertation, Walden University). Walden Dissertations and Doctoral Studies. https://scholarworks.waldenu.edu/dissertations/7809
33. *Kabakçıoğlu, E. B. (2023). Gerçekçi matematik eğitimi ve STEM eğitim yaklaşımına göre matematik eğitiminin öğrencilerin matematik başarısı ve öğrenme kalıcılığına etkisi [Realistic mathematics education and the effect of mathematics education on students' mathematics achievement and learning retention according to the stem education approach] Master's thesis, Aydın Adnan Menderes University.
34. Kalemkuş, J. (2020). Deneysel araştırmalarda STEM eğilimi. [STEM tendency in experimental researches]. Dicle University Journal of Ziya Gökalp Faculty of Education, (36), 78-90.
35. *Karabörk, M. A. (2023). Ortaokul matematik dersi kazanımlarının interdisipliner STEM yaklaşımıyla uyarlanması ve buna dayalı etkinliklerin etkililiğinin incelenmesi [Adaptation of acquisition of secondary school mathematics course with interdispliner STEM approach and analysis of activities' effectiveness based on this]. Doctorate Dissertation, Bolu Abant İzzet Baysal University.
36. *Karadeniz, H. (2019). STEM uygulamalarının öğrencilerin STEM farkındalıkları üzerine ve 'üçgenler' ünitesindeki başarılarının kalıcılık düzeyine etkisi [The effect of STEM applications on the STEM perceptions of the students and the success of the success in the 'triangles' unit]. Master's thesis, Bayburt University.
37. Kwak, H., & Ryu, H. (2016). Analysis on the research trends in STEAM education. Journal of Science Education, 40(1), 72-89.
38. Lueangsuwan, T., & Srikoon, S. (2021). Meta-analysis of STEM Education approach effected on students’ learning achievement in Thailand. Journal of Physics: Conference Series, 1835(1), 1–7. https://doi.org/10.1088/1742-6596/1835/1/012084
39. *Macun, Y. (2019). Problem temelli STEM etkinliklerinin oran-orantı ve yüzdeler konularının öğretiminde 7. sınıf öğrencilerinin matematik başarılarına, tutumlarına ve görüşlerine etkisi [Effect of problem-based STEM activities on 7th grade students' mathematics achievements, attitudes, and views on teaching ratio-proportion and percentage]. Master's thesis, Erciyes University.
40. Mandev, F. ve Yavuz, S. (2021). Fen, teknoloji, mühendislik ve matematik (FeTeMM) ile ilgili araştırmalar üzerine bir içerik analizi. [A Content analysis on research in science, technology, engineering and mathematics (STEM)]. Karaelmas Journal of Educational Sciences, 10(1), 27-46.
41. Mao, P., Cai, Z., He, J., Chen, X., & Fan, X. (2021). The relationship between attitude toward science and academic achievement in science: A three-level meta-analysis. Frontiers in Psychology, 12, 784068. https://doi.org/10.3389/fpsyg.2021.784068
42. Ministry of National Education [MoNE] (2016). STEM education report. Ministry of National Education General Directorate of Innovation and Educational Technologies.
43. Ministry of National Education [MoNE] (2024a). Türkiye century education model curricula common text. Access address: https://mufredat.meb.gov.tr/
44. Ministry of National Education [MoNE] (2024b). Türkiye century education model middle school mathematics curriculum. Access address: https://mufredat.meb.gov.tr/
45. Ministry of National Education [MoNE] (2024c). Türkiye century education model high school mathematics curriculum. Access address: https://mufredat.meb.gov.tr/
46. Moore, T. J., Glancy, A. W., Tank, K. M., Kersten, J. A., Stohlmann, M. S., Ntow, F. D., & Smith, K. A. (2013, 23-26 Haziran). A framework for implementing quality K-12 engineering education. In 2013 ASEE Annual Conference & Exposition, Atlanta, Georgia. 10.18260/1-2—19060
47. OECD (2016). Innovating education and educating for innovation: The power of digital technologies and skills. OECD.
48. *Özdemir, H. (2018). Meslek lisesi öğrencilerinin alanlarıyla ilgili mesleki matematik başarısını geliştirmeye yönelik STEM uygulamaları [STEM (Science, technology, engineering, mathematics) implementations to improve the students' vocational mathematics success regarding their branch in vocational high schools]. Doctorate Dissertation, Bursa Uludağ University.
49. Rahmatika, Z., Wiliyanti, V., Diani, R., Daenuri, E., & Putri, C. A. S. A. (2024). Science, technology, engineering, and mathematics (STEM) approach in physics learning: Meta-analysis study. AIP Conference Proceedings, 3058(1).
50. Riechert, S., & Post, B. (2010). From skeletons to bridges & other STEM enrichment exercises for high school biology. The American Biology Teacher, 72(1), 20-22. https://doi.org/10.1525/abt.2010.72.1.6
51. *Tekneci, S. (2024). STEM destekli 3B blok kodlama araçlarının fen ve matematik başarısına, mühendislik, kodlama ve uzamsal görselleştirme becerisine etkisi [The effect of STEM-supported 3D block coding tools on science and mathematics achievement, engineering, coding and spatial visualization skills]. Master's thesis, Giresun University.
52. Tezel, Ö., & Yaman, H. (2017). A review of studies on STEM education in Turkey. Journal of Research in Education and Teaching, 6(1), 135-144.
53. Thalheimer, W., & Cook, S. (2002). How to calculate effect sizes from published research articles: A simplified methodology. Work-Learning Research.
54. Thomas, D. R., & Larwin, K. H. (2023). A meta-analytic investigation of the impact of middle school STEM education: Where are all the students of color? International Journal of STEM Education, 10(1), 43. https://doi.org/10.1186/s40594-023-00425-8
55. Tümkaya, S., & Ulum, H. (2020). A systematic review of the approaches enhancing the mathematics achievement. Journal of Education Culture and Society, 11(2), 171-182.
56. TUSIAD (2014). STEM alanında eğitim almış işgücüne yönelik talep ve beklentiler araştırması [Research on demand and expectations for labour force trained in STEM field] https://tusiad.org/tr/yayinlar/raporlar/item/download/7014_d28ffa2adda423c6d3852cc01c965993
57. *Türk, E. F. (2023). Eğitsel robot setleri ile gerçekleştirilen STEM etkinliklerinin ortaokul 5. sınıf öğrencilerinin matematik dersi başarılarına, problem çözme becerilerine ve STEM beceri düzeylerine etkisi [The effect of STEM activities performed with educational robot sets on middle school 5th grade students' mathematics success, problem solving skills and STEM skills levels]. Master's thesis, Amasya University.
58. Sümen, Ö. Ö. (2018). Matematik dersinde uygulanan STEM etkinliklerinin sınıf öğretmeni adaylarının öğrenme ürünlerine etkileri [The effects of STEM activities in mathematics lessons on learning outcomes of pre-service elementary teachers]. Doctorate Dissertation, Ondokuz Mayıs University.
59. Şen, S., & Yıldırım, İ. (2020). Meta-analysis applications with CMA. Anı Publishing.
60. Wang, L. H., Chen, B., Hwang, G. J., Guan, J. Q., & Wang, Y. Q. (2022). Effects of digital game-based STEM education on students’ learning achievement: A meta-analysis. International Journal of STEM Education, 9(1), 26.
61. Wells, J. G. (2016). PIRPOSAL model of integrative STEM education: Conceptual and pedagogical framework for classroom implementation. Technology and Engineering Teacher, 75(6), 12-19.
62. Yıldırım, B., & Altun, Y. (2015). STEM eğitim ve mühendislik uygulamalarının fen bilgisi laboratuar dersindeki etkilerinin incelenmesi [Investigating the effect of STEM education and engineering applications on science laboratory lectures]. El-Cezerî Journal of Science and Engineering, 2(2), 28-40.
63. Zhang, X., & Skaalvik, E. M. (2021). Attitudes towards mathematics, achievement, and drop-out intentions among STEM and non-STEM students in Norway. International Journal of STEM Education, 8(1), 24. https://doi.org/10.1186/s40594-021-00275-5