The Effectiveness of Nudge Methods in Education: A Meta-Analysis Study

Abstract

The use of the nudge method in educational sciences is increasing gradually. However, a study has not been yet found in the domestic literature on what extent the nudges are actually effective. Wtih this study, it is planned to fill this gap and tackle a related topic holistically. Thus, the study aims to determine the effectiveness of nudging methods in educational sciences. Meta-analysis, which makes it possible to convert and interpret the results of many experimental studies into a single value has been determined as the method of this study. As a result of the literature review, 46 nudge practices in the field of education were analyzed. The dependent variable of the meta-analysis calculated with the random effects model is the mean effect size d=0.243. It means that nudges do not have a desired effect on educational sciences. Subgroup analysis shows that nudges are more effective at pre-school and primary-secondary education levels. Nudge has various characteristics because of its relationship with economics. Experts in the educational sciences field should design nudges. The level of education to which the nudges will be applied, the subject of the nudges, and the type of nudge should be examined and determined in detail. The nudges to be applied to younger students should be more straightforward. On the other hand, as nudges to older students seem to ineffective, they should be reconsidered and prepared.

Keywords

• educational science
• nudge
• meta-analysis

Eğitim Alanında Uygulanan Dürtme Yöntemlerinin Etkinliği: Meta-Analiz Çalışması

Abstract

Eğitim bilimlerinde dürtme yönteminin kullanımı giderek artmaktadır. Ancak, yerli literatürde dürtmelerin gerçekte ne kadar etkili olduğuna dair bir çalışmaya henüz rastlanılmamıştır. Bu çalışmayla literatürdeki bu boşluğun doldurulması ve ilgili konunun bütüncül bir şekilde ele alınması planlanmaktadır. Çalışmanın amacı, eğitim bilimlerinde uygulanan dürtme yöntemlerinin ne kadar etkili olduğunu tespit etmektir. Çok sayıda deneysel çalışmanın sonucunu tek bir değere dönüştürüp yorumlanmasını olanaklı kılan meta-analiz, çalışmanın yöntemi olarak belirlenmiştir. Yapılan literatür taraması sonucunda eğitim alanında 46 adet dürtme uygulaması analiz edilmiştir. Rastgele etkiler modeli ile hesaplanan meta-analizin bağımlı değişkeni, ortalama etki büyüklüğü, d=0,243 bulunmuştur. Bu, dürtmelerin eğitim bilimlerinde tatmin edici bir etki yaratmadığını göstermektedir. Yapılan alt grup analizleri, dürtmelerin okulöncesi ve ilkokul-ortaokul eğitim seviyelerinde daha etkili sonuçlar verdiğini göstermektedir. Dürtme iktisatla bağlantısı nedeniyle farklı özelliklere sahiptir. Eğitim bilimi alanındaki uzmanlarca dürtme tasarlanmalıdır. Dürtmelerin uygulanacağı eğitim seviyesi, dürtmelerin konusu, dürtme tipi ayrıntılı şekilde incelenmeli ve belirlenmelidir. Küçük yaştaki öğrencilere uygulanacak dürtmeler daha basit olmalıdır. Öte yandan, daha büyük yaştaki öğrencilere yapılan dürtmelerin etkin olmadığı görüldüğünden bunlar tekrar ele alınıp hazırlanmalıdır.

Keywords

• eğitim bilimleri
• dürtme
• meta-analiz

References

1. Agarwal, S., Rengarajan, S., Sing, T. F. ve Yang, Y. (2017). Nudges from school children and electricity conservation: Evidence from the “Project Carbon Zero” campaign in Singapore. Energy Economics, 61, 29-41. https://doi.org/10.1016/j.eneco.2016.10.014
2. Aktan, C. A. (2021). Patolojik Paternalizm. İçinde Aktan, C. A. (Edt.), Paternalizm (s. 68-103). SOBİAD Hukuk ve İktisat Araştırmaları Merkezi Yayınları.
3. Aleahmad, T. (2011). Improving students’ study practices through the principled design of research probes [Yayımlanmış doktora tezi]. Carnegie Mellon University. Pittsburgh.
4. Andrews, C. A. B. (2020). Always something there to remind me: the role of nudging in assignment submission [Yayımlanmış doktora tezi]. Brigham Young University. Utah.
5. Balaban, R. ve Conway, P. (2020). A test of enhancing learning in economics through nudges. AEA Papers and Proceedings, 110, 289-293. https://doi.org/10.1257/pandp.20201050
6. Benito-Ostolaza, J. M., Echavarri, R., Garcia-Prado, A. ve Oses-Eraso, N. (2021). Using visual stimuli to promote healthy snack choices among children. Social Science & Medicine, 270, 1-9. https://doi.org/10.1016/j.socscimed.2020.113587
7. Bevet, S., Niles, M. T. ve Pope, L. (2018). You can’t “nudge” nuggets: An investigation of college late-night dining with behavioral economics interventions. Plos One, 13(5), 1-12. https://doi.org/10.1371/journal.pone.0198162
8. Boehm, R., Read, M., Henderson, K. E. ve Schwartz, M. B. (2020). Removing competitive foods v. nudging and marketing school meals: A pilot study in high-school cafeterias. Public Health Nutrition, 23(2), 366-373. https://doi.org/10.1017/S136898001900329X

9. Borenstein, M. (Ed.). (2009). Introduction to meta-analysis. John Wiley & Sons.
10. Brockman, S. (2021). Does career mentoring enhance college readiness? Experimental and social validity evidence from detroit of career mentoring ımpacts, mechanisms, and program ımprovement [Yayımlanmış doktora tezi]. University of Michigan. Michigan.
11. Brown, A., Lawrence, J., Basson, M., Axelsen, M., Redmond, P., Turner, J., Maloney, S. ve Galligan, L. (2022). The creation of a nudging protocol to support online student engagement in higher education. Active Learning in Higher Education, https://doi.org/10.1177/14697874211039077
12. Camerer, C., Issacharoff, S., Loewenstein, G., O’Donoghue, T. ve Rabin, M. (2003). Regulation for conservatives: behavioral economics and the case for “Asymmetric Paternalism”. University of Pennsylvania Law Review, 151(3), 1211-1254. https://doi.org/10.2307/3312889
13. Card, N. A. (2015). Applied meta-analysis for social science research. Guilford Publications.
14. Charry, K. ve Parguel, B. (2019). Educating children to environmental behaviours with nudges: The effectiveness of social labelling and moderating role of age. Environmental Education Research, 25(10), 1495-1509. https://doi.org/10.1080/13504622.2018.1551518
15. Chen, J. C., Fonseca, M. A., ve Grimshaw, S. B. (2021). When a nudge is (not) enough: Experiments on social information and incentives. European Economic Review, 134, 103711. https://doi.org/10.1016/j.euroecorev.2021.103711
16. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed). L. Erlbaum Associates.
17. Congiu, L. ve Moscati, I. (2022). A review of nudges: Definitions, justifications, effectiveness. Journal of Economic Surveys, 36(1), 188-213. https://doi.org/10.1111/joes.12453
18. Damgaard, M. T. ve Nielsen, H. S. (2018). Nudging in education. Economics of Education Review, 64, 313-342. https://doi.org/10.1016/j.econedurev.2018.03.008
19. Dave, J., Chen, T.-A., Thompson, D., Oceguera, A. ve Cullen, K. (2015). Outcome evaluation of a pilot study using “nudges”. International Journal of Child Health and Nutrition, 4(1), 33-39. https://doi.org/10.6000/1929-4247.2015.04.01.3
20. Duval, S. ve Tweedie, R. (2000). Trim and fill: a simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics, 56(2), 455-463. https://doi.org/10.1111/j.0006-341x.2000.00455.x
21. Egger, M., Davey Smith, G., Schneider, M. ve Minder, C. (1997). Bias in meta-analysis detected by a simple, graphical test. BMJ (Clinical research ed.), 315, 629-634. https://doi.org/10.1136/bmj.315.7109.629
22. Erjavec, M., Williams, S., Viktor, S. ve Marcano-Olivier, M. (2021). Nudge with caution: Targeting fruit and vegetable consumption in primary schools. European Journal of Clinical Nutrition, 75(4), 724-727. https://doi.org/10.1038/s41430-020-00772-7
23. Field, A. P. ve Gillett, R. (2010). How to do a meta-analysis. British Journal of Mathematical and Statistical Psychology, 63(3), 665-694. https://doi.org/10.1348/000711010X502733
24. Fouh, E., Lee, W. ve Baker, R. S. (2021). Nudging students to reduce procrastination in office hours and forums. 2021 25th International Conference Information Visualisation (IV), 248-254. https://doi.org/10.1109/IV53921.2021.00047
25. Giubilini, A., Caviola, L., Maslen, H., Douglas, T., Nussberger, A.-M., Faber, N., Vanderslott, S., Loving, S., Harrison, M. ve Savulescu, J. (2019). Nudging ımmunity: The case for vaccinating children in school and day care by default. HEC Forum, 31(4), 325-344. https://doi.org/10.1007/s10730-019-09383-7
26. Grady, A., Barnes, C., Lum, M., Jones, J. ve Yoong, S. L. (2021). Impact of nudge strategies on nutrition education participation in child care: Randomized controlled trial. Journal of Nutrition Education and Behavior, 53(2), 151-156. https://doi.org/10.1016/j.jneb.2020.11.017
27. Graham, A., Toon, I., Wynn-Williams, K. ve Beatson, N. (2017). Using ‘nudges’ to encourage student engagement: An exploratory study from the UK and New Zealand. The International Journal of Management Education, 15(2), 36-46. https://doi.org/10.1016/j.ijme.2017.04.003
28. Grover, E., Hossain, M. K., Uddin, S., Venkatesh, M., Ram, P. K. ve Dreibelbis, R. (2018). Comparing the behavioural impact of a nudge-based handwashing intervention to high-intensity hygiene education: A cluster-randomised trial in rural Bangladesh. Tropical Medicine & International Health, 23(1), 10-25. https://doi.org/10.1111/tmi.12999
29. Grüne-Yanoff, T. (2012). Old wine in new casks: Libertarian paternalism still violates liberal principles. Social Choice and Welfare, 38(4), 635-645. https://doi.org/10.1007/s00355-011-0636-0
30. Hammond, S. L. (2022). Nudging towards diversity: A randomized controlled trial involving veterinary college applicants [Yayınlanmış doktora tezi]. Educational Leadership, Policy, and Human Development. North Carolina.
31. Hansen, P. G. (2016). The definition of nudge and libertarian paternalism: Does the hand fit the glove? European Journal of Risk Regulation, 7(1), 155-174. https://doi.org/10.1017/S1867299X00005468
32. Hattie, J. (2009). Visible learning: A synthesis of over 800 meta-analyses relating to achievement (Reprinted). Routledge.
33. Hedges, L. V. (1982). Estimation of effect size from a series of independent experiments. Psychological Bulletin, 92, 490-499. https://doi.org/10.1037/0033-2909.92.2.490
34. Higgins, J. P. T., Thompson, S. G., Deeks, J. J. ve Altman, D. G. (2003). Measuring inconsistency in meta-analyses. BMJ (Clinical Research Ed.), 327(7414), 557-560. https://doi.org/10.1136/bmj.327.7414.557
35. Huang, H. C., Le, N., Battle, M., Villasenor, J. M. ve Maule, L. (2021). Nudging handwashing among primary school students in the philippines: Evidence from a cluster randomized trial. The American Journal of Tropical Medicine and Hygiene, 105(6), 1806-1815. https://doi.org/10.4269/ajtmh.20-0673
36. İltüzer, Y. ve Demi̇r Aslançevik, Y. (2021). Çevrimiçi öğrenme ortamlarında kullanılan dürtme stratejilerinin üniversite öğrencilerinin performanslarına etkisi ve performans ile motivasyonlarına yönelik görüşleri. Eğitim Teknolojisi Kuram ve Uygulama. 11 (2) , 178-210. https://doi.org/10.17943/etku.711173
37. Jäckle, S. ve Waldvogel, T. (2022). Attitudes toward coronavirus protection measures among german school students: the effects of education and knowledge about the pandemic. Social Sciences, 11(7), 280. https://doi.org/10.3390/socsci11070280
38. Lipsey, M. W. ve Wilson, D. B. (2001). Practical meta-analysis: applied social research methods series (Vol. 49). Sage Publications.
39. Loeb, K. L., Radnitz, C., Keller, K., Schwartz, M. B., Marcus, S., Pierson, R. N., Shannon, M. ve DeLaurentis, D. (2017). The application of defaults to optimize parents’ health-based choices for children. Appetite, 113, 368-375. https://doi.org/10.1016/j.appet.2017.02.039
40. Marcano-Olivier, M., Pearson, R., Ruparell, A., Horne, P. J., Viktor, S. ve Erjavec, M. (2019). A low-cost Behavioural Nudge and choice architecture intervention targeting school lunches increases children’s consumption of fruit: A cluster randomised trial. International Journal of Behavioral Nutrition and Physical Activity, 16(1), 20. https://doi.org/10.1186/s12966-019-0773-x
41. Mikkelsen, B. E., Sudzina, F., Ørnbo, L. E. ve Tvedebrink, T. D. O. (2021). Does visibility matter? – A simple nudge reduces the purchase of sugar sweetened beverages in canteen drink coolers. Food Quality and Preference, 92, 104190. https://doi.org/10.1016/j.foodqual.2021.104190
42. Neckermann, S., Turmunkh, U., van Dolder, D. ve Wang, T. V. (2022). Nudging student participation in online evaluations of teaching: Evidence from a field experiment. European Economic Review, 141, 104001. https://doi.org/10.1016/j.euroecorev.2021.104001
43. Nye, B., Konstantopoulos, S., ve Hedges, L. V. (2004). How large are teacher effects? Educational Evaluation and Policy Analysis, 26(3), 237–257. https://doi.org/10.3102/01623737026003237
44. O’Connell, S. D. ve Lang, G. (2018). Can personalized nudges ımprove learning in hybrid classes? Experimental evidence from an introductory undergraduate course. Journal of Research on Technology in Education, 50(2), 105-119. https://doi.org/10.1080/15391523.2017.1408438
45. Ojwang’, S. O., Okello, J. J., Otieno, D. J., Nyikal, R. A. ve Muoki, P. N. (2022). Using preschoolers to improve caregivers’ knowledge, attitude, and practices relating to biofortified crops: Evidence from a randomized nutrition education trial in Kenya. Food Science & Nutrition. 2960. https://doi.org/10.1002/fsn3.2960
46. Ojwang, S. O., Otieno, D. J., Okello, J. J., Nyikal, R. A. ve Muoki, P. (2021). The role of targeted nutrition education of preschoolers and caregivers on sustained consumption of biofortified orange-fleshed sweetpotato in Kenya. Current Developments in Nutrition, 5(8), nzab096. https://doi.org/10.1093/cdn/nzab096
47. Olstad, D. L. (2014). Assessing and catalyzing adoption and implementation of the Alberta nutrition guidelines for children and youth in recreational sports settings. Applied Physiology, Nutrition, and Metabolism, 39(7), 842-842. https://doi.org/10.1139/apnm-2014-0018
48. Oreopoulos, P. (2020). Promises and limitations of nudging in education. SSRN Electronic Journal. 13718. https://doi.org/10.2139/ssrn.3695419
49. Oxford Advanced American Dictionary (2022, 14 Ağustos) Paternalism. https://www.oxfordlearnersdictionaries.com/definition/american_english/paternalism
50. Ozturk, O. D., Frongillo, E. A., Blake, C. E., McInnes, M. M. ve Turner-McGrievy, G. (2020). Before the lunch line: Effectiveness of behavioral economic interventions for pre-commitment on elementary school children’s food choices. Journal of Economic Behavior & Organization, 176, 597-618. https://doi.org/10.1016/j.jebo.2020.03.027
51. Plak, S., van Klaveren, C. ve Cornelisz, I. (2022). Raising student engagement using digital nudges tailored to students’ motivation and perceived ability levels. British Journal of Educational Technology, 13261. https://doi.org/10.1111/bjet.13261
52. Rosenthal, R. (1979). The file drawer problem and tolerance for null results. Psychological Bulletin, 86, 638-641. https://doi.org/10.1037/0033-2909.86.3.638
53. Rosenthal, R. (1994). Parametric measures of effect size. In H. Cooper ve H. V. Hedges (Eds.), The Handbook of Research Synthesis (ss. 231-244). Russell Sage Foundation.
54. Schindler-Ruwisch, J. ve Gordon, M. (2021). Nudging healthy college dining hall choices using behavioral economics. Journal of American College Health, 69(7), 697-703. https://doi.org/10.1080/07448481.2019.1705842
55. Schreinemachers, P., Baliki, G., Shrestha, R. M., Bhattarai, D. R., Gautam, I. P., Ghimire, P. L., Subedi, B. P. ve Brück, T. (2020). Nudging children toward healthier food choices: An experiment combining school and home gardens. Global Food Security, 26, 100454. https://doi.org/10.1016/j.gfs.2020.100454
56. Shipkova, A. O., Vdovenko, D. Z., Efimova, A. N. ve Shushunova, A. T. (2016). Nudging in education: The case of master program. In 3rd International Multidisciplinary Scientific Conference on Social Sciences and Arts. 689-696.
57. Sunstein, C. R. (2017). Human agency and behavioral economics. Springer International Publishing. https://doi.org/10.1007/978-3-319-55807-3
58. Sunstein, C. R. (2019). Nudging: A very short guide. Business Economics, 54(2), 127-129. https://doi.org/10.1057/s11369-018-00104-5
59. Sutter, C., Rosenberger, W. ve Sutter, M. (2020). Nudging with your child’s education. A field experiment on collecting municipal dues when enforcement is scant. Economics Letters, 191, 109116. https://doi.org/10.1016/j.econlet.2020.109116
60. Szaszi, B., Palinkas, A., Palfi, B., Szollosi, A. ve Aczel, B. (2018). A systematic scoping review of the choice architecture movement: Toward understanding when and why nudges work. Journal of Behavioral Decision Making, 31(3), 355-366. https://doi.org/10.1002/bdm.2035
61. Şen, S. ve Yıldırım, İ. (2020). CMA ile meta-analiz uygulamaları. Anı Yayıncılık.
62. T.C. Ticaret Bakanlığı. (2022, 11 Temmuz). Senin kararın (mı?). https://ticaret.gov.tr/kurumsal-haberler/senin-kararin-mi
63. Thaler, R. H. (2018). From cashews to nudges: The evolution of behavioral economics. American Economic Review, 108(6), 1265-1287. https://doi.org/10.1257/aer.108.6.1265
64. Thaler, R. H. ve Sunstein, C. R. (2003). Libertarian paternalism. American Economic Review, 93(2), 175-179. https://doi.org/10.1257/000282803321947001
65. Thaler, R. H. ve Sunstein, C. R. (2019). Dürtme: Sağlık, zenginlik ve mutluluk için alınan kararları geliştirmek üzere (E. Günsel, Çev.). Pegasus Yayınları.
66. Thaler, R. H. ve Sunstein, C. R. (2021). Nudge: The final edition. Penguin Books.
67. van Kleef, E., Vrijhof, M., Polet, I. A., Vingerhoeds, M. H. ve de Wijk, R. A. (2014). Nudging children towards whole wheat bread: A field experiment on the influence of fun bread roll shape on breakfast consumption. BMC Public Health, 14(1), 906. https://doi.org/10.1186/1471-2458-14-906
68. Vidal-Mones, B., Diaz-Ruiz, R. ve M. Gil, J. (2022). From evaluation to action: Testing nudging strategies to prevent food waste in school canteens. Waste Management, 140, 90-99. https://doi.org/10.1016/j.wasman.2022.01.006
69. Viscusi, W. K. (2019). Efficiency criteria for nudges and norms. Public Choice, 1-18. https://doi.org/10.1007/s11127-019-00712-5
70. Visser, M., Booysen, M. J., Brühl, J. M. ve Berger, K. J. (2018). Saving water at Cape Town schools by using smart metering and behavioural change. Water Resources and Economics. 34. https://doi.org/10.1016/j.wre.2020.100175
71. Weber, E. (2015). Smarter lunchroom makeover pilot- the effect of subtle nudging strategies on fruit and vegetable consumption among students participating in the national school lunch program. Yale School of Public Health. Connecticut.
72. Weijers, R. J., de Koning, B. B. ve Paas, F. (2021). Nudging in education: From theory towards guidelines for successful implementation. European Journal of Psychology of Education, 36(3), 883-902. https://doi.org/10.1007/s10212-020-00495-0
73. Weijers, R., de Koning, B., Vermetten, Y., & Paas, F. (2023). Nudging autonomous learning behavior: three field experiments. Education Sciences, 13(1), 49. https://doi.org/10.3390/educsci13010049
74. Ye, X., Zhai, M., Feng, L., Xie, A., Wang, W. ve Wu, H. (2022). Still want to be a doctor? Medical student dropout in the era of COVID-19. Journal of Economic Behavior & Organization, 195, 122-139. https://doi.org/10.1016/j.jebo.2021.12.034