The Effects of Immersive Virtual Reality Environments on Students' Academic Achievement: A Meta-analytical and Meta-thematic Study

Year 2022, Volume: 9 Issue: 3, 111 - 131, 01.05.2022

Muhterem Akgün , Bünyamin Atıcı

https://doi.org/10.17275/per.22.57.9.3

Cited By: 4

Abstract

The objective of this study is to ascertain the effects of immersive virtual reality environments on students’ academic achievement utilizing quantitative and qualitative approaches. First, databases of Web of Science, Google Scholar, ERIC, Proquest, YÖK Thesis Center, and ULAKBİM of Turkey were searched, and 31 studies (23 journal papers and 8 theses) were selected for the meta-analysis. In this context, the overall effect size on students' academic achievement was analyzed with the CMA program using subject area and grade level moderator variables. In the second part, content analysis was performed using the ATLAS.ti program for 8 studies selected for the meta-thematic analysis. it was found that immersive virtual reality environments had a positive, moderate (d = 0.526) effect on students' academic achievement. After the meta-thematic analysis, it was observed that immersive virtual reality environments had many positive effects on students' cognitive, affective, and psychomotor skills and that created a perception of reality and sense of presence in students, facilitates learning, increases motivation, creates a safe and interactive learning environment and make many contributions to learning. In addition, it was determined that there may be problems such as technical problems and health problems during the environments, and it was stated that measures should be taken.

Keywords

Immersive virtual reality, meta-analysis, meta-thematic

References

• *Acar, A. & Cavaş, B. (2020). The Effect Of Virtual Reality Enhanced Learning Environment On The 7th-Grade Students’ Reading and Writing Skills İn English. Malaysian Online Journal of Educational Sciences, 8(4), 22-33.
• *Akbulut, A., Catal, C., & Yıldız, B. (2018). On the effectiveness of virtual reality in the education of software engineering. Computer Applications in Engineering Education, 26(4), 918-927.
• *Akman, E. & Çakır, R. (2020): The effect of educational virtual reality game on primary school students’ achievement and engagement in mathematics, Interactive Learning Environments, DOI: 10.1080/10494820.2020.1841800
• *Alfadil, M. M. (2017). Virtual Reality game classroom implementation: teacher perspectives and student learning outcomes. Unpublished Doctoral Thesis. The University of Northern Colorado.
• Batdı, V. (2019). Meta-tematik analiz. V. Batdı (Ed.), Meta-tematik analiz: Örnek uygulamalar İçinde. (s. 10-76). Ankara: Anı Yayıncılık Bayraktar, E., & Kaleli, F. (2007). Sanal gerceklik ve uygulama alanlari. Akademik Bilişim, 1-6.
• Biocca, F., & Delaney, B. (1995). Immersive virtual reality technology. Communication in the age of virtual reality, 15(32), 10-5555. Bogusevschi, D., Bratu, M., Ghergulescu, I., Muntean, C. H., & Muntean, G. M. (2018, April). Primary school STEM education: using 3D computer-based virtual reality and experimental laboratory simulation in a physics case study. In Ireland International Conference on Education, IPeTEL workshop, Dublin.
• Borenstein, M., Hedges, L. V., Higgins, J. P., & Rothstein, H. R. (2010). A basic introduction to fixed‐effect and random‐effects models for meta‐analysis. Research synthesis methods, 1(2), 97-111.
• Borenstein, M., Hedges, L. V., Higgins, J. P., & Rothstein, H. R. (2011). Introduction to meta-analysis. John Wiley & Sons.
• Botden, S. M., Buzink, S. N., Schijven, M. P., & Jakimowicz, J. J. (2007). Augmented versus virtual reality laparoscopic simulation: what is the difference?. World journal of surgery, 31(4), 764-772.
• *Bowen, M. M. (2018). Effect of virtual reality on motivation and achievement of middle-school students. Unpublished Doctoral Thesis. The University of Memphis.
• Burdea, G. C., & Coiffet, P. (2003). Virtual reality technology. John Wiley & Sons.
• Cha, M., Han, S., Lee, J., & Choi, B. (2012). A virtual reality-based fire training simulator integrated with fire dynamics data. Fire Safety Journal, 50, 12-24.
• *Chen, J. C., Huang, Y., Lin, K. Y., Chang, Y. S., Lin, H. C., Lin, C. Y., & Hsiao, H. S. (2020). Developing a hands‐on activity using virtual reality to help students learn by doing. Journal of Computer Assisted Learning, 36(1), 46-60.
• *Chien, S. Y., Hwang, G. J., & Jong, M. S. Y. (2020). Effects of peer assessment within the context of spherical video-based virtual reality on EFL students’ English-Speaking performance and learning perceptions. Computers & Education, 146, 103751.
• *Civelek, T., Ucar, E., Ustunel, H., & Aydın, M. K. (2014). Effects of a haptic augmented simulation on K-12 students’ achievement and their attitudes towards physics. Eurasia Journal of Mathematics, Science and Technology Education, 10(6), 565-574.
• Cohen, L., Manion, L., & Morrison, K. (2007). Research methods in education. Routledge. https://doi.org/10.4324/9780203029053. Crochet, P., Aggarwal, R., Dubb, S. S., Ziprin, P., Rajaretnam, N., Grantcharov, T., ... & Darzi, A. (2011). Deliberate practice on a virtual reality laparoscopic simulator enhances the quality of surgical technical skills. Annals of surgery, 253(6), 1216-1222.
• Çakiroğlu, Ü. & Gökoğlu, S. (2019). Development of fire safety behavioral skills via virtual reality. Computers & Education, 133, 56-68. Çavaş, B., Çavaş, P. H., & Can, B. T. (2004). Eğitimde sanal gerceklik. TOJET: The Turkish Online Journal of Educational Technology, 3(4). *Davis, A., Linvill, D. L., Hodges, L. F., Da Costa, A. F., & Lee, A. (2020). Virtual reality versus face-to-face practice: A study into situational apprehension and performance. Communication Education, 69(1), 70-84.
• Demir, R. (2019). Sanal gerçeklik gözlüğüne dayalı din öğretimine yönelik öğretmen adaylarının tutumu. MANAS Sosyal Araştırmalar Dergisi, 8(1), 847-861.
• Duval, S. & Tweedie, R. (2000). Trim and fill: a simple funnel‐plot–based method of testing and adjusting for publication bias in meta‐analysis. Biometrics, 56(2), 455-463.
• Egger, M., Smith, G. D., Schneider, M. & Minder, C. (1997). Bias in meta-analysis detected by a simple, graphical test. Bmj, 315(7109), 629-634.
• El-Mounayri, H., Rogers, C., Fernandez, E., & Satterwhite, J. C. (2016). Assessment of STEM e-Learning in an immersive virtual reality (VR) environment. Paper presented at 2016 ASEE Annual Conference & Exposition, New Orleans, Louisiana.
• Fabris, C. P., Rathner, J. A., Fong, A. Y., & Sevigny, C. P. (2019). Virtual Reality in Higher Education. International Journal of Innovation in Science and Mathematics Education, 27(8).
• Finkelstein, S., Nickel, A., Lipps, Z., Barnes, T., Wartell, Z., & Suma, E. A. (2011). Astrojumper: Motivating exercise with an immersive virtual reality exergame. Presence: Teleoperators and Virtual Environments, 20(1), 78-92.
• Freina, L., & Ott, M. (2015, April). A literature review on immersive virtual reality in education: state of the art and perspectives. In The international scientific conference elearning and software for education (Vol. 1, No. 133, pp. 10-1007).
• Fu, Y., & Li, Q. (2020, April). Immersive Virtual Reality for Fire Safety Behavioural Skills Training via Gesture-based Technology. In IOP Conference Series: Materials Science and Engineering (Vol. 825, No. 1, p. 012015). IOP Publishing.
• Guzzo, R. A., Jackson, S. E., & Katzell, R. A. (1987). Meta-analysis analysis. Research in organizational behavior, 9(1), 407-442. Helsel, S. (1992). Virtual reality and education. Educational Technology, 32(5), 38-42.
• Higgins, J. P. (2008). Commentary: Heterogeneity in meta-analysis should be expected and appropriately quantified. International journal of epidemiology, 37(5), 1158-1160.
• Higgins, J. P., Thompson, S. G., & Spiegelhalter, D. J. (2009). A re‐evaluation of random‐effects meta‐analysis. Journal of the Royal Statistical Society: Series A (Statistics in Society), 172(1), 137-159.
• Hilfert, T., & König, M. (2016). Low-cost virtual reality environment for engineering and construction. Visualization in Engineering, 4(1), 1-18.
• *Huang, H. L., Hwang, G. J., & Chang, C. Y. (2020). Learning to be a writer: A spherical video‐based virtual reality approach to supporting descriptive article writing in high school Chinese courses. British Journal of Educational Technology, 51(4), 1386-1405.
• Huedo-Medina, T. B., Sánchez-Meca, J., Marín-Martínez, F., & Botella, J. (2006). Assessing heterogeneity in meta-analysis: Q statistic or I² index?. Psychological methods, 11(2), 193.
• *Hwang, W. Y., & Hu, S. S. (2013). Analysis of peer learning behaviors using multiple representations in virtual reality and their impacts on geometry problem solving. Computers & Education, 62, 308-319.
• Jayaram, S., Connacher, H. I., & Lyons, K. W. (1997). Virtual assembly using virtual reality techniques. Computer-aided design, 29(8), 575-584.
• Kaleci, D., Tepe, T. ve Tüzün, H. (2017). Üç Boyutlu Sanal Gerçeklik Ortamlarindaki Deneyimlere Ilişkin Kullanici Görüşleri. Türkiye Sosyal Araştırmalar Dergisi, 21(3), 669-689.
• *Kalkan, N. (2020). Temel Teknik Beceri Öğretiminde Sanal Gerçeklik Teknolojisinin Etkililiğinin İncelenmesi: Masa Tenisi Örneği. Yayımlanmamış Doktora Tezi. Manisa Celal Bayar Üniversitesi. Sağlık Bilimleri Enstitüsü. Manisa.
• Karaoğlan Yılmaz, F. G. ve Yılmaz, R. (2019). Sanal gerçeklik uygulamalarının eğitimde kullanımına ilişkin öğretmen adaylarının görüşlerinin incelenmesi. III. International Congress on Science and Education. Afyonkarahisar.
• Kayabaşı, Y. (2002). Sanal Gerçeklik ve Eğitim Amaçli Kullanilmasi. Turkish Online, 151.
• Kim, K., Kim, C. H., Cha, K. R., Park, J., Han, K., Kim, Y. K., ... & Kim, S. I. (2008). Anxiety provocation and measurement using virtual reality in patients with obsessive-compulsive disorder. CyberPsychology & Behavior, 11(6), 637-641.
• *Kim, P. (2006) Effects of 3D virtual reality of plate tectonics on fifth grade students' achievement and attitude toward science, Interactive Learning Environments, 14:1, 25-34, DOI: 10.1080/10494820600697687
• *Koçbuğ, R. (2018). The Effectiveness of Virtual Reality on Vocabulary Learning and Retention. Yayımlanmamış Yüksek Lisans Tezi. İstanbul Üniversitesi, Eğitim Bilimleri Enstitüsü.
• Kulinskaya, E., Dollinger, M. B., & Bjørkestøl, K. (2011). Testing for homogeneity in meta‐analysis I. The one‐parameter case: standardized mean difference. Biometrics, 67(1), 203-212.
• Kurbanoğlu, S. (1996). Sanal gerçeklik: Gerçek mi, değil mi?. Türk Kütüphaneciliği 10,1 (1996), 21-31
• La Paglia, F., La Cascia, C., Cipresso, P., Rizzo, R., Francomano, A., Riva, G., & La Barbera, D. (2014, May). Psychometric assessment using classic neuropsychological and virtual reality based test: A study in obsessive-compulsive disorder (OCD) and schizophrenic patients. In International Symposium on Pervasive Computing Paradigms for Mental Health (pp. 23-32). Springer, Cham.
• *Leder, J., Horlitz, T., Puschmann, P., Wittstock, V., & Schütz, A. (2019). Comparing immersive virtual reality and powerpoint as methods for delivering safety training: Impacts on risk perception, learning, and decision making. Safety science, 111, 271-286.
• *Legault, J., Zhao, J., Chi, Y. A., Chen, W., Klippel, A., & Li, P. (2019). Immersive virtual reality as an effective tool for second language vocabulary learning. Languages, 4(1), 13.
• Lin, L., & Chu, H. (2018). Quantifying publication bias in meta‐analysis. Biometrics, 74(3), 785-794.
• *Liou, H.-H., Yang, S. J. H., Chen, S. Y., & Tarng, W. (2017). The Influences of the 2D Image-Based Augmented Reality and Virtual Reality on Student Learning. Educational Technology & Society, 20 (3), 110–121.
• *Liu, R., Wang, L., Lei, J., Wang, Q., & Ren, Y. (2020). Effects of an immersive virtual reality‐based classroom on students’ learning performance in science lessons. British Journal of Educational Technology, 51(6), 2034-2049.
• Lucas, S. M., Zeltser, I. S., Bensalah, K., Tuncel, A., Jenkins, A., Pearle, M. S., & Cadeddu, J. A. (2008). Training on a virtual reality laparoscopic simulator improves performance of an unfamiliar live laparoscopic procedure. The Journal of urology, 180(6), 2588-2591.
• *Lund, Brady D. and Wang, Ting (2019) "Effect of Virtual Reality on Learning Motivation and Academic Performance: What Value May VR Have for Library Instruction?," Kansas Library Association College and University Libraries Section Proceedings: Vol. 9: No. 1. https://doi.org/10.4148/2160-942X.1073
• Macaskill, P., Walter, S. D., & Irwig, L. (2001). A comparison of methods to detect publication bias in meta‐analysis. Statistics in medicine, 20(4), 641-654.
• *Makransky, G., Terkildsen, T. S., & Mayer, R. E. (2019). Adding immersive virtual reality to a science lab simulation causes more presence but less learning. Learning and Instruction, 60, 225-236.
• Manseur, R. (2005, October). Virtual reality in science and engineering education. In Proceedings Frontiers in Education 35th Annual Conference (pp. F2E-8). IEEE.
• McLellan, H. (1996). Virtual realities. Handbook of Research for Educational Communications and Technology (pp. 457-487). Boston: Kluwer-Nijhoff Publishing.
• Merchant, Z., Goetz, E. T., Cifuentes, L., Keeney-Kennicutt, W., & Davis, T. J. (2014). Effectiveness of virtual reality-based instruction on students’ learning outcomes in K-12 and higher education: A meta-analysis. Computers & Education, 70, 29–40.
• *Merchant, Z., Goetz, E. T., Keeney‐Kennicutt, W., Cifuentes, L., Kwok, O. M., & Davis, T. J. (2013). Exploring 3‐D virtual reality technology for spatial ability and chemistry achievement. Journal of Computer Assisted Learning, 29(6), 579-590.
• Miles, M. B., & Huberman, A. M. (1994). Qualitative data analysis: An expanded sourcebook (2nd ed.). Thousand Oaks: Sage Publications.
• Pan, Z., Cheok, A. D., Yang, H., Zhu, J., & Shi, J. (2006). Virtual reality and mixed reality for virtual learning environments. Computers & graphics, 30(1), 20-28.
• Pantelidis, V. S. (2010). Reasons to use virtual reality in education and training courses and a model to determine when to use virtual reality. Themes in Science and Technology Education, 2(1-2), 59-70.
• Patton, M.Q (2018). Nitel Araştırma ve Değerlendirme Yöntemleri (Çev. Ed.: Mesut BÜTÜN ve Selçuk Beşir DEMİR). Pegem Akademi: Ankara
• Petitti, D. B. (2001). Approaches to heterogeneity in meta‐analysis. Statistics in medicine, 20(23), 3625-3633.
• Rosenthal, R., & DiMatteo, M. R. (2002). Meta‐analysis. Stevens' handbook of experimental psychology.
• Sakdavong, J. C., Burgues, M., & Huet, N. (2019, May). Virtual Reality in Self-regulated Learning: Example in Art Domain. In CSEDU (2) (pp. 79-87).
• Sanchez-Vives, M. V., & Slater, M. (2005). From presence to consciousness through virtual reality. Nature Reviews Neuroscience, 6(4), 332-339.
• *Sarıoglu, S. & Girgin, S. (2020). The Effect of Using Virtual Reality in 6th Grade Science Course the Cell Topic on Students’ Academic Achievements and Attitudes Towards the Course. Journal of Turkish Science Education, 17 (1), 109-125.
• Schwind, V., Knierim, P., Haas, N., & Henze, N. (2019, May). Using presence questionnaires in virtual reality. In Proceedings of the 2019 CHI conference on human factors in computing systems (pp. 1-12).
• *Selzer, M. N., Gazcon, N. F., & Larrea, M. L. (2019). Effects of virtual presence and learning outcome using low-end virtual reality systems. Displays, 59, 9-15.
• *Shi, A., Wang, Y., & Ding, N. (2019). The effect of game–based immersive virtual reality learning environment on learning outcomes: designing an intrinsic integrated educational game for pre–class learning. Interactive Learning Environments, 1-14.
• Slater, M., & Sanchez-Vives, M. V. (2016). Enhancing our lives with immersive virtual reality. Frontiers in Robotics and AI, 3, 74. *Smith, S. J., Farra, S. L., Ulrich, D. L., Hodgson, E., Nicely, S., & Mickle, A. (2018). Effectiveness of two varying levels of virtual reality simulation. Nursing education perspectives, 39(6), E10-E15.
• Soeken, K. L., & Sripusanapan, A. (2003). Assessing publication bias in meta-analysis. Nursing research, 52(1), 57-60.
• Sterne, J. A., Becker, B. J., & Egger, M. (2005). The funnel plot. Publication bias in meta-analysis: Prevention, assessment and adjustments, 75-98.
• Sutton, A. J., Song, F., Gilbody, S. M., & Abrams, K. R. (2000). Modelling publication bias in meta-analysis: a review. Statistical methods in medical research, 9(5), 421-445.
• *Tai, T. Y., Chen, H. H. J., & Todd, G. (2020). The impact of a virtual reality app on adolescent EFL learners’ vocabulary learning. Computer Assisted Language Learning, 1-26.
• *Tepe, T. (2019). Başa Takılan Görüntüleyiciler İçin Geliştirilmiş Sanal Gerçeklik Ortamlarının Öğrenme ve Buradalık Algısı Üzerine Etkilerinin İncelenmesi. Yayımlanmamış Doktora Tezi. Hacettepe Üniversitesi. Eğitim Bilimleri Enstitüsü. Ankara
• *Topuz, Y. (2018). Anatomi eğitiminde sanal gerçeklik ve üç boyutlu masaüstü materyallerin akademik başarı ve bilişsel yük açısından karşılaştırılması. Yüksek Lisans Tezi, Marmara Üniversitesi, Eğitim Bilimler Enstitüsü, Bilgisayar ve Öğretim Teknolojileri Eğitimi Ana Bilim Dalı, İstanbul.
• UNESCO (2018). UNESCO ICT Competency Framework for Teachers.
• Vincent, D. S., Sherstyuk, A., Burgess, L., & Connolly, K. K. (2008). Teaching mass casualty triage skills using immersive three‐dimensional virtual reality. Academic Emergency Medicine, 15(11), 1160-1165.
• *Wang, T. (2017). The effect of virtual reality on learning motivation and academic performance. Unpublished mastery thesis. Emporia State University.
• Weber, R. P. (1990). Basic content analysis (No. 49). Sage.
• Wiederhold, B. K., & Wiederhold, M. D. (2005). Virtual reality therapy for anxiety disorders: Advances in evaluation and treatment. American Psychological Association.
• Wu, B., Yu, X. & Gu, X. (2020). Effectiveness of immersive virtual reality using head‐mounted displays on learning performance: A meta‐analysis. British Journal of Educational Technology, 51(6), 1991-2005.
• Xu, Z., Lu, X. Z., Guan, H., Chen, C., & Ren, A. Z. (2014). A virtual reality based fire training simulator with smoke hazard assessment capacity. Advances in engineering software, 68, 1-8.
• Yıldırım, A., & Şimşek, H. (2006). Sosyal Bilimlerde Nitel Araştırma Yöntemleri. Seçkin Yayıncılık: Ankara
• *Yildirim, B., Sahin-Topalcengiz, E., Arikan, G., & Timur, S. (2020). Using virtual reality in the classroom: Reflections of STEM teachers on the use of teaching and learning tools. Journal of Education in Science, Environment and Health (JESEH), 6(3), 231-245. DOI:10.21891/jeseh.711779
• Zhang, K., Suo, J., Chen, J., Liu, X., & Gao, L. (2017, September). Design and implementation of fire safety education system on campus based on virtual reality technology. In 2017 Federated Conference on Computer Science and Information Systems (FedCSIS) (pp. 1297-1300). IEEE.
• Zheng, J. M., Chan, K. W., & Gibson, I. (1998). Virtual reality. Ieee Potentials, 17(2), 20-23.
• *Zhou, Y., Ji, S., Xu, T., & Wang, Z. (2018). Promoting knowledge construction: a model for using virtual reality interaction to enhance learning. Procedia computer science, 130, 239-246.