The Effect of Augmented Reality Use on Achievement, Misconception and Course Engagement

Abstract

Augmented reality is defined as a technology in which real world and virtual objects are combined with a simultaneous interaction. The aim of this study is to determine the effect of augmented reality use on students' achievement, misconception and course engagement. A (matched) quasi-experimental research design with both pretest and posttest control groups was used in the study.  The sample of the study consisted of 118 seventh grade students receiving education in six different classes. The students in the experimental group took their lessons with an augmented reality learning material, while the students in the control group continued using their traditional course materials. An achievement test, a misconception test and the student course engagement questionnaire were used as data collection tools. As a result of a 7-week implementation, this study found that augmented reality technology increased the achievement level of students and eliminated their misconceptions. However, the study also found that augmented reality technology did not affect the course engagement of students.

Keywords

• Augmented reality,Achievement,Misconception,Course engagement,Astronomy education

References

1. Abdusselam, M. S. & Karal, H. (2012). The effect of mixed reality environments on the students’ academic achievement in physics education: 11th grade magnetism topic example. Journal of Research in Education and Teaching, 1(4), 170-181.
2. Akcayir, M., Akcayir, G., Pektas, H. M., & Ocak, M. A. (2016). Augmented reality in science laboratories: The effects of augmented reality on university students’ laboratory skills and attitudes toward science laboratories. Computers in Human Behavior, 57, 334-342.
3. Akcayir, M., Akcayir, G. (2017). Advantages and challenges associated with augmented reality for education: A systematic review of the literature. Educational Research Review, 20, 1-11.
4. Aktamis, H. & Arici, V. A. (2013). The effects of using virtual reality software in teaching astronomy subjects on academic achievement and retention. Mersin University Faculty of Education Journal, 9(2), 58-70.
5. Azuma, R. (1997). A survey of augmented reality. Presence: Teleoperators and Virtual Environments, 6(4), 355-385. http://doi.org/10.1.1.30.4999
6. Bai, Z., Blackwell, F., & Coulouris, G. (2013). Through the looking glass: Pretend play for children with autism. IEEE International Symposium on Mixed and Augmented Reality (pp. 49-58). Adelaide, Australia. DOI: 10.1109/ISMAR.2013.6671763
7. Billinghurst, M., Kato, H., & Poupyrev, I. (2001). The MagicBook - moving seamlessly between reality and virtuality. IEEE Computer Graphics and Applications, 21)3). DOI: 10.1109/38.920621
8. Bujak, K. R., Radu, I., Catrambone, R., MacIntyre, B., Zheng, R., & Golubski, G. (2013). A psychological perspective on augmented reality in the mathematics classroom. Computers & Education, 68, 536-544.

9. Buyukozturk, S. (2007). Sosyal bilimler icin veri analizi el kitabı. Ankara: PegemA.
10. Buyukozturk, S., Kilic Cakmak, E., Akgun, O., E., Karadeniz, ŞS., & Demirel, F. (2008). Bilimsel arastirma yontemleri. Ankara: Pegem Akademi.
11. Cai, H. (2013). Using augmented reality as motivators for youth enviromental education: An American Harts’s tongue fern conservation project (Unpublished master’s thesis). State University of New York.
12. Cai, S., Chiang, F.-K., & Wang, X. (2013). Using the augmented reality 3D technique for a convex imaging experiment in a physics course. International Journal of Engineering Education, 29(4), 856-865.
13. Cai, S., Chiang, F. K., Sun, Y., Lin, C., & Lee, J. J. (2017). Applications of augmented reality-based natural interactive learning in magnetic field instruction. Interactive Learning Environments, 25(6), 778-791.
14. Cai, S., Wang, X., & Chiang, F.-K. (2014). A case study of augmented reality simulation system application in a chemistry course. Computers in Human Behavior, 37, 31-40. http://doi.org/http://dx.doi.org/10.1016/j.chb.2014.04.018
15. Chang, Y.-J., Chen, C.-H., Huang, W.-T., & Huang, W.-S. (2011). Investigating students’ perceived satisfaction, behavioral intention, and effectiveness of English learning using augmented reality. Multimedia and Expo (ICME), (pp. 1-6). Barcelona, Spain: IEEE.
16. Chen, C. H., Yang, J. C., Shen, S., & Jeng, M. C. (2007). A desktop virtual reality earth motion system in astronomy education. Journal of Educational Technology & Society, 10(3), 289-304.
17. Chen, Y.-C. (2006). A study of comparing the use of augmented reality and physical models in chemistry education. Proceedings of the 2006 ACM international conference on virtual reality continuum and its applications (pp. 369-372).
18. Cheng, K.-H. & Tsai, C.-C. (2013). Affordances of augmented reality in science learning: Suggestions for future research. Journal of Science Education and Technology, 22(4), 449-462.
19. Chiras, A. (2008). Day/Night Cycle: Mental models of primary school children. Science Education International, 19(1), 65-83.
20. Chiu, J. L., DeJaegher, C. J., & Chao, J. (2015). The effects of augmented virtual science laboratories on middle school students’ understanding of gas properties. Computers & Education, 85, 59-73.
21. Cin, M. (2007). Alternative views of the solar system among Turkish students. International Review of Education, 53(1), 39-53.
22. De Ravé, E. G., Jiménez-Hornero, F. J., Ariza-Villaverde, A. B., & Taguas-Ruiz, J. (2016). DiedricAR: a mobile augmented reality system designed for the ubiquitous descriptive geometry learning. Multimedia Tools and Applications, 75(16), 9641-9663.
23. Delello, J. A. (2014). Insights from pre-service teachers using science-based augmented reality. Journal of Computers in Education, 1(4), 295-311.
24. Dunleavy, M., Dede, C., & Mitchell, R. (2009). Affordances and limitations of immersive participatory augmented reality simulations for teaching and learning. Journal of Science Education and Technology, 18(1), 7-22.
25. Eursch, A. (2007). Increased safety for manual tasks in the field of nuclear science using the technology of augmented reality. 2007 IEEE Nuclear Science Symposium Conference Record (Vol. 3, pp. 2053–2059). IEEE.
26. Fleck, S. & Simon, G. (2013). An augmented reality environment for astronomy learning in elementary Grades: an exploratory study. 25. Conference Francophone sur l’Interaction Homme-Machine, IHM’13. Bordeaux, France: ACM.
27. Fleck, S., Hachet, M., & Bastien, C. (2015). Marker-based augmented reality: Instructional-design to improve children interactions with astronomical concepts. International Conference on Interaction Design and Children. Medford, MA: ACM. http://dx.doi.org/10.1145/2771839. 2771842
28. Fleck, S., Simon, G., & Christian Bastien, J. M. (2014). AIBLE: An inquiry-based augmented reality environment for teaching astronomical phenomena. 2014 IEEE International Symposium on Mixed and Augmented Reality - Media, Art, Social Science, Humanities and Design (IMSAR-MASH’D) (pp. 65-66). IEEE.
29. George, D. & Mallery, M. (2010). SPSS for windows step by step: A simple guide and reference. Boston: Pearson.
30. Goncu, O. (2013). Determining of astronomical misconception in fifth and seventh grade students (Unpublished master’s thesis). Mehmet Akif Ersoy University, Burdur, Turkey.
31. Goncu, O., & Korur, F. (2012). Ilkogretim ogrencilerinin astronomi temelli unitelerdeki kavram yanilgilarinin uc asamali test ile tespit edilmesi. X. National Science & Matmematis Education Conference. Retrieved on 4 March 2018 from http://kongre.nigde.edu.tr/xufbmek/dosyalar/ tam_metin/pdf/2536-01_06_2012-16_35_38.pdf
32. Gurer, M. D. (2013). Utilization of learning objects in social studies session: Achievement, attitude and engagement. (Unpublished doctoral dissertation). Middle East Technical University, Ankara, Turkey.
33. Handelsman, M. M., Briggs, W. L., Sullivan, N., & Towler, A. (2005). A measure of college student course engagement. The Journal of Educational Research, 98(3), 184-192.
34. Hartma, N. W., & Bertoline, G. R. (2005). Spatial abilities and virtual technologies: Examining the computer graphics learning environment. Ninth International Conference on Information Visualisation. London: IEEE.
35. Heywood, D., Parker, J., & Rowlands, M. (2013). Exploring the visuospatial challenge of learning about day and night and the sun’s path. Dience Education, 97(5), 772-796.
36. Hsu, T.C. (2017). Learning English with augmented reality: Do learning styles matter? Computers & Education, 106, 137-149.
37. Ibáñez, M. B. & Delgado-Kloos, C. (2018). Augmented reality for STEM learning: A systematic review. Computers & Education, 123, 109-123.
38. Ivanova, M. & Ivanov, G. (2011). Enhancement of learning and teaching in computer graphics through marker augmented reality technology. International Journal of New Computer Architectures and Their Applications (IJNCAA), 1(1), 176-184.
39. Ibili, E. (2013). Geometri dersi icin artirilmis gerceklik materyallerinin gelistirilmesi, uygulanmasi ve etkisinin değerlendirilmesi (Unpublished doctoral dissertation). Gazi University, Ankara, Turkey.
40. Karal, H., & Abdusselam, M. S. (2015). Artirilmis gerceklik. In B. Akkoyunlu, A. Isman, & F. Odabaşı (Eds.), Eğitim Teknolojileri Okumaları (pp. 149-176). Ankara: TOJET.
41. Kaufmann, H. (2003). Collaborative augmented reality in education. Institute of Software Technology and Interactive Systems, Vienna University of Technology.
42. Kaufmann, H. & Schmalstieg, D. (2003). Mathematics and geometry education with collaborative augmented reality. Computers & Graphics, 27(3), 339-345.
43. Kerawalla, L., Luckin, R., Seljeflot, S., & Woolard, A. (2006). Making it real: exploring the potential of augmented reality for teaching primary school science. Virtual Reality, 10(3-4), 163-174.
44. Kucuk, S., Yilmaz, R. M., Baydas, O., & Goktas, Y. (2014). Augmented reality applications attitude scale in secondary schools: Validity and reliability study. Education and Science, 39(176), 383–392.
45. Kucuk, S., Yilmaz, R., & Yuksel, G. (2014). Augmented reality for learning English: Achievement, attitude and cognitive load levels of students. Education and Science, 39(176), 393-404.
46. Lau, N., Oxley, A., & Nayan, M. Y. (2012). An augmented reality tool to aid understanding of protein loop configuration. Computer & Information Science (ICCIS), 2012 International Conference on (Vol. 1, pp. 500-505).
47. Lin, C.-Y., Chai, H.-C., Wang, J., Chen, C.-J., Liu, Y.-H., Chen, C.-W., … Huang, Y.-M. (2016). Augmented reality in educational activities for children with disabilities. Displays, 42, 51-54.
48. Matcha, W. & Rambli, D. R. A. (2013). Exploratory study on collaborative interaction through the use of augmented reality in science learning. Procedia Computer Science, 25, 144-153.
49. Medicherla, P. S., Chang, G., & Morreale, P. (2010). Visualization for increased understanding and learning using augmented reality. Proceedings of the International Conference on Multimedia Information Retrieval (pp. 441-444). New York, NY, USA: ACM. http://doi.org/10.1145/ 1743384.1743462
50. Núñez, M., Quirós, R., Núñez, I., Carda, J. B., Camahort, E., Mauri, J. L., … others. (2008). Collaborative augmented reality for inorganic chemistry education. WSEAS International Conference. Proceedings-Mathematics and Computers in Science and Engineering. Heraklion, Greece: ACM Digital Library.
51. Ozturk, A., & Doganay, A. (2013). Primary school 5th and 8th graders’ understanding and mental models about the shape of the world and gravity. Educational Sciences: Theory & Practice, 13(4), 2469-2476.
52. Parnafes, O. (2012). Developing Explanations and Developing Understanding: Students Explain the Phases of the Moon Using Visual Representations. Cognition and Instruction, 30(4), 359-403.
53. Perez-Lopez, D., & Contero, M. (2013). Delivering educational multimedia contents through an augmented reality application: A case study on its impact on knowledge acquisition and retention. Turkish Online Journal of Educational Technology, 12(4), 19-28.
54. Piaget, J. (1976). Piaget’s theory. Berlin Heidelberg: Springer.
55. Rambli, D. R. A., Matcha, W., & Sulaiman, S. (2013). Fun learning with AR alphabet book for preschool children. Procedia Computer Science, 25, 211-219.
56. Rosenbaum, E., Klopfer, E., & Perry, J. (2006). On location learning: Authentic applied science with networked augmented realities. Journal of Science Education and Technology, 16(1), 31-45.
57. Schmalstieg, D., Fuhrmann, A., Hesina, G., Szalavari, Z., Encarnaçao, L. M., Gervautz, M., & Purgathofer, W. (2002). The studierstube augmented reality project. Presence: Teleoperators and Virtual Environments, 11(1), 33-54.
58. Schrier, K. (2006). Using augmented reality games to teach 21st century skills. ACM SIGGRAPH 2006 Educators program on - SIGGRAPH ’06 (p. 15). Boston, MA: ACM Digital Library.
59. Seferoglu, S. S. (2009). Ilkogretim okullarinda teknoloji kullanimi ve yoneticilerin bakis aciları. Akademik Bilişim ’09 (pp. 403–410). Şanlıurfa, Turkey.
60. Shelton, B. E. & Hedley, N. R. (2002). Using augmented reality for teaching earth-sun relationships to undergraduate geography students: Augmented reality toolkit. The First IEEE International Workshop (pp. 8). Darmstadt, Germany.
61. Shelton, B. E. & Stevens, R. (2004). Using coordination classes to interpret conceptual change in astronomical thinking. Proceedings of the 6th international conference for the learning sciences. Mahweh, NJ: Lawrence Erlbaum & Associates.
62. Sirakaya, M. (2015). Effects of augmented reality applications on students' achievement, misconceptions and course engagement (Unpublished doctoral dissertation). Gazi University, Ankara, Turkey.
63. Sin, A. K. & Badioze Zaman, H. (2009). Tangible interaction in learning astronomy through augmented reality book-based educational tool. Lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics) (Vol. 5857, pp. 302-313). Berlin-Heidelberg: Springer.
64. Sin, A. K., & Zaman, H. B. (2010). Live Solar System (LSS): Evaluation of an Augmented Reality book-based educational tool. 2010 International Symposium on Information Technology (Vol. 1, pp. 1–6). IEEE.
65. Singhal, S., Bagga, S., Goyal, P., & Saxena, V. (2012). Augmented chemistry: Interactive education system. International Journal of Computer Applications, 49(15), 1-5.
66. Skinner, E. A., Kinderman, T. A., & Furrer, C. J. (2009). A motivational perspective on engagement and disaffection: Conceptualization and assessment of children’s behavioral and emotional participation in academic activities in the classroom. Educational and Psychological Measurement, (69), 493-525.
67. Soga, M., Matsui, K., Takaseki, K., & Tokoi, K. (2008). Interactive learning environment for astronomy with finger pointing and augmented reality. 2008 Eighth IEEE International Conference on Advanced Learning Technologies (pp. 542-543). Santander, Cantabria, Spain.
68. Sotiriou, S. & Bogner, F. X. (2008). Visualizing the Invisible: augmented reality as an innovative science education scheme. Journal of Computational and Theoretical Nanoscience, 1(1), 114-122.
69. Squire, K. D. & Jan, M. (2007). Mad city mystery: Developing scientific argumentation skills with a place-based augmented reality game on handheld computers. Journal of Science Education and Technology, 16(1), 5-29.
70. Sumadio, D. D. & Rambli, D. R. A. (2010). Preliminary evaluation on user acceptance of the augmented reality use for education. Proceedings of Second International Conference on Computer Engineering and Applications (pp. 461–465). Retrieved on 4 March 2018 from https://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=5445691
71. Sun, K.-T., Lin, C.-L., & Wang, S.-M. (2010). A 3-d vırtual realıty model of the sun and the moon for e-learnıng at elementary schools. International Journal of Science and Mathematics Education, 8(4), 689-710.
72. Tian, K., Endo, M., Urata, M., Mouri, K., & Yasuda, T. (2013). Ubiquitous augmented reality mobile learning system for supporting moon observation. The International Conference on Business and Information (pp. 223–242). Retrieved on 4 March 2018 from https://pdfs.semanticscholar. org/e44a/83db642f5398ea883146e9e8264ca8615092.pdf
73. Tian, K., Endo, M., Urata, M., Mouri, K., & Yasuda, T. (2014). Multi-viewpoint smartphone AR-based learning system for astronomical observation. International Journal of Computer Theory and Engineering, 6(5), 396-400.
74. Tomi, A. & Rambli, D. R. A. (2013). An interactive mobile augmented reality magical playbook: Learning number with the thirsty crow. Procedia Computer Science, 25, 123-130.
75. Turk, C., Alemdar, M., & Kalkan, H. (2012). Ilkogretim ogrencilerinin mevsimler konusunu kavrama duzeylerinin saptanmasi. Journal of Educational and Instructional Studies in the World, 2(1), 62-67.
76. Vilkoniene, M. (2009). Influence of augmented reality technology upon pupils’ knowledge about human digestive system: The results of the experiment. Online Submission, 6(1), 36-43.
77. Vygotsky, L., Hanfmann, E., & Vakar, G. (2012). Thought and language. Cambridge, MA: MIT.
78. Wang, Y.-H. (2017). Exploring the effectiveness of integrating augmented reality-based materials to support writing activities. Computers & Education, 113, 162-176.
79. Wang, Z., Bergin, C., & Bergin, D. A. (2014). Measuring engagement in fourth to twelfth grade classrooms: The classroom engagement inventory. School Psychology Quarterly, 29(4), 517-35.
80. Wojciechowski, R. & Cellary, W. (2013). Evaluation of learners’ attitude toward learning in ARIES augmented reality environments. Computers & Education, 68, 570-585.
81. Wu, H.-K., Lee, S. W.-Y., Chang, H.-Y., & Liang, J.-C. (2013). Current status, opportunities and challenges of augmented reality in education. Computers & Education, 62, 41-49.
82. Yagbasan, R., & Gulcicek, C. (2003). Describing the characteristics of misconceptions in science teaching. Pamukkale University Journal of Education 1(3), 102-120.
83. Yen, J. C., Tsai, C. H., & Wang, J. Y. (2012). The effects of augmented reality on students’ moon phases concept learning and their conceptual changes of misconception. 2012 International Conference on Business and Information. Sapporo, Japan.
84. Yen, J.-C., Tsai, C.-H., & Wu, M. (2013). Augmented reality in the higher education: Students’ science concept learning and academic achievement in astronomy. Procedia - Social and Behavioral Sciences, 103, 165-173.
85. Yilmaz, R. M. (2016). Educational magic toys developed with augmented reality technology for early childhood education. Computers in Human Behavior, 54, 240-248.
86. Yoon, S., Anderson, E., Lin, J., & Elinich, K. (2017). How augmented reality enables conceptual understanding of challenging science content. Educational Technology & Society, 20 (1), 156-168.
87. Yuen, S., Yaoyuneyong, G., & Johnson, E. (2011). Augmented reality: An overview and five directions for AR in education. Journal of Educational Technology Development and Exchange, 4(1), 119-140.
88. Yusoff, Z. & Dahlan, H. M. (2013). Mobile based learning: An integrated framework to support learning engagement through augmented reality environment. Research and Innovation in Information Systems (ICRIIS), (pp. 251–256). Kuala Lumpur, Malaysia: IEEE.
89. Zarzuela, M. M., Pernas, F. J. D., Martínez, L. B., Ortega, D. G., & Rodríguez, M. A. (2013). Mobile serious game using augmented reality for supporting children’s learning about animals. Procedia Computer Science, 25, 375-381.
90. Zhang, J., Sung, Y.-T., Hou, H.-T., & Chang, K.-E. (2014). The development and evaluation of an augmented reality-based armillary sphere for astronomical observation instruction. Computers & Education, 73, 178-188.
91. Zimmerman, H. T., Land, S. M., & Jung, Y. J. (2016). Using augmented reality to support children’s situational interest and science learning during context-sensitive informal mobile learning. In A. Peña-Ayala (Ed.), Mobile, ubiquitous, and pervasive learning: Fundaments, applications, and trends (pp. 101–119). Switzerland: Springer International.