The Effects of Augmented Reality in the Technical Drawing Course on Engineering Students' Spatial Ability and Academic Achievement

Abstract

The purpose of this study is to investigate the effects of Augmented Reality (AR) intervention on students' spatial skills and academic achievement. The study was conducted in a freshman technical drawing course at Mechanical Engineering Department. An exploratory quasi-experimental method was used for the study. The study was conducted in two groups (Experiment-Control) as a quasi-experimental pre-post design. The pre-test results were used only to determine the control group and the experimental group. The research process was conducted within a four-week experimental period, including a one-week pilot study. The researchers and lecturers who are recognised experts prepared the instruments. The drawings of the experimental and control groups were evaluated using the evaluation criteria prepared by the two expert lecturers of the course. In the evaluation, two types of scores were given to the students, namely "Academic Achievement Score" and "Spatial Ability Score". Using ANOVA, the effects of AR intervention on students' spatial skills and academic performance were examined over three experimental periods. There was a significant main effect for both groups with a large effect size (η2=.253). However, it was found that there was no significant effect between the control group and the experimental group on spatial skills. However, it was found that there was a significant interaction effect providing the interaction between time and group on spatial abilities. In addition, no statistically significant difference was found between the academic performance of the experimental group and the control group and no significant difference was found in the weekly measurements of the groups. It was suggested that AR applications are very useful for students' spatial skills in technical drawing.

Keywords

• Augmented Reality
• Spatial Ability
• Virtual environments
• Technical drawing

References

1. Ada´nez, G. P., & Velasco, A. D. (2002). Predicting academic success of engineering students in technical drawing from visualization test scores. Journal of Geometry and Graphics. 6(1): 99–109. Retrieved from http://www.heldermann-verlag.de/jgg/jgg06/jgg0608.pdf.
2. Akkuş, İ., & Özhan, U. (2017). Matematik ve geometri eğitiminde artırılmış gerçeklik uygulamaları. İnönü Üniversitesi Eğitim Bilimleri Enstitüsü Dergisi, 4(8), 19-33.
3. Akçayır, M., & Akçayır, G. (2017). Advantages and challenges associated with augmented reality for education: A systematic review of the literature. Educational Research Review, 20, 1-11.
4. Arth, C., & Schmalstieg, D. (2011). Challenges of large-scale augmented reality on smartphones. Graz University of Technology, Graz, 1-4. doi: 10.1.1.420.2414
5. Aydın, M. (2005). Educational Leadership, Ankara: Hatipoğlu Publications.
6. Azuma, R. T. (1999). The challenge of making augmented reality work outdoors. Mixed reality: Merging real and virtual worlds, 379-390.
7. Azuma, R. T. (2001). Augmented reality: Approaches and technical challenges. Fundamentals of wearable computers and augmented reality, 27-63.
8. Backfisch, I., Lachner, A., Stürmer, K., & Scheiter, K. (2021). Variability of teachers’ technology integration in the classroom: A matter of utility!. Computers & Education, 166, 104159.

9. Basham, K. L., & Kotrlik, J. W. (2008). The effects of 3-dimensional CADD modeling on the development of the spatial ability of technology education students. Journal of technology education, 20(1), 32-47.
10. Bennett, G., & Seashore, H. (1973). Differential aptitude tests, forms S and T: The Psychological Corporation, New York.
11. Berkemeier, L., Zobel, B., Werning, S., Ickerott, I., & Thomas, O. (2019). Engineering of augmented reality-based information systems. Business & Information Systems Engineering, 61(1), 67-89.
12. Billinghurst, M., Clark, A., & Lee, G. (2015). A survey of augmented reality. Retrieved from http://ir.canterbury.ac.nz/handle/10092/15494
13. Borrero, A. M., & Márquez, J. A. (2012). A pilot study of the effectiveness of augmented reality to enhance the use of remote labs in electrical engineering education. Journal of science education and technology, 21(5), 540-557. doi:10.1007/s10956-011-9345-9
14. Bujak, K., Radu, I., Catrambone, C., MacIntyre, B., Zheng, R. & Golubski, G. (2013). A psychological perspective on augmented reality in the mathematics classroom. Computers and Education, 68, 536–544. http://dx.doi.org/10.1016/j.compedu.2013.02.017
15. Çağıltay, N. E. (2016). Using Technology in Engineering Education. (Ed: Çağıltay, K. ve Göktaş, Y.), The Base of Instructional Technologies: Theories, Researches, Approaches. (2th Ed.) Ankara: Pegem Akademi, 613-632.
16. Cai, S., Chiang, F. K., & Wang, X. (2013). Using the augmented reality 3D technique for a convex imaging experiment in a physics course. International Journal of Engineering Education, 29(4), 856-865.
17. Carbonell Carrera, C., & Bermejo Asensio, L. A. (2017). Augmented reality as a digital teaching environment to develop spatial thinking. Cartography and geographic information science, 44(3), 259-270.
18. Cardoso, O.I., Unver, E., Aslan, R., Kus, A., & Chotrov, D. (2019). Application of VR and AR Tools for Technical Drawing Education. Computer-Aided Design and Applications. https://doi.org/10.14733/cadaps.2020.836-849
19. Carmigniani, J., Furht, B., Anisetti, M., Ceravolo, P., Damiani, E., & Ivkovic, M. (2011). Augmented reality technologies, systems and applications. Multimedia tools and applications, 51(1), 341-377.
20. Chang, Y. J., Chen, C. H., Huang, W. T., & Huang, W. S. (2011). Investigating students' perceived satisfaction, behavioral intention, and effectiveness of English learning using augmented reality. In 2011 IEEE International Conference on Multimedia and Expo (pp. 1-6). IEEE. doi: 10.1109/ICME.2011.6012177 Chi, H. L., Kang, S. C., & Wang, X. (2013). Research trends and opportunities of augmented reality applications in architecture, engineering, and construction. Automation in construction, 33, 116-122.
21. Cipresso, P., Giglioli, I. A. C., Raya, M. A., & Riva, G. (2018). The past, present, and future of virtual and augmented reality research: a network and cluster analysis of the literature. Frontiers in psychology, 9, 2086.
22. Cohen, C. A., & Hegarty, M. (2014). Visualizing cross sections: Training spatial thinking using interactive animations and virtual objects. Learning and Individual Differences, 33, 63-71.
23. Cohen, J. (1988). Statistical Power analysis for the behavior science. Hillsdale, NJ: ERLbaum. (pp. 273-406). http://dx.doi.org/10.1016/B978-0-12-179060-8.50013-X
24. Cumaoglu, G., Sacici, E., & Torun, K. (2013). E-book versus printed materials: Preferences of university students. Contemporary educational technology, 4(2), 121-135.
25. Deshpande, A., & Kim, I. (2018). The effects of augmented reality on improving spatial problem solving for object assembly. Advanced Engineering Informatics, 38, 760-775.
26. Di Serio, Á., Ibáñez, M. B., & Kloos, C. D. (2013). Impact of an augmented reality system on students' motivation for a visual art course. Computers & Education, 68, 586-596. http://dx.doi.org/10.1016/j.compedu.2012.03.002.
27. Dini, G., & Dalle Mura, M. (2015). Application of augmented reality techniques in through-life engineering services. Procedia Cirp, 38, 14-23.
28. Dunleavy, M., Dede, C., & Mitchell, R. (2009). Affordances and limitations of immersive participatory augmented reality simulations for teaching and learning. Journal of Science Education and Technology, 18(1), 7‐22. doi:10.1007/s10956-008-9119-1
29. Dünser, A., Steinbügl, K., Kaufmann, H., & Glück, J. (2006, July). Virtual and augmented reality as spatial ability training tools. In Proceedings of the 7th ACM SIGCHI New Zealand chapter's international conference on Computer-human interaction: design centered HCI (pp. 125-132). ACM. doi: 10.1145/1152760.1152776
30. Eliot, J. (1980). Classification of figural spatial tests. Perceptual and Motor Skills, 51(3), 847-851.
31. Enzai, N. I. M., Ahmad, N., Ghani, M. A. H. A., Rais, S. S., & Mohamed, S. (2021). Development of Augmented Reality (AR) for Innovative Teaching and Learning in Engineering Education. Asian Journal of University Education, 16(4), 99-108.
32. Fakhry, M., Kamel, I., & Abdelaal, A. (2021). CAD using preference compared to hand drafting in architectural working drawings coursework. Ain Shams Engineering Journal. https://doi.org/10.1016/j.asej.2021.01.016
33. Feisel, L. D., & Rosa, A. J. (2005). The role of the laboratory in undergraduate engineering education. Journal of Engineering Education, 94(1), 121-130. doi: 10.1002/j.2168-9830.2005.tb00833.x
34. Fonseca, D., Martí, N., Redondo, E., Navarro, I., & Sánchez, A. (2014). Relationship between student profile, tool use, participation, and academic performance with the use of Augmented Reality technology for visualized architecture models. Computers in Human Behavior, 31, 434-445. http://dx.doi.org/10.1016/j.chb.2013.03.006
35. Fraenkel, J. R., & Wallen, N. E. (2003). The nature of qualitative research. In a How to design and evaluate research in education (pp. 429-449). New York: McGraw-Hill.
36. Fung*, Y. Y. (2005). Teachers' views on and use of printed materials in a distance learning teacher education course. Open Learning: The Journal of Open, Distance and e-Learning, 20(2), 175-183.
37. Gluck, J., & Fitting, S. (2003). Spatial strategy selection: Interesting incremental information. International Journal of Testing, 3(3), 293-308.
38. Hartman, N. W., & Bertoline, G. R. (2005). Spatial abilities and virtual technologies: Examining the computer graphics learning environment. Paper presented at the Ninth International Conference on Information Visualisation (IV'05).
39. Hartman, R. J., Townsend, M. B., & Jackson, M. (2019). Educators’ perceptions of technology integration into the classroom: a descriptive case study. Journal of Research in Innovative Teaching & Learning.
40. Hirzer, M. (2008). Marker detection for augmented reality applications. In Seminar/Project Image Analysis. Graz. Retrieved from http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.383.8993
41. Hoe, Z. Y., Lee, I. J., Chen, C. H., & Chang, K. P. (2019). Using an augmented reality-based training system to promote spatial visualization ability for the elderly. Universal Access in the Information Society, 18(2), 327-342.
42. Hsiao, K. F., & Rashvand, H. F. (2011). Integrating body language movements in augmented reality learning environment. Human-centric Computing and Information Sciences, 1(1), 1-10. doi: 10.1186/2192-1962-1-1
43. Gómez-Tone, H. C., Martin-Gutierrez, J., Valencia Anci, L., & Mora Luis, C. E. (2020). International comparative pilot study of spatial skill development in engineering students through autonomous augmented reality-based training. Symmetry, 12(9), 1401.
44. İbili, E. (2013). Development, implementation and assessment of the effect augmented reality on geometry teaching materials for geometry classes. Ankara, Turkey: Gazi University. (Unpublished PhD Dissertation).
45. Kan, T. W., Teng, C. H., & Chou, W. S. (2009, December). Applying QR code in augmented reality applications. In Proceedings of the 8th International Conference on Virtual Reality Continuum and its Applications in Industry (pp. 253-257). ACM. doi:10.1145/1670252.1670305
46. Kato, H., & Billinghurst, M. (1999). Marker tracking and HMD calibration for a video-based augmented reality conferencing system. In Augmented Reality, 1999. (IWAR'99) Proceedings. 2nd IEEE and ACM International Workshop on (pp. 85-94). IEEE. doi: 10.1109/IWAR.1999.803809
47. Kaufmann, H., & Dünser, A. (2007, July). Summary of usability evaluations of an educational augmented reality application. Springer Berlin Heidelberg. (pp. 660-669). doi: 10.1007/978-3-540-73335-5_71
48. Kelly, W.F., Branoff, T.J., & Clark, A. (2014). Spatial Ability Measurement in an Introductory Graphic Communications Course. Proc. 121st Annual ASEE. American Society for Engineering Education
49. Kerawalla, L., Luckin, R., Seljeflot, S., & Woolard, A. (2006). Making it real: Exploring the potential of augmented reality for teaching primary school science. Virtual Reality, 10 (3-4), 163-174. doi:10.1007/s10055-006-0036-4
50. Kim, J., & Irizarry, J. (2020). Evaluating the use of augmented reality technology to improve construction management student’s spatial skills. International Journal of Construction Education and Research, 1-18.
51. Kirner, T. G., Reis, F. M. V., & Kirner, C. (2012, June). Development of an interactive book with Augmented Reality for teaching and learning geometric shapes. In Information Systems and Technologies (CISTI), 2012 7th Iberian Conference on (pp. 1-6). IEEE. ISBN: 978-989-96247-7-1
52. Kreijns, K., Acker, F., Vermeulen M., & Buuren, H. (2013). What stimulates teachers to integrate ICT in their pedagogical practices? The use of digital learning materials in education. Computers in Human Behavior, Vol. 29, pp. 217-225. http://dx.doi.org/10.1016/j.chb.2012.08.008
53. Küçük, S. (2015). Effects of learning anatomy via mobile augmented reality on medical students' academic achievement, cognitive load, and views toward implementation. Erzurum, Turkey: Atatürk University. (Unpublished PhD Dissertation).
54. Kwiatek, C., Sharif, M., Li, S., Haas, C., & Walbridge, S. (2019). Impact of augmented reality and spatial cognition on assembly in construction. Automation in Construction, 108, 102935.
55. Leopold, C., Gorska, R. A., & Sorby, S. A. (2001). International experiences in developing the spatial visualization abilities of engineering students. Journal for Geometry and Graphics, 5(1), 81-91.
56. Liarokapis, F., Mourkoussis, N., White, M., Darcy, J., Sifniotis, M., Petridis, P., Basu, A., & Lister, P. F. (2004). Web3D and augmented reality to support engineering education. World Transactions on Engineering and Technology Education, 3(1), 11-14. ISSN 1446-2257
57. Li, W., Nee, A. Y. C., & Ong, S. K. (2017). A state-of-the-art review of augmented reality in engineering analysis and simulation. Multimodal Technologies and Interaction, 1(3), 17.
58. Li, X., Yi, W., Chi, H. L., Wang, X., & Chan, A. P. (2018). A critical review of virtual and augmented reality (VR/AR) applications in construction safety. Automation in Construction, 86, 150-162.
59. Linn, M. C., & Petersen, A. C. (1985). Emergence and characterization of sex differences in spatial ability: A meta-analysis. Child development, 1479-1498.
60. Maier, P. H. (1996). Spatial geometry and spatial ability–How to make solid geometry solid. Paper presented at the Selected papers from the Annual Conference of Didactics of Mathematics.
61. Majoros, A. E., & Neumann, U. (2001, January). Support of Crew Problem Solving and Performance with Augmented Reality. In Bioastronautics Investigators' Workshop, Galveston, (p. 17‐19).
62. Marinakis, A., Mania, K., & Antoniadis, A. (2021). Augmented Reality for CAD-CAM Training Featuring 3D Interactive Geometric Transformations. Computer Aided Design and Applications. https://doi.org/10.14733/cadaps.2021.561-570
63. Martin, S., Diaz, G., Sancristobal, E., Gil, R., Castro, M., & Peire, J. (2011). New technology trends in education: Seven years of forecasts and convergence. Computers & Education, 57(3), 1893-1906. http://dx.doi.org/10.1016/j.compedu.2011.04.003
64. Martin-Gutierrez, J., Guinters, E., & Perez-Lopez, D. (2012). Improving strategy of self-learning in engineering: laboratories with augmented reality. Procedia-Social and Behavioral Sciences, 51, 832-839. http://dx.doi.org/10.1016/j.sbspro.2012.08.249
65. Martin-Gutierrez, J., Luis Saorin, J., Martin-Dorta, N., & Contero, M. (2009). Do video games improve spatial abilities of engineering students? International Journal of Engineering Education, 25(6), 1194-1204.
66. Martín-Gutierrez, J., Saorín, J. L., Contero, M., Alcañiz, M., Pérez-López, D. C., & Ortega, M. (2010). Design and validation of an augmented book for spatial abilities development in engineering students. Computers & Graphics, 34(1), 77-91. http://dx.doi.org/10.1016/j.cag.2009.11.003
67. Menezes, P., Chouzal, F., Urbano, D., & Restivo, T. (2016, September). Augmented reality in engineering. In International Conference on Interactive Collaborative Learning (pp. 221-228). Springer, Cham.
68. McGee, M. G. (1979). Human spatial abilities: Psychometric studies and environmental, genetic, hormonal, and neurological influences. Psychological bulletin, 86(5), 889.
69. Milgram, P., & Kishino, F. (1994). A taxonomy of mixed reality visual displays. IEICE Transactıons on Information and Systems, 77(12), 1321-1329. ISSN: 0916-8532
70. Miller C. A. (1996) Historical review of applied and theoretical spatial visualization publications in engineering graphics. Engineering Design Graphics Journal. 60(3):12–33.
71. Milne, M., Morris, R., Katz, T., Covill, D., & Elton, E. (2014). Culturally Influenced Learning: Why do some Students have Difficulty Visualising in 3D? Paper presented at the DS 78: Proceedings of the 16th International conference on Engineering and Product Design Education (E&PDE14), Design Education and Human Technology Relations, University of Twente, The Netherlands, 04-05.09. 2014.
72. Morosi, F., Carli, I., Caruso, G., Cascini, G., Dhokia, V., & Ben Guefrache, F. (2018). Analysis of co-design scenarios and activities for the development of a spatial-augmented reality design platform. In DS 92: Proceedings of the DESIGN 2018 15th International Design Conference (pp. 381-392).
73. Nicholson, S. (2005). A framework for technology selection in a web-based distance education environment: supporting community-building through richer interaction opportunities. Journal of Education for Library and Information Science, 46(3), 217-233. doi: 10.2307/40323846
74. Nikolaos, T., & Kiyoshi, T. (2010). QR-code calibration for mobile augmented reality applications: linking a unique physical location to the digital world. In ACM SIGGRAPH 2010 Posters (p. 144). ACM. doi: 10.1145/1836845.1836999
75. Noghabaei, M., Heydarian, A., Balali, V., & Han, K. (2020). Trend analysis on adoption of virtual and augmented reality in the architecture, engineering, and construction industry. Data, 5(1), 26.
76. Ong, S. K., & Shen, Y. (2009). A mixed reality environment for collaborative product design and development. CIRP Annals-Manufacturing Technology, 58(1), 139-142. http://dx.doi.org/10.1016/j.cirp.2009.03.020
77. Özdemir, S. (2010). Supporting printed books with multimedia: A new way to use mobile technology for learning. British Journal of Educational Technology, 41(6), E135-E138.
78. Pekdağ, B. (2010). Alternative ways of learning chemistry: animation, simulation, video and multimedia learning. The Journal of Turkish Science Education, 7(2), 79-110.
79. Peng, Q. (2011). Virtual reality technology in product design and manufacturing. Proceedings of the Canadian Engineering Education Association. Retrieved from http://ojs.library.queensu.ca/index.php/PCEEA/article/download/3792/3786
80. Prieto, G., & Velasco, A. D. (2010). Does spatial visualization ability improve after studying technical drawing?. Quality & Quantity, 44(5), 1015-1024. doi:10.1007/s11135-009-9252-9.
81. Rafi, A., Samsudin, K. A., & Ismail, A. (2006). On improving spatial ability through computer-mediated engineering drawing instruction. Journal of educational technology and society, 9(3), 149.
82. Ross, S. M., Morrison, G. R., & Lowther, D. L. (2005). Using experimental methods in higher education research. Journal of Computing in Higher Education, 16(2), 39-64. doi:10.1007/BF02961474.
83. Sahin, A., Top, N., & Delen, E. (2016). Teachers’ first-year experience with chromebook laptops and their attitudes towards technology integration. Technology, Knowledge and Learning, 21(3), 361-378.
84. Sharma, G. V. S. S., Murugadoss, J. R., & Rambabu, V. (2020). Fostering Higher Order Thinking Skills in Engineering Drawing. Journal of Engineering Education Transformations, 34(1), 28-40.
85. Shelton, B. E., & Hedley, N. R. (2002). Using augmented reality for teaching earth-sun relationships to undergraduate geography students. In Augmented Reality Toolkit, The First IEEE International Workshop (pp. 8-pp). IEEE. doi: 10.1109/ART.2002.1106948
86. Sheharyar, A., Srinivasa, A. R., & Masad, E. (2020, June). Enhancing 3-D Spatial Skills of Engineering Students Using Augmented Reality. In 2020 ASEE Virtual Annual Conference Content Access.
87. Shen, Y., Ong, S. K., & Nee, A. Y. C. (2010). Augmented reality for collaborative product design and development. Design Studies, 31(2), 118-145. http://dx.doi.org/10.1016/j.destud.2009.11.001
88. Singh, G., Mantri, A., Sharma, O., Dutta, R., & Kaur, R. (2019). Evaluating the impact of the augmented reality-learning environment on electronics laboratory skills of engineering students. Computer Applications in Engineering Education, 27(6), 1361-1375.
89. Sorby, S. A. (1999). Developing 3-D spatial visualization skills. The Engineering Design Graphics Journal. 63(2):21–32.
90. Sorby, S. A. (2009). Educational research in developing 3‐D spatial skills for engineering students. International Journal of Science Education, 31(3), 459-480.
91. Sorby, S. A., & Baartmans, B. J. (2000). The development and assessment of a course for enhancing the 3‐D spatial visualization skills of first year engineering students. Journal of Engineering Education, 89(3), 301-307.
92. Sorby, S., Nevin, E., Behan, A., Mageean, E., & Sheridan, S. (2014). Spatial skills as predictors of success in first-year engineering. Paper presented at the 2014 IEEE Frontiers in Education Conference (FIE) Proceedings.
93. Spasova, N., & Ivanova, M. (2020). Towards Augmented Reality Technology In Cad/Cam Systems And Engineering Education. In The International Scientific Conference eLearning and Software for Education (Vol. 2, pp. 496-503). "Carol I" National Defence University. Tabachnick, B. G., & Fidell, L. S. (2001). Review of Univariate and Bivariate Statistics. In A Using multivariate statistics (4th ed.). Boston, MA: Allyn and Bacon.
94. Tian, F., Hua, M., Zhang, W., Li, Y., & Yang, X. (2021). Emotional arousal in 2D versus 3D virtual reality environments. PloS one, 16(9), e0256211.
95. Usta, İ. (2015). Evaluation of Student Outcomes and Satisfaction on the Elective Course of Technical Drawing. Hacettepe University Sociological Research E-Journal. ISSN 1304-2823
96. Walsh, A. (2010). QR Codes–using mobile phones to deliver library instruction and help at the point of need. Journal of information literacy, 4(1), 55-65. http://dx.doi.org/10.11645/4.1.1458
97. Wang, X., Kim, M. J., Love, P. E., & Kang, S. C. (2013). Augmented Reality in built environment: Classification and implications for future research. Automation in Construction, 32, 1-13. http://dx.doi.org/10.1016/j.autcon.2012.11.021
98. Witmer, B. G., Bailey, J. H., Knerr, B. W., & Parsons, K. C. (1996). Virtual spaces and real world places: transfer of route knowledge. International Journal of Human-Computer Studies, 45(4), 413-428. http://dx.doi.org/10.1006/ijhc.1996.0060
99. Wojciechowski, R., & Cellary, W. (2013). Evaluation of learners’ attitude toward learning in ARIES augmented reality environments. Computers & Education, 68, 570-585. http://dx.doi.org/10.1016/j.compedu.2013.02.014
100. Wu, H. K., Lee, S. W. Y., Chang, H. Y., & Liang, J. C. (2013). Current status, opportunities and challenges of augmented reality in education. Computers & Education, 62, 41-49. http://dx.doi.org/10.1016/j.compedu.2012.10.024
101. Yue, J., & Chen, D. M. (2001). Does Cad Improve Spatial Visualization Ability? Paper presented at 2001 Annual Conference, Albuquerque, New Mexico. https://peer.asee.org/9149.
102. Yusoff, R. C. M., Zaman, H. B., & Ahmad, A. (2011). Evaluation of user acceptance of mixed reality technology. Australasian Journal of Educational Technology, 27(8). http://dx.doi.org/10.14742/ajet.899