Immersive realities: a comprehensive guide from virtual reality to metaverse

Abstract

This comprehensive literature review explores the diverse landscape of immersive realities, offering a thorough examination of key technologies from Virtual Reality (VR) to the emerging and innovative concept of the Metaverse. The article concentrates the nuances of Extended Reality (XR), Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR), providing an in-depth understanding of their individual functionalities, applications, and evolving interplay. The paper also mentions about wearable technologies which play key role in the realization of these immersive realities. The article begins by explaining the fundamental principles of each immersive reality, tracing their technological evolution and highlighting distinctive features that define their user experiences. It then navigates through the complex intersections and synergies between these immersive technologies, shedding light on how they collectively contribute to shaping the future of digital interaction. The paper unfolds how the journey of immersive realities lead to the Metaverse which is relatively a novel paradigm that transcends individual immersive realities, creating a unified, interconnected digital space. The exploration of the Metaverse encompasses its conceptual foundations, potential social impacts, and the fusion of various immersive technologies within this evolving ecosystem. With an inclusive approach, this paper caters to both novices and seasoned professionals in the field, offering insights into the practical applications associated with different immersive realities. By fostering a comprehensive understanding of these technologies, the paper aims to empower readers to navigate and contribute to the dynamic landscape of immersive realities.

Keywords

• Extended Reality
• Virtual Reality
• Augmented Reality
• Mixed Reality
• Metaverse

References

1. Alizadehsalehi, S., Hadavi, A., & Huang, J. C. (2020). From BIM to extended reality in AEC industry. Automation in Construction, 116, 103254. https://doi.org/10.1016/j.autcon.2020.103254
2. Anderson, P. L., Price, M., Edwards, S. M., Obasaju, M. A., Schmertz, S. K., & Powers, M. B. (2019). Virtual reality Exposure Therapy for Social Anxiety Disorder: A Randomized Controlled Trial. Journal of Consulting and Clinical Psychology, 87(7), 599-611. https://doi:10.1037/ccp0000416
3. Apple. (2021). Official webpage for iPhone 12 Pro on Apple's website. [Online]. https://www.apple.com/iphone-12-pro/
4. Azuma, R. T. (1997). A survey of augmented reality. Presence: Teleoperators & Virtual Environments, 6(4), 355-385.
5. Azuma, R., Bailot, Y., & Behringer, R. F. (2001). S., Simon, J. & MacIntyre, B. (2001). Recent advances in augmented reality. IEEE Computer Graphics and Applications, 34-47. https://doi.org/10.1109/38.963459.
6. Bacca, J., Baldiris, S., Fabregat, R., & Graf, S. (2014). Augmented reality trends in education: A systematic review of research and applications. Journal of Educational Technology & Society, 17(4), 133-149. https://www.jstor.org/stable/jeductechsoci.17.4.133
7. Behzadan, A. H., Timm, B. W., & Kamat, V. R. (2008). General-purpose modular hardware and software framework for mobile outdoor augmented reality applications in engineering. Advanced Engineering Informatics, 22(1), 90-105. https://doi.org/10.1016/j.aei.2007.08.005
8. Bhattacharjee, K., & Moghaddam, B. (2018). Virtual reality games for cancer patients with chemotherapy-induced neuropathy: A pilot study. Games for Health Journal, 7(1), 33-42. https://doi.org/10.1089/g4h.2017.0118

9. Biocca, F., & Delaney, B. (1995). Immersive Virtual Reality Technology. Communications of the ACM, 38(4), 36-38. https://doi.org/10.1145/205323.205326
10. Biocca, F., & Levy, M. R. (1995). Communication in the age of virtual reality. Routledge. https://www.routledge.com/Communication-in-the-Age-of-Virtual-Reality/Biocca-Levy/p/book/9780805815504
11. Braguez, J., Braguez, M., Moreira, S., & Filipe, C. (2023). The possibilities of changes in learning experiences with Metaverse. Procedia Computer Science, 219, 504-511. https://doi.org/10.1016/j.procs.2022.11.048
12. Burdea, G. C., & Coiffet, P. (2003). Virtual Reality Technology. John Wiley & Sons. https://books.google.co.kr/books/about/Virtual_Reality_Technology.html?id=0xWgPZbcz4AC&redir_esc=y
13. Caudell, T. P., & Mizell, D. W. (1992). Augmented reality: An application of heads-up display technology to manual manufacturing processes. Proceedings of the 1992 IEEE Annual Conference on Industrial Electronics, 2, 659-669.
14. Cheong, B. C. (2022). Avatars in the metaverse: potential legal issues and remedies. International Cybersecurity Law Review, 1-28. https://doi.org/10.1365/s43439-022-00056-9
15. Chuah, S. H. W. (2018). Why and who will adopt extended reality technology? Literature review, synthesis, and future research agenda. Social Science Research Network. https://doi.org/10.2139/ssrn.3300469
16. De Kort, Y. A. W., IJsselsteijn, W. A., & Midden, C. J. H. (2020). Cybersickness and anxiety in virtual environments: A systematic review. Frontiers in Virtual Reality, 1, 11. https://doi.org/10.3389/frvir.2020.00011
17. Delgado, A., Javidi, B., & Gu, X. (2020). Wearable technology for military training and performance enhancement. Journal of Imaging, 6(10), 103. https://doi.org/ 10.3390/jimaging6100103
18. Fisher, S. S. (1992). Virtual environments and advanced interface design. New York: Oxford University Press.
19. Freeman, D., Reeve, S., Robinson, A., Ehlers, A., Clark, D., Spanlang, B., & Slater, M. (2017). Virtual reality in the assessment, understanding, and treatment of mental health disorders. Psychological Medicine, 47(14), 2393-2400. https://doi.org/10.1017/S003329171700040X
20. Fuchs, M. (2021). Metaverse. In M. Consalvo & R. B. Ewalt (Eds.), The Oxford handbook of internet studies (pp. 500-518). Oxford University Press.
21. Furness, T. (1989). Configuring virtual space for the super cockpit. Human Interface Technology (HIT) Laboratory Technical Report.
22. Gao, Y., Gao, Z., Ji, X., & Liang, C. (2019). Research on development and application of mixed reality technology. IOP Conference Series: Materials Science and Engineering, 571(3), 032019.
23. Globaldata Plc. (2022, January 31). Metaverse market size to reach USD 996.42 billion by 2030 growing at 39.8% CAGR [Newswire]. EIN News. https://www.einnews.com/pr_news/593931863/metaverse-market-size-to- reach-usd-996-42-billion-by-2030-growing-at-39-8-cagr-globaldata-plc
24. Gong, E., Yu, Y., Wang, W., Chen, X., & Chen, X. (2019). Wearable medical systems for p-Health. Journal of Medical Systems, 43(6), 146. https://doi.org/10.1007/s10916-019-1257-9
25. Heilig M. L. (1962). Sensorama simulator. United States Patent and Trademark Office. (1962). US Patent No. 3,050,870. https://www.scirp.org/(S(lz5mqp453edsnp55rrgjct55.))/reference/referencespapers.aspx?referenceid=2521425
26. Hickey, J. T., Hu, B., Peake, J. M., & Tan, S. Y. (2018). Wearable technology applications in sports: A critical review. International Journal of Sports Science & Coaching, 13(5), 757-764. https://doi.org/10.1177/1747954118787423
27. Hjorth, L., & Kim, J. (2018). The promise of wearable technology for healthcare in the future. Healthcare, 6(4), 129. https://doi.org/10.3390/healthcare6040129
28. Holt-Lunstad, J., Smith, T. B., Baker, M., Harris, T., & Stephenson, D. (2015). Loneliness and social isolation as risk factors for mortality: A meta-analytic review. Perspectives on Psychological Science, 10(2), 227-237. https://doi.org/10.1177/1745691614568352
29. Jetter, J., Eimecke, J., & Rese, A. (2018). Augmented reality tools for industrial applications: What are potential key performance indicators and who benefits? Computers in Human Behavior, 87, 18-33. https://doi.org/10.1016/j.chb.2018.04.054.
30. Kanematsu, H., Kobayashi, T., Barry, D. M., Fukumura, Y., Dharmawansa, A., & Ogawa, N. (2014). Virtual STEM class for nuclear safety education in metaverse. Procedia computer science, 35, 1255-1261. https://doi.org/10.1016/j.procs.2014.08.224
31. Kim, H. J., & Kim, B. H. (2018). Implementation of young children English education system by AR type based on P2P network service model. Peer-to-Peer Networking and Applications, 11, 1252-1264. https://doi.org/10.1007/s12083-017-0612-2.
32. Ko, S. H., & Rogers, J. (2021). Functional materials and devices for XR (VR/AR/MR) applications. Advanced Functional Materials, 31(39), 2106546. https://doi.org/10.1002/adfm.202106546.
33. Krokos, E., Plaisant, C., & Varshney, A. (2019). Virtual Reality for Science, Technology, Engineering, and Mathematics Education and Training. In the Palgrave Handbook of Education Law for Schools (pp. 1-29). Palgrave Macmillan. https://doi.org/10.1007/978-981-13-2835-8_7-1
34. Krueger, M. (1983). Artificial Reality Reading. Massachusetts: Addison Wesley. https://search.worldcat.org/ko/title/artificial-reality/oclc/8282915
35. Krueger, M. (1991). Artificial reality II. Addison-Wesley. https://search.worldcat.org/ko/title/21408597
36. Lamb, R. (2020). A brief history of virtual and augmented reality. Harvard Business Review. https://hbr.org/2020/07/a-brief-history-of-virtual-and-augmented-reality
37. Lanier, J. (1989). Virtual reality. In M. Benedikt (Ed.), Cyberspace: First steps (pp. 53-62). MIT Press.
38. Lee, J., Kim, J. H., Kim, J., & Kim, S. (2018). A systematic review and meta-analysis of virtual reality rehabilitation programs for patients with stroke: Effects on upper-limb function, activities of daily living, and quality of life. Games for Health Journal, 7(5), 291-307. https://doi.org/10.1089/g4h.2017.0145
39. Lee, J., Kim, S., & Kim, J. H. (2021). Virtual reality training for upper extremity function and activities of daily living in stroke patients: A systematic review and meta-analysis. Journal of Stroke and Cerebrovascular Diseases, 30(8), 105889. https://doi.org/10.1016/j.jstrokecerebrovasdis.2021.105889
40. Liao, H.-T., & Humphreys, L. (2019). Immersive storytelling: Creating emotionally engaging virtual reality experiences. Journal of Advertising, 48(3), 323-335. https://doi.org/10.1080/00913367.2019.1593125
41. Linden Lab. (2003). About Linden Lab. https://www.lindenlab.com/about
42. Luckey, P. (2014). Oculus VR: Step into the Rift. Oculus VR blog. https://www.oculus.com/blog/step-into-the-rift/
43. Luczak, T., Burch, R., Lewis, E., Chander, H., & Ball, J. (2020). State-of-the-art review of athletic wearable technology: What 113 strength and conditioning coaches and athletic trainers from the USA said about technology in sports. International Journal of Sports Science & Coaching, 15(1), 26-40. https://doi.org/10.1177/1747954120909552
44. Mann, S., Fung, J., Aimone, C., Sehgal, A., & Chen, D. (2005). Designing EyeTap digital eyeglasses for continuous lifelong capture and sharing of personal experiences. In Alt. Chi, Proc. CHI 2005.
45. Mantovani, F., & Castelnuovo, G. (2003). Virtual reality training for health-care professionals. CyberPsychology & Behavior, 6(4), 389-395. https://doi.org/10.1089/109493103322278765
46. McGreevy, M. W., & Zimmermann, T. G. (1984). The Aspen Movie Map: A first step. Proceedings of the Association for Computing Machinery Conference on Human Factors in Computing Systems, 4-8.
47. Milgram, P., & Colle, H. (1995). A taxonomy of real and virtual world display integration. Proceedings of the SPIE, 2351, 282-292.
48. Milgram, P., & Kishino, F. (1994). A taxonomy of mixed reality visual displays. IEICE Transactions on Information and Systems, 77(12), 1321-1329.
49. Milgram, P., & Kishino, F. (1994). Figure 1: Mixed Reality on the Reality-Virtuality Continuum [Image description]. In A taxonomy of mixed reality visual displays. IEICE Transactions on Information and Systems, 77(12), 1321-1329. https://www.researchgate.net/publication/321405854_Milgram_and_Kishino's_Mixed_Reality_on_the_Realit y-Virtuality_Continuum
50. Moro, C., Birt, J., Stromberga, Z., Phelps, C., Clark, J., Glasziou, P., & Scott, A. M. (2021). Virtual and augmented reality enhancements to medical and science student physiology and anatomy test performance: A systematic review and meta-analysis. Anatomical sciences education, 14(3), 368-376. https://doi.org/10.1002/ase.2049
51. Moro, C., Štromberga, Z., Raikos, A., & Stirling, A. (2017). The effectiveness of virtual and augmented reality in health sciences and medical anatomy. Anatomical Sciences Education, 10(6), 549-559. https://doi.org/10.1002/ase.1696
52. Muhammad, K., Khan, N., Lee, M. Y., Imran, A. S., & Sajjad, M. (2021). School of the future: A comprehensive study on the effectiveness of augmented reality as a tool for primary school children’s education. Applied Sciences, 11(11), 5277. https://doi:10.3390/app11115277
53. Mukhopadhyay, A., Sharma, V. K., Tatyarao, P. G., Shah, A. K., Rao, A. M., Subin, P. R., & Biswas, P. (2023). A comparison study between XR interfaces for driver assistance in take over request. Transportation Engineering, 11, 100159. https://doi.org/10.1016/j.treng.2022.100159
54. Myre, G. (2017). From wristwatches to radio, how World War I ushered in the modern world. NPR. https://www.npr.org/sections/parallels/2017/04/02/521792062/from-wristwatches-to-radio-how-world-war-i-ushered-in-the-modern-world?t=1568188507348
55. Niantic Labs. (2016, June 15). More Pokémon GO updates. https://nianticlabs.com/news/e3-2016
56. Nowak, K. L., & Fox, J. (2018). Avatars and computer-mediated communication: A review of the definitions, uses, and effects of digital representations. Review of Communication Research, 6, 30-53. https://doi.org/10.12840/issn.2255-4165.2018.06.01.015
57. Oculus VR. (2022). What is VR? https://www.oculus.com/virtual-reality/what-is-vr/
58. Oestmann, G. (2016). The Origins and Diffusion of Watches in the Renaissance: Germany. Comune di Cremona, 141-143.
59. Oh, H. J., Kim, J., Chang, J. J., Park, N., & Lee, S. (2023). Social benefits of living in the metaverse: The relationships among social presence, supportive interaction, social self-efficacy, and feelings of loneliness. Computers in Human Behavior, 139, 107498. https://doi.org/10.1016/j.chb.2022.107498
60. Ometov, A., Shubina, V., Klus, L., Skibińska, J., Saafi, S., Pascacio, P., ... & Lohan, E. S. (2021). A survey on wearable technology: History, state-of-the-art and current challenges. Computer Networks, 193, 108074.
61. Online Etymology Dictionary. (n.d.). Universe. https://www.etymonline.com/word/universe#etymonline_v_4519
62. Oxford English Dictionary. (2021). Meta-. https://www.oed.com/view/Entry/117081
63. Papadopoulos, D. (2019). MBracelet (1999): New York, New York, USA & London, UK with the Knowledge Lab, NCR. Fashionable Technology. http://www.fashionabletechnology.org/press/photosbook/hi-res/ft-book-p117.pdf
64. Park, S. M., & Kim, Y. G. (2022). A metaverse: Taxonomy, components, applications, and open challenges. IEEE Access, 10, 4209-4251. https://doi.org/10.1109/ACCESS.2021.3057828
65. Rodrigues, J., Segundo, D., Junqueira, H. A., Sabino, M. H., Prince, R. M., Al-Muhtadi, J., & Albuquerque, V. H. C. (2018). Enabling technologies for the Internet of Health Things. IEEE Access, 6, 20529-20547. https://doi.org/10.1109/ACCESS.2017.2789329
66. Russell, S. (1962). Spacewar! Digital Equipment Corporation.
67. Shaw, S. (2021). The future of extended reality. Forbes. https://www.forbes.com/sites/shawnpowers/2021/01/28/the-future-of-extended-reality/?sh=63e4b4ce2b4e
68. Shi, F., Ning, H., Zhang, X., Li, R., Tian, Q., Zhang, S., & Daneshmand, M. (2023). A new technology perspective of the Metaverse: its essence, framework and challenges. Digital Communications and Networks. Advance online publication. https://doi.org/10.1016/j.digcomnet.2023.100059
69. Sinhasane, S. (2018, May 29). Wearable technology in healthcare: Revolutionizing patient care. https://mobisoftinfotech.com/resources/blog/wearable-technology-in-healthcare/
70. Slater, M., & Wilbur, S. (1997). A framework for immersive virtual environments (FIVE): Speculations on the role of presence in virtual environments. Presence: Teleoperators & Virtual Environments, 6(6), 603–616. https://doi.org/10.1162/pres.1997.6.6.603
71. Smartsearch, R. (2022). Something about the six core technologies in the Metaverse. RamaOnHealthcare. https://ramaonhealthcare.com/something-about-the-six-core-technologies-in-the-metaverse/
72. Speicher, M., Hall, B. D., & Nebeling, M. (2019, May). What is mixed reality? In Proceedings of the 2019 CHI conference on human factors in computing systems (pp. 1-15). https://doi.org/10.1145/3290605.3300767
73. Stamp, J. (2013). A Partial History of Headphones. https://web.archive.org/web/20130409012634/http://blogs.smithsonianmag.com/design/2013/03/a-partial- history-of-headphones/
74. Steven, F., Blair, M., & Dorée, S. (1993). Knowledge-based augmented reality. Communications of the ACM, 36(7), 53-62
75. Sutherland, I. E. (1965). The ultimate display. Proceedings of the IFIPS Congress, 2(1), 506-508.
76. Sutherland, I. E. (1968). A head-mounted three-dimensional display. In Proceedings of the December 9-11, 1968, fall joint computer conference, part I (pp. 757-764). AFIPS Press.
77. Tang, L., Chen, M., Wang, D., & Wang, X. (2019). Online community participation and subjective well-being: The mediating role of social support. International Journal of Environmental Research and Public Health, 16(12), 2225. https://doi.org/10.3390/ijerph16122225
78. Tao, X., & Cheng, J. (2016). Wearable technology: What potential for healthcare provision? British Journal of Healthcare Management, 22(12), 604-610. https://doi.org/ 10.12968/bjhc.2016.22.12.604
79. Tarr, J. E., & Warren, S. J. (2021). Virtual reality in education: Opportunities and challenges. Journal of Educational Technology Systems, 50(1), 3-26. https://doi.org/10.1177/0047239520966713
80. The College of Optometrists. (2019). The invention of spectacles: How and where glasses may have begun. https://www.collegeoptometrists.org/the-college/museum/online-exhibitions/virtual-spectacles-gallery/the-invention-of-spectacles.html
81. The Editors of Encyclopedia Britannica. (2021). Universe. In Encyclopedia Britannica. https://www.britannica.com/science/universe
82. The National Archives. (2019). Fighting talk: First World War Telecommunications. http://www.nationalarchives.gov.uk/first-world-war/telecommunications-in-war/
83. Ticknor, B. (2018). Virtual Reality and the Criminal Justice System: Exploring the Possibilities for Correctional Rehabilitation. Lexington Books.
84. Venkatesan, M., Mohan, H., Ryan, J. R., Schürch, C. M., Nolan, G. P., Frakes, D. H., & Coskun, A. F. (2021). Virtual and augmented reality for biomedical applications. Cell reports medicine, 2(7), 100348. https://doi.org/10.1016/j.xcrm.2021.100348
85. Venkatesan, M., Mohan, H., Ryan, J. R., Schürch, C. M., Nolan, G. P., Frakes, D. H., & Coskun, A. F. (2021). Virtual and augmented reality for biomedical applications. Cell reports medicine, 2(7), 100348. https://doi.org/10.1016/j.xcrm.2021.100348
86. Virtuality Group. (1992). Dactyl Nightmare: The world's first virtual reality arcade game. https://www.virtuality.org/dactylnightmare
87. Vogt, J., Krummenacher, J., Puschmann, A. K., Schwandt, J., & Felnhofer, A. (2022). Virtual reality as a tool in mental health treatment: A systematic review of recent literature. Journal of Medical Internet Research, 24(1), e31554. https://doi.org/10.2196/31554
88. Wang, D., Li, Y., Li, Q., Zhang, X., & Liu, W. (2019). Wearable hearing aid: A review. Journal of Healthcare Engineering, 2019, 1-14. https://doi.org/10.1155/2019/6916358
89. Wiederhold, B. K., & Riva, G. (2019). Virtual reality therapy: emerging topics and future challenges.
90. Cyberpsychology, Behavior, and Social Networking, 22(1), 3-6. https://doi.org/10.1089/cyber.2018.29040.bkw
91. Wu, W., Hartless, J., Tesei, A., Gunji, V., Ayer, S., & London, J. (2019). Design assessment in virtual and mixed reality environments: Comparison of novices and experts. Journal of Construction Engineering and Management, 145(9), 04019049. https://doi.org/10.1061/(ASCE)CO.1943-7862.00
92. Zalan, T., & Barbesino, P. (2023). Making the Metaverse real. In Digital Business (p. 100059). Elsevier BV. https://doi.org/10.1016/j.digbus.2023.100059
93. Zuckerberg, M. (2021). Connect 2021 Keynote: Our Vision for the Metaverse. Facebook. https://about.fb.com/news/2021/10/connect-2021-keynote-our-vision-for-the-metaverse/