Computer Vision in the Metaverse

Abstract

Metaverse is a rapidly developing new technology today. The purpose of this article is to examine this technology from a computer vision and general perspective. In this study, a comprehensive review of Metaverse concepts in computer vision has been made. Its history, process, techniques, architecture, advantages, and disadvantages are mentioned. The adaptation of Metaverse to life, the ideas of companies about this technological change, and how society will take place in Metaverse are also discussed. The future of Metaverse and what needs to be done to adapt to this technology are explained. As a result, since there are few studies in the literature, this article aims to be a review article that increases academic studies.

Keywords

• Metaverse
• computer vision
• virtual world
• extended reality
• augmented reality
• blockchain
• artificial intelligence in metaverse
• architecture of the metaverse

References

1. Joshua, J. (2017). Information Bodies: Computational Anxiety in Neal Stephenson's Snow Crash. Interdisciplinary Literary Studies, 19(1), 17-47.
2. North of 41 (2020). What really is the difference between AR / MR / VR / XR? Access Date: 15/12/2021 https://medium.com/@northof41/what-really-is-the-difference-between-ar-mr-vr-xr-35bed1da1a4e
3. Milgram, Paul & Kishino, Fumio. (1994). A Taxonomy of Mixed Reality Visual Displays. IEICE Trans. Information Systems. vol. E77-D, no. 12. 1321-1329.
4. Thomas, P. C., & David, W. M. (1992, January). Augmented reality: An application of heads-up display technology to manual manufacturing processes. In Hawaii international conference on system sciences (pp. 659-669).
5. Fast-Berglund, Å., Gong, L., & Li, D. (2018). Testing and validating Extended Reality (xR) technologies in manufacturing. Procedia Manufacturing, 25, 31-38.
6. Huang, T. S. (1996). Computer vision: Evolution and promise. CERN European Organization for Nuclear Research-Reports-CERN, 21-26.
7. Marr, D. (1982). Vision: A computational investigation into the human representation and processing of visual information, henry holt and co. Inc., New York, NY, 2(4.2).
8. Huang, T. S. (1996). Computer vision: Evolution and promise. CERN European Organization for Nuclear Research-Reports-CERN, 21-26.

9. Barioni, R. R., Figueiredo, L., Cunha, K., & Teichrieb, V. (2018, October). Human Pose Tracking from RGB Inputs. In 2018 20th Symposium on Virtual and Augmented Reality (SVR) (pp. 176-182). IEEE.
10. Fast-Berglund, Å., Gong, L., & Li, D. (2018). Testing and validating Extended Reality (xR) technologies in manufacturing. Procedia Manufacturing, 25, 31-38.
11. Marion Davies (2021). Pros and Cons of the Metaverse. Access Date: 15/12/2021. https://www.konsyse.com/articles/pros-and-cons-of-the-metaverse/
12. Mehul (2020). Object Tracking in Videos: Introduction and Common Techniques. Access Date:15/12/2021. https://aidetic.in/blog/2020/10/05/object-tracking-in-videos-introduction-and-common-techniques/
13. Ammous, S. (2016). Blockchain Technology: What is it good for?, Available at SSRN 2832751.
14. Lee, L. H., Braud, T., Zhou, P., Wang, L., Xu, D., Lin, Z., ... & Hui, P. (2021). All one needs to know about metaverse: A complete survey on technological singularity, virtual ecosystem, and research agenda. arXiv preprint arXiv:2110.05352.
15. Lee, L. H., Braud, T., Zhou, P., Wang, L., Xu, D., Lin, Z., ... & Hui, P. (2021). All one needs to know about metaverse: A complete survey on technological singularity, virtual ecosystem, and research agenda. arXiv preprint arXiv:2110.05352.
16. Smart, J., Cascio, J., & Paffendorf, J. (2007). Metaverse Roadmap 2007: pathways to the 3D Web. A Cross-industry Public Foresight Project. Retrieved December, 31, 2008.
17. Jon Radoff (2021). The Metaverse Value-Chain. Access Date: 15/12/2021. https://medium.com/building-the-metaverse/the-metaverse-value-chain-afcf9e09e3a7
18. Duan, H., Li, J., Fan, S., Lin, Z., Wu, X., & Cai, W. (2021, October). Metaverse for social good: A university campus prototype. In Proceedings of the 29th ACM International Conference on Multimedia (pp. 153-161).