A four-wall virtual reality visualization of patient-specific anatomy: Creating full user immersive experience from computed tomography scans

Abstract

Virtual reality is the future of medical imaging diagnosis. Previous studies have introduced virtual reality rendering of anatomical models while others have mentioned processes to extract 3D models from Computed Tomography (CT) images. In this study, we provide a detailed workflow to transforming patient-specific two-dimensional (2D) CT dicom format imaging files to three-dimensional (3D) immersive, dynamic and interactive anatomical assembly models while incorporating them into a four-wall virtual reality environment system. Our study implemented 3D CAD and virtual reality capacities through software and engineering design tools to transform 2D medical images into interactive 3D models in our system. In doing so, the user was able to gain a sense of depth, scale, and dimensionality while immersed in the environment and while implementing interactive tools to investigate patient- specific hip-femur dynamics. At the same time, users were able to identify key anatomical landmarks in the patients’ hip joints. Applications of the VR system to the medical field and orthopedics, in particular, were discussed.

Keywords

• Virtual Reality in Medicine
• Patient-Specific Anatomy Simulation
• Tomography
• Tracking
• Simulation

Supporting Institution

Eastern Michigan University

Project Number

n/a

Thanks

This is our first time submitting a manuscript to your esteemed journal and we hope to submit more in the near future. Thanks

References

1. Tcha-Tokey, K., Loup-Escande, E., Christmann, O., & Richir, S. (2017). Effects on User Experience in an Edutainment Virtual Environment. Proceedings of the European Conference on Cognitive Ergonomics 2017, 1–8. https://doi.org/10.1145/3121283.3121284
2. Nan, X., Zhang, Z., Zhang, N., Guo, F., He, Y., & Guan, L. (2013). VDESIGN: Toward image segmentation and composition in cave using finger interactions. 2013 IEEE China Summit and International Conference on Signal and Information Processing, 461–465. https://doi.org/10.1109/ChinaSIP.2013.6625382
3. Sigitov, A., Scherfgen, D., Hinkenjann, A., & Staadt, O. (2015). Adopting a Game Engine for Large, High- Resolution Displays. Procedia Computer Science, 75, 257–266. https://doi.org/10.1016/j.procs.2015.12.246
4. Long, G., Kim, H. S., Marsden, A., Bazilevs, Y., & Schulze, J. P. (2012). Immersive volume rendering of blood vessels (I. E. McDowall & M. Dolinsky, Eds.; p. 82890L). https://doi.org/10.1117/12.909729
5. Witkowski, M., Lenar, J., Sitnik, R., & Verdonschot, N. (2012). A virtual reality interface for pre-planning of surgical operations based on a customized model of the patient (I. E. McDowall & M. Dolinsky, Eds.; p. 82890M). https://doi.org/10.1117/12.909857
6. Al-khalifah, A. H., Woff, R., Alexandrov, V. N., & Roberts, D. J. (2005). Case study: interacting with volumetric medical datasets in networked CAVE environments (R. F. Erbacher, J. C. Roberts, M. T. Grohn, & K. Borner, Eds.; p. 350). https://doi.org/10.1117/12.587633
7. Toward Precision Medicine. (2011). National Academies Press. https://doi.org/10.17226/13284
8. Arnold, J. L., McKenzie, F. (Rick) D., Miller, J. L., & Mancini, M. E. (2018). The Many Faces of Patient-Centered Simulation. Simulation in Healthcare: The Journal of the Society for Simulation in Healthcare, 13(3S), S51–S55. https://doi.org/10.1097/SIH.0000000000000312

9. simlab-soft.com. (n.d.). https://www.simlab-soft.com/3dplugins/SolidWorks/fbx_exporter_for_SolidWorks- main.aspx?h=1. Retrieved February 8, 2022, from https://www.simlab-soft.com/3dplugins/SolidWorks/fbx_exporter_for_SolidWorks-main.aspx?h=1
10. He, Y., Zhang, Z., Nan, X., Zhang, N., Guo, F., Rosales, E., & Guan, L. (2017). vConnect: perceive and interact with real world from CAVE. Multimedia Tools and Applications, 76(1), 1479–1508. https://doi.org/10.1007/s11042-015-3121-4
11. Koning, A. H. J. (2011). How 3D immersive visualization is changing medical diagnostics (B. E. Rogowitz & T. N. Pappas, Eds.;p.786503). https://doi.org/10.1117/12.881511
12. Lin, Q., Xu, Z., Li, B., Baucom, R., Poulose, B., Landman, B. A., & Bodenheimer, R. E. (2013). Immersive virtual reality for visualization of abdominal CT (C. K. Abbey & C. R. Mello-Thoms, Eds.; p. 867317). https://doi.org/10.1117/12.2008050
13. Ritter, K. A., Borst, C. W., & Chambers, T. L. (2015). Overview and Assessment of Unity Toolkits for Rapid Development of an Educational VR Application. International Journal for Innovation Education and Research, 3(7), 147–164. https://doi.org/10.31686/ijier.vol3.iss7.398
14. Garellick G, K. J. L. H. (2013). Swedish Hip Arthroplasty Register Annual Report 2013.
15. Bozic, K. J., Kurtz, S. M., Lau, E., Ong, K., Vail, T. P., & Berry, D. J. (2009). The Epidemiology of Revision Total Hip Arthroplasty in the United States. The Journal of Arthroplasty, 24(2), e19. https://doi.org/10.1016/j.arth.2008.11.033