Development and Utilization of 3D Anatomy Education Content using Metaverse and XR for Remote Telemedicine Education

Abstract

AbstractThe objective of this study is to explore innovative integration within the field of anatomy education by leveraging HoloLens 2 Augmented Reality Head-Mounted Display (AR HMD) technology and real-time cloud rendering. Initial 3D datasets, comprising extensive anatomical information for each bone, were obtained through the 3D scanning of a full-body cadaver of Korean male origin. Subsequently, these datasets underwent refinement processes aimed at enhancing visual fidelity and optimizing polygon counts, utilizing Blender software. Unity was employed for the development of the Metaverse platform, incorporating tailored 3D User Experience (UX) and User Interface (UI) components to facilitate interactive anatomy education via imported cadaver models. Integration with real-time remote rendering cloud servers, such as Azure, was implemented to augment the performance and rendering capabilities of the HoloLens 2 AR HMD. The extended reality (XR) content uses the Photon Cloud network for real-time data synchronization and HoloLens 2 voice functionality. The metaverse platform supports user interaction through room creation and joining, with various tools for bone manipulation, color differentiation, and surface output. Collaboration features enable sharing and synchronization of model states. The study highlights the importance of technological innovation in anatomy education for future medical professionals. The proposed content aims to address limitations of traditional methods and enhance learning experiences. Continued efforts in developing and improving such technologies are crucial to equip learners with essential skills for adaptation in the evolving healthcare landscape. keyword: Metaverse, Anatomy, Cadaver, Extended Reality(XR), Virtual Reality(VR)