Affiliation:
1. Medical Robotics and Imaging Lab, Department of Computer Science, University of Houston, Houston, TX 77004, USA
2. Tietronix Software, Inc., Houston, TX 77058, USA
Abstract
Background: The ever-growing extended reality (XR) technologies offer unique tools for the interactive visualization of images with a direct impact on many fields, from bioinformatics to medicine, as well as education and training. However, the accelerated integration of artificial intelligence (AI) into XR applications poses substantial computational processing demands. Additionally, the intricate technical challenges associated with multilocation and multiuser interactions limit the usability and expansion of XR applications. Methods: A cloud deployable framework (Holo-Cloud) as a virtual server on a public cloud platform was designed and tested. The Holo-Cloud hosts FI3D, an augmented reality (AR) platform that renders and visualizes medical 3D imaging data, e.g., MRI images, on AR head-mounted displays and handheld devices. Holo-Cloud aims to overcome challenges by providing on-demand computational resources for location-independent, synergetic, and interactive human-to-image data immersion. Results: We demonstrated that Holo-Cloud is easy to implement, platform-independent, reliable, and secure. Owing to its scalability, Holo-Cloud can immediately adapt to computational needs, delivering adequate processing power for the hosted AR platforms. Conclusion: Holo-Cloud shows the potential to become a standard platform to facilitate the application of interactive XR in medical diagnosis, bioinformatics, and training by providing a robust platform for XR applications.
Funder
National Science Foundation
National Aeronautics and Space Administration
Reference65 articles.
1. Capecchi, I., Bernetti, I., Borghini, T., and Caporali, A. (2023, January 6–9). CaldanAugmenty—Augmented Reality and Serious Game App for Urban Cultural Heritage Learning. Proceedings of the Extended Reality: International Conference, XR Salento 2023, Lecce, Italy.
2. Ayoub, A., and Pulijala, Y. (2019). The Application of Virtual Reality and Augmented Reality in Oral & Maxillofacial Surgery. BMC Oral Health, 19.
3. Geyer, M. (2023, December 25). BMW Group Starts Global Rollout of NVIDIA Omniverse. Available online: https://blogs.nvidia.com/blog/bmw-group-nvidia-omniverse/.
4. Extended Reality in Diagnostic Imaging—A Literature Review;Kukla;Tomography,2023
5. Augmented Reality and Shoulder Replacement: A State-of-the-Art Review Article;Daher;JSES Rev. Rep. Tech.,2023