Mobile internet-based mixed-reality interactive telecollaboration system for neurosurgical procedures: technical feasibility and clinical implementation

Abstract

OBJECTIVE To increase access to health interventions and healthcare services for patients in resource-constrained settings, strategies such as telemedicine must be implemented for the allocation of medical resources across geographic boundaries. Telecollaboration is the dominant form of surgical telemedicine. In this study, the authors report and evaluate a novel mobile internet-based mixed-reality interactive telecollaboration (MIMIT) system as a new paradigm for telemedicine and validate its clinical feasibility. METHODS The application of this system was demonstrated for long-distance, real-time collaboration of neuroendoscopic procedures. The system consists of a local video processing workstation, a head-mounted mixed-reality display device, and a mobile remote device, connected over mobile internet (4G or 5G), allowing global point-to-point communication. Using this system, 20 cases of neuroendoscopic surgery were performed and evaluated. The system setup, composite video latency, technical feasibility, clinical implementation, and future potential business model were analyzed and evaluated. RESULTS The MIMIT system allows two surgeons to perform complex visual and verbal communication during the operation. The average video delay time is 184.25 msec (range 160–230 msec) with 4G mobile internet, and 23.25 msec (range 20–26 msec) with 5G mobile internet. Excellent image resolution enabled remote neurosurgeons to visualize all critical anatomical structures intraoperatively. Remote instructors could easily make marks on the surgical view; then the composite image, as well as the audio conversation, was transferred to the local surgeon. In this way, a real-time, long-distance collaboration can occur. This system was used for 20 neuroendoscopic surgeries in various cities in China and even across countries (Boston, Massachusetts, to Jingzhou, China). Its simplicity and practicality have been recognized by both parties, and there were no technically related complications recorded. CONCLUSIONS The MIMIT system allows for real-time, long-distance telecollaborative neuroendoscopic procedures and surgical training through a commercially available and inexpensive system. It enables remote experts to implement real-time, long-distance intraoperative interaction to guide inexperienced local surgeons, thus integrating the best medical resources and possibly promoting both diagnosis and treatment. Moreover, it can popularize and improve neurosurgical endoscopy technology in more hospitals to benefit more patients, as well as more neurosurgeons.