Augmented reality simulator for CT-guided interventions

Abstract

Abstract Introduction CT-guided interventions are taught using a mentored approach on real patients. It is well established that simulation is a valuable training tool in medicine. This project assessed the feasibility and acceptance of replicating a CT-guided intervention using a bespoke software application with an augmented reality head-mounted display (ARHMD). Methods A virtual patient was generated using a CT dataset obtained from The Cancer Imaging Archive. A surface mesh of a virtual patient was projected into the field-of-view of the operator. ChArUco markers, placed on both the needle and agar jelly phantom, were tracked using RGB cameras built into the ARHMD. A virtual CT slice simulating the needle position was generated on voice command. The application was trialled by senior interventional radiologists and trainee radiologists with a structured questionnaire evaluating face validity and technical aspects. Results Sixteen users trialled the application and feedback was received from all. Eleven felt the accuracy and realism was adequate for training and twelve felt more confident about their CT biopsy skills after this training session. Discussion The study showed the feasibility of simulating a CT-guided procedure with augmented reality and that this could be used as a training tool. Key Points • Simulating a CT-guided procedure using augmented reality is possible. • The simulator developed could be an effective training tool for clinical practical skills. • Complexity of cases can be tailored to address the training level demands.