Experience with augmented reality technology in the surgical treatment of a patient with encapsulated metal foreign bodies of lower extremities

Abstract

This paper presents the experience of using augmented reality (AR) technology in the surgical treatment of a patient with encapsulated foreign bodies in the lower extremities. The study aims to test a previously developed algorithm for implementing AR technology in surgery and assess its effectiveness in treating patients with encapsulated foreign bodies. The study was conducted by a multidisciplinary team, comprising the Department of Naval Surgery of the S.M. Kirov Military Medical Academy and the Technical University named after Peter the Great. The medical and technical aspects involved an AR hardware and software package, including a personal computer and Microsoft Hololens II AR glasses. An invasive fixation system was also developed, incorporating a threaded pin used as an X-ray contrast mark with a seat for attaching special markers. The clinical part of the study involved observing and subsequently removing encapsulated foreign bodies in a patient who received inpatient treatment at the clinic of the Department of Naval Surgery in October 2022. Overall, AR technology demonstrated the potential for performing minimally invasive removal of encapsulated foreign bodies in limbs. The detailed visualization provided by AR allowed for determining optimal operative access, the volume of the upcoming operation, and the exact position, skeletotopy, and syntopia of the foreign body during the preoperative stage. Consequently, various intervention options could be digitally simulated. The use of AR technology facilitated intraoperative navigation, enhancing the safety and efficiency of the operation. Thus, AR technology has proven to be a minimally invasive, safe, and effective tool in surgical treatment. However, several unresolved issues require further research.