Biomechanical modeling and simulation of a human organ using an augmented reality technique during open surgery

Abstract

Basically, augmented reality (AR) technology grants innovative ways so as to manipulate and visualize a three-dimensional (3D) model of an object through superimposing computer-generated images onto another object interactively. Being able to interact in real-time with digital and spatial information offers further chances in order to manipulate medical data efficiently and easily. In fact, surgeons encounter multiple challenges handling digital patient data during surgical interventions. Multiple techniques are invested in order to visualize the operative areas, as for example fluoroscopy and ultrasound methods. The latter display certain deficiencies. Therefore, the AR technique can stand for a good candidate in order to project a 3D model of a target organ into the surgeon’s perspective and view field so as to enhance the efficiency and accuracy of the medical intervention intraoperatively. The basic target of this paper is to simulate a generated biomechanical model of the liver organ and visualize its deformations through the use of an AR headset during the open surgery. The proposed approach is validated by the use of acquired CT scans of a human liver organ.