Abstract
A patient’s internal anatomy can be difficult to visualize when viewed on a monitor, head-mounted display, or even when looking at an actual patient. Combining medical images (CT, MRI, US, PET) with a physical model helps recover missing anatomical context and improves situational awareness. This chapter describes an augmented reality system capable of projecting medical image information directly onto curved targets such as the human body or a mannequin. The motion of the targets and the projector are tracked using a motion capture system so that the images are adjusted in real time to match the anatomy changes in position and orientation. The augmented information can be displayed using volume rendering for realistic visualization of the internal anatomy and 3D models from segmented images. Calibration is performed on the projector and the tracking system to obtain an accurate, common coordinate system and correct visual distortions created by the fact that the projected screen (human body) is no longer a plane. The system is easily extendable to other display technology and has many potential applications, including medical education, surgical planning, and laparoscopic surgery.
Reference24 articles.
1. Longmore SK, Naik G, Gargiulo GD. Laparoscopic robotic surgery: Current perspective and future directions. Robotics. 2020;:42
2. Walczak DA, Pawełczak D, Piotrowski P, Trzeciak PW, Jędrzejczyk A, Pasieka Z. Video display during laparoscopy—Where should it be placed? Wideochir Inne Tech Maloinwazyjne. 2015;(1):87-91
3. Rahman R, Wood ME, Qian L, Price CL, Johnson AA, Osgood GM. Head-mounted display use in surgery: A systematic review. Surgical Innovation. 2020;(1):88-100
4. Prendergast CJ, Ryder BA, Abodeely A, Muratore CS, Crawford GP, Luks FI. Surgical performance with head-mounted displays in laparoscopic surgery. Journal of Laparoendoscopic & Advanced Surgical Techniques. Part A. 2009;(Suppl 1):S237-S240
5. Gupta SC, Klein SA, Barker JH, Franken RJPM, Banis JC. Introduction of new technology to clinical practice: A guide for the assessment of new VR applications. Journal of Medical Virtual Reality. 1995;(1):16-20