Affiliation:
1. From the Department of Pathology, University of Pittsburgh Medical Center (UPMC), Pittsburgh, Pennsylvania (Drs Hanna, Nine, and Pantanowitz and Mr Ahmed); Icahn School of Medicine at Mount Sinai, The Mount Sinai Hospital, New York, New York (Dr Prajapati).
Abstract
Context
Augmented reality (AR) devices such as the Microsoft HoloLens have not been well used in the medical field.
Objective
To test the HoloLens for clinical and nonclinical applications in pathology.
Design
A Microsoft HoloLens was tested for virtual annotation during autopsy, viewing 3D gross and microscopic pathology specimens, navigating whole slide images, telepathology, as well as real-time pathology-radiology correlation.
Results
Pathology residents performing an autopsy wearing the HoloLens were remotely instructed with real-time diagrams, annotations, and voice instruction. 3D-scanned gross pathology specimens could be viewed as holograms and easily manipulated. Telepathology was supported during gross examination and at the time of intraoperative consultation, allowing users to remotely access a pathologist for guidance and to virtually annotate areas of interest on specimens in real-time. The HoloLens permitted radiographs to be coregistered on gross specimens and thereby enhanced locating important pathologic findings. The HoloLens also allowed easy viewing and navigation of whole slide images, using an AR workstation, including multiple coregistered tissue sections facilitating volumetric pathology evaluation.
Conclusions
The HoloLens is a novel AR tool with multiple clinical and nonclinical applications in pathology. The device was comfortable to wear, easy to use, provided sufficient computing power, and supported high-resolution imaging. It was useful for autopsy, gross and microscopic examination, and ideally suited for digital pathology. Unique applications include remote supervision and annotation, 3D image viewing and manipulation, telepathology in a mixed-reality environment, and real-time pathology-radiology correlation.
Publisher
Archives of Pathology and Laboratory Medicine
Subject
Medical Laboratory Technology,General Medicine,Pathology and Forensic Medicine
Cited by
164 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献