A Deep Learning approach to 3D Viewing of MRI/CT images in Augmented Reality

Abstract

Abstract CT (Computed Tomography) and MRI (Magnetic Resonance Imaging) are both used to diagnose internal damage and deformities of the organs. These are 3D data so doctors diagnose these scans by splitting them into many 2D slices and analyse each slices for detecting disease. This is a hard and time-consuming task to accomplish. Experts are enough trained to analyse this data for interpreting insights. But when they try to explain vulnerable situations to their patients, these scans are not very readable and understandable for them. Thus, it scares them a lot when they are asked to take these scans for diagnosis. Thus, an approach is given to viewing these scans in AR (augmented reality), making them available to view via their smartphones. The idea is to build an application that can take CT and MRI scans as input from “.stl” files and help to view them in AR with plane detection for mesh to be rendered and placed properly. This also reduces the task of storing these scans in bulk. Instead, one can just send data to their patients and store it as records on their phones. Whenever necessary, one can visualise it on the spot.