Mixed Reality: A Reconsideration Based on Mixed Objects and Geospatial Modalities

Abstract

We put forward a conceptualization of Mixed Reality as a blend of digital objects with real ones that coexist and interact with each other and they are also spatially referenced so that they are properly perceived in space by an observer that could potentially be at any position any time. In accordance with this statement, we have adopted the concept of a Mixed Object which is composed of a set of physical properties linked with a set of digital ones. In our case, the physical properties are acquired by employing geospatial technologies such as photogrammetry, laser scanning, unmanned aerial vehicles and positioning systems and are further processed in order to be visually displayed by utilizing Geographical Information Systems and Geovisualization frameworks in combination with traditional image processing techniques. We show that the Mixed Object approach is in conformance with Microsoft’s approach on Mixed Reality as the common space between humans, computers, and the environment and we further incorporate in these the Geospatial Linking Modalities. We finally provide an affordable MR experience as a proof of concept, by utilizing a smartphone for capturing and visualizing the environment, a visual tag for positioning purposes and freely available photogrammetrically mapped content and virtual objects to form a digital scene blended with the real environment.