Design and Implementation of a Mixed Reality Night Hoisting Assistance System Driven by Digital Twins

Abstract

Abstract Hoisting at night has low visibility and high operational complexity, which has the problems of large cognitive load and high risk. With the help of digital twin (DT) and mixed reality (MR), the article designs and implements a MR night hoisting assistance system driven by DT. The system is developed on the Unity3D platform and based on the UNet networking communication mechanism. It realizes the functions of fusion highlighting, motion synchronization, multi-terminal collaboration and error display. It also has multiple interaction methods such as voice interaction, gesture recognition, and sight tracking. The research results have positive significance for improving the effect of night hoisting.