Predictive display and interaction of telerobots based on augmented reality

Abstract

A predictive display method and man-virtual robot interaction based on augmented reality are applied to control a telerobot. We first discuss the process of the augmented reality environment development. Then, we present the advantages of predictive display. Simulation of virtual robot's tasks in the augmented environment improves the safety of the telerobot when it executes the planned tasks. In addition, the immediate feedback from the virtual robot avoids the exacerbation of maneuverability caused by time-delay. For a more natural operation process, we apply multi man-virtual robot interactive methods. Lastly, the experiment of pick & place is conducted to validate the system.