Virtual Tour Using Telepresence Robot and MQTT Protocol

Abstract

We often face obstacles to visit certain places, facilities, and institutions. This was especially noticeable during the COVID-19 pandemic. In this period telepresence applications were of exceptional importance. They supported communications and provided social interactions, enriching our lives during isolation. In this paper, we propose a solution for telepresence using Padbot U1 robot and the MQTT protocol. The idea is to use this solution for virtual tours in museums, art galleries, historical sites, etc. We have developed two different applications. One is a client application used by the visitor, for controlling the robot remotely. The other application is for the mobile device (tablet) attached to the robot, which is used to enable telepresence and to forward control commands to the robot. By scanning the QR codes placed on the objects, visitors can also get specific information about each of objects. Communication between applications (sending commands and receiving information for objects) is realized with the MQTT protocol. For the developed solution, we also conducted experiments to evaluate some basic criteria for VTs.