A Basic Framework of View Systems Allowing Teleoperators to Pre-Acquire Spatial Knowledge from Survey and Route Perspectives

Abstract

One of the most important problems in teleoperation of heavy machinery is that the work efficiency of teleoperation is lower than half that of a typical boarding operation. This difference is primarily caused by operators' difficulty in creating mental representations (i.e., cognitive maps) of work sites. Operators have two opportunities to acquire information, namely before work and during work, because the introduction of teleoperation requires about one week. Therefore, we have developed a view system to be used before work to provide environmental information concerning work sites on the basis of human spatial cognition. Cognitive maps can be built by acquiring knowledge from two perspectives—the survey perspective and the route perspective. We display an external view from any viewpoint to acquire knowledge from a survey perspective and a view from an operator's viewpoint, which can be modified by the operator's intention to acquire knowledge from the route perspective. Experimental results using a simulator suggested that a proposed view system could help operators acquire cognitive maps, which may lead to a decrease in task time, the number of stops, and the moving distance and an increase in speed during grasping.