Natural human–computer interaction control of multi operators in collaborative virtual maintenance based on optical human motion capture system

Abstract

Aiming at the human–computer interaction control (HCIC) requirements of multi operators in collaborative virtual maintenance (CVM), real-time motion capture and simulation drive of multi operators with optical human motion capture system (HMCS) is proposed. The detailed realization process of real-time motion capture and data drive for virtual operators in CVM environment is presented to actualize the natural and online interactive operations. In order to ensure the cooperative and orderly interactions of virtual operators with the input operations of actual operators, collaborative HCIC model is established according to specific planning, allocating and decision-making of different maintenance tasks as well as the human–computer interaction features and collaborative maintenance operation features among multi maintenance trainees in CVM process. Finally, results of the experimental implementation validate the effectiveness and practicability of proposed methods, models, strategies and mechanisms.