A VR-Enabled Chatbot Supporting Design and Manufacturing of Large and Complex Power Transformers

Abstract

Virtual reality (VR) immersive technology allows users to experience enhanced reality using human–computer interfaces (HCI). Many systems have implemented VR with improved HCI to provide strategic market advantages for industry and engineering applications. An intelligent chatbot is a conversational system capable of natural language communication allowing users to ask questions and receive answers online to enhance customer services. This research develops and implements a system framework for a VR-enabled large industrial power transformer mass-customization chatbot. The research collected 1272 frequently asked questions (FAQs) from a power transformer manufacturers’ knowledge base that is used for question matching and answer retrieval. More than 1.2 million Wikipedia engineering pages were used to train a word-embedding model for natural language understanding of question intent. The complex engineering questions and answers are integrated with an immersive VR computer human interface. The system enables users to ask questions and receive explicit and detailed answers combined with 3D immersive images of industrial sized power transformer assemblies. The user interfaces can be projected into the VR headwear or computer screen and manipulated with a controller. The unique immersive VR consultation chatbot system is to support real-time design consultation for the design and manufacturing of complex power transformers.