Author:
Bhushan Ravi,Kulkarni Karthik,Pandey Vishal Kumar,Rawls Connor,Mechtley Brandon,Jayasuriya Suren,Ziegler Christian
Abstract
This paper presents the design of a multimodal chatbot for use in an interactive theater performance. This chatbot has an architecture consisting of vision and natural language processing capabilities, as well as embodiment in a non-anthropomorphic movable LED array set in a stage. Designed for interaction with up to five users at a time, the system can perform tasks including face detection and emotion classification, tracking of crowd movement through mobile phones, and real-time conversation to guide users through a nonlinear story and interactive games. The final prototype, named ODO, is a tangible embodiment of a distributed multimedia system that solves several technical challenges to provide users with a unique experience through novel interaction.
Subject
Computer Networks and Communications,Computer Science Applications,Human-Computer Interaction,Neuroscience (miscellaneous)
Reference47 articles.
1. The Design and Implementation of XiaoIce, an Empathetic Social Chatbot
2. A Deep Learning Based Chatbot for Campus Psychological Therapy;Yin;arXiv,2019
3. Universal sentence encoder;Cer;arXiv,2018
4. Real-time convolutional neural networks for emotion and gender classification;Arriaga;arXiv,2017
Cited by
8 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献