Affiliation:
1. University of Houston at Victoria TX
2. University of Houston Houston, TX
Abstract
Abstract
In this article, we present a live speech-driven, avatar-mediated, three-party telepresence system, through which three distant users, embodied as avatars in a shared 3D virtual world, can perform natural three-party telepresence that does not require tracking devices. Based on live speech input from three users, this system can real-time generate the corresponding conversational motions of all the avatars, including head motion, eye motion, lip movement, torso motion, and hand gesture. All motions are generated automatically at each user side based on live speech input, and a cloud server is utilized to transmit and synchronize motion and speech among different users. We conduct a formal user study to evaluate the usability and effectiveness of the system by comparing it with a well-known online virtual world, Second Life, and a widely-used online teleconferencing system, Skype. The user study results indicate our system can provide a measurably better telepresence user experience than the two widely-used methods.
Subject
Computer Vision and Pattern Recognition,Human-Computer Interaction,Control and Systems Engineering,Software
Reference70 articles.
1. Fast generation of realistic virtual humans;Achenbach;Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology,2017
2. The influence of avatar representation and behavior on communication in social immersive virtual environments;Aseeri;Proceedings of IEEE Conference on Virtual Reality and 3D User Interfaces,2018
3. Remote collaboration using augmented reality videoconferencing;Barakonyi,2004
4. Ubiquitous collaborative activity virtual environments;Basu,2012
Cited by
4 articles.
订阅此论文施引文献
订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献
1. A Review of 3D Avatar Reconstruction for Virtual Conferencing;Lecture Notes in Networks and Systems;2024
2. Multimodal Turn Analysis and Prediction for Multi-party Conversations;INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION;2023-10-09
3. Enhancing Teleoperated Robot Customer Service through Speech Monitoring and Filtering;2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS);2023-10-01
4. S2M-Net: Speech Driven Three-party Conversational Motion Synthesis Networks;Proceedings of the 15th ACM SIGGRAPH Conference on Motion, Interaction and Games;2022-11-03