Affiliation:
1. Czech Technical University in Prague, Czech Republic
Abstract
This paper presents a novel framework for easy creation of interactive, platform-independent voice-services with an animated 3D talking-head interface, on mobile phones. The Framework supports automated multi-modal interaction using speech and 3D graphics. The difficulty of synchronizing the audio stream to the animation is examined and alternatives for distributed network control of the animation and application logic is discussed. The ability of modern mobile devices to handle such applications is documented and it is shown that the power consumption trade-off of rendering on the mobile phone versus streaming from the server favors the phone. The presented tools will empower developers and researchers in future research and usability studies in the area of mobile talking-head applications (Figure 1). These may be used for example in entertainment, commerce, health care or education.
Subject
Human-Computer Interaction
Reference48 articles.
1. acbPocketSoft (n. d.). acbTaskMan for PocketPC. Retrieved from http://www.acbpocketsoft.com
2. Power-aware network swapping for wireless palmtop PCs
3. Agarwal, S. K., Chakraborty, D., Kumar, A., Nanavati, A. A., & Rajput, N. (2007). HSTP: Hyperspeech transfer protocol. In Proceedings of the Eighteenth Conference on Hypertext and Hypermedia (pp. 67-76). New York, NY: ACM Press.
4. Agarwal, S. K., Kumar, A., Nanavati, A., & Rajput, N. (2008). The world wide telecom web browser. In Proceeding of the 17th International Conference on World Wide Web (pp. 1121-1122). New York, NY: ACM Press.
5. Albrecht, I., Haber, J., & Seidel, H. (2002). Speech synchronization for physicsbased facial animation. In Proceedings of the 10th International Conference on Computer Graphics, Visualization, and Computer Vision (pp. 9-16).
Cited by
3 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献