Author:
Tang Yongkang, ,Vu Hai An,Le Phuc Q.,Masano Daisuke,Thet OoHan,Fatichah Chastine,Liu Zhentao,Yamaguchi Masashi,Tangel Martin Leonard,Dong Fangyan,Yamazaki Yoichi,Hirota Kaoru,
Abstract
A multimodal gesture recognition method for mascot robot system is proposed based on Choquet integral by fusing camera and 3D accelerometer data. The optimization of two fuzzy measures in the training phase for two recognition units, i.e., camera-based and accelerometer-based units, obtains enough recognition rate of 92.7% for 8 types of gestures by improving the recognition rate approximate 20% compared with that of each unit. The proposed method targets casual communication from humans to robots by integrating nonverbal gesture messages and verbal messages.
Publisher
Fuji Technology Press Ltd.
Subject
Artificial Intelligence,Computer Vision and Pattern Recognition,Human-Computer Interaction
Reference18 articles.
1. Y. Yamazaki, H. A. Vu et al., “Mascot Robot System by Integrating Eye Robot and Speech Recognition Using RT Middleware and its Casual Information Recommendation,” 3rd Int. Symposium on Computational Intelligence and Industrial Applications (ISCIIA2008), pp. 375-384, 2008.
2. H. A. Vu, Y. Yamazaki et al., “The Interrupt of Mascot Robot System Embedded in RT Middleware Based on Fuzzy Logic,” FACTA UNIVERSITATIS Series: Mechanics, Automatic Control and Robotics, Vol.7, No.1, pp. 11-28, 2009.
3. C. Shan, T. Tan et al., “Real-time Hand Tracking Using aMean Shift Embedded Particle Filter,” J. of the Pattern Recognition Society, 1958-1970, 2007.
4. E. Huber and D. Kortenkamp, “A Behavior Based Approach to Active Stereo Vision for Mobile Robots,” Engineering Applications of Artificial Intelligence J., pp. 229-243, 1998.
5. R. Douglas-Cowie, E. Tsapatsoulis et al., “Emotion Recognition in Human-Computer Interaction,” Signal Process Magazine, IEEE, Vol.18, No.1, pp. 32-80, 2001.
Cited by
3 articles.
订阅此论文施引文献
订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献