Affiliation:
1. School of Computer Science and Technology, College of Intelligence and Computing Tianjin University Tianjin People's Republic of China
2. Tianjin Key Laboratory of Cognitive Computing and Application Tianjin University Tianjin People's Republic of China
Abstract
AbstractIn recent years, the short video industry is booming. However, there are still many difficulties in the action generation of virtual characters. We observed that on the short video social platform, “hand gesture dance” is a very popular short video form. However, its development is limited by the professionalism of choreography. In order to solve these problems, we propose an intelligent choreography framework, which can generate new gesture sequences for unseen audio based on pairing data in the database. Our framework adopts multimodal method and obtains excellent results. In additional, we collected and produced the first and largest pair labeled hand gesture dance data set. Various experiments showed that our results not only generate smooth and rich action sequences, but also collect some semantic information contained in the audio.
Funder
National Natural Science Foundation of China
Subject
Computer Graphics and Computer-Aided Design,Software
Reference41 articles.
1. An automatic system for humanoid dance creation;Manfrè A;Biol Inspired Cogn Archit,2016
2. Music-Driven Dance Generation