Abstract
Sign Languages (SLs) are visual–gestural languages that have developed naturally in deaf communities. They are based on the use of lexical signs, that is, conventionalized units, as well as highly iconic structures, i.e., when the form of an utterance and the meaning it carries are not independent. Although most research in automatic Sign Language Recognition (SLR) has focused on lexical signs, we wish to broaden this perspective and consider the recognition of non-conventionalized iconic and syntactic elements. We propose the use of corpora made by linguists like the finely and consistently annotated dialogue corpus Dicta-Sign-LSF-v2. We then redefined the problem of automatic SLR as the recognition of linguistic descriptors, with carefully thought out performance metrics. Moreover, we developed a compact and generalizable representation of signers in videos by parallel processing of the hands, face and upper body, then an adapted learning architecture based on a Recurrent Convolutional Neural Network (RCNN). Through a study focused on the recognition of four linguistic descriptors, we show the soundness of the proposed approach and pave the way for a wider understanding of Continuous Sign Language Recognition (CSLR).
Subject
Computational Mathematics,Computational Theory and Mathematics,Numerical Analysis,Theoretical Computer Science
Reference68 articles.
1. Sign Language Structure: An Outline of the Visual Communication Systems of the American Deaf. Studies in Linguistics;Stokoe;Stud. Linguist.,1960
2. French Sign Language: Proposition of a Structural Explanation by Iconicity;Cuxac,1999
3. Verbal and Sign Languages. Comparing Structures, Constructs, Methodologies;Pizzuto,2007
4. An Investigation into the Syntactic Structure of American Sign Language;Liddell,1977
5. Elicited imitation of verb agreement in American Sign Language: Iconically or morphologically determined?
Cited by
2 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献