Affiliation:
1. Faculty of Automatic Control and Computer Science, University Politehnica of Bucharest, 006042 Bucharest, Romania
Abstract
The manner of walking (gait) is a powerful biometric that is used as a unique fingerprinting method, allowing unobtrusive behavioral analytics to be performed at a distance without subject cooperation. As opposed to more traditional biometric authentication methods, gait analysis does not require explicit cooperation of the subject and can be performed in low-resolution settings, without requiring the subject’s face to be unobstructed/clearly visible. Most current approaches are developed in a controlled setting, with clean, gold-standard annotated data, which powered the development of neural architectures for recognition and classification. Only recently has gait analysis ventured into using more diverse, large-scale, and realistic datasets to pretrained networks in a self-supervised manner. Self-supervised training regime enables learning diverse and robust gait representations without expensive manual human annotations. Prompted by the ubiquitous use of the transformer model in all areas of deep learning, including computer vision, in this work, we explore the use of five different vision transformer architectures directly applied to self-supervised gait recognition. We adapt and pretrain the simple ViT, CaiT, CrossFormer, Token2Token, and TwinsSVT on two different large-scale gait datasets: GREW and DenseGait. We provide extensive results for zero-shot and fine-tuning on two benchmark gait recognition datasets, CASIA-B and FVG, and explore the relationship between the amount of spatial and temporal gait information used by the visual transformer. Our results show that in designing transformer models for processing motion, using a hierarchical approach (i.e., CrossFormer models) on finer-grained movement fairs comparatively better than previous whole-skeleton approaches.
Funder
CRC research
Google IoT/Wearables Student Grants
Keysight Master Research Sponsorship
Subject
Electrical and Electronic Engineering,Biochemistry,Instrumentation,Atomic and Molecular Physics, and Optics,Analytical Chemistry
Reference51 articles.
1. Gait pattern analysis and clinical subgroup identification: A retrospective observational study;Kyeong;Medicine,2020
2. Embodiment of Sadness and Depression—Gait Patterns Associated With Dysphoric Mood;Michalak;Psychosom. Med.,2009
3. Gait-related risk factors for exercise-related lower-leg pain during shod running;Willems;Med. Sci. Sports Exerc.,2007
4. Vision-based gait recognition: A survey;Singh;IEEE Access,2018
5. Makihara, Y., Nixon, M.S., and Yagi, Y. (2020). Gait recognition: Databases, representations, and applications. Comput. Vis. Ref. Guide, 1–13.
Cited by
2 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献