Affiliation:
1. Department of Electrical Engineering, City University of Hong Kong, Hong Kong, China
Abstract
Image-based gender classification is very useful in many applications, such as intelligent surveillance, micromarketing, etc. One common approach is to adopt a machine learning algorithm to recognize the gender class of the captured subject based on spatio-temporal gait features extracted from the image. The image input can be generated from the video of the walking cycle, e.g., gait energy image (GEI). Recognition accuracy depends on the similarity of intra-class GEIs, as well as the dissimilarity of inter-class GEIs. However, we observe that, at some viewing angles, the GEIs of both gender classes are very similar. Moreover, the GEI does not exhibit a clear appearance of posture. We postulate that distinctive postures of the walking cycle can provide additional and valuable information for gender classification. This paper proposes a gender classification framework that exploits multiple inputs of the GEI and the characteristic poses of the walking cycle. The proposed framework is a cascade network that is capable of gradually learning the gait features from images acquired in multiple views. The cascade network contains a feature extractor and gender classifier. The multi-stream feature extractor network is trained to extract features from the multiple input images. Features are then fed to the classifier network, which is trained with ensemble learning. We evaluate and compare the performance of our proposed framework with state-of-the-art gait-based gender classification methods on benchmark datasets. The proposed framework outperforms other methods that only utilize a single input of the GEI or pose.
Funder
Research Grants Council of the Hong Kong Special Administrative Region, China
City University of Hong Kong Strategic Research Grant
Hong Kong Innovation and Technology Commission
Subject
Electrical and Electronic Engineering,Biochemistry,Instrumentation,Atomic and Molecular Physics, and Optics,Analytical Chemistry
Reference42 articles.
1. Multi-task learning on the edge for effective gender, age, ethnicity and emotion recognition;Foggia;Eng. Appl. Artif. Intell.,2023
2. A real-time multi-view gait-based automatic gender classification system using Kinect sensor;Azhar;Multimed. Tools Appl.,2022
3. Non-invasive multi-camera gait analysis system and its application to gender classification;Guffanti;IEEE Access,2020
4. Greco, A., Saggese, A., and Vento, M. (2020, January 3–5). Digital signage by real-time gender recognition from face images. Proceedings of the IEEE International Workshop on Metrology for Industry 4.0 & IoT, Roma, Italy.
5. A hybrid deep learning CNN-ELM for age and gender classification;Duan;Neurocomputing,2018