Human Action Detection and Recognition: A Pragmatic Approach using Multiple Feature Extraction Techniques and Convolutional Neural Networks-Reference-Cited by-同舟云学术

Human Action Detection and Recognition: A Pragmatic Approach using Multiple Feature Extraction Techniques and Convolutional Neural Networks

Published:2022-12-19 Issue: Volume: Page:
ISSN:
Container-title:
language:
Short-container-title:

Author:

Basavaiah Jagadeesh¹^ORCID,Anthony Audre Arlene¹

Affiliation:

1. Vidyavardhaka College of Engineering

Abstract

Abstract Action recognition is described as the capability of determining the action that a human exhibit in the video. Latest innovations in either deep-learning or hand-crafted methods substantially increased the accuracy of action recognition. However, there are many issues, which keep action recognition task far from being solved. The task of human action recognition persists to be complicated and challenging due to the high complexity associated with human actions such as motion pattern variation, appearance variation, viewpoint variation, occlusions, background variation and camera motion. This paper presents a computational approach for human action recognition using video datasets through different stages: Detection, tracking of human and recognition of actions. Human detection and tracking are carried out using Gaussian Mixture Model (GMM) and Kalman filtering respectively. Different feature extraction techniques such as Scale Invariant Feature Transform (SIFT), Optical Flow Estimation, Bi-dimensional Empirical Mode Decomposition (BEMD), Discrete Wavelet Transform (DWT) are used to extract optimal features from the video frames. The features are fed to the Convolutional Neural Network classifier to recognize and classify the actions. Three datasets viz. KTH, Weizmann and Own created datasets are used to evaluate the performance of the developed method. Using SIFT, BEMD and DWT multiple feature extraction technique, the proposed method is called Hybrid Feature Extraction – Convolutional Neural Network based Video Action Recognition (HFE-CNN-VAR) method. The results of the work demonstrated that the HFE-CNN-VAR method enhanced the accuracy of action classification. The accuracy of classification is 99.33% for Weizmann dataset, 99.01% for KTH dataset and 90% for own dataset. Results of the experiment and comparative analysis shows that proposed approach surpasses when compared with other contemporary techniques.

Publisher

Research Square Platform LLC

Reference31 articles.

1. Xinyu Wu, Y., Ou, H., Qian, & Xu, Y. (2005). "A detetion system for human abnormal behavior," IEEE/RSJ International Conference on Intelligent Robots and Systems, 2005, pp. 1204–1208, https://doi.org/10.1109/IROS.2005.1545205

2. "Deep convolutional framework for abnormal behavior detection in a smart surveillance system.";Ko KE;Engineering Applications of Artificial Intelligence vol,2018

3. Aran, O., Sanchez-Cortes, D., Do, M. T., & Gatica-Perez, D. (2016). Anomaly Detection in Elderly Daily Behavior in Ambient Sensing Environments. In M. Chetouani, J. Cohn, & A. Salah (Eds.), Human Behavior Understanding. HBU 2016 (9997 vol.). Cham: Springer. Lecture Notes in Computer Science()https://doi.org/10.1007/978-3-319-46843-3_4.

4. Gutzeit, L., Otto, M., Kirchner, E. A. Simple and Robust Automatic Detection and Recognition of Human Movement Patterns in Tasks of Different Complexity. In: Holzinger, A., Pope, A., Plácido, Jin, C. B., Li, S., & Kim, H. (2019). 2017. Real-time action detection in video surveillance using sub-action descriptor with multi-cnn, https://doi.org/10.48550/arXiv.1710.03383

5. Ballan, L., Bertini, M., Del Bimbo, A., Seidenari, L., & Serra, G. (2009). December. Human action recognition and localization using spatio-temporal descriptors and tracking. In Proceedings of the Workshop on Pattern Recognition and Artificial Intelligence for Human Behaviour Analysis, Reggio Emilia, Italy (pp. 1–8).