Affiliation:
1. The Department of Decision Consulting Party School of Liaoning Provincial Party Committee Shenyang China
2. The College of Economics and Management Shenyang Agricultural University Shenyang China
Abstract
AbstractThe behaviour analysis of farmers is very important to gradually improve the sustainable production capacity of the land and promote the economics reasonable increasement. How to effectively extract video features and identify human behaviour is a current research hotspot. In this paper, the authors propose a convolutional neural network model based on the deformable convolution including a residual module and an attention module. The model fuses and encodes video spatial features on the time axis and extracts semantic information. The authors combine the attention mechanism to extract local and global features in the video, which are used to calculate spatial features and micro‐motion features, respectively. Temporal attention mechanism fuses each micro‐motion feature of video to extract higher‐level semantic features of motion. Next, the authors describe their proposed model based on deep learning. First, the authors introduce a video frame sampling method based on the TRN algorithm. Second, they design a feature extraction and fusion model based on the ResNet model and the attention mechanism that extract local and global features in videos. Finally, the authors classify and identify the extracted video features through the classifier. The authors’ approach shows comparable performance on publicly available datasets.
Funder
National Natural Science Foundation of China
Natural Science Foundation of Guangdong Province
Publisher
Institution of Engineering and Technology (IET)
Subject
Electrical and Electronic Engineering,Control and Optimization,Computer Science Applications,Human-Computer Interaction,Control and Systems Engineering