Affiliation:
1. School of Cyberspace Security Gansu University of Political Science and Law Lanzhou China
2. Gansu O.M.Y. Information Technology Co. LTD Lanzhou Jiaotong University Science and Technology Park Incubation Building Lanzhou China
Abstract
AbstractA novel video summarisation method called the Hyperbolic Graph Convolutional Network (HVSN) is proposed, which addresses the challenges of summarising edited videos and capturing the semantic consistency of video shots at different time points. Unlike existing methods that use linear video sequences as input, HVSN leverages Hyperbolic Graph Convolutional Networks (HGCNs) and an adaptive graph convolutional adjacency matrix network to learn and aggregate features from video shots. Moreover, a feature fusion mechanism based on the attention mechanism is employed to facilitate cross‐module feature fusion. To evaluate the performance of the proposed method, experiments are conducted on two benchmark datasets, TVSum and SumMe. The results demonstrate that HVSN achieves state‐of‐the‐art performance, with F1‐scores of 62.04% and 50.26% on TVSum and SumMe, respectively. The use of HGCNs enables the model to better capture the complex spatial structures of video shots, and thus contributes to the improved performance of video summarisation.
Funder
Natural Science Foundation of Gansu Province
Publisher
Institution of Engineering and Technology (IET)
Subject
Computer Vision and Pattern Recognition,Software
Reference40 articles.
1. VSUMM: A mechanism designed to produce static video summaries and a novel evaluation method
2. Spatio-temporal feature-based keyframe detection from video shots using spectral clustering
3. Video summarization generation model based on improved bi‐directional long short‐term memory network;WU G.L.;J. Comput. Appl.,2021
4. Video summarization generation based on self‐attention mechanism and random forest regression;WU G.L.;Comput. Eng. Appl.,2022