Multi-features combinatorial optimization for keyframe extraction
-
Published:2023
Issue:10
Volume:31
Page:5976-5995
-
ISSN:2688-1594
-
Container-title:Electronic Research Archive
-
language:
-
Short-container-title:era
Author:
Ma Lei12, Wang Weiyu12, Zhang Yaozong12, Shi Yu12, Huang Zhenghua12, Hong Hanyu12
Affiliation:
1. School of Electrical and Information Engineering, Wuhan Institute of Technology, Wuhan 430205, China 2. Hubei Key Laboratory of Optical Information and Pattern Recognition, Wuhan 430205, China
Abstract
<abstract><p>Recent advancements in network and multimedia technologies have facilitated the distribution and sharing of digital videos over the Internet. These long videos contain very complex contents. Additionally, it is very challenging to use as few frames as possible to cover the video contents without missing too much information. There are at least two ways to describe these complex videos contents with minimal frames: the keyframes extracted from the video or the video summary. The former lays stress on covering the whole video contents as much as possible. The latter emphasizes covering the video contents of interest. As a consequence, keyframes are widely used in many areas such as video segmentation and object tracking. In this paper, we propose a keyframe extraction method based on multiple features via a novel combinatorial optimization algorithm. The key frame extraction is modeled as a combinatorial optimization problem. A fast dynamic programming algorithm based on a forward non-overlapping transfer matrix in polynomial time and a 0-1 integer linear programming algorithm based on an overlapping matrix is proposed to solve our maximization problem. In order to quantitatively evaluate our approach, a long video dataset named 'Animal world' is self-constructed, and the segmentation evaluation criterions are introduced. A good result is achieved on 'Animal world' dataset and a public available Keyframe-Sydney KFSYD dataset <sup>[<xref ref-type="bibr" rid="b1">1</xref>]</sup>.</p></abstract>
Publisher
American Institute of Mathematical Sciences (AIMS)
Subject
General Mathematics
Reference45 articles.
1. G. Guan, Z. Wang, S. Lu, J. Deng, D. Feng, Keypoint-based keyframe selection, IEEE Trans. Circuits Syst. Video Technol., 23 (2013), 729–734. https://doi.org/10.1007/978-1-4684-2001-2-9 2. Z. Dong, G. Zhang, J. Jia, H. Bao, Keyframe-based real-time camera tracking, in IEEE International Conference on Computer Vision, (2009), 1538–1545. https://doi.org/10.1109/ICCV.2009.5459273 3. C. Huang, E. Boyer, N. Navab, S. Ilic, Human shape and pose tracking using keyframes, in IEEE Conference on Computer Vision and Pattern Recognition, (2014), 3446–3453. https://doi.org/10.1109/CVPR.2014.440 4. C. Vondrick, D. Ramanan, Video annotation and tracking with active learning, in Conference on Neural Information Processing Systems, (2011), 28–36. 5. Z. Li, G. M. Schuster, A. K. Katsaggelos, MINMAX optimal video summarization, IEEE Trans. Circuits Syst. Video Technol., 15 (2005), 1245–1256. https://doi.org/10.1109/TCSVT.2005.854230
|
|