Affiliation:
1. School of Telecommunications Engineering, Xidian University, Xi’an 710071, China
Abstract
Due to the proliferation of video data in Internet of Things (IoT) systems, in order to reduce the data burden, most social media platforms typically employ downsampling to reduce the resolution of high-resolution (HR) videos before video coding. Consequently, the loss of detail and the introduction of additional artifacts seriously compromise the quality of experience (QoE). Recently, the task of compressive video super-resolution (CVSR) has garnered significant attention, aiming to simultaneously eliminate compression artifacts and enhance the resolution of compressed videos. In this paper, we propose an edge-oriented compressed video super-resolution network (EOCVSR), which focuses on reconstructing higher-quality details, to effectively address the CVSR task. Firstly, we devised a motion-guided alignment module (MGAM) to achieve precise bi-direction motion compensation in a multi-scale manner. Secondly, we introduced an edge-oriented recurrent block (EORB) to reconstruct edge information by combining the merits of explicit and implicit edge extraction. In addition, benefiting from the recurrent structure, the receptive field of EOCVSR can be enhanced and the features can be effectively refined without introducing additional parameters. Extensive experiments conducted on benchmark datasets demonstrate that our method surpasses the performance of state-of-the-art (SOTA) approaches in both quantitative and qualitative evaluations. Our approach can provide users with high-quality and cost-effective HR videos by integrating with sensors and codecs.
Subject
Electrical and Electronic Engineering,Biochemistry,Instrumentation,Atomic and Molecular Physics, and Optics,Analytical Chemistry
Reference26 articles.
1. Dai, Y., Liu, D., and Wu, F. (2017, January 4–6). A convolutional neural network approach for post-processing in HEVC intra coding. Proceedings of the MultiMedia Modeling: 23rd International Conference, MMM 2017, Reykjavik, Iceland. Proceedings, Part I 23.
2. Wang, T., Chen, M., and Chao, H. (2017, January 4–7). A novel deep learning-based method of improving coding efficiency from the decoder-end for HEVC. Proceedings of the 2017 Data Compression Conference (DCC), Snowbird, UT, USA.
3. Efficient in-loop filtering based on enhanced deep convolutional neural networks for HEVC;Pan;IEEE Trans. Image Process.,2020
4. Yang, R., Xu, M., Wang, Z., and Li, T. (2018, January 18–23). Multi-frame quality enhancement for compressed video. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.
5. MFQE 2.0: A new approach for multi-frame quality enhancement on compressed video;Guan;IEEE Trans. Pattern Anal. Mach. Intell.,2019