Affiliation:
1. School of Electrical Engineering, University of Belgrade, Bulevar kralja Aleksandra 73, 11120 Belgrade, Serbia
Abstract
In recent years, video research has dealt with high-frame-rate (HFR) content. Even though low or standard frame rates (SFR) that correspond to values less than 60 frames per second (fps) are still covered. Temporal conversions are applied accompanied with video compression and, thus, it is of importance to observe and detect possible effects of typical compressed video manipulations over HFR (60 fps+) content. This paper addresses ultra-high-definition HFR content via Hurst index as a measure of long-range dependency (LRD), as well as using Legendre multifractal spectrum, having in mind standard high-efficiency video coding (HEVC) format and temporal resolution recovery (TRR), meaning frame upconversion after temporal filtering of compressed content. LRD and multifractals-based studies using video traces have been performed for characterization of compressed video, and they are mostly presented for advanced video coding (AVC). Moreover, recent studies have shown that it is possible to perform TRR detection for SFR data compressed with standards developed before HEVC. In order to address HEVC HFR data, video traces are analyzed using LRD and multifractals, and a novel TRR detection model is proposed based on a weighted k-nearest neighbors (WkNN) classifier and multifractals. Firstly, HFR video traces are gathered using six constant rate factors (crfs), where Hurst indices and multifractal spectra are calculated. According to TRR and original spectra comparison, a novel detection model is proposed based on new multifractal features. Also, five-fold cross-validation using the proposed TRR detection model gave high-accuracy results of around 98%. The obtained results show the effects on LRD and multifractality and their significance in understanding changes in typical video manipulation. The proposed model can be valuable in video credibility and quality assessments of HFR HEVC compressed content.
Funder
Ministry of Science, Technological Development and Innovation of the Republic of Serbia
Subject
Fluid Flow and Transfer Processes,Computer Science Applications,Process Chemistry and Technology,General Engineering,Instrumentation,General Materials Science
Reference84 articles.
1. A study of high frame rate video formats;Mackin;IEEE Trans. Multimed.,2018
2. High frame-rate television;Armstrong;SMPTE Motion Imaging J.,2009
3. Ultra-high-definition television (Rec. ITU-R BT. 2020): A generational leap in the evolution of television [standards in a nutshell];Sugawara;IEEE Signal Process. Mag.,2014
4. ATSC: Beyond Standards and a Look at the Future;Noland;SMPTE Motion Imaging J.,2021
5. Advanced Television Systems Committee (ATSC) (2023, May 20). ATSC 3.0 Standards. [Online]. Available online: https://www.atsc.org/standards/atsc-3-0-standards/;https://prdatsc.wpenginepowered.com/wp-content/uploads/2021/04/A341-2019-Video-HEVC.pdf.