Real‐time face perception based encoding strategy optimization method for UHD videos

Abstract

AbstractFace regions containing rich semantic information appear frequently in the videos. As the video resolution increase dramatically, the face regions will inevitably attract more attentions. This paper proposes a face perception based coding scheme to improve the visual quality of the face regions in UHD videos. A specially tailored face perception model is first utilized to precisely and quickly locate the face regions. Then, a face perception map is generated based on a hierarchical mapping algorithm. Finally, the face perception map is employed as a guidance to optimize the encoding process, including mode decision, block partition and bit allocation. The proposed method is implemented on HEVC to demonstrate the effectiveness. Experimental results on a set of 4K test sequences show that the proposed method can obviously improve the objective and subjective quality of the face regions, while causing only slight quality decline over the rest of the frame. Additionally, the computation required for mode decision and block partition is reduced, thereby saving encoding time cost.