Visual Perception Based Algorithm for Fast Depth Intra Coding of 3D-HEVC
This paper utilizes the characteristics of human visual system to propose a fast algorithm based on visual perception for the acceleration of the depth intra coding for 3D-HEVC.
Fig. 1. Quadtree structure of the CU split in 3D-HEVC
Technology Overview
For CU early termination, we combine the check of the boundary continuity, RD-cost limitation and distribution of the perceptual and directional edges to avoid the recursive CU split of the smooth CTU.
Applications & Benefits
We propose a fast algorithm for intra prediction and CU splitting using visual perception of depth map. Experimental results show that the proposed method significantly reduces the computation time of depth intra coding and outperforms numerous previous works with much better time-saving performance and ignorable efficiency loss.
Abstract：
3D-HEVC (The 3D Extension of High Efficiency Video Coding), is the newest 3D video coding standard, which enriches multimedia applications with the video format of multi-view plus depth. For the depth map coding in 3D-HEVC, the advanced coding tools enhance the coding efficiency of the depth map and the quality of the synthesized view. However, the time consumption and complexity of 3D-HEVC also increase significantly. This paper utilizes the characteristics of human visual system to propose a fast algorithm based on visual perception for the acceleration of the depth intra coding for 3D-HEVC. The depth map is segmented into different regions by Otsu's auto-thresholding. The dominate edge direction is categorized for each prediction unit. We detect the perceptual edge based on just noticeable depth difference model to extract the area that may affect the visual perception. According to depth map segmentation and edge distribution, we reduce the corresponding intra angular modes and determine whether to perform depth modelling mode. We also incorporate the boundary continuity and rate-distortion cost thresholding to propose the fast coding unit decision. The experimental results show that the proposed algorithm eliminates 53.09% of the depth coding time with only 0.15% BDBR on average. The coding performances of the proposed algorithm outperform previous works significantly.
Visual Perception Based Algorithm for Fast Depth Intra Coding of 3D-HEVC
Author：Lin J., Chen M., Yeh C., Chen Y., Kau L., Chang C., Lin M.
Year：2021
Source publication：IEEE Transactions on Multimedia ( Early Access )
Subfield Highest percentage：99% Media Technology #1/61