Depth video spatial and temporal correlation enhancement algorithm based on just noticeable rendering distortion model

作者：Peng Zongju^*; Chen Fen; Jiang Gangyi; Yu Mei; Shao Feng; Ho Yo Song

来源：Journal of Visual Communication and Image Representation, 2015, 33: 309-322.

DOI：10.1016/j.jvcir.2015.10.003

• Three dimensional video system
• Depth video
• Just noticeable rendering distortion
• Virtual view rendering
• Spatial and temporal enhancement
• Human visual perception
• Depth video segmentation
• Bit rate saving

Spatial and temporal inconsistency of depth video deteriorates encoding efficiency in three dimensional video systems. A depth video processing algorithm based on human perception is presented. Firstly, a just noticeable rendering distortion (JNRD) model is formulated by combining the analyses of the influence of depth distortion on virtual view rendering with human visual perception characteristics. Then, depth video is processed based on the JNRD model from two aspects, spatial and temporal correlation enhancement. During the process of spatial correlation enhancement, depth video is segmented into edge, foreground, and background regions, and smoothened by Gaussian and mean filters. The operations of the temporal correlation enhancement include temporal-spatial transpose (TST), temporal smoothing filter and inverse TST. Finally, encoding and virtual view rendering experiments are conducted to evaluate the proposed algorithm. Experimental results show that the proposed algorithm can greatly reduce the bit rate while it maintains the quality of virtual view.

• 出版日期2015-11
• 单位宁波大学