An efficient temporal distortion measure of videos based on spacetime texture

作者：Peng Peng^*; Liao Danping; Li Ze Nian

来源：Pattern Recognition, 2017, 70: 1-11.

DOI：10.1016/j.patcog.2017.04.031

• Video quality assessment
• Temporal distortion measure
• Spacetime texture
• Spatio-temporal oriented energy (SOE)
• Visual saliency

Objective video quality assessment (VQA) plays an important role in controlling video quality. Most of the existing VQA methods measure motion-related temporal distortion based on optical-flow methods, which are not consistently reliable in modeling general visual dynamics. This paper presents a full-reference temporal distortion measure based on spacetime texture, a uniform and distributive descriptor of a broad set of spacetime structures. Our method measures the distortion of spacetime texture in video with a motion-tuning strategy, which effectively captures temporal distortion along the motion trajectories. Then it estimates self-information based visual saliency for spatial pooling by reusing the motion descriptors. We evaluated our method on two public VQA databases with a wide variety of distortion types, in which the videos were viewed on a large screen or mobile devices. The results show that our method correlates highly with the subjective quality and has high computational efficiency.

• 出版日期2017-10