A Highly Efficient Compression Framework for Time-Varying 3-D Facial Expressions

作者：Hou Junhui^*; Chau Lap Pui; Zhang Minqi; Magnenat Thalmann Nadia; He Ying

来源：IEEE Transactions on Circuits and Systems for Video Technology, 2014, 24(9): 1541-1553.

DOI：10.1109/TCSVT.2014.2313890

• Geometry video (GV)
• low-rank and sparse matrix decomposition (LRSMD)
• optimal bit allocation
• rate and distortion models
• time-varying 3-D mesh

The rapid recent development of 3-DTV technology has led to an increase in studies on mesh-based 3-D scene representation. Compressing 3-D time-varying meshes is critical for the storage and transmission of 3-D contents. This paper proposes a highly efficient framework for compressing time-varying 3-D facial expressions. We use the near-isometric property of human facial expressions to parameterize the 3-D dynamic faces into an expression-invariant 2-D canonical domain that will naturally generate 2-D geometry videos (GVs). Considering the intrinsic properties of GVs, we apply low-rank and sparse matrix decomposition (LRSMD) separately to three dimensions of GVs (namely, X, Y, and Z). Based on our high precision rate and distortion models for GVs, we further compress the components from LRSMD using a video encoder in which bitrates of all components are assigned optimally according to the target bitrate. Experimental results show that the proposed scheme can significantly improve compression performance in terms of rate-distortion performance and visual quality compared with the state-of-the-art algorithms.

• 出版日期2014-9
• 单位南阳理工学院