Muscular Movement Model-Based Automatic 3D/4D Facial Expression Recognition

作者：Zhen, Qingkai; Huang, Di^*; Wang, Yunhong; Chen, Liming

来源：IEEE Transactions on Multimedia, 2016, 18(7): 1438-1450.

DOI：10.1109/TMM.2016.2557063

• 3D/4D facial expression recognition
• muscle movement model (MMM)
• shape representation

Facial expression is an important channel for human nonverbal communication. This paper presents a novel and effective approach to automatic 3D/4D facial expression recognition based on the muscular movement model (MMM). In contrast to most of existing methods, the MMM deals with such an issue in the viewpoint of anatomy. It first automatically segments the input 3D face (frame) by localizing the corresponding points within each muscular region of the reference using iterative closest normal point. A set of features with multiple differential quantities, including coordinate, normal, and shape index values, are then extracted to describe the geometry deformation of each segmented region. Meanwhile, we analyze the importance of these muscular areas, and a score level fusion strategy is exploited to optimize their weights by the genetic algorithm in the learning step. The support vector machine and the hidden Markov model are finally used to predict the expression label in 3D and 4D, respectively. The experiments are conducted on the BU-3DFE and BU-4DFE databases, and the results achieved clearly demonstrate the effectiveness of the proposed method.

• 出版日期2016-7
• 单位北京航空航天大学