Sparsity in Dynamics of Spontaneous Subtle Emotions: Analysis and Application

作者：Anh Cat Le Ngo^*; See John; Phan Raphael C W

来源：IEEE Transactions on Affective Computing, 2017, 8(3): 396-411.

DOI：10.1109/TAFFC.2016.2523996

• Spontaneous subtle emotions
• emotion suppression
• data sparsity
• dynamic mode decomposition
• Micro-expression recognition

Subtle emotions are present in diverse real-life situations: in hostile environments, enemies and/or spies maliciously conceal their emotions as part of their deception; in life-threatening situations, victims under duress have no choice but to with hold their real feelings; in the medical scene, patients with psychological conditions such as depression could either be intentionally or subconsciously suppressing their anguish from loved ones. Under such circumstances, it is often crucial that these subtle emotions are recognized before it is too late. These spontaneous subtle emotions are typically expressed through micro-expressions, which are tiny, sudden and short-lived dynamics of facial muscles; thus, such micro-expressions pose a great challenge for visual recognition. The abrupt but significant dynamics for the recognition task are temporally sparse while the rest, i.e. irrelevant dynamics, are temporally redundant. In this work, we analyze and enforce sparsity constraints to learn significant temporal and spectral structures while eliminating irrelevant facial dynamics of micro-expressions, which would ease the challenge in the visual recognition of spontaneous subtle emotions. The hypothesis is confirmed through experimental results of automatic spontaneous subtle emotion recognition with several sparsity levels on CASME II and SMIC, the two well-established and publicly available spontaneous subtle emotion databases. The overall performances of the automatic subtle emotion recognition are boosted when only significant dynamics of the original sequences are preserved.

• 出版日期2017-9