A new framework of action recognition with discriminative parts, spatio-temporal and causal interaction descriptors

作者：Tong, Ming^*; Chen, Yiran; Zhao, Mengao; Tian, Weijuan

来源：Journal of Visual Communication and Image Representation, 2018, 56: 116-130.

DOI：10.1016/j.jvcir.2018.09.001

• Action recognition
• Spectral clustering
• Discriminative constraint
• Action part
• Spatio-temporal relationship
• Causal relationship

To improve action recognition performance, a novel discriminative spectral clustering method is firstly proposed, by which the candidate parts with the internal trajectories being close in spatial position, consistent in appearance and similar in motion velocity are mined. Furthermore, the discriminative constraint is introduced to select discriminative parts. Meanwhile, by fully considering the local and global distributions of data, a new similarity matrix is constructed, which enhances clustering effect. Secondly, the spatio-temporal interaction descriptor and causal interaction descriptor are constructed respectively, which fully mine the spatio-temporal and implicit causal interactive relationships between parts. Finally, a new framework is proposed. By associating the discriminative parts, spatio-temporal and causal interaction descriptors together as the inputs of Latent Support Vector Machine (LSVM), the correlations between action categories and action parts as well as interaction descriptors are mined. Consequently, accuracy is enhanced. The extensive and adequate experiments demonstrate the effectiveness of the proposed method.

• 出版日期2018-10
• 单位西安电子科技大学