Automatic Visual Concept Learning for Social Event Understanding

作者:Yang, Xiaoshan*; Zhang, Tianzhu; Xu, Changsheng; Hossain, M. Shamim
来源:IEEE Transactions on Multimedia, 2015, 17(3): 346-358.
DOI:10.1109/TMM.2015.2393635

摘要

Vision-based event analysis is extremely difficult due to the various concepts (object, action, and scene) contained in videos. Though visual concept-based event analysis has achieved significant progress, it has two disadvantages: visual concept is defined manually, and has only one corresponding classifier in traditional methods. To deal with these issues, we propose a novel automatic visual concept learning algorithm for social event understanding in videos. First, instead of defining visual concept manually, we propose an effective automatic concept mining algorithm with the help of Wikipedia, N-gram Web services, and Flickr. Then, based on the learned visual concept, we propose a novel boosting concept learning algorithm to iteratively learn multiple classifiers for each concept to enhance its representative discriminability. The extensive experimental evaluations on the collected dataset well demonstrate the effectiveness of the proposed algorithm for social event understanding.

  • 出版日期2015-3
  • 单位中国科学院; 模式识别国家重点实验室