A spatio-temporal pyramid matching for video retrieval

作者：Choi Jaesik; Wang Ziyu; Lee Sang Chul; Jeon Won J^*

来源：Computer Vision and Image Understanding, 2013, 117(6): 660-669.

DOI：10.1016/j.cviu.2013.02.003

• Video retrieval
• Query by video clip
• High-activity videos
• Sport videos
• Pyramid matching
• Spatio-temporal pyramid matching

An efficient video retrieval system is essential to search relevant video contents from a large set of video clips, which typically contain several heterogeneous video clips to match with. In this paper, we introduce a content-based video matching system that finds the most relevant video segments from video database for a given query video clip. Finding relevant video clips is not a trivial task, because objects in a video clip can constantly move over time. To perform this task efficiently, we propose a novel video matching called Spatio-Temporal Pyramid Matching (STPM). Considering features of objects in 2D space and time, STPM recursively divides a video clip into a 3D spatio-temporal pyramidal space and compares the features in different resolutions. In order to improve the retrieval performance, we consider both static and dynamic features of objects. We also provide a sufficient condition in which the matching can get the additional benefit from temporal information. The experimental results show that our STPM performs better than the other video matching methods.

• 出版日期2013-6