Automatic video activity detection using compressed domain motion trajectories for H.264 videos

作者：Liu Haowei^*; Sun Ming Ting; Wu Ruei Cheng; Yu Shiaw Shian

来源：Journal of Visual Communication and Image Representation, 2011, 22(5): 432-439.

DOI：10.1016/j.jvcir.2011.03.010

• Activity detection
• Vehicle tracking
• Compressed domain processing
• H.264 videos
• Object classification
• Trajectory classification
• Motion vector tracking
• Residual error tracking

Most automatic event detection methods for video surveillance detect target events based on features extracted in the pixel domain. However, in practice, surveillance videos are often compressed. It is desirable to perform automatic event detection in the compressed domain directly so that the video does not need to be decoded for analysis purpose. In this paper, we investigate the use of motion trajectories for video activity detection in the compressed domain. We show it is possible to extract reliable motion trajectories directly from compressed H.264 video streams. To overcome the problems caused by unreliable motion vectors, we propose to include the information from the compressed domain prediction residuals to make the tracking more robust. We use a real world application of detecting vacant or occupied parking spaces to demonstrate the effectiveness of our proposed approach. We also demonstrate the robustness of our approach to different encoder settings, and lighting conditions.

• 出版日期2011-7