A novel video abstraction method based on fast clustering of the regions of interest in key frames

作者:Song, Guang-Hua; Ji, Qing-Ge; Lu, Zhe-Ming*; Fang, Zhi-Dan; Xie, Zhen-Hua
来源:AEU-International Journal of Electronics and Communications, 2014, 68(8): 783-794.
DOI:10.1016/j.aeue.2014.03.004

摘要

Online video nowadays has become one of the top activities for users and has become easy to access. In the meantime, how to manage, such huge amount of video data and retrieve them efficiently has become a big issue. In this article, we propose a novel method for video abstraction based on fast clustering of the regions of interest (ROIs). Firstly, the key-frames in each shot are extracted using the average histogram algorithm. Secondly, the saliency and edge maps are generated from each key-frame. According to these two maps, the key points for the visual attention model can be determined. Meanwhile, in order to expand the regions surrounding the key points, several thresholds are calculated from the corresponding key-frame. Thirdly, based on the key points and thresholds, several regions of interest are expanded and thus the main content in each frame is obtained. Finally, the fast clustering method is performed on the key frames by utilizing their ROIs. The performance and effectiveness of the proposed video abstraction algorithm is demonstrated by several experimental results.