Multimedia data clustering based on correlation matrix fusion

作者：Zhang Hong^*; Wu Fei; Zhang Xiao Long

来源：Chinese Journal of Computers, 2011, 34(9): 1705-1711.

DOI：10.3724/SP.J.1016.2011.01705

• Auditory feature
• Clustering methods
• Correlation matrix
• Cross-retrieval
• Fusion strategies
• Image similarity
• Multimedia data
• Similarity matrix
• Statistical correlation
• Visual-auditory feature

It is a hot issue to explore statistical correlation between different types of multimedia data, especially in the area of multimedia clustering. In this paper, we propose a multimedia clustering method based on correlation matrix fusion. Visual and auditory feature matrices are firstly initialized and simultaneously mapped into a subspace; Then we utilize correlation fusion strategy on image similarity matrix, audio similarity matrix and image-audio correlation matrix for global reinforcement and optimization; Thirdly, similarity-based clustering method is implemented for image and audio clustering in the subspace. Experiment results are encouraging and show that the performance of our approach is effective. Besides, an interesting experiment of image-audio cross-retrieval validates the applicability of our approach.

• 出版日期2011
• 单位武汉科技大学