Sparse Multi-Modal Hashing

作者：Wu, Fei^*; Yu, Zhou; Yang, Yi; Tang, Siliang; Zhang, Yin; Zhuang, Yueting

来源：IEEE Transactions on Multimedia, 2014, 16(2): 427-439.

DOI：10.1109/TMM.2013.2291214

• Dictionary learning
• multi-modal hashing
• sparse coding

Learning hash functions across heterogenous high-dimensional features is very desirable for many applications involving multi-modal data objects. In this paper, we propose an approach to obtain the sparse codesets for the data objects across different modalities via joint multi-modal dictionary learning, which we call sparse multi-modal hashing (abbreviated as). In, both intra-modality similarity and inter-modality similarity are first modeled by a hypergraph, then multi-modal dictionaries are jointly learned by Hypergraph Laplacian sparse coding. Based on the learned dictionaries, the sparse codeset of each data object is acquired and conducted for multi-modal approximate nearest neighbor retrieval using a sensitive Jaccard metric. The experimental results show that outperforms other methods in terms of mAP and Percentage on two real-world data sets.

• 出版日期2014-2
• 单位浙江大学