Adaptive Semi-Supervised Feature Selection for Cross-Modal Retrieval

作者：Yu, En; Sun, Jiande^*; Li, Jing; Chang, Xiaojun; Han, Xian-Hua; Hauptmann, Alexander G.

来源：IEEE Transactions on Multimedia, 2019, 21(5): 1276-1288.

DOI：10.1109/TMM.2018.2877127

• Semi-supervised
• cross-modal retrieval
• feature selection

Inorder to exploit the abundant potential information of the unlabeled data and contribute to analyzing the correlation among heterogeneous data, we propose the semi-supervised model named adaptive semi-supervised feature selection for cross-modal retrieval. First, we utilize the semantic regression to strengthen the neighboring relationship between the data with the same semantic. And the correlation between heterogeneous data can be optimized via keeping the pairwise closeness when learning the common latent space. Second, we adopt the graph-based constraint to predict accurate labels for unlabeled data, and it can also keep the geometric structure consistency between the label space and the feature space of heterogeneous data in the common latent space. Finally, an efficient joint optimization algorithm is proposed to update the mapping matrices and the label matrix for unlabeled data simultaneously and iteratively. It makes samples from different classes to be far apart, while the samples from same class lie as close as possible. Meanwhile, the l(2,1)-norm constraint is used for feature selection and outlier reduction when the mapping matrices are learned. In addition, we propose learning different mapping matrices corresponding to different sub-tasks to emphasize the semantic and structural information of query data. Experiment results on three datasets demonstrate that our method performs better than the state-of-the-art methods.

• 出版日期2019-5
• 单位山东师范大学