Assessment of feature fusion strategies in visual attention mechanism for saliency detection

作者:Jian, Muwei*; Zhou, Quan; Cui, Chaoran; Nie, Xiushan; Luo, Hanjiang; Zhao, Jianli; Yin, Yilong*
来源:Pattern Recognition Letters, 2019, 127: 37-47.
DOI:10.1016/j.patrec.2018.08.022

摘要

Saliency detection is a hot topic in the field of computer vision and pattern recognition, thus plenty of saliency models have been exploited and extended to various visual correspondence applications. Currently, it's still confronted with a variety of obstacles and challenges, although it has been studied for decades. With the progress of saliency detection, different computational models and salient features have been proposed and some of them improve and compensate the deficiencies of the others. In this paper, we focus on investigating the salient feature fusion strategies in human visual attention mechanism for saliency detection (e.g., linear and non-linear), in order to efficiently incorporate various salient cues for achieving a better result. Based on the complementary principle, we firstly construct a saliency map based on the information of the image background. Then, we generate a supplemental saliency map from the compactness saliency features. Finally, we evaluate the performance of six individual fusion strategies including both linear and non-linear models in terms of three publicly available image datasets. Experimental results show that our designed non-linear fusion strategy based on least-square method outperforms the other fusion strategies in saliency detection.