Forward Basis Selection for Pursuing Sparse Representations over a Dictionary

作者：Yuan, Xiao-Tong^*; Yan, Shuicheng

来源：IEEE Transactions on Pattern Analysis and Machine Intelligence, 2013, 35(12): 3025-3036.

DOI：10.1109/TPAMI.2013.85

• Greedy selection
• sparse representation
• optimization
• Gaussian graphical models
• subspace segmentation

The forward greedy selection algorithm of Frank and Wolfe [9] has recently been applied with success to coordinate-wise sparse learning problems, characterized by a tradeoff between sparsity and accuracy. In this paper, we generalize this method to the setup of pursuing sparse representations over a prefixed dictionary. Our proposed algorithm iteratively selects an atom from the dictionary and minimizes the objective function over the linear combinations of all the selected atoms. The rate of convergence of this greedy selection procedure is analyzed. Furthermore, we extend the algorithm to the setup of learning nonnegative and convex sparse representation over a dictionary. Applications of the proposed algorithms to sparse precision matrix estimation and low-rank subspace segmentation are investigated with efficiency and effectiveness validated on benchmark datasets.

• 出版日期2013-12
• 单位南京信息工程大学