Acceleration method for convex optimization over the fixed point set of a nonexpansive mapping

作者：Iiduka Hideaki^*

来源：Mathematical Programming, 2015, 149(1-2): 131-165.

DOI：10.1007/s10107-013-0741-1

• Convex optimization
• Fixed point set
• Nonexpansive mapping
• Conjugate gradient method
• Three-term conjugate gradient method
• Fixed point optimization algorithm

The existing algorithms for solving the convex minimization problem over the fixed point set of a nonexpansive mapping on a Hilbert space are based on algorithmic methods, such as the steepest descent method and conjugate gradient methods, for finding a minimizer of the objective function over the whole space, and attach importance to minimizing the objective function as quickly as possible. Meanwhile, it is of practical importance to devise algorithms which converge in the fixed point set quickly because the fixed point set is the set with the constraint conditions that must be satisfied in the problem. This paper proposes an algorithm which not only minimizes the objective function quickly but also converges in the fixed point set much faster than the existing algorithms and proves that the algorithm with diminishing step-size sequences strongly converges to the solution to the convex minimization problem. We also analyze the proposed algorithm with each of the Fletcher-Reeves, Polak-Ribi,re-Polyak, Hestenes-Stiefel, and Dai-Yuan formulas used in the conventional conjugate gradient methods, and show that there is an inconvenient possibility that their algorithms may not converge to the solution to the convex minimization problem. We numerically compare the proposed algorithm with the existing algorithms and show its effectiveness and fast convergence.

• 出版日期2015-2