Multivariate spectral gradient method for unconstrained optimization

作者：Han, Le; Yu, Gaohang^*; Guan, Lutai

来源：Applied Mathematics and Computation, 2008, 201(1-2): 621-630.

DOI：10.1016/j.amc.2007.12.054

• two-point stepsize gradient method
• Barzilai-Borwein method
• global convergence
• unconstrained optimization
• finite convergence

Multivariate spectral gradient method is proposed for solving unconstrained optimization problems. Combined with some quasi-Newton property multivariate spectral gradient method allows an individual adaptive stepsize along each coordinate direction, which guarantees that the method is finitely convergent for positive definite quadratics. Especially, it converges no more than two steps for positive definite quadratics with diagonal Hessian, and quadratically for objective functions with positive definite diagonal Hessian. Moreover, based on a nonmonotone line search, global convergence is established for multivariate spectral gradient algorithm. At last numerical results are reported, which show that this method is promising and deserves further discussing.

• 出版日期2008-7-15
• 单位中山大学; 华南理工大学