A Note on Application of Nesterov's Method in Solving Lasso-Type Problems

作者:Tian Ye*; Lian Heng
来源:Communications in Statistics - Simulation and Computation, 2015, 44(7): 1673-1682.
DOI:10.1080/03610918.2013.824096

摘要

Many different algorithms have been proposed to solve penalized variable selection problems, in particular lasso and its variants, including group lasso and fused lasso. Loss functions other than quadratic loss also pose significant challenges for finding efficient solvers. Here, we note that Nesterov's method can be used to transform an optimization problem with general smooth convex loss to quadratic loss with identity covariate matrix in each iteration. After such reduction, the problem becomes much easier to solve or even can be solved in closed form in some cases. We perform some simulations and apply our implementation to phoneme discrimination.

  • 出版日期2015
  • 单位南阳理工学院

全文