A new adaptive Barzilai and Borwein method for unconstrained optimization |
| |
Authors: | Hongwei Liu Zexian Liu Xiaoliang Dong |
| |
Institution: | 1.School of Mathematics and Statistics,Xidian University,Xi’an,People’s Republic of China;2.School of Mathematics and Computer Science,Hezhou University,Hezhou,People’s Republic of China;3.School of Mathematics and Information,Beifang University of Nationalities,Yinchuan,People’s Republic of China |
| |
Abstract: | In this paper we view the Barzilai and Borwein (BB) method from a new angle, and present a new adaptive Barzilai and Borwein (NABB) method with a nonmonotone line search for general unconstrained optimization. In the proposed method, the scalar approximation to the Hessian matrix is updated by the Broyden class formula to generate an adaptive stepsize. It is remarkable that the new stepsize is chosen adaptively in the interval which contains the two well-known BB stepsizes. Moreover, for the negative curvature direction, a strategy for the choice of the stepsize is designed to accelerate the convergence rate of the NABB method. Furthermore, we apply the NABB method without any line search to strictly convex quadratic minimization. The numerical experiments show the NABB method is very promising. |
| |
Keywords: | |
本文献已被 SpringerLink 等数据库收录! |
|