包含FR方法的一类无约束极小化方法的全局收敛性

本文对包含Fletcher-Reeves共轭梯度法的一类无约束最优化方法的全局收敛性进行了研究．Fletcher-Reeves方法的某些性质在收敛性分析中起着重要的作用．我们以一种简单的方式证明了这类方法在一种Wolfe型非精确线搜索条件下对光滑的非凸函数具有下降性和全局收敛性．全局收敛性结果也被推广到了一种广义Wolfe型非精确线搜索．     

Conjugate Gradient Methods with Armijo-type Line Searches

Abstract Two Armijo-type line searches are proposed in this paper for nonlinear conjugate gradient methods.Under these line searches, global convergence results are established for several famous conjugate gradientmethods, including the Fletcher-Reeves method, the Polak-Ribiere-Polyak method, and the conjugate descentmethod.     

在Armijo型线搜索下共轭梯度法簇的全局收敛性

本文我们讨论了一簇共轭梯度法，它可被看作是FR法和DY法的凸组合．我们提出了两种Armijo型线搜索，并在这两种线搜索下，讨论了共轭梯度法簇的全局收敛性．     

A NOTE ON THE NONLINEAR CONJUGATE GRADIENT METHOD

The conjugate gradient method for unconstrained optimization problems varies with a scalar. In this note, a general condition concerning the scalar is given, which ensures the global convergence of the method in the case of strong Wolfe line searches. It is also discussed how to use the result to obtain the convergence of the famous Fletcher-Reeves, and Polak-Ribiere-Polyak conjugate gradient methods. That the condition cannot be relaxed in some sense is mentioned.     

共轭下降法的全局收敛性

共轭下降法最早由Ｆｌｅｔｃｈｅｒ提出，本文证明了一类非精确线搜索条件能保证共轭下的降法的收敛性，并且构造了反例表明，如果线搜索条件放松，则共轭下降法可能不收敛，此外，我们还得到了与Ｆｌｅｃｈｅｒ－Ｒｅｅｖｅｓ方法有关的一类方法的结论。     

Convergence properties of the Fletcher-Reeves method

This paper investigates the global convergence properties ofthe Fletcher-Reeves (FR) method for unconstrained optimization.In a simple way, we prove that a kind of inexact line searchcondition can ensure the convergence of the FR method. Severalexamples are constructed to show that, if the search conditionsare relaxed, the FR method may produce an ascent search direction,which implies that our result cannot be improved.     

GLOBAL CONVERGENCE OF THE FLETCHER-REEVES ALGORITHM WITH INEXACT LINESEARCH

In this paper, we investigate the convergence properties of the Fletcher Reeves algorithm. Under conditions weaker than those in a paper of M. A1-Baali,we get the global convergence of the Fletcher-Reeves algorithm with a low-accuracy inexact linesearch.     

CG Global Convergence Properties with Goldstein Linesearch*

This paper explores the convergence of nonlinear conjugate gradient methods with Goldstein line search without regular restarts. Under this line search, global convergence for a subsequence is given for the famous conjugate gradient methods, Fletcher-Reeves method. The same result can be obtained for Polak-Ribiére-Polyak method and others. *This work was partially supported by National Hitech Program (863,2002AA104540) and National Natural Science Foundation of China (No.60373060).     

CONVERGENCE OF NONLINEAR CONJUGATE GRADIENT METHODS

1. IntroductionConsider the unconstrained OPtbo8tion problem,min f(x), (1.1)where j is smooth and its gradient g is available. Conjugate gradieot methods are highly usefulfOr solving (1.1) especially if n is large. They are iterative methods of the formHere oh is a 8tepsbo obtained by a 1-dboensional line search and gk is a scalar. The chOiceof Ph is such tha (l.2)--(l.3) reduces to the linear cOnugate gradient method in the casewhen j is a strictly convex qUadratic and crk is the exact 1-…     

On the convergence of conjugate gradient algorithms

In this paper we present a new family of conjugate gradientalgorithms. This family originates in the algorithms providedby Wolfe and Lemaréchal for non-differentiable problems.It is shown that the Wolfe-Lemaréchal algorithm is identicalto the Fletcher-Reeves algorithm when the objective functionis smooth and when line searches are exact. The convergenceproperties of the new algorithms are investigated. One of themis globally convergent under minimum requirements on the directionalminimization.     

Applying the Powell's Symmetrical Technique to Conjugate Gradient Methods with the Generalized Conjugacy Condition

This article proposes new conjugate gradient method for unconstrained optimization by applying the Powell symmetrical technique in a defined sense. Using the Wolfe line search conditions, the global convergence property of the method is also obtained based on the spectral analysis of the conjugate gradient iteration matrix and the Zoutendijk condition for steepest descent methods. Preliminary numerical results for a set of 86 unconstrained optimization test problems verify the performance of the algorithm and show that the Generalized Descent Symmetrical Hestenes-Stiefel algorithm is competitive with the Fletcher-Reeves (FR) and Polak-Ribiére-Polyak (PRP⁺) algorithms.     

NEW HYBRID CONJUGATE GRADIENT METHOD AS A CONVEX COMBINATION OF LS AND FR METHODS

In this paper, we present a new hybrid conjugate gradient algorithm for unconstrained optimization. This method is a convex combination of Liu-Storey conjugate gradient method and Fletcher-Reeves conjugate gradient method. We also prove that the search direction of any hybrid conjugate gradient method, which is a convex combination of two conjugate gradient methods, satisfies the famous D-L conjugacy condition and in the same time accords with the Newton direction with the suitable condition. Furthermore, this property doesn't depend on any line search. Next, we also prove that, moduling the value of the parameter t,the Newton direction condition is equivalent to Dai-Liao conjugacy condition.The strong Wolfe line search conditions are used.The global convergence of this new method is proved.Numerical comparisons show that the present hybrid conjugate gradient algorithm is the efficient one.     

无记忆拟牛顿方法的收敛性

本讨论了无约束最优化问题的无记忆拟牛顿方法的收敛性,给出了对于非凸目标函数,在非精确线搜索条件下,无记忆拟牛顿方法收敛性的几个充分性条件。     

一类非单调算法的收敛性质

1.搜索步长和搜索方向对于无约束最优化问题(?)f(x),其中f:R~n→R~1,f∈C~1,一般采用形如x_(k+1)=x_k+λ_kd_k(k=1,2,…)的迭代算法来求解,这里λ_k为搜索步长,d_k为搜索方向.     

由FR共轭梯度法控制的两类优化算法的全局收敛性

１引言 考虑无约束优化问题其中ｆ：Ｒｎ→Ｒ是一阶可微函数．求解（１）的非线性共轭梯度法具有如下形式：其中ｇｋ＝　ｆ（ｘｋ）,ａｋ是通过某种线搜索获得的步长,纯量βｋ的选取使得方法（２）—（３）在ｆ（ｘ）是严格凸二次函数且采用精确线搜索时化为线性共轭梯度法［１］．比较常见的βｋ的取法有Ｆｌｅｔｃｈｅｒ－Ｒｅｅｖｅｓ（ＦＲ）公式［２］和Ｐｏｌａｋ－Ｒｉｂｉｅｒｅ－Ｐｏｌｙａｋ（ＰＲＰ）公式［３－４］等．它们分别为其中　　　取欧几里得范数．对于一般非线性函数,ＦＲ方法具有较好的理论收敛性［５－６］,而…     

Affine scaling inexact generalized Newton algorithm with interior backtracking technique for solving bound-constrained semismooth equations

We develop and analyze an affine scaling inexact generalized Newton algorithm in association with nonmonotone interior backtracking line technique for solving systems of semismooth equations subject to bounds on variables. By combining inexact affine scaling generalized Newton with interior backtracking line search technique, each iterate switches to inexact generalized Newton backtracking step to strict interior point feasibility. The global convergence results are developed in a very general setting of computing trial steps by the affine scaling generalized Newton-like method that is augmented by an interior backtracking line search technique projection onto the feasible set. Under some reasonable conditions we establish that close to a regular solution the inexact generalized Newton method is shown to converge locally p-order q-superlinearly. We characterize the order of local convergence based on convergence behavior of the quality of the approximate subdifferentials and indicate how to choose an inexact forcing sequence which preserves the rapid convergence of the proposed algorithm. A nonmonotonic criterion should bring about speeding up the convergence progress in some ill-conditioned cases.     

共轭下降法的全局收敛性

本文提出了一种Armijo型的线搜索，并在这种线搜索下讨论了共轭下降法的全局收敛性，且可得方法在每次迭代均产生一个下降搜索方向．     

A direct method of linearization for continuous minimax problems

We consider the problem of minimizing a nondifferentiable function that is the pointwise maximum over a compact family of continuously differentiable functions. We suppose that a certain convex approximation to the objective function can be evaluated. An iterative method is given which uses as successive search directions approximate solutions of semi-infinite quadratic programming problems calculated via a new generalized proximity algorithm. Inexact line searches ensure global convergence of the method to stationary points.This work was supported by Project No. CPBP-02.15/2.1.1.     

Goldstein线搜索下混合共轭梯度法的全局收敛性

本文结合FR算法和DY算法,给出了一类新的杂交共轭梯度算法,并结合Goldstein线搜索,在较弱的条件下证明了算法的收敛性．数值实验表明了新算法的有效性．     

Convergence Properties of the DFP Algorithm for Unconstrained Optimization

In this article, the convergence properties of the DFP algorithm with inexact line searches on uniformly convex functions are investigated. An inexact line search is proposed and the global convergence and superlinear convergence of the DFP algorithm with this line search on uniformly convex functions are proved.