A ROBUST TRUST REGION ALGORITHM FOR SOLVING GENERAL NONLINEAR PROGRAMMING

1. Introductioncrust region methods are iterative. As a strategy of globalization, the trust region approach was introduced into solving unconstrained optimization and proved to be efficient androbust. An excellent survey was given by Mor6(1983). The associated research with trustregion methods for unconstrained optimization can be found in Fletcher(1980), Powell(1975),Sorensen(1981), Shultz, Schnabel and Byrd(1985), Yuan(1985). The solution of the trust region subproblem is still an activ…     

A NEW NONMONOTONE TRUST REGION ALGORITHM FOR SOLVING UNCONSTRAINED OPTIMIZATION PROBLEMS

Based on the nonmonotone line search technique proposed by Gu and Mo （Appl. Math. Comput. 55, （2008） pp. 2158-2172）, a new nonmonotone trust region algorithm is proposed for solving unconstrained optimization problems in this paper. The new algorithm is developed by resetting the ratio ρk for evaluating the trial step dk whenever acceptable. The global and superlinear convergence of the algorithm are proved under suitable conditions. Numerical results show that the new algorithm is effective for solving unconstrained optimization problems.     

GLOBAL CONVERGENCE OF NONMONOTONIC TRUST REGION ALGORITHM FOR NONLINEAR OPTIMIZATION

§ 1　 IntroductionIn this paper we study the following nonlinear equality constrained optimization prob-lem:minimize f(x) ,subjectto h(x) =0 ,(P)where h(x) =(h1 (x) ,h2 (x) ,...,hm(x) ) T,f and hi(i=1 ,2 ,...,m) are Rn→R twice conti-nously differentiable(m≤n) .Many authors have studied the problem(P) with trustregion method(see,references[1～ 3 ] ) .These methods have the same property:to enforce strict monotonicity for meritfunction at every iteration.Paper[4 ] shows thatstrictmonotonic …     

非线性不等式约束最优化快速收敛的可行信赖域算法

In this paper,by combining the trust region technique with the generalized gradient projection.a new trust region algorithm with feasible iteration points is presented for nonlinear inequality constrained optimization,and its trust region is a general compact set containing the origion as an inteior point.No penalty function is used in the algorithm,and it is feasible descent .Under suitable assumptions,the algorithm is proved to possess global and strong convergence as well as superlinear and quadratic convergence.Some numerical results are reported.     

AN INTERIOR TRUST REGION ALGORITHM FOR NONLINEAR MINIMIZATION WITH LINEAR CONSTRAINTS

AbstractAn interior trust-region-based algorithm for linearly constrained minimization problems is proposed and analyzed. This algorithm is similar to trust region algorithms for unconstrained minimization: a trust region subproblem on a subspace is solved in each iteration. We establish that the proposed algorithm has convergence properties analogous to those of the trust region algorithms for unconstrained minimization. Namely, every limit point of the generated sequence satisfies the Krush-Kuhn-Tucker (KKT) conditions and at least one limit point satisfies second order necessary optimality conditions. In addition, if one limit point is a strong local minimizer and the Hessian is Lipschitz continuous in a neighborhood of that point, then the generated sequence converges globally to that point in the rate of at least 2-step quadratic. We are mainly concerned with the theoretical properties of the algorithm in this paper. Implementation issues and adaptation to large-scale problems will be addressed in a     

A SELF—ADAPTIVE TRUST REGION ALGORITHM

In this paper we propose a self-adaptive trust region algorithm.The trust region radius is updated at a varable rate according to the ratio between the actual reduction and the predicted reduction of the objective function,rather than by simply enlarging or reducing the original trust region radius at a constant rate.We show that this new algorithm preserves the strong convergence property of traditional trust region methods.Numerical results are also presented.     

A TRUST REGION ALGORITHM FOR CONSTRAINED NONSMOOTH OPTIMIZATION PROBLEMS

1. Introductioncrust region methods are an hoportat class Of iterative wthods for solving nonlinearoptbozation problems, and have been developed rapidly in recent twenty years (see [1]--[9] 1 115] )[16] etc.). FOr nonsmooth optbozation problems, as early as in 1984, Y. Yuan [21 [3] prOPosed atrust region method for the composite function f(x) = h(g(x)), where h is convex and g E C';L. Qi and J. Sam [4] proposed an inexaCt trust region method for the general unconstrainednonsmooth optchatio…     

非线性回归M-估计的信赖域算法

１引言 考虑具有随机载荷的非线性回归模型其中（Ｘｉ,ｙｉ）　　是ｉ．ｉ．ｄ．随机序列,具有公共分布　　　　　　是已知的回归函数,β　Ｒｍ是未知参数向量,误差ｉ与兄独立　　　．为简单计,本文假设　　　＝１且ｆ（ｘ,·）是连续可微函数． 如何根据观察值（Ｘ１,ｙ１）,…,（Ｘｎ,ｙｎ）对回归参数向量β进行有效地估计,这是一个重要的统计问题．由于传统的最小二乘法关于残差异常值不具有稳健性,因此,迫使人们考虑新的估计方法．Ｈｕｂｅｒ最早提出了线性回归的稳健Ｈｕｂｅｒ估计,后又推广成一般形式的Ｍ－估计、ＧＭ…     

一种改进的无约束非光滑优化问题的信赖域算法

本文提出了一种新的求解无约束非光滑优化问题的信赖域算法,并证明了该算法的迭代点列的任何聚点都是的问题的稳定点。     

一类无约束复合非光滑优化的信赖域算法

本文提出了一个易实施的处理一类无约束复合非光滑优化的信赖域算法，并在一定条件下证明了该算法所产生的迭代序列的任何聚点都是原问题的稳定点．     

CONIC TRUST REGION METHOD FOR LINEARLY CONSTRAINED OPTIMIZATION

In this paper we present a trust region method of conic model for linearly constrained optimization problems.We discuss trust region approaches with conic model subproblems.Some equivalent variation properties and optimality conditions are given.A trust region algorithm based on conic model is constructed.Global convergence of the method is established.     

A NONMONOTONE TRUST REGION METHOD FOR NONLINEAR LEAST SQUARES PROBLEMS

In this paper we present a nonmonotone trust region method for nonlinear least squares problems with zero-residual and prove its convergence properties. The extensive numerical results are reported which show that the nonmonotone trust region method is generally superior to the usual trust region method.     

一个解非线性方程组新的非单调自适应信赖域法

本文利用函数平均权重的非单调技术以及自适应信赖域方法,提出一个解非线性方程组的非单调自适应信赖域法.并在适当假设条件下,讨论了算法的全局收敛性.数值试验表明了算法是有效的.     

解无约束优化问题的一个新的带线搜索的信赖域算法

在传统信赖域方法的基础上, 提出了求解无约束最优化问题的一个新的带线搜索的信赖域算法. 该算法采用大步长 Armijo 线搜索技术获得迭代步长, 克服了每次迭代求解信赖域子问题时计算量较大的缺点, 因而适用于求解大型的优化问题. 在适当的条件下, 我们证明了算法的全局收敛性. 数值实验结果表明本文所提出的算法是有效的.     

无约束非光滑优化问题的信赖域算法及收敛性

1．引言考虑下列无约束非光滑优化问题：其中f为R”上的局部LIPSChitZ函数．本文将11·112简记为11·l．信赖域算法是通过求解一系列子问题3＊B（二，凸）：来求解问题（1）的，其中拉x，·）为j在x点的一阶近似，B为nxn阶对称阵．下面给出信赖域的基本算法TRA：步1·给定...     

一个无正则条件下一般约束最优化问题的信赖域算法的收敛性

本文我们对[1]的算法给出一个修正并在无正则条件下对这一算法给出了收敛性分析，与[1]不同，我们不需要(SBSQ)约束条件。因此本文的结果是[1]的结果的推广和加强。     

非线性最小二乘问题的信赖域方法

本文提出一个新的非线性最小二乘的信赖域方法,在该方法中每个信赖域子问题只需要一次求解,而且每次迭代的一维搜索步长因子是给定的,避开一维搜索的环节,大大地提高了算法效率.文中证明了在一定的条件下算法的全局收敛性.     

A SUPERLINEARLY CONVERGENT TRUST REGION ALGORITHM FOR LC^1 CONSTRAINED OPTIMIZATION PROBLEMS

In this paper, a new trust region algorithm for nonlinear equality constrained LC^1 optimization problems is given. It obtains a search direction at each iteration not by solving a quadratic programming subproblem with a trust region bound, but by solving a system of linear equations. Since the computational complexity of a QP-Problem is in general much larger than that of a system of linear equations, this method proposed in this paper may reduce the computational complexity and hence improve computational efficiency. Furthermore, it is proved under appropriate assumptions that this algorithm is globally and super-linearly convergent to a solution of the original problem. Some numerical examples are reported, showing the proposed algorithm can be beneficial from a computational point of view.     

A Nonmonotone Trust Region Algorithm for Nonlinear Optimization Subject to General Constraints

In this paperwe present a nonmonotone trust region algorthm for general nonlinear constrained optimization problems.The main idea of this paper is to combine Yuan‘‘‘‘s technique[1]with a nonmonotone method similar to Ke and Han[2].This new algorithm may not only keep the robust properties of the algorithm given by Yuan,but also have some advantages led by the nonmonotone technique.Under very mild conditions,global convergence for the algorithm is given.Numerical experiments demostrate the efficency of the algorithm.