一类拟牛顿非单调信赖域算法及其收敛性

本文提出了一类求解无约束最优化问题的非单调信赖域算法.将非单调Wolfe线搜索技术与信赖域算法相结合,使得新算-法不仅不需重解子问题,而且在每步迭代都满足拟牛顿方程同时保证目标函数的近似Hasse阵Bk的正定性.在适当的条件下,证明了此算法的全局收敛性.数值结果表明该算法的有效性.     

On the Convergence of a Trust-Region Method for Solving Constrained Nonlinear Equations with Degenerate Solutions

This paper presents a trust-region method for solving the constrained nonlinear equation F(x) = 0, x , where R ⁿ is a nonempty and closed convex set, F is defined on the open set containing and is continuously differentiable. The iterates generated by the method are feasible. The method is globally and quadratically convergent under local error bounded assumption on F. The results obtained are extensions of the work of Yamashita Fukushima (Ref. 1) and Fan Yuan (Ref. 2) for unconstrained nonlinear equations. Numerical results show that the new algorithm works quite well.     

解非线性约束优化问题的依赖域算法

本文对一般非线性约束优化问题提出了一个信赖域算法,导出了等价的KKT条件.在试探步满足适当条件下,证明了算法的全局收敛性,并进行了数值试验.     

一个改进的序列二次规划可行下降算法及其全局收敛性

利用广义投影校正技术对搜索方向进行某种修正,改进假设条件,采用一种新型的一阶修正方向并结合SQP技术,建立了求解非线性约束最优化问题(p)的一个新的SQP可行下降算法,在较温和的假设条件下证明了算法的全局收敛性.由于新算法仅需较小的存储,从而适合大规模最优化问题的计算.     

关于不等式约束的信赖域算法

对于具有不等式约束的非线性优化问题，本文给出一个依赖域算法，由于算法中依赖区域约束采用向量的∞范数约束的形式，从而使子问题变二次规划，同时使算法变得更实用。在通常假设条件下，证明了算法的整体收敛性和超线性收敛性。     

非线性最优化一个可行序列等式约束二次规划算法

本文针对非线性不等式约束优化问题,提出了一个新的可行序列等式约束二次规划算法．在每次迭代中,该算法只需求解三个相同规模且仅含等式约束的二次规划(必要时求解一个辅助的线性规划),因而其计算工作量较小．在一般的条件下,证明了算法具有全局收敛及超线性收敛性．数值实验表明算法是有效的．     

等式约束优化非单调信赖域算法

设计了一个新的求解等式约束优化问题的非单调信赖域算法.该算法不需要罚函数也无需滤子.在每次迭代过程中只需求解满足下降条件的拟法向步及切向步.新算法产生的迭代步比滤子方法更易接受,计算量比单调算法小.在一般条件下,算法具有全局收敛性.     

不等式约束优化的非单调可行信赖域-SQP算法

本文讨论不等式约束优化问题,给出一个信赖域方法与SQP方法相结合的新的可行算法,算法中采用了压缩技术,使得QP子问题产生的搜索方向尽可能为可行方向,并且采用了高阶校正的方法来克服算法产生的Maratos效应现象.在适当的条件下,证明了算法的全局收敛性和超线性收敛性.数值结果表明算法是有效的.     

A New Trust-Region Algorithm for Equality Constrained Optimization

We present a new trust-region algorithm for solving nonlinear equality constrained optimization problems. Quadratic penalty functions are employed to obtain global convergence. At each iteration a local change of variables is performed to improve the ability of the algorithm to follow the constraint level set. Under certain assumptions we prove that this algorithm globally converges to a point satisfying the second-order necessary optimality conditions. Results of preliminary numerical experiments are reported.     

一个等式约束问题的拟Newton—信赖域型方法及其收敛性

在[1]中,Vardi提出一个信赖域方法,而收敛性证明却是在精确λ-搜索下给出的,本文在[1]的基础上提出一个新的算法-拟Newton-信赖域型算法,并证明该算法是全局收敛的,通过利用二阶修正技术去修正该算法,我们证明了该算法是局部超线性收敛的。     

The Global Convergence of Self-Scaling BFGS Algorithm with Nonmonotone Line Search for Unconstrained Nonconvex Optimization Problems

The self-scaling quasi-Newton method solves an unconstrained optimization problem by scaling the Hessian approximation matrix before it is updated at each iteration to avoid the possible large eigenvalues in the Hessian approximation matrices of the objective function. It has been proved in the literature that this method has the global and superlinear convergence when the objective function is convex （or even uniformly convex）. We propose to solve unconstrained nonconvex optimization problems by a self-scaling BFGS algorithm with nonmonotone linear search. Nonmonotone line search has been recognized in numerical practices as a competitive approach for solving large-scale nonlinear problems. We consider two different nonmonotone line search forms and study the global convergence of these nonmonotone self-scale BFGS algorithms. We prove that, under some weaker condition than that in the literature, both forms of the self-scaling BFGS algorithm are globally convergent for unconstrained nonconvex optimization problems.     

一类新拟牛顿非单调信赖域算法

提出了一类新的求解无约束最优化问题的新拟牛顿非单调信赖域算法.采用加权的r_k用以调整信赖域半径,在适当的条件下,证明了算法的全局收敛性.数值结果表明算法的有效性.     

On the Convergence of a Population-Based Global Optimization Algorithm

In global optimization, a typical population-based stochastic search method works on a set of sample points from the feasible region. In this paper, we study a recently proposed method of this sort. The method utilizes an attraction-repulsion mechanism to move sample points toward optimality and is thus referred to as electromagnetism-like method (EM). The computational results showed that EM is robust in practice, so we further investigate the theoretical structure. After reviewing the original method, we present some necessary modifications for the convergence proof. We show that in the limit, the modified method converges to the vicinity of global optimum with probability one.     

非线性等式与有界约束优化问题的正割算法

提出了结合仿射尺度技术的正割算法解非线性等式与有界约束优化问题. 在合理假设下, 证明了渐弱滤子线搜索方法可以保证新算法具有整体收敛性. 通过引入一个高阶修正方向, 克服Maratos效应的影响, 使得算法二步$q$-\!\!超线性收敛于最优点. 进一步地, 对算法进行修改, 使得新算法达到$q$-\!\!超线性收敛性.     

基于非拟牛顿方法无约束最优化问题的全局收敛性

In this paper, the non-quasi-Newton's family with inexact line search applied to unconstrained optimization problems is studied. A new update formula for non-quasi-Newton's family is proposed. It is proved that the constituted algorithm with either Wolfe-type or Armijotype line search converges globally and Q-superlinearly if the function to be minimized has Lipschitz continuous gradient.     

约束优化问题的一个变尺度投影算法的全局收敛性

利用投影算子 PxΩ 建立了求解问题 ( P)的变尺度投影算法 ,并讨论了算法的全局收敛性 .     

Global Convergence of a Modified Gradient Projection Method for Convex Constrained Problems

In this paper, the continuously differentiable optimization problem min{f（x） ： x∈Ω}, where Ω ∈ R^n is a nonempty closed convex set, the gradient projection method by Calamai and More （Math. Programming, Vol.39. P.93-116, 1987） is modified by memory gradient to improve the convergence rate of the gradient projection method is considered. The convergence of the new method is analyzed without assuming that the iteration sequence {x^k} of bounded. Moreover, it is shown that, when f（x） is pseudo-convex （quasiconvex） function, this new method has strong convergence results. The numerical results show that the method in this paper is more effective than the gradient projection method.     

等式约束优化的组合信赖域与拟牛顿算法

本文对等式约束问题提出了一个种组合信赖域与拟牛顿算法。该算法的特点是若Lagrangian函数的近似Ｈessian阵在等式约束Jacobi阵的零空间正定的,则选择拟牛顿算法,否则用信赖域算法,在通常信赖域算法的收敛假设下,该文证明了组合算法的全局收敛性。     

Nonmonotone Line Search Algorithm for Constrained Minimax Problems

In this paper, an algorithm for constrained minimax problems is presented which is globally convergent and whose rate of convergence is two-step superlinear. The algorithm applies SQP to the constrained minimax problems by combining a nonmonotone line search and a second-order correction technique, which guarantees a full steplength while close to a solution, such that the Maratos effect is avoided and two-step superlinear convergence is achieved.