求解一类约束优化信赖域方法的子问题

１引言设Ｈ为一给定的ｎ×ｎ对称矩阵,ｃＲ＂,本文考虑如｝的约束优化问题这里ａ＞０为给定的参数,Ｃ＝｛ｘＲｎｘ＜ａ是Ｒ”中的一个球体,Ｋ是一个简单凸闭集．当Ｋ＝Ｒｎ时,问题（Ｐ）便是无约束优化的信赖域子问题．当Ｋ＝｛ｘＲｎμ≤ｘ≤υ５,（μ１,μ２,…,μｎ）Ｔ,υ＝（υ１,υ２…,υｎ）Ｔ,且—∞＜μｉ＜υｉ＜ｖ＜＋∞,ｉ＝１,２,…,ｎ时,问题（Ｐ）便是用信赖域方法求解带上下界约束的优化问题时遇到的子问题．对于无约束信赖域方法的子问题已经有了比较成熟的算法［８,１２－１３,１５－１６］．Ｋ＝Ｒ…     

求解一般约束优化问题的修正BFGS信赖域算法

借鉴无约束优化问题的BFGS信赖域算法,建立了非线性一般约束优化问题的BFGS信赖域算法,并证明了算法的全局收敛性．数值实验表明,算法是有效的．     

简单界约束优化的仿射尺度内点信赖域算法的收敛性

本文对简单界约束优化问题提出一种仿射尺度内点信赖域算法,讨论了算法的全 局收敛性,在没有严格互补假设条件下,分析了算法的局部收敛性,给出了数值试验结果.     

求解界约束优化问题的有效集算法综述

主要介绍了求解界约束优化问题的有效集方法,包括投影共轭梯度法和有效集识别函数法,讨论了各自的优点和不足.最后,指出了有效集法的研究趋势及应用前景.     

带非线性不等式约束优化问题的信赖域算法

借助于KKT条件和NCP函数,提出了求解带非线性不等式约束优化问题的信赖域算法.该算法在每一步迭代时,不必求解带信赖域界的二次规划子问题,仅需求一线性方程组系统.在适当的假设条件下,它还是整体收敛的和局部超线性收敛的.数值实验结果表明该方法是有效的.     

求解非线性系统的有效集信赖域方法

该文给出了一个求解非线性系统的信赖域方法.主要思想是通过引入松弛变量,将问题等价地转化为带非负约束的最优化问题.作者利用有效集策略,在每次迭代中只需求解一个低维的信赖域子问题,该信赖域子问题是通过截断共轭梯度法来近似求解的.在较弱的条件下,获得了一个更一般的收敛性结果.     

基于增广Lagrange函数的约束优化问题的一个信赖域方法

本文提出一个求解不等式约束优化问题的基于指数型增广Lagrange函数的信赖域方法.基于指数型增广Lagrange函数,将传统的增广Lagrange方法的精确求解子问题转化为一个信赖域子问题,从而减少了计算量,并建立相应的信赖域算法.在一定的假设条件下,证明了算法的全局收敛性,并给出相应经典算例的数值实验结果.     

约束优化的曲线搜索信赖域算法及其全局收敛性

本文通过对无约束优化ＯＤＥ算法的信赖域分析,提出了约束优化问题的曲线搜索信赖域算法,给出了算法步骤,并讨论了该算法的全局收敛性。     

求解变量带简单界约束的非线性规划问题的信赖域方法

1．引言。本文考虑下述变量带简单界约束的非线性规划问题：问题（1．1）不仅是实际应用中出现的简单的约束最优化问题，而且相当一部分最优化问题可以把变量限制在有意义的区间内181．因此，无论在理论方面还是在实际应用方面，都有必要研究此种问题．给出简便而且有效的算法．有些文章提出了一些特殊的方法．如011和［2］．14］及16］提出了一类信赖域方法，它们都借助于某种辅助点，证明了算法的全局收敛性．在收敛速度的分析方面，除要求在＊－T点满足严格互补松弛外，它们还要求另一个条件，即在每次迭代中，辅助点的有效约束必须在尝…     

A trust region affine scaling method for bound constrained optimization

We study a new trust region affine scaling method for general bound constrained optimization problems. At each iteration, we compute two trial steps. We compute one along some direction obtained by solving an appropriate quadratic model in an ellipsoidal region. This region is defined by an affine scaling technique. It depends on both the distances of current iterate to boundaries and the trust region radius. For convergence and avoiding iterations trapped around nonstationary points, an auxiliary step is defined along some newly defined approximate projected gradient. By choosing the one which achieves more reduction of the quadratic model from the two above steps as the trial step to generate next iterate, we prove that the iterates generated by the new algorithm are not bounded away from stationary points. And also assuming that the second-order sufficient condition holds at some nondegenerate stationary point, we prove the Q-linear convergence of the objective function values. Preliminary numerical experience for problems with bound constraints from the CUTEr collection is also reported.     

Global and local convergence of a new affine scaling trust region algorithm for linearly constrained optimization

Chen and Zhang [Sci.China,Ser.A,45,1390–1397(2002)] introduced an affine scaling trust region algorithm for linearly constrained optimization and analyzed its global convergence.In this paper,we derive a new affine scaling trust region algorithm with dwindling filter for linearly constrained optimization.Different from Chen and Zhang's work,the trial points generated by the new algorithm are accepted if they improve the objective function or improve the first order necessary optimality conditions.Under mild conditions,we discuss both the global and local convergence of the new algorithm.Preliminary numerical results are reported.     

A TRUST REGION METHOD WITH A CONIC MODEL FOR NONLINEARLY CONSTRAINED OPTIMIZATION

Trust region methods are powerful and effective optimization methods.The conic model method is a new type of method with more information available at each iteration than standard quadratic-based methods.The advantages of the above two methods can be combined to form a more powerful method for constrained optimization.The trust region subproblem of our method is to minimize a conic function subject to the linearized constraints and trust region bound.At the same time,the new algorithm still possesses robust global properties.The global convergence of the new algorithm under standard conditions is established.     

On a subproblem of trust region algorithms for constrained optimization

We study a subproblem that arises in some trust region algorithms for equality constrained optimization. It is the minimization of a general quadratic function with two special quadratic constraints. Properties of such subproblems are given. It is proved that the Hessian of the Lagrangian has at most one negative eigenvalue, and an example is presented to show that the Hessian may have a negative eigenvalue when one constraint is inactive at the solution.Research supported by a Research Fellowship of Fitzwilliam College, Cambridge, and by a research grant from the Chinese Academy of Sciences.     

等式与界约束非线性优化信赖域算法的全局收敛

§ 1　ＩｎｔｒｏｄｕｃｔｉｏｎＣｏｎｓｉｄｅｒｔｈｅｆｏｌｌｏｗｉｎｇｎｏｎｌｉｎｅａｒｏｐｔｉｍｉｚａｔｉｏｎｐｒｏｂｌｅｍ :ｍｉｎｉｍｉｚｅｆ(ｘ)ｓｕｂｊｅｃｔｔｏＣ(ｘ) =0 ,　ａ≤ｘ≤ｂ ,( 1 .1 )ｗｈｅｒｅｆ(ｘ) :Ｒｎ→Ｒ ,Ｃ(ｘ) =(ｃ1(ｘ) ,ｃ2 (ｘ) ,...,ｃｍ(ｘ) ) Ｔ:Ｒｎ→Ｒｍ ａｒｅｔｗｉｃｅｃｏｎｔｉｎｕｏｕｓｌｙｄｉｆｆｅｒｅｎｔｉａｂｌｅ,ｍ≤ｎ ,ａ ,ｂ∈Ｒｎ.Ｔｒｕｓｔｒｅｇｉｏｎａｌｇｏｒｉｔｈｍｓａｒｅｖｅｒｙｅｆｆｅｃｔｉｖｅｆｏｒｓｏｌｖｉｎｇｎｏｎｌｉｎｅａｒｏｐｔｉｍｉ…     

A trust region algorithm for equality constrained optimization

A trust region algorithm for equality constrained optimization is proposed that employs a differentiable exact penalty function. Under certain conditions global convergence and local superlinear convergence results are proved.     

Projected quasi-Newton algorithm with trust region for constrained optimization

In Ref. 1, Nocedal and Overton proposed a two-sided projected Hessian updating technique for equality constrained optimization problems. Although local two-step Q-superlinear rate was proved, its global convergence is not assured. In this paper, we suggest a trust-region-type, two-sided, projected quasi-Newton method, which preserves the local two-step superlinear convergence of the original algorithm and also ensures global convergence. The subproblem that we propose is as simple as the one often used when solving unconstrained optimization problems by trust-region strategies and therefore is easy to implement.This research was supported in part by the National Natural Science Foundation of China.     

Modified active set projected spectral gradient method for bound constrained optimization

In this paper, by means of an active set strategy, we present a projected spectral gradient algorithm for solving large-scale bound constrained optimization problems. A nice property of the active set estimation technique is that it can identify the active set at the optimal point without requiring strict complementary condition, which is potentially used to solve degenerated optimization problems. Under appropriate conditions, we show that this proposed method is globally convergent. We also do some numerical experiments by using some bound constrained problems from CUTEr library. The numerical comparisons with SPG, TRON, and L-BFGS-B show that the proposed method is effective and promising.     

An active set limited memory BFGS algorithm for large-scale bound constrained optimization

An active set limited memory BFGS algorithm for large-scale bound constrained optimization is proposed. The active sets are estimated by an identification technique. The search direction is determined by a lower dimensional system of linear equations in free subspace. The implementations of the method on CUTE test problems are described, which show the efficiency of the proposed algorithm. The work was supported by the 973 project granted 2004CB719402 and the NSF project of China granted 10471036.