不等式约束最优化超线性与二次收敛的强次可行SQP算法

利用ＳＱＰ方法、广义投影技术和强次可行方（向）法思想,建立不等式约束优化一个新的初始点任意的快速收敛算法． 算法每次迭代仅需解一个总存在可行解的二次子规划,或用广义投影计算“一阶”强次可行下降辅助搜索方向;采用曲线搜索与直线搜索相结合的方法产生步长． 在较温和的条件下,算法具有全局收敛性、强收敛性、超线性与二次收敛性． 给出了算法有效的数值试验．     

SQP技术与广义投影相结合的次可行方向法

本文建立非线性不等式约束优化的一个新算法，分析和证明了算法的整体收敛性和超线性收敛性。其技巧在于将广义投影和ＳＱＰ技术结合使用。     

AN EFFECTIVE SEQUENTIAL QUADRATIC PROGRAMMING ALGORITHM FOR NONLINEAR OPTIMIZATION PROBLEMS

In this paper,a new globally convergent algorithm for nonlinear optimization prablems with equality and inequality constraints is presented. The new algorithm is of SQP type which determines a search direction by solving a quadratic programming subproblem per itera-tion. Some revisions on the quadratic programming subproblem have been made in such a way that the associated constraint region is nonempty for each point x generated by the algorithm, i. e. , the subproblems always have optimal solutions. The new algorithm has two important properties. The computation of revision parameter for guaranteeing the consistency of quadratic sub-problem and the computation of the second order correction step for superlinear convergence use the same inverse of a matrix per iteration, so the computation amount of the new algorithm will not be increased much more than other SQP type algorithms; Another is that the new algorithm can give automatically a feasible point as a starting point for the quadratic subproblems pe     

一般约束最优化强收敛的拟乘子-强次可行方向法

本文讨论一般等式和不等式约束优化问题 ,利用广义投影技术和强次可行方向法思想 ,结合拟 K-T点和拟乘子法 [1] 两个新概念 ,建立问题一个初始点任意的有显式搜索方向的新算法 .证明算法不仅收敛到原问题的拟 K- T点 ,且具有更好的强收敛性 .对算法进行了一定的数值试验 .     

A method combining norm-relaxed QP subproblems with systems of linear equations for constrained optimization

Based on the ideas of norm-relaxed sequential quadratic programming (SQP) method and the strongly sub-feasible direction method, we propose a new SQP algorithm for the solution of nonlinear inequality constrained optimization. Unlike the previous work, at each iteration, the norm-relaxed quadratic programming subproblem (NRQPS) in our algorithm only consists of the constraints corresponding to an estimate of the active set, and the high-order correction direction (used to avoid the Maratos effect) is obtained by solving a system of linear equations (SLE) which also only consists of such a subset of constraints and gradients. Moreover, the line search technique can effectively combine the initialization process with the optimization process, and therefore (if the starting point is not feasible) the iteration points always get into the feasible set after a finite number of iterations. The global convergence is proved under the Mangasarian–Fromovitz constraint qualification (MFCQ), and the superlinear convergence is obtained without assuming the strict complementarity. Finally, the numerical experiments show that the proposed algorithm is effective and promising for the test problems.     

线性约束两分块非凸优化的ADMM-SQP算法

基于乘子交替方向法(ADMM)和序列二次规划(SQP)方法思想, 致力于研究线 性约束两分块非凸优化的新型高效算法. 首先, 以SQP思想为主线, 在其二次规划(QP)子问题的求解中引入ADMM思想, 将QP分解为两个相互独立的小规模QP求解. 其次, 借助增广拉格朗日函数和Armijo线搜索产生原始变量新迭代点. 最后, 以显式解析式更新对偶变量. 因此, 构建了一个新型ADMM-SQP算法. 在较弱条件下, 分析了算法通常意义下的全局收敛性, 并对算法进行了初步的数值试验.     

A globally and superlinearly convergent modified SQP-filter method

In this paper, we presented a modified SQP-filter method based on the modified quadratic subproblem proposed by Zhou (J. Global Optim. 11, 193–2005, 1997). In contrast with the SQP methods, each iteration this algorithm only needs to solve one quadratic programming subproblems and it is always feasible. Moreover, it has no demand on the initial point. With the filter technique, the algorithm shows good numerical results. Under some conditions, the globally and superlinearly convergent properties are given.     

非线性规划的拟罚函数—强次可行方向法

本文首先提出非线性规划的拟Ｋｕｈｎ—Ｔｕｃｋｅｒ点和拟罚函数法的概念和思想，然后结合强次可行方向法思想给出问题的两个新型算法，称之为拟罚函数—强次可行方向法．证明了该算法收敛到原问题的拟Ｋｕｈｎ—Ｔｕｃｋｅｒ点．     

基于并行计算的多方向强次可行模松弛SQP算法

本文研究求解非线性约束优化问题.利用多方向并行方法,提出了一个新的强次可行模松弛序列二次规划(SQP)算法.数值试验表明,迭代次数和计算时间少于只取单一参数的传统算法.     

A Modified SQP Method with Nonmonotone Linesearch Technique

In this paper, a modified SQP method with nonmonotone line search technique is presented based on the modified quadratic subproblem proposed in Zhou (1997) and the nonmonotone line search technique. This algorithm starts from an arbitrary initial point, adjusts penalty parameter automatically and can overcome the Maratos effect. What is more, the subproblem is feasible at each iterate point. The global and local superlinear convergence properties are obtained under certain conditions.     

Global convergence of a robust filter SQP algorithm

We present a robust filter SQP algorithm for solving constrained optimization problems. This algorithm is based on the modified quadratic programming proposed by Burke to avoid the infeasibility of the quadratic programming subproblem at each iteration. Compared with other filter SQP algorithms, our algorithm does not require any restoration phase procedure which may spend a large amount of computation. The main advantage of our algorithm is that it is globally convergent without requiring strong constraint qualifications, such as Mangasarian–Fromovitz constraint qualification (MFCQ) and the constant rank constraint qualification (CRCQ). Furthermore, the feasible limit points of the sequence generated by our algorithm are proven to be the KKT points if some weaker conditions are satisfied. Numerical results are also presented to show the efficiency of the algorithm.     

An algorithm of sequential systems of linear equations for nonlinear optimization problems with arbitrary initial point

For current sequential quadratic programming (SQP) type algorithms, there exist two problems: (i) in order to obtain a search direction, one must solve one or more quadratic programming subproblems per iteration, and the computation amount of this algorithm is very large. So they are not suitable for the large-scale problems; (ii) the SQP algorithms require that the related quadratic programming subproblems be solvable per iteration, but it is difficult to be satisfied. By using ε-active set procedure with a special penalty function as the merit function, a new algorithm of sequential systems of linear equations for general nonlinear optimization problems with arbitrary initial point is presented. This new algorithm only needs to solve three systems of linear equations having the same coefficient matrix per iteration, and has global convergence and local superlinear convergence. To some extent, the new algorithm can overcome the shortcomings of the SQP algorithms mentioned above. Project partly supported by the National Natural Science Foundation of China and Tianyuan Foundation of China.     

非线性约束条件下一个超线性收敛的可行方法

在本文中，我们对非线性不等式约束条件下的非线性优化问题给出了一个新的ＳＱＰ类可行方法．此算法不但结构简单、易于计算，并且在适当的假设条件下，我们证明了算法具有全局收敛性及超线性收敛性     

A superlinearly and quadratically convergent SQP type feasible method for constrained optimization

A new SQP type feasible method for inequality constrained optimization is presented, it is a combination of a master algorithm and an auxiliary algorithm which is taken only in finite iterations. The directions of the master algorithm are generated by only one quadratic programming, and its step-size is always one, the directions of the auxiliary algorithm are new “secondorder“ feasible descent. Under suitable assumptions, the algorithm is proved to possess global and strong convergence, superlinear and quadratic convergence.     

一般约束最优化拓广的强次可行方向法

本文讨论非线性等式与不等式最优化问题,引进一个拟罚函数及其相应的只带不等式约束的辅助问题,然后采用广义投影技术和强次可行方向法思想建立原问题的一个全局收敛新算法,该算法具有初点始任意,结构简单,计算量较小等特点。     

A sequential equality constrained quadratic programming algorithm for inequality constrained optimization

In this paper, the feasible type SQP method is improved. A new SQP algorithm is presented to solve the nonlinear inequality constrained optimization. As compared with the existing SQP methods, per single iteration, in order to obtain the search direction, it is only necessary to solve equality constrained quadratic programming subproblems and systems of linear equations. Under some suitable conditions, the global and superlinear convergence can be induced.     

一个解不等式约束优化问题的初始点任意而不需罚函数的SQP算法(英文)

本文构造了一解不等式约束优化问题的非单调SQP方法 ,与类似的算法比较 ,它有以下特点 :( 1 )初始点任意 ,并不用罚函数 ;( 2 )有限步后必产生可行点 ;( 3)在每次迭代 ,只需解一个二次规划子问题 ;( 4)不需要严格互补条件 ,在较弱的条件下 ,算法超线性收敛 .     

一类MPEC问题的SQP算法

本文研究带线性互补约束规划问题的 SQP算法 .该算法不要求精确计算初值 ,是针对初值非精确计算情形的新算法 ,证明了该算法的收敛性 .     

An improved sequential quadratic programming algorithm for solving general nonlinear programming problems

In this paper, a class of general nonlinear programming problems with inequality and equality constraints is discussed. Firstly, the original problem is transformed into an associated simpler equivalent problem with only inequality constraints. Then, inspired by the ideals of the sequential quadratic programming (SQP) method and the method of system of linear equations (SLE), a new type of SQP algorithm for solving the original problem is proposed. At each iteration, the search direction is generated by the combination of two directions, which are obtained by solving an always feasible quadratic programming (QP) subproblem and a SLE, respectively. Moreover, in order to overcome the Maratos effect, the higher-order correction direction is obtained by solving another SLE. The two SLEs have the same coefficient matrices, and we only need to solve the one of them after a finite number of iterations. By a new line search technique, the proposed algorithm possesses global and superlinear convergence under some suitable assumptions without the strict complementarity. Finally, some comparative numerical results are reported to show that the proposed algorithm is effective and promising.     

A ROBUST SQP METHOD FOR OPTIMIZATION WITH INEQUALITY CONSTRAINTS

A new algorithm for inequality constrained optimization is presented, which solves a linear programming subproblem and a quadratic subproblem at each iteration. The algorithm can circumvent the difficulties associated with the possible inconsistency of QP subproblem of the original SQP method. Moreover, the algorithm can converge to a point which satisfies a certain first-order necessary condition even if the original problem is itself infeasible. Under certain condition, some global convergence results are proved and local superlinear convergence results are also obtained. Preliminary numerical results are reported.