非线性最优化一个超线收敛的可行下降算法

本文讨论非线性等式和不等式约束最优化的求解方法。首先将原问题扩充成一个只含不等式约束的参数规划，对于充分大的参数，扩充问题与原问题是等价的。然手建立具有以下特点的一个新算法。１）算法对扩充问题而言是可行下降的，参数只须自动调整有限次；２）每次迭代仅需解一个二次规划；３）在适当的假设下，算法超线性收敛于原问题的最优解。     

线性约束三次规划问题的全局最优性必要条件和最优化算法

讨论了带线性不等式约束三次规划问题的最优性条件和最优化算法. 首先, 讨论了带有线性不等式约束三次规划问题的 全局最优性必要条件. 然后, 利用全局最优性必要条件, 设计了解线性约束三次规划问题的一个新的局部最优化算法(强局部最优化算法). 再利用辅助函数和所给出的新的局部最优化算法, 设计了带有线性不等式约束三 规划问题的全局最优化算法. 最后, 数值算例说明给出的最优化算法是可行的、有效的.     

不等式约束最优化无严格互补条件下的快速收敛序列线性方程组算法

本文讨论无严格互补性的非线性不等式约束最优化问题,建立了一个新的序列线性方程组算法。算法每次迭代只需解一个线性方程组或计算一次广义梯度投影,并不要求Lagrange函数的近似Hessian阵正定。在较弱的假设下,证明了算法的整体收敛性、强收敛性、超线性收敛性及二次收敛速度。还对算法进行了有效的数值试验。     

基于双参数罚函数求解约束优化问题的一个新算法

对于含约束不等式的最优化问题给出了一种双参数罚函数形式,在文[7]的拟牛顿算法的基础上提出了一个同时改变双参数罚函数的新算法,研究了它的收敛性,数值实验表明了该算法是有效的.     

一般约束最优化的拟乘子—强次可行方向法

本文讨论一般等式和不等式约束的优化问题，首先提出了问题的拟Ｋｕｈｎ－Ｔｕｃｋｅｒ点和拟乘子法两个新概念，然后借助于不等式约束优化问题强次可行方向法的思想和技巧建立问题的两个新算法。     

不等式约束最优化的一个使用非单调搜索的可行算法

对不等式约束最优化问题本文提出了一个新算法。算法使用了非单调搜索,它不仅放松了每步迭代中对搜索的限制,而且使得算法迭代到一定阶段后具有非常简洁的形式,在不需要严格互补条件的较弱假设下,算法是整体和超线性收敛的。     

变分不等式的几类求解方法

本文转为系统地分析和概述了变分不等式问题中几类占有重要地位的求解方法,包括方法产生的背景,主要结果及应用等,这几类算法分别为连续算法,（拟）牛顿型算法,一般迭代模型,投影算法,投影收缩算法等。     

一般约束优化基于识别函数的模松弛算法

借助于半罚函数和产生工作集的识别函数以及模松弛SQP算法思想, 本文建立了求解带等式及不等式约束优化的一个新算法. 每次迭代中, 算法的搜索方向由一个简化的二次规划子问题及一个简化的线性方程组产生. 算法在不包含严格互补性的温和条件下具有全局收敛性和超线性收敛性. 最后给出了算法初步的数值试验报告.     

一般约束最优化强收敛的拟乘子-强次可行方向法

本文讨论一般等式和不等式约束优化问题 ,利用广义投影技术和强次可行方向法思想 ,结合拟 K-T点和拟乘子法 [1] 两个新概念 ,建立问题一个初始点任意的有显式搜索方向的新算法 .证明算法不仅收敛到原问题的拟 K- T点 ,且具有更好的强收敛性 .对算法进行了一定的数值试验 .     

关于单调的变分不等式问题的收敛性方法

１引言变分不等式的性质及解法的研究是优化领域的重要课题．所谓变分不等式问题就是：寻找一个点,使得其中Ｘ是Ｒｎ中的非空闲凸集,Ｆ是Ｒｎ中的映射,表示Ｒｎ中的内积．求解问题（１．１）有多种思路［１,４,５］其中之一就是将（１．１）转化为它的某种等价问题,再进行求解．在山中ＭａｓａｏＦｕｋｕｓｈｉｍａ给出了（１．１）的如下的等价问题Ｇ是对称正定矩阵．山提出了求解（１．２）的带精确搜索和Ａｒｍｉｊｏ搜索的两种收敛性算法．本文建立了“ｄ－ｆｕｎｃｔｉｏｎ”的概念,利用“Ｄ－ｆｕｎｃｔｉｎ”给出了（１．１）…     

不等式约束极大极小问题的一个新型模松弛强次可行SQCQP算法

针对带不等式约束的极大极小问题,借鉴一般约束优化问题的模松弛强次可行SQP算法思想,提出了求解不等式约束极大极小问题的一个新型模松弛强次可行SQCQP算法.首先,通过在QCQP子问题中选取合适的罚函数,保证了算法的可行性以及目标函数F(x)的下降性,同时简化QCQP子问题二次约束项参数α_k的选取,可保证算法的可行性和收敛性.其次,算法步长的选取合理简单.最后,在适当的假设条件下证明了算法具有全局收敛性及强收敛性.初步的数值试验结果表明算法是可行有效的.     

Solving Variational Inequality Problems with Linear Constraints by a Proximal Decomposition Algorithm

The alternating direction method solves large scale variational inequality problems with linear constraints via solving a series of small scale variational inequality problems with simple constraints. The algorithm is attractive if the subproblems can be solved efficiently and exactly. However, the subproblem is itself variational inequality problem, which is structurally also difficult to solve. In this paper, we develop a new decomposition algorithm, which, at each iteration, just solves a system of well-conditioned linear equations and performs a line search. We allow to solve the subproblem approximately and the accuracy criterion is the constructive one developed recently by Solodov and Svaiter. Under mild assumptions on the problem's data, the algorithm is proved to converge globally. Some preliminary computational results are also reported to illustrate the efficiency of the algorithm.     

A GENERALIZED PROJECTION-SUCCESSIVE LINEAREQUATIONS ALGORITHM FOR NONLINEARLY EQUALITy AND INEQUALITY CONSTRAINED OPTIMIZATION AND ITS RATE OF CONVERGENCE

In this paper, a new superlinearly convergent algorithm is presented for optimization problems with general nonlineer equality and inequality Constraints, Comparing with other methods for these problems, the algorithm has two main advantages. First, it doesn‘t solve anyquadratic programming (QP), and its search directions are determined by the generalized projection technique and the solutions of two systems of linear equations. Second, the sequential points generated by the algoritbh satisfy all inequity constraints and its step-length is computed by the straight line search,The algorithm is proved to possesa global and auperlinear convergence.     

Sequential Systems of Linear Equations Algorithm for Nonlinear Optimization Problems with General Constraints

In Ref. 1, a new superlinearly convergent algorithm of sequential systems of linear equations (SSLE) for nonlinear optimization problems with inequality constraints was proposed. At each iteration, this new algorithm only needs to solve four systems of linear equations having the same coefficient matrix, which is much less than the amount of computation required for existing SQP algorithms. Moreover, unlike the quadratic programming subproblems of the SQP algorithms (which may not have a solution), the subproblems of the SSLE algorithm are always solvable. In Ref. 2, it is shown that the new algorithm can also be used to deal with nonlinear optimization problems having both equality and inequality constraints, by solving an auxiliary problem. But the algorithm of Ref. 2 has to perform a pivoting operation to adjust the penalty parameter per iteration. In this paper, we improve the work of Ref. 2 and present a new algorithm of sequential systems of linear equations for general nonlinear optimization problems. This new algorithm preserves the advantages of the SSLE algorithms, while at the same time overcoming the aforementioned shortcomings. Some numerical results are also reported.     

Handling equality constraints with agent-based memetic algorithms

In addition to inequality constraints, many mathematical models require equality constraints to represent the practical problems appropriately. The existence of equality constraints reduces the size of the feasible space significantly, which makes it difficult to locate feasible and optimal solutions. This paper presents a new equality constraint handling technique which enhances the performance of an agent-based evolutionary algorithm in solving constrained optimization problems with equality constraints. The technique is basically used as an agent learning process in the agent-based evolutionary algorithm. The performance of the proposed algorithm is tested on a set of well-known benchmark problems including seven new problems. The experimental results confirm the improved performance of the proposed technique.     

A linear programming-based optimization algorithm for solving nonlinear programming problems

In this paper a linear programming-based optimization algorithm called the Sequential Cutting Plane algorithm is presented. The main features of the algorithm are described, convergence to a Karush–Kuhn–Tucker stationary point is proved and numerical experience on some well-known test sets is showed. The algorithm is based on an earlier version for convex inequality constrained problems, but here the algorithm is extended to general continuously differentiable nonlinear programming problems containing both nonlinear inequality and equality constraints. A comparison with some existing solvers shows that the algorithm is competitive with these solvers. Thus, this new method based on solving linear programming subproblems is a good alternative method for solving nonlinear programming problems efficiently. The algorithm has been used as a subsolver in a mixed integer nonlinear programming algorithm where the linear problems provide lower bounds on the optimal solutions of the nonlinear programming subproblems in the branch and bound tree for convex, inequality constrained problems.     

A modified SLP algorithm and its global convergence

This paper concerns a filter technique and its application to the trust region method for nonlinear programming (NLP) problems. We used our filter trust region algorithm to solve NLP problems with equality and inequality constraints, instead of solving NLP problems with just inequality constraints, as was introduced by Fletcher et al. [R. Fletcher, S. Leyffer, Ph.L. Toint, On the global converge of an SLP-filter algorithm, Report NA/183, Department of Mathematics, Dundee University, Dundee, Scotland, 1999]. We incorporate this filter technique into the traditional trust region method such that the new algorithm possesses nonmonotonicity. Unlike the tradition trust region method, our algorithm performs a nonmonotone filter technique to find a new iteration point if a trial step is not accepted. Under mild conditions, we prove that the algorithm is globally convergent.     

A Superlinearly Convergent Implicit Smooth SQP Algorithm for Mathematical Programs with Nonlinear Complementarity Constraints

This paper discusses a special class of mathematical programs with nonlinear complementarity constraints, its goal is to present a globally and superlinearly convergent algorithm for the discussed problems. We first reformulate the complementarity constraints as a standard nonlinear equality and inequality constraints by making use of a class of generalized smoothing complementarity functions, then present a new SQP algorithm for the discussed problems. At each iteration, with the help of a pivoting operation, a master search direction is yielded by solving a quadratic program, and a correction search direction for avoiding the Maratos effect is generated by an explicit formula. Under suitable assumptions, without the strict complementarity on the upper-level inequality constraints, the proposed algorithm converges globally to a B-stationary point of the problems, and its convergence rate is superlinear.AMS Subject Classification: 90C, 49MThis work was supported by the National Natural Science Foundation (10261001) and the Guangxi Province Science Foundation (0236001, 0249003) of China.     

Global convergence analysis of the aggregate constraint homotopy method for nonlinear programming problems with both inequality and equality constraints

In this paper, we construct appropriate aggregate mappings and a new aggregate constraint homotopy (ACH) equation by converting equality constraints to inequality constraints and introducing two variable parameters. Then, we propose an ACH method for nonlinear programming problems with inequality and equality constraints. Under suitable conditions, we obtain the global convergence of this ACH method, which makes us prove the existence of a bounded smooth path that connects a given point to a Karush–Kuhn–Tucker point of nonlinear programming problems. The numerical tracking of this path can lead to an implementable globally convergent algorithm. A numerical procedure is given to implement the proposed ACH method, and the computational results are reported.