非线性极大极小问题一个新的QP-free算法

本文研究非线性无约束极大极小优化问题. QP-free算法是求解光滑约束优化问题的有效方法之一,但用于求解极大极小优化问题的成果甚少.基于原问题的稳定点条件,既不需含参数的指数型光滑化函数,也不要等价光滑化,提出了求解非线性极大极小问题一个新的QP-free算法.新算法在每一次迭代中,通过求解两个相同系数矩阵的线性方程组获得搜索方向.在合适的假设条件下,该算法具有全局收敛性.最后,初步的数值试验验证了算法的有效性.     

一种求解混合约束优化问题的半可行序列线性方程组滤子算法的局部收敛性

作者在[10]中提出了一种半可行序列线性规划滤子方法.它将QP-free方法推广至混合约束优化问题上,并且保持对不等式约束的可行性,对等式约束部分用滤子方法处理,从而避免了罚参数的选取.该算法只需求解四个具有相同系数矩阵的线性方程组以得到搜索方向.在一定程度上克服了序列二次规划方法的缺点.[10]中仅给出了全局收敛性.本文主要给出了该算法的局部超线性收敛性证明以及数值结果.     

一种求解混合约束优化问题的半可行序列线性方程组滤子算法的全局收敛性

本文提出了一种半可行的序列线性方程组(SSLE)滤子方法.在文献[6]的基础上,将QP-free方法推广到混合约束优化问题,对不等式约束部分保持其可行性,而对等式约束部分用滤子方法处理,从而避免了罚参数的选取.本文提出的算法只需求解四个具有相同的非退化的系统矩阵的线性方程组以得到搜索方向.在一定程度上克服了SQP方法的缺点.另外,为了提高计算效率,算法中使用了χ -有效集.本文给出了该算法的全局收敛性证明.     

不等式约束优化一个新型可行QP-free算法

本文对非线性不等式约束优化问题提出了一个新的可行 QP-free 算法. 新算法保存了现有算法的优点, 并具有以下特性: (1) 算法每次迭代只需求解三个具有相同系数矩阵的线性方程组, 计算量小; (2) 可行下降方向只需通过求解一个线性方程组即可获得, 克服了以往分别求解两个线性方程组获得下降方向和可行方向, 然后再做凸组合的困难;(3) 迭代点均为可行点, 并不要求是严格内点; (4) 算法中采用了试探性线搜索,可以进一步减少计算量; (5) 算法中参数很少,数值试验表明算法具有较好的数值效果和较强的稳定性.     

不等式约束优化一个可行序列线性方程组算法

提出了求解非线性不等式约束优化问题的一个可行序列线性方程组算法. 在每次迭代中, 可行下降方向通过求解两个线性方程组产生, 系数矩阵具有较好的稀疏性. 在较为温和的条件下, 算法具有全局收敛性和强收敛性, 数值试验表明算法是有效的.     

修正的SQP型并行变量分配算法

Ferris 和Mangasarian 提出求解最优化问题的PVD(并行变量分配)算法, 此算法是把变量分为主要变量和辅助变量, 分配到p个处理机上, 每个处理机除了负责更新本处理机的主要变量外, 同时还沿着给定的方向更新辅助变量, 使算法的鲁棒性和灵活性得到了很大的提高. 该文基于文献[6]提出一种修正的SQP型PVD算法, 构造其搜索方向是下降方向和可行方向的组合, 并对此方向给予一个高阶修正, 使此算法很好地防止 Maratos 效应发生, 而且能够克服在求解子问题时出现约束不相容的情况. 在合适的条件下, 推导出此算法具有全局收敛性.     

非线性互补约束问题的一个强全局收敛QP-free算法

本文研究非线性互补约束均衡问题.利用光滑近似法的思想及罚函数思想,把非线性互补约束均衡问题转化为一光滑非线性规划问题,该光滑非线性规划问题通过一个新的QP-free算法求解.特别地,不需要严格互补假设条件以及不需要Hessian阵估计正定的假设条件,算法仍具有强全局收敛性.     

不等式约束优化全局收敛的滤子线性方程组算法

设计了求解不等式约束非线性规划问题的一种新的滤子序列线性方程组算法,该算法每步迭代由减小约束违反度和目标函数值两部分构成.利用约束函数在某个中介点线性化的方法产生搜索方向.每步迭代仅需求解两个线性方程组,计算量较小.在一般条件下,证明了算法产生的无穷迭代点列所有聚点都是可行点并且所有聚点都是所求解问题的KKT点.     

解一类结构变分不等式问题的非精确并行交替方向法

带线性约束的具有两分块结构的单调变分不等式问题, 出现在许多现代应用中, 如交通和经济问题等. 基于该问题良好的可分结构, 分裂型算法被广泛研究用于其求解. 提出新的带回代的非精确并行交替方向法解该类问题, 在每一步迭代中,首先以并行模式通过投影得到预测点, 然后对其校正得到下一步的迭代点. 在压缩型算法的理论框架下, 在适当条件下证明了所提算法的全局收敛性. 数值结果表明了算法的有效性. 此外, 该算法可推广到求解具有多分块结构的问题.     

不等式约束优化一个超线性收敛的可行内点型算法

本文针对非线性不等式约束优化问题,提出了-个可行内点型算法.在每次迭代中,基于积极约束集策略,该算法只需求解三个线性方程组,因而其计算工作量较小.在-般的条件下,证明了算法具有全局收敛及超线性收敛性.     

A Globally Convergent Sequential Quadratic Programming Algorithm for Mathematical Programs with Linear Complementarity Constraints

This paper presents a sequential quadratic programming algorithm for computing a stationary point of a mathematical program with linear complementarity constraints. The algorithm is based on a reformulation of the complementarity condition as a system of semismooth equations by means of Fischer-Burmeister functional, combined with a classical penalty function method for solving constrained optimization problems. Global convergence of the algorithm is established under appropriate assumptions. Some preliminary computational results are reported.     

非线性互补约束优化问题的可行性条件

本文研究了非线性互补约束优化问题的可行性条件，其中约束条件除互补问题外还包括第一水平(设计)变量和第二水平(状态)变量同时出现的其它非线性约束，它是线性互补约束优化问题的可行性条件的推广。     

Admissibility of linear estimators with respect to inequality constraints under some loss functions

In this paper, we study the issue of admissibility of linear estimated functions of parameters in the multivariate linear model with respect to inequality constraints under a matrix loss and a matrix balanced loss. Under the matrix loss, when the model is not constrained, the results in the class of non-homogeneous linear estimators [Xie, 1989, Chinese Sci. Bull., 1148–1149; Xie, 1993, J. Multivariate Anal., 1071–1074] showed that the admissibility under the matrix loss and the trace loss is equivalent. However, when the model is constrained by the inequality constraints, we find this equivalency is not tenable, our result shows that the admissibility of linear estimator does not depend on the constraints again under this matrix loss, but it is contrary under the trace loss [Wu, 2008, Linear Algebra Appl., 2040–2048], and it is also relative to the constraints under another matrix loss [He, 2009, Linear Algebra Appl., 241–250]. Under the matrix balanced loss, the necessary and sufficient conditions that the linear estimators are admissible in the class of homogeneous and non-homogeneous linear estimators are obtained, respectively. These results will support the theory of admissibility on the linear model with inequality constraints.     

Sequential Systems of Linear Equations Algorithm for Nonlinear Optimization Problems with General Constraints

In Ref. 1, a new superlinearly convergent algorithm of sequential systems of linear equations (SSLE) for nonlinear optimization problems with inequality constraints was proposed. At each iteration, this new algorithm only needs to solve four systems of linear equations having the same coefficient matrix, which is much less than the amount of computation required for existing SQP algorithms. Moreover, unlike the quadratic programming subproblems of the SQP algorithms (which may not have a solution), the subproblems of the SSLE algorithm are always solvable. In Ref. 2, it is shown that the new algorithm can also be used to deal with nonlinear optimization problems having both equality and inequality constraints, by solving an auxiliary problem. But the algorithm of Ref. 2 has to perform a pivoting operation to adjust the penalty parameter per iteration. In this paper, we improve the work of Ref. 2 and present a new algorithm of sequential systems of linear equations for general nonlinear optimization problems. This new algorithm preserves the advantages of the SSLE algorithms, while at the same time overcoming the aforementioned shortcomings. Some numerical results are also reported.     

A new method of moving asymptotes for large-scale linearly equality-constrained minimization

A new method of moving asymptotes for large-scale minimization subject to linear equality constraints is discussed.In this method,linear equality constraints are deleted with null space technique and the descending direction is obtained by solving a convex separable subproblem of moving asymptotes in each iteration. New rules for controlling the asymptotes parameters are designed and the global convergence of the method under some reasonable conditions is established and proved.The numerical results show that the new method may be capable of processing some large scale problems.     

A Superlinearly Convergent SSLE Algorithm for Optimization Problems with Linear Complementarity Constraints

In this paper we study a special kind of optimization problems with linear complementarity constraints. First, by a generalized complementarity function and perturbed technique, the discussed problem is transformed into a family of general nonlinear optimization problems containing parameters. And then, using a special penalty function as a merit function, we establish a sequential systems of linear equations (SSLE) algorithm. Three systems of equations solved at each iteration have the same coefficients. Under some suitable conditions, the algorithm is proved to possess not only global convergence, but also strong and superlinear convergence. At the end of the paper, some preliminary numerical experiments are reported.     

线性无关假设如何影响非线性约束最优化算法

首先综述非线性约束最优化最近的一些进展. 首次定义了约束最优化算法的全局收敛性. 注意到最优性条件的精确性和算法近似性之间的差异, 并回顾等式约束最优化的原始的Newton 型算法框架, 即可理解为什么约束梯度的线性无关假设应该而且可以被弱化. 这些讨论被扩展到不等式约束最优化问题. 然后在没有线性无关假设条件下, 证明了一个使用精确罚函数和二阶校正技术的算法可具有超线性收敛性. 这些认知有助于接下来开发求解包括非线性半定规划和锥规划等约束最优化问题的更加有效的新算法.     

A constrained min‐max algorithm for rival models of the same economic system

There are well established rival theories about the economy. These have, in turn, led to the development of rival models purporting to represent the economic system. The models are large systems of discrete-time nonlinear dynamic equations. Observed data of the real system does not, in general, provide sufficient information for statistical methods to invalidate all but one of the rival models. In such a circumstance, there is uncertainty about which model to use in the formulation of policy. Prudent policy design would suggest that a model-based policy should take into account all the rival models. This is achieved as a pooling of the models. The pooling that yields the policy which is robust to model choice is formulated as a constrained min-max problem. The minimization is over the decision variables and the maximization is over the rival models. Only equality constraints are considered.A successive quadratic programming algorithm is discussed for the solution of the min-max problem. The algorithm uses a stepsize strategy based on a differentiable penalty function for the constraints. Two alternative quadratic subproblems can be used. One is a quadratic min-max and the other a quadratic programming problem. The objective function of either subproblem includes a linear term which is dependent on the penalty function. The penalty parameter is determined at every iteration, using a strategy that ensures a descent property as well as the boundedness of the penalty term. The boundedness follows since the strategy is always satisfied for finite values of the parameter which needs to be increased a finite number of times.The global and local convergence of the algorithm is established. The conditions, involving projected Hessian approximations, are discussed under which the algorithm achieves unit stepsizes and subsequently Q-superlinear convergence.     

Stabilized Sequential Quadratic Programming

Recently, Wright proposed a stabilized sequential quadratic programming algorithm for inequality constrained optimization. Assuming the Mangasarian-Fromovitz constraint qualification and the existence of a strictly positive multiplier (but possibly dependent constraint gradients), he proved a local quadratic convergence result. In this paper, we establish quadratic convergence in cases where both strict complementarity and the Mangasarian-Fromovitz constraint qualification do not hold. The constraints on the stabilization parameter are relaxed, and linear convergence is demonstrated when the parameter is kept fixed. We show that the analysis of this method can be carried out using recent results for the stability of variational problems.     

A linear programming proof of the second order conditions of non-linear programming

In this note we give a new, simple proof of the standard first and second order necessary conditions, under the Mangasarian–Fromovitz constraint qualification (MFCQ), for non-linear programming problems. We work under a mild constraint qualification, which is implied by MFCQ. This makes it possible to reduce the proof to the relatively easy case of inequality constraints only under MFCQ. This reduction makes use of relaxation of inequality constraints and it makes use of a penalty function. The new proof is based on the duality theorem for linear programming; the proofs in the literature are based on results of mathematical analysis. This paper completes the work in a recent note of Birbil et al. where a linear programming proof of the first order necessary conditions has been given, using relaxation of equality constraints.