Quadratic Convergence of a Primal-Dual Interior Point Method for Degenerate Nonlinear Optimization Problems

Recently studies of numerical methods for degenerate nonlinear optimization problems have been attracted much attention. Several authors have discussed convergence properties without the linear independence constraint qualification and/or the strict complementarity condition. In this paper, we are concerned with quadratic convergence property of a primal-dual interior point method, in which Newton’s method is applied to the barrier KKT conditions. We assume that the second order sufficient condition and the linear independence of gradients of equality constraints hold at the solution, and that there exists a solution that satisfies the strict complementarity condition, and that multiplier iterates generated by our method for inequality constraints are uniformly bounded, which relaxes the linear independence constraint qualification. Uniform boundedness of multiplier iterates is satisfied if the Mangasarian-Fromovitz constraint qualification is assumed, for example. By using the stability theorem by Hager and Gowda (1999), and Wright (2001), the distance from the current point to the solution set is related to the residual of the KKT conditions.By controlling a barrier parameter and adopting a suitable line search procedure, we prove the quadratic convergence of the proposed algorithm.     

A smoothing Newton method for mathematical programs constrained by parameterized quasi-variational inequalities

We consider a class of mathematical programs governed by parameterized quasi-variational inequalities(QVI).The necessary optimality conditions for the optimization problem with QVI constraints are reformulated as a system of nonsmooth equations under the linear independence constraint qualification and the strict slackness condition.A set of second order sufficient conditions for the mathematical program with parameterized QVI constraints are proposed,which are demonstrated to be sufficient for the second o...     

关于求解带线性互补约束的数学规划问题正则方法的一个注记

本文主要研究在某些较弱条件下求解带线性互补约束的数学规划问题(MPLCC)正则方法的收敛性.若衡约束规划线性独立约束规范条件(MPEC-LICQ)在由正则方法产生的点列的聚点处成立,且迭代点列满足二阶必要条件,同时,若比在文[7]中渐近弱非退化条件Ⅰ更弱的渐近弱非退化条件Ⅱ在聚点处也成立,那么所有这些聚点都是B-稳定点.此外,在弱MPEC-LICQ,二阶必要条件及渐近弱退化条件Ⅱ下,我们仍能证明通过正则方法所得的聚点都是B-稳定点.     

Regularity properties of optimal controls for problems with time-varying state and control constraints

In this paper we report new results on the regularity of optimal controls for dynamic optimization problems with functional inequality state constraints, a convex time-dependent control constraint and a coercive cost function. Recently, it has been shown that the linear independence condition on active state constraints, present in the earlier literature, can be replaced by a less restrictive, positive linear independence condition, that requires linear independence merely with respect to non-negative weighting parameters, provided the control constraint set is independent of the time variable. We show that, if the control constraint set, regarded as a time-dependent multifunction, is merely Lipschitz continuous with respect to the time variable, then optimal controls can fail to be Lipschitz continuous. In these circumstances, however, a weaker Hölder continuity-like regularity property can be established. On the other hand, Lipschitz continuity of optimal controls is guaranteed for time-varying control sets under a positive linear independence hypothesis, when the control constraint sets are described, at each time, by a finite collection of functional inequalities.     

Second-order analysis for optimal control problems with pure state constraints and mixed control-state constraints

This paper deals with the optimal control problem of an ordinary differential equation with several pure state constraints, of arbitrary orders, as well as mixed control-state constraints. We assume (i) the control to be continuous and the strengthened Legendre–Clebsch condition to hold, and (ii) a linear independence condition of the active constraints at their respective order to hold. We give a complete analysis of the smoothness and junction conditions of the control and of the constraints multipliers. This allows us to obtain, when there are finitely many nontangential junction points, a theory of no-gap second-order optimality conditions and a characterization of the well-posedness of the shooting algorithm. These results generalize those obtained in the case of a scalar-valued state constraint and a scalar-valued control.     

A Sequential Smooth Penalization Approach to Mathematical Programs with Complementarity Constraints

In this paper, a mathematical program with complementarity constraints (MPCC) is reformulated as a nonsmooth constrained mathematical program via the Fischer–Burmeister function. Smooth penalty functions are used to treat this nonsmooth constrained program. Under linear independence constraint qualification, and upper level strict complementarity condition, together with some other mild conditions, we prove that the limit point of stationary points satisfying second-order necessary conditions of unconstrained penalized problems is a strongly stationary point, hence a B-stationary point of the original MPCC. Furthermore, this limit point also satisfies a second-order necessary condition of the original MPCC. Numerical results are presented to test the performance of this method.     

Partial Augmented Lagrangian Method and Mathematical Programs with Complementarity Constraints

In this paper, we apply a partial augmented Lagrangian method to mathematical programs with complementarity constraints (MPCC). Specifically, only the complementarity constraints are incorporated into the objective function of the augmented Lagrangian problem while the other constraints of the original MPCC are retained as constraints in the augmented Lagrangian problem. We show that the limit point of a sequence of points that satisfy second-order necessary conditions of the partial augmented Lagrangian problems is a strongly stationary point (hence a B-stationary point) of the original MPCC if the limit point is feasible to MPCC, the linear independence constraint qualification for MPCC and the upper level strict complementarity condition hold at the limit point. Furthermore, this limit point also satisfies a second-order necessary optimality condition of MPCC. Numerical experiments are done to test the computational performances of several methods for MPCC proposed in the literature. This research was partially supported by the Research Grants Council (BQ654) of Hong Kong and the Postdoctoral Fellowship of The Hong Kong Polytechnic University. Dedicated to Alex Rubinov on the occassion of his 65th birthday.     

A Robust SQP Method for Mathematical Programs with Linear Complementarity Constraints

The relationship between the mathematical program with linear complementarity constraints (MPLCC) and its inequality relaxation is studied. Based on this relationship, a new sequential quadratic programming (SQP) method is presented for solving the MPLCC. A certain SQP technique is introduced to deal with the possible infeasibility of quadratic programming subproblems. Global convergence results are derived without assuming the linear independence constraint qualification for MPEC, the nondegeneracy condition, and any feasibility condition of the quadratic programming subproblems. Preliminary numerical results are reported. Research is partially supported by Singapore-MIT Alliance and School of Business, National University of Singapore.     

A Modified Relaxation Scheme for Mathematical Programs with Complementarity Constraints

In this paper, we consider a mathematical program with complementarity constraints. We present a modified relaxed program for this problem, which involves less constraints than the relaxation scheme studied by Scholtes (2000). We show that the linear independence constraint qualification holds for the new relaxed problem under some mild conditions. We also consider a limiting behavior of the relaxed problem. We prove that any accumulation point of stationary points of the relaxed problems is C-stationary to the original problem under the MPEC linear independence constraint qualification and, if the Hessian matrices of the Lagrangian functions of the relaxed problems are uniformly bounded below on the corresponding tangent space, it is M-stationary. We also obtain some sufficient conditions of B-stationarity for a feasible point of the original problem. In particular, some conditions described by the eigenvalues of the Hessian matrices mentioned above are new and can be verified easily. This work was supported in part by the Scientific Research Grant-in-Aid from the Ministry of Education, Science, Sports, and Culture of Japan. The authors are grateful to an anonymous referee for critical comments.     

A superlinearly convergent method to linearly constrained optimization problems under degeneracy

Most papers concerning nonlinear programming problems with linear constraints assume linear independence of the gradients of the active constraints at any feasible point. In this paper we remove this assumption and give an algorithm and prove its convergency. Also, under appropriate assumptions on the objective function, including one which could be viewed as an extension of the strict complementary slackness condition at the optimal solution, we prove the rate of convergence of the algorithm to be superlinear.     

Necessary conditions for constrained optimal control problems via mathematical programming

Necessary conditions for optimal control problems with state-control variable inequality constraints are obtained via mathematical programming formulation and functional analysis in Banach space. These conditions are general ones that hold without any constraint qualifications but differentiability. Furthermore, these conditions are shown to be equivalent to the classical result in the presence of the linear independence constraint qualification.     

Some Remarks on Stability of Generalized Equations

The paper concerns the computation of the graphical derivative and the regular (Fréchet) coderivative of the solution map to a class of generalized equations, where the multivalued term amounts to the regular normal cone to a (possibly nonconvex) set given by C ² inequalities. Instead of the linear independence qualification condition, standardly used in this context, one assumes a combination of the Mangasarian–Fromovitz and the constant rank qualification conditions. Based on the obtained generalized derivatives, new optimality conditions for a class of mathematical programs with equilibrium constraints are derived, and a workable characterization of the isolated calmness of the considered solution map is provided.     

A Class of Quadratic Programs with Linear Complementarity Constraints

We consider a class of quadratic programs with linear complementarity constraints (QPLCC) which belong to mathematical programs with equilibrium constraints (MPEC). We investigate various stationary conditions and present new and strong necessary and sufficient conditions for global and local optimality. Furthermore, we propose a Newton-like method to find an M-stationary point in finite steps without MEPC linear independence constraint qualification. The research of this author is partially supported by NSERC, and Research Grand Council of Hong Kong.     

线性无关假设如何影响非线性约束最优化算法

首先综述非线性约束最优化最近的一些进展. 首次定义了约束最优化算法的全局收敛性. 注意到最优性条件的精确性和算法近似性之间的差异, 并回顾等式约束最优化的原始的Newton 型算法框架, 即可理解为什么约束梯度的线性无关假设应该而且可以被弱化. 这些讨论被扩展到不等式约束最优化问题. 然后在没有线性无关假设条件下, 证明了一个使用精确罚函数和二阶校正技术的算法可具有超线性收敛性. 这些认知有助于接下来开发求解包括非线性半定规划和锥规划等约束最优化问题的更加有效的新算法.     

On Normality of Lagrange Multipliers for State Constrained Optimal Control Problems

An optimal control problem for nonlinear ODEs, subject to mixed control-state and pure state constraints is considered. Sufficient conditions are formulated, under which unique normal Lagrange multipliers exist and are given by regular functions. These conditions include pointwise linear independence of gradients of f -active constraints and controllability of the linearized state equation. Under some additional assumptions, further regularity of the multipliers is shown.     

A Proof of the Necessity of Linear Independence Condition and Strong Second-Order Sufficient Optimality Condition for Lipschitzian Stability in Nonlinear Programming

For a nonlinear programming problem with a canonical perturbations, we give an elementary proof of the following result: If the Karush–Kuhn–Tucker map is locally single-valued and Lipschitz continuous, then the linear independence condition for the gradients of the active constraints and the strong second-order sufficient optimality condition hold.     

Shadow prices in nonconvex mathematical programming

In this paper a definition is proposed for the concept of shadow prices in nonconvex programming. For a nonlinear program with equality and inequality constraints, existence of these prices and bounds for their possible values are obtained under the Mangasarian—Fromowitz regularity condition. Their exact values and some continuity properties are obtained under the more restrictive linear independence regularity condition. A definition of equilibrium prices is also proposed. Under convexity assumptions, all definitions and results coincide with those already known on this subject in convex programming.This research was supported by the Natural Sciences and Engineering Research Council of Canada under Grant A-9273.     

New results on linearly perturbed polyhedral normal cone mappings

This paper establishes an exact formula for the Fréchet coderivative and some estimates for the Mordukhovich coderivative of the linearly perturbed normal cone mappings in reflexive Banach spaces. In comparison with Nam (2010) [5], Qui (in press) [8], Qui (2011) [7], Trang (2010) [9], the major advantage of our investigation is that here neither the linear independence condition nor the positively linear independence condition are used. Thus, no assumption on the normal vectors of the active constraints at the point in question is needed. Some aspects of the preceding results (Henrion, Mordukhovich and Nam (2010) [3], Nam (2009) [5], Qui (2011) [7], Yao and Yen (2009) [10], Yao and Yen (2009) [11]) are developed.     

Global Convergence of a Smooth Approximation Method for Mathematical Programs with Complementarity Constraints

A new smoothing approach was given for solving the mathematical programs with complementarity constraints (MPCC) by using the aggregation technique. As the smoothing parameter tends to zero, if the KKT point sequence generated from the smoothed problems satisfies the second-order necessary condition, then any accumulation point of the sequence is a B-stationary point of MPCC if the linear independence constraint qualification (LICQ) and the upper level strict complementarity (ULSC) condition hold at the limit point. The ULSC condition is weaker than the lower level strict complementarity (LLSC) condition generally used in the literatures. Moreover, the method can be easily extended to the mathematical programs with general vertical complementarity constraints.     

Optimality Conditions for Generalized Ky Fan Quasi-Inequalities with Applications

In this paper, the image space analysis is employed to study a generalized Ky Fan quasi-inequality with cone constraints. By virtue of a nonlinear scalarization function and a positive linear operator, a nonlinear (regular) weak separation function and a linear regular weak separation function are introduced. Nonlinear and, in particular, linear separations for the generalized Ky Fan quasi-inequality with cone constraints are characterized. Some necessary and sufficient optimality conditions, especially a saddle-point sufficient optimality condition for the generalized Ky Fan quasi-inequality with cone constraints, are obtained. As applications, some sufficient conditions for (weak) vector equilibrium flows of vector traffic equilibrium problems with capacity arc constraints, are derived.