Nonlinear Lagrangians for Nonlinear Programming Based on Modified Fischer-Burmeister NCP Functions

This paper proposes nonlinear Lagrangians based on modified Fischer-Burmeister NCP functions for solving nonlinear programming problems with inequality constraints. The convergence theorem shows that the sequence of points generated by this nonlinear Lagrange algorithm is locally convergent when the penalty parameter is less than a threshold under a set of suitable conditions on problem functions, and the error bound of solution, depending on the penalty parameter, is also established. It is shown that the condition number of the nonlinear Lagrangian Hessian at the optimal solution is proportional to the controlling penalty parameter. Moreover, the paper develops the dual algorithm associated with the proposed nonlinear Lagrangians. Numerical results reported suggest that the dual algorithm based on proposed nonlinear Lagrangians is effective for solving some nonlinear optimization problems.     

Extended Entropy Functional for Nonlinear Systems in Stochastic Dynamics

The maximum entropy approach is utilized for deriving the stationary probability density function of nonlinear stochastic systems to white noise excitation. To this aim a variational formulation is proposed where by means of the Lagrange multiplier methods the entropy functional is maximised constrained to the Fokker Planck equation. Some exact solutions in terms of Lagrange function of MDOF linear systems and for a class of SDOF nonlinear systems, are obtained.     

A nonlinear Lagrangian for constrained optimization problems

A novel nonlinear Lagrangian is presented for constrained optimization problems with both inequality and equality constraints, which is nonlinear with respect to both functions in problem and Lagrange multipliers. The nonlinear Lagrangian inherits the smoothness of the objective and constraint functions and has positive properties. The algorithm on the nonlinear Lagrangian is demonstrated to possess local and linear convergence when the penalty parameter is less than a threshold (the penalty parameter in the penalty method has to approximate zero) under a set of suitable conditions, and be super-linearly convergent when the penalty parameter is decreased following Lagrange multiplier update. Furthermore, the dual problem based on the nonlinear Lagrangian is discussed and some important properties are proposed, which fail to hold for the dual problem based on the classical Lagrangian. At last, the preliminary and comparing numerical results for several typical test problems by using the new nonlinear Lagrangian algorithm and the other two related nonlinear Lagrangian algorithms, are reported, which show that the given nonlinear Lagrangian is promising.     

Nonlinear rescaling and proximal-like methods in convex optimization

The nonlinear rescaling principle (NRP) consists of transforming the objective function and/or the constraints of a given constrained optimization problem into another problem which is equivalent to the original one in the sense that their optimal set of solutions coincides. A nonlinear transformation parameterized by a positive scalar parameter and based on a smooth sealing function is used to transform the constraints. The methods based on NRP consist of sequential unconstrained minimization of the classical Lagrangian for the equivalent problem, followed by an explicit formula updating the Lagrange multipliers. We first show that the NRP leads naturally to proximal methods with an entropy-like kernel, which is defined by the conjugate of the scaling function, and establish that the two methods are dually equivalent for convex constrained minimization problems. We then study the convergence properties of the nonlinear rescaling algorithm and the corresponding entropy-like proximal methods for convex constrained optimization problems. Special cases of the nonlinear rescaling algorithm are presented. In particular a new class of exponential penalty-modified barrier functions methods is introduced. Partially supported by the National Science Foundation, under Grants DMS-9201297, and DMS-9401871. Partially supported by NASA Grant NAG3-1397 and NSF Grant DMS-9403218.     

Convergence analysis of a nonlinear Lagrange algorithm for general nonlinear constrained optimization problems

The convergence analysis of a nonlinear Lagrange algorithm for solving nonlinear constrained optimization problems with both inequality and equality constraints is explored in detail. The estimates for the derivatives of the multiplier mapping and the solution mapping of the proposed algorithm are discussed via the technique of the singular value decomposition of matrix. Based on the estimates, the local convergence results and the rate of convergence of the algorithm are presented when the penalty parameter is less than a threshold under a set of suitable conditions on problem functions. Furthermore, the condition number of the Hessian of the nonlinear Lagrange function with respect to the decision variables is analyzed, which is closely related to efficiency of the algorithm. Finally, the preliminary numericM results for several typical test problems are reported.     

Numerical solution of an optimal investment problem with proportional transaction costs

This paper mainly concerns the numerical solution of a nonlinear parabolic double obstacle problem arising in a finite-horizon optimal investment problem with proportional transaction costs. The problem is initially posed in terms of an evolutive HJB equation with gradient constraints and the properties of the utility function allow to obtain the optimal investment solution from a nonlinear problem posed in one spatial variable. The proposed numerical methods mainly consist of a localization procedure to pose the problem on a bounded domain, a characteristics method for time discretization to deal with the large gradients of the solution, a Newton algorithm to solve the nonlinear term in the governing equation and a projected relaxation scheme to cope with the double obstacle (free boundary) feature. Moreover, piecewise linear Lagrange finite elements for spatial discretization are considered. Numerical results illustrate the performance of the set of numerical techniques by recovering all qualitative properties proved in Dai and Yi (2009) [6].     

从常步长梯度方法的视角看不可微凸优化增广Lagrange方法的收敛性

增广Lagrange方法是求解非线性规划的一种有效方法.从一新的角度证明不等式约束非线性非光滑凸优化问题的增广Lagrange方法的收敛性.用常步长梯度法的收敛性定理证明基于增广Lagrange函数的对偶问题的常步长梯度方法的收敛性,由此得到增广Lagrange方法乘子迭代的全局收敛性.     

Structure of the first-order solution set for a class of nonlinear programs with parameters

This paper studies the set of first-order solutions of a family of nonlinear programs in which the inequality constraints are fixed but the right hand side of the equality constraints varies. It is shown that under certain conditions this set is a topological manifold. The results are applied to the problem of describing the set of first-order Pareto optima in a pure exchange economy with monotone utility functions.     

线性比式和规划问题的输出空间分支定界算法

本文旨在针对线性比式和规划这一NP-Hard非线性规划问题提出新的全局优化算法.首先,通过引入p个辅助变量把原问题等价的转化为一个非线性规划问题,这个非线性规划问题的目标函数是乘积和的形式并给原问题增加了p个新的非线性约束,再通过构造凸凹包络的技巧对等价问题的目标函数和约束条件进行相应的线性放缩,构成等价问题的一个下界线性松弛规划问题,从而提出了一个求解原问题的分支定界算法,并证明了算法的收敛性.最后,通过数值结果比较表明所提出的算法是可行有效的.     

Bi-directional evolutionary topology optimization of geometrically nonlinear continuum structures with stress constraints

This paper proposes a design method to maximize the stiffness of geometrically nonlinear continuum structures subject to volume fraction and maximum von Mises stress constraints. An extended bi-directional evolutionary structural optimization (BESO) method is adopted in this paper. BESO method based on discrete variables can effectively avoid the well-known singularity problem in density-based methods with low density elements. The maximum von Mises stress is approximated by the p-norm global stress. By introducing one Lagrange multiplier, the objective of the traditional stiffness design is augmented with p-norm stress. The stiffness and p-norm stress are considered simultaneously by the Lagrange multiplier method. A heuristic method for determining the Lagrange multiplier is proposed in order to effectively constrain the structural maximum von Mises stress. The sensitivity information for designing variable updates is derived in detail by adjoint method. As for the highly nonlinear stress behavior, the updated scheme takes advantages from two filters respectively of the sensitivity and topology variables to improve convergence. Moreover, the filtered sensitivity numbers are combined with their historical sensitivity information to further stabilize the optimization process. The effectiveness of the proposed method is demonstrated by several benchmark design problems.     

Convergence of an augmented Lagrange algorithm for nonlinear optimizations with second-order cone constraints

An augmented Lagrange algorithm for nonlinear optimizations with second-order cone constraints is proposed based on a Löwner operator associated with a potential function for the optimization problems with inequality constraints. The favorable properties of both the Löwner operator and the corresponding augmented Lagrangian are discussed. And under some mild assumptions, the rate of convergence of the augmented Lagrange algorithm is studied in detail.     

用非线性方程组求解等式约束非线性规划问题的降维算法

本文研究线性和非线性等式约束非线性规划问题的降维算法.首先,利用一般等式约束问题的降维方法,将线性等式约束非线性规划问题转换成一个非线性方程组,解非线性方程组即得其解;然后,对线性和非线性等式约束非线性规划问题用Lagrange乘子法,将非线性约束部分和目标函数构成增广的Lagrange函数,并保留线性等式约束,这样便得到一个线性等式约束非线性规划序列,从而,又将问题转化为求解只含线性等式约束的非线性规划问题.     

Infinite dimensional duality and applications

The usual duality theory cannot be applied to infinite dimensional problems because the underlying constraint set mostly has an empty interior and the constraints are possibly nonlinear. In this paper we present an infinite dimensional nonlinear duality theory obtained by using new separation theorems based on the notion of quasi-relative interior, which, in all the concrete problems considered, is nonempty. We apply this theory to solve the until now unsolved problem of finding, in the infinite dimensional case, the Lagrange multipliers associated to optimization problems or to variational inequalities. As an example, we find the Lagrange multiplier associated to a general elastic–plastic torsion problem.     

An efficient method for nonlinearly constrained networks

Many nonlinear network flow problems (in addition to the balance constraints in the nodes and capacity constraints on the arc flows) have nonlinear side constraints, which specify a flow relationship between several of the arcs in the network flow model. The short-term hydrothermal coordination of electric power generation is an example of this type. In this work we solve this kind of problem using an approach in which the efficiency of the well-known techniques for network flow can be preserved. It lies in relaxing the side constraints in an augmented Lagrangian function, and minimizing a sequence of these functions subject only to the network constraints for different estimates of the Lagrange multipliers of the side constraints. This method gives rise to an algorithm, which combines first- and superlinear-order multiplier methods to estimate these multipliers. When the number of free variables is very high we can obtain a superlinear-order estimate by means of the limited memory BFGS method fitted to our problem. An extensive computational comparison with other methods has been performed. The numerical results reported indicate that the algorithm described may be employed advantageously to solve large-scale network flow problems with nonlinear side constraints.     

Stability in stochastic programming with recourse-estimated parameters

In this paper, stability of the optimal solution of stochastic programs with recourse with respect to parameters of the given distribution of random coefficients is studied. Provided that the set of admissible solutions is defined by equality constraints only, asymptotical normality of the optimal solution follows by standard methods. If nonnegativity constraints are taken into account the problem is solved under assumption of strict complementarity known from the theory of nonlinear programming (Theorem 1). The general results are applied to the simple recourse problem with random right-hand sides under various assumptions on the underlying distribution (Theorems 2–4).     

带摩擦的弹性接触问题广义变分不等原理的简化证明

在弹性摩擦接触问题中 ,从变分原理出发来研究接触问题 ,可以将摩擦力纳入问题的能量泛函 .为了得到摩擦约束弹性接触问题的能量泛函 ,日前大多是用拉格朗日乘子法 ,但拉格朗日方法用在变分不等问题中 ,要利用非线性泛函分析和凸分析来证明 ,证明复杂 .本文利用向量分析的工具及巧妙的变换 ,对带摩擦约束的弹性接触问题的广义变分不等原理进行了严格的证明 ,由于只用到向量分析 ,简化了证明 .     

On Normality of Lagrange Multipliers for State Constrained Optimal Control Problems

An optimal control problem for nonlinear ODEs, subject to mixed control-state and pure state constraints is considered. Sufficient conditions are formulated, under which unique normal Lagrange multipliers exist and are given by regular functions. These conditions include pointwise linear independence of gradients of f -active constraints and controllability of the linearized state equation. Under some additional assumptions, further regularity of the multipliers is shown.     

Optimal control of constrained time lag systems: Necessary conditions and numerical treatment

We consider retarded optimal control problems with constant delays in state and control variables under mixed controlstate inequality constraints. First order necessary optimality conditions in the form of Pontryagin's minimum principle are presented and discussed as well as numerical methods based upon discretization techniques and nonlinear programming. The minimum principle for the considered problem class leads to a boundary value problem which is retarded in the state dynamics and advanced in the costate dynamics. It can be shown that the Lagrange multipliers associated with the programming problem provide a consistent discretization of the advanced adjoint equation for the delayed control problem. (© 2008 WILEY-VCH Verlag GmbH & Co. KGaA, Weinheim)     

The p-Factor-Lagrange Methods for Degenerate Nonlinear Programming

The paper presents a new approach to solving nonlinear programming (NLP) problems for which the strict complementarity condition (SCC), a constraint qualification (CQ), and a second-order sufficient condition (SOSC) for optimality are not necessarily satisfied at a solution. Our approach is based on the construction of p-regularity and on reformulating the inequality constraints as equalities. Namely, by introducing the slack variables, we get the equality constrained problem, for which the Lagrange optimality system is singular at the solution of the NLP problem in the case of the violation of the CQs, SCC and/or SOSC. To overcome the difficulty of singularity, we propose the p-factor method for solving the Lagrange system. The method has a superlinear rate of convergence under a mild assumption. We show that our assumption is always satisfied under a standard second-order sufficient condition (SOSC) for optimality. At the same time, we give examples of the problems where the SOSC does not hold, but our assumption is satisfied. Moreover, no estimation of the set of active constraints is required. The proposed approach can be applied to a variety of problems.