带约束广义变分不等式问题的一般分解算法的收敛性分析

本文考虑如下带约束广义变分不等式问题的增广Lagrangian对偶理论:寻找一点x∈Γ使满足,〈F(x),y-x〉 φ(x,y)-φ(x,x)≥0,y∈Γ,其中,Γ={y∈X｜Θ(y)∈-C}.对于求解这类一般变分不等式问题的基于增广Lagrangian对偶理论分解算法,本文给出了算法的收敛性分析.     

Study on the Splitting Methods for Separable Convex Optimization in a Unified Algorithmic Framework

It is well recognized the convenience of converting the linearly constrained convex optimization problems to a monotone variational inequality. Recently, we have proposed a unified algorithmic framework which can guide us to construct the solution methods for solving these monotone variational inequalities. In this work, we revisit two full Jacobian decomposition of the augmented Lagrangian methods for separable convex programming which we have studied a few years ago. In particular, exploiting this framework, we are able to give a very clear and elementary proof of the convergence of these solution methods.     

Duality and Penalization in Optimization via an Augmented Lagrangian Function with Applications

This paper aims to establish duality and exact penalization results for the primal problem of minimizing an extended real-valued function in a reflexive Banach space in terms of a valley-at-0 augmented Lagrangian function. It is shown that every weak limit point of a sequence of optimal solutions generated by the valley-at-0 augmented Lagrangian problems is a solution of the original problem. A zero duality gap property and an exact penalization representation between the primal problem and the valley-at-0 augmented Lagrangian dual problem are obtained. These results are then applied to an inequality and equality constrained optimization problem in infinite-dimensional spaces and variational problems in Sobolev spaces, respectively. The first author was supported by the Research Committee of Hong Kong Polytechnic University, by Grant 10571174 from the National Natural Science Foundation of China and Grant 08KJB11009 from the Jiangsu Education Committee of China. The second author was supported by Grant BQ771 from the Research Grants Council of Hong Kong. We are grateful to the referees for useful suggestions which have contributed to the final presentation of the paper.     

Macro-Hybrid Variational Formulations of Constrained Boundary Value Problems

In the context of convex analysis, macro-hybrid variational formulations of constrained boundary value problems are presented. Monotone mixed variational inclusions are macro-hybridized on the basis of nonoverlapping domain decompositions, and corresponding three-field versions are derived. Then, for regularization purposes, augmented formulations are established via preconditioned exact penalizations and expressed in terms of proximation operators. Optimization interpretations are given for potential problems, recovering the classic two- and three-field augmented Lagrangian formulations. Furthermore, associated parallel two- and three-field proximal-point algorithms are discussed for numerical resolution of finite element discretizations. Applications to dual mixed variational formulations of problems from mechanics illustrate the theory.     

Augmented Lagrangian method for second-order cone programs under second-order sufficiency

This paper addresses problems of second-order cone programming important in optimization theory and applications. The main attention is paid to the augmented Lagrangian method (ALM) for such problems considered in both exact and inexact forms. Using generalized differential tools of second-order variational analysis, we formulate the corresponding version of second-order sufficiency and use it to establish, among other results, the uniform second-order growth condition for the augmented Lagrangian. The latter allows us to justify the solvability of subproblems in the ALM and to prove the linear primal–dual convergence of this method.

     

Augmented Lagrangian Objective Penalty Function

Augmented Lagrangian function is one of the most important tools used in solving some constrained optimization problems. In this article, we study an augmented Lagrangian objective penalty function and a modified augmented Lagrangian objective penalty function for inequality constrained optimization problems. First, we prove the dual properties of the augmented Lagrangian objective penalty function, which are at least as good as the traditional Lagrangian function's. Under some conditions, the saddle point of the augmented Lagrangian objective penalty function satisfies the first-order Karush-Kuhn-Tucker condition. This is especially so when the Karush-Kuhn-Tucker condition holds for convex programming of its saddle point existence. Second, we prove the dual properties of the modified augmented Lagrangian objective penalty function. For a global optimal solution, when the exactness of the modified augmented Lagrangian objective penalty function holds, its saddle point exists. The sufficient and necessary stability conditions used to determine whether the modified augmented Lagrangian objective penalty function is exact for a global solution is proved. Based on the modified augmented Lagrangian objective penalty function, an algorithm is developed to find a global solution to an inequality constrained optimization problem, and its global convergence is also proved under some conditions. Furthermore, the sufficient and necessary calmness condition on the exactness of the modified augmented Lagrangian objective penalty function is proved for a local solution. An algorithm is presented in finding a local solution, with its convergence proved under some conditions.     

Smooth methods of multipliers for complementarity problems

This paper describes several methods for solving nonlinear complementarity problems. A general duality framework for pairs of monotone operators is developed and then applied to the monotone complementarity problem, obtaining primal, dual, and primal-dual formulations. We derive Bregman-function-based generalized proximal algorithms for each of these formulations, generating three classes of complementarity algorithms. The primal class is well-known. The dual class is new and constitutes a general collection of methods of multipliers, or augmented Lagrangian methods, for complementarity problems. In a special case, it corresponds to a class of variational inequality algorithms proposed by Gabay. By appropriate choice of Bregman function, the augmented Lagrangian subproblem in these methods can be made continuously differentiable. The primal-dual class of methods is entirely new and combines the best theoretical features of the primal and dual methods. Some preliminary computation shows that this class of algorithms is effective at solving many of the standard complementarity test problems. Received February 21, 1997 / Revised version received December 11, 1998? Published online May 12, 1999     

An Exact Augmented Lagrangian Function for Nonlinear Programming with Two-Sided Constraints

This paper is aimed toward the definition of a new exact augmented Lagrangian function for two-sided inequality constrained problems. The distinguishing feature of this augmented Lagrangian function is that it employs only one multiplier for each two-sided constraint. We prove that stationary points, local minimizers and global minimizers of the exact augmented Lagrangian function correspond exactly to KKT pairs, local solutions and global solutions of the constrained problem.     

带有不等式约束的非线性规划问题的一个精确增广Lagrange函数

对求解带有不等式约束的非线性非凸规划问题的一个精确增广Lagrange函数进行了研究．在适当的假设下,给出了原约束问题的局部极小点与增广Lagrange函数,在原问题变量空间上的无约束局部极小点之间的对应关系．进一步地,在对全局解的一定假设下,还提供了原约束问题的全局最优解与增广Lagrange函数,在原问题变量空间的一个紧子集上的全局最优解之间的一些对应关系．因此,从理论上讲,采用该文给出的增广Lagrange函数作为辅助函数的乘子法,可以求得不等式约束非线性规划问题的最优解和对应的Lagrange乘子．     

A nonlinear augmented Lagrangian for constrained minimax problems

A novel smooth nonlinear augmented Lagrangian for solving minimax problems with inequality constraints, is proposed in this paper, which has the positive properties that the classical Lagrangian and the penalty function fail to possess. The corresponding algorithm mainly consists of minimizing the nonlinear augmented Lagrangian function and updating the Lagrange multipliers and controlling parameter. It is demonstrated that the algorithm converges Q-superlinearly when the controlling parameter is less than a threshold under the mild conditions. Furthermore, the condition number of the Hessian of the nonlinear augmented Lagrangian function is studied, which is very important for the efficiency of the algorithm. The theoretical results are validated further by the preliminary numerical experiments for several testing problems reported at last, which show that the nonlinear augmented Lagrangian is promising.     

Power law Stokes equations with threshold slip boundary conditions: Numerical methods and implementation

For the power law Stokes equations driven by nonlinear slip boundary conditions of friction type, we propose three iterative schemes based on augmented Lagrangian approach and interior point method to solve the finite element approximation associated to the continuous problem. We formulate the variational problem which in this case is a variational inequality and construct the weak solution of the continuous problem. Next, we formulate two alternating direction methods based on augmented Lagrangian formalism in order to separate the velocity from the symmetric part the velocity gradient and tangential part of the velocity. Thirdly, we present some salient points of a path‐following variant of the interior point method associated to the finite element approximation of the problem. Some numerical experiments are performed to confirm the validity of the schemes and allow us to compare them.     

A Modified Barrier-Augmented Lagrangian Method for Constrained Minimization

We present and analyze an interior-exterior augmented Lagrangian method for solving constrained optimization problems with both inequality and equality constraints. This method, the modified barrier—augmented Lagrangian (MBAL) method, is a combination of the modified barrier and the augmented Lagrangian methods. It is based on the MBAL function, which treats inequality constraints with a modified barrier term and equalities with an augmented Lagrangian term. The MBAL method alternatively minimizes the MBAL function in the primal space and updates the Lagrange multipliers. For a large enough fixed barrier-penalty parameter the MBAL method is shown to converge Q-linearly under the standard second-order optimality conditions. Q-superlinear convergence can be achieved by increasing the barrier-penalty parameter after each Lagrange multiplier update. We consider a dual problem that is based on the MBAL function. We prove a basic duality theorem for it and show that it has several important properties that fail to hold for the dual based on the classical Lagrangian.     

Further Study on Augmented Lagrangian Duality Theory

In this paper, we present a necessary and sufficient condition for a zero duality gap between a primal optimization problem and its generalized augmented Lagrangian dual problems. The condition is mainly expressed in the form of the lower semicontinuity of a perturbation function at the origin. For a constrained optimization problem, a general equivalence is established for zero duality gap properties defined by a general nonlinear Lagrangian dual problem and a generalized augmented Lagrangian dual problem, respectively. For a constrained optimization problem with both equality and inequality constraints, we prove that first-order and second-order necessary optimality conditions of the augmented Lagrangian problems with a convex quadratic augmenting function converge to that of the original constrained program. For a mathematical program with only equality constraints, we show that the second-order necessary conditions of general augmented Lagrangian problems with a convex augmenting function converge to that of the original constrained program.This research is supported by the Research Grants Council of Hong Kong (PolyU B-Q359.)     

非线性规划问题的精确增广Lagrange函数

对于一般的非线性规划给出一种精确增广Lagrange函数,并讨论其性质.无需假设严格互补条件成立,给出了原问题的局部极小点与增广Lagrange函数在原问题的变量空间上的局部极小的关系.进一步,在适当的假设条件下,建立了两者的全局最优解之间的关系.     

Convexity of the Implicit Lagrangian

The implicit Lagrangian has attracted much attention recently because of its utility in reformulating complementarity and variational inequality problems as unconstrained minimization problems. It was first proposed by Mangasarian and Solodov as a merit function for the nonlinear complementarity problem (Ref. 1). Three open problems were also raised in the same paper. This paper addresses, among other issues, one of these problems by giving the properties of the implicit Lagrangian and establishing its convexity under appropriate assumptions.     

Numerical Solution of Viscoplastic Flow Problems by Augmented Lagrangians

This paper describes an application of augmented Lagrangiantechniques to the numerical solution of quasistatic flow problemsin incompressible viscoplasticity, focusing on cases where theinternal viscoplastic dissipation potential is not a differentiablefunction of the material deformation rate. The stresses of elasticorigin are neglected, and the variational formulation of theseproblems is approximated via low-order mixed finite elements,which reduces the original problems to the constrained minimizationof a convex, but possibly not differentiable functional. Convergenceresults are proved or recalled, both for the finite elementapproximation and for the augmented Lagrangian algorithm. Adetailed study of the local minimization problems which occurin the augmented Lagrangian decomposition of the above problemsis also presented, together with several numerical results.     

Gap functions and global error bounds for set-valued variational inequalities

The set-valued variational inequality problem is very useful in economics theory and nonsmooth optimization. In this paper, we introduce some gap functions for set-valued variational inequality problems under suitable assumptions. By using these gap functions we derive global error bounds for the solution of the set-valued variational inequality problems. Our results not only generalize the previously known results for classical variational inequalities from single-valued case to set-valued, but also present a way to construct gap functions and derive global error bounds for set-valued variational inequality problems.     

Convergence of an augmented Lagrange algorithm for nonlinear optimizations with second-order cone constraints

An augmented Lagrange algorithm for nonlinear optimizations with second-order cone constraints is proposed based on a Löwner operator associated with a potential function for the optimization problems with inequality constraints. The favorable properties of both the Löwner operator and the corresponding augmented Lagrangian are discussed. And under some mild assumptions, the rate of convergence of the augmented Lagrange algorithm is studied in detail.     

Saddle points of general augmented Lagrangians for constrained nonconvex optimization

Local and global saddle point conditions for a general augmented Lagrangian function proposed by Mangasarian are investigated in the paper for inequality and equality constrained nonconvex optimization problems. Under second order sufficiency conditions, it is proved that the augmented Lagrangian admits a local saddle point, but without requiring the strict complementarity condition. The existence of a global saddle point is then obtained under additional assumptions that do not require the compactness of the feasible set and the uniqueness of global solution of the original problem.     

Duality for generalized equilibrium problem

We introduce a generalized equilibrium problem (GEP) that allow us to develop a robust dual scheme for this problem, based on the theory of conjugate functions. We obtain a unified dual analysis for interesting problems. Indeed, the Lagrangian duality for convex optimization is a particular case of our dual problem. We establish necessary and sufficient optimality conditions for GEP that become a well-known theorem given by Mosco and the dual results obtained by Morgan and Romaniello, which extend those introduced by Auslender and Teboulle for a variational inequality problem.