Unified Duality Theory for Constrained Extremum Problems. Part I: Image Space Analysis

This paper is concerned with a unified duality theory for a constrained extremum problem. Following along with the image space analysis, a unified duality scheme for a constrained extremum problem is proposed by virtue of the class of regular weak separation functions in the image space. Some equivalent characterizations of the zero duality property are obtained under an appropriate assumption. Moreover, some necessary and sufficient conditions for the zero duality property are also established in terms of the perturbation function. In the accompanying paper, the Lagrange-type duality, Wolfe duality and Mond–Weir duality will be discussed as special duality schemes in a unified interpretation. Simultaneously, three practical classes of regular weak separation functions will be also considered.     

Separation Functions and Optimality Conditions in Vector Optimization

In this paper, we propose weak separation functions in the image space for general constrained vector optimization problems on strong and weak vector minimum points. Gerstewitz function is applied to construct a special class of nonlinear separation functions as well as the corresponding generalized Lagrangian functions. By virtue of such nonlinear separation functions, we derive Lagrangian-type sufficient optimality conditions in a general context. Especially for nonconvex problems, we establish Lagrangian-type necessary optimality conditions under suitable restriction conditions, and we further deduce Karush–Kuhn–Tucker necessary conditions in terms of Clarke subdifferentials.     

Unified Duality Theory for Constrained Extremum Problems. Part II: Special Duality Schemes

In the first part of this paper series, a unified duality scheme for a constrained extremum problem is proposed by virtue of the image space analysis. In the present paper, we pay our attention to study of some special duality schemes. Particularly, the Lagrange-type duality, Wolfe duality and Mond–Weir duality are discussed as special duality schemes in a unified interpretation. Moreover, three practical classes of regular weak separation functions are also considered.     

A geometric framework for nonconvex optimization duality using augmented lagrangian functions

We provide a unifying geometric framework for the analysis of general classes of duality schemes and penalty methods for nonconvex constrained optimization problems. We present a separation result for nonconvex sets via general concave surfaces. We use this separation result to provide necessary and sufficient conditions for establishing strong duality between geometric primal and dual problems. Using the primal function of a constrained optimization problem, we apply our results both in the analysis of duality schemes constructed using augmented Lagrangian functions, and in establishing necessary and sufficient conditions for the convergence of penalty methods.     

Nonlinear separation concerning <Emphasis Type="Italic">E</Emphasis>-optimal solution of constrained multi-objective optimization problems

This paper aims at investigating optimality conditions in terms of E-optimal solution for constrained multi-objective optimization problems in a general scheme, where E is an improvement set with respect to a nontrivial closed convex point cone with apex at the origin. In the case where E is not convex, nonlinear vector regular weak separation functions and scalar weak separation functions are introduced respectively to realize the separation between the two sets in the image space, and Lagrangian-type optimality conditions are established. These results extend and improve the convex ones in the literature.     

Discrete convex analysis

A theory of “discrete convex analysis” is developed for integer-valued functions defined on integer lattice points. The theory parallels the ordinary convex analysis, covering discrete analogues of the fundamental concepts such as conjugacy, subgradients, the Fenchel min-max duality, separation theorems and the Lagrange duality framework for convex/nonconvex optimization. The technical development is based on matroid-theoretic concepts, in particular, submodular functions and exchange axioms. Sections 1–4 extend the conjugacy relationship between submodularity and exchange ability, deepening our understanding of the relationship between convexity and submodularity investigated in the eighties by A. Frank, S. Fujishige, L. Lovász and others. Sections 5 and 6 establish duality theorems for M- and L-convex functions, namely, the Fenchel min-max duality and separation theorems. These are the generalizations of the discrete separation theorem for submodular functions due to A. Frank and the optimality criteria for the submodular flow problem due to M. Iri-N. Tomizawa, S. Fujishige, and A. Frank. A novel Lagrange duality framework is also developed in integer programming. We follow Rockafellar’s conjugate duality approach to convex/nonconvex programs in nonlinear optimization, while technically relying on the fundamental theorems of matroid-theoretic nature.     

A complete characterization of strong duality in nonconvex optimization with a single constraint

We first establish sufficient conditions ensuring strong duality for cone constrained nonconvex optimization problems under a generalized Slater-type condition. Such conditions allow us to cover situations where recent results cannot be applied. Afterwards, we provide a new complete characterization of strong duality for a problem with a single constraint: showing, in particular, that strong duality still holds without the standard Slater condition. This yields Lagrange multipliers characterizations of global optimality in case of (not necessarily convex) quadratic homogeneous functions after applying a generalized joint-range convexity result. Furthermore, a result which reduces a constrained minimization problem into one with a single constraint under generalized convexity assumptions, is also presented.     

Convergence and Application of a Decomposition Method Using Duality Bounds for Nonconvex Global Optimization

The subject of this article is a class of global optimization problems, in which the variables can be divided into two groups such that, in each group, the functions involved have the same structure (e.g. linear, convex or concave, etc.). Based on the decomposition idea of Benders (Ref. 1), a corresponding master problem is defined on the space of one of the two groups of variables. The objective function of this master problem is in fact the optimal value function of a nonlinear parametric optimization problem. To solve the resulting master problem, a branch-and-bound scheme is proposed, in which the estimation of the lower bounds is performed by applying the well-known weak duality theorem in Lagrange duality. The results of this article concentrate on two subjects: investigating the convergence of the general algorithm and solving dual problems of some special classes of nonconvex optimization problems. Based on results in sensitivity and stability theory and in parametric optimization, conditions for the convergence are established by investigating the so-called dual properness property and the upper semicontinuity of the objective function of the master problem. The general algorithm is then discussed in detail for some nonconvex problems including concave minimization problems with a special structure, general quadratic problems, optimization problems on the efficient set, and linear multiplicative programming problems.     

Separations and Optimality of Constrained Multiobjective Optimization via Improvement Sets

In this paper, we investigate the separations and optimality conditions for the optimal solution defined by the improvement set of a constrained multiobjective optimization problem. We introduce a vector-valued regular weak separation function and a scalar weak separation function via a nonlinear scalarization function defined in terms of an improvement set. The nonlinear separation between the image of the multiobjective optimization problem and an improvement set in the image space is established by the scalar weak separation function. Saddle point type optimality conditions for the optimal solution of the multiobjective optimization problem are established, respectively, by the nonlinear and linear separation methods. We also obtain the relationships between the optimal solution and approximate efficient solution of the multiobjective optimization problem. Finally, sufficient and necessary conditions for the (regular) linear separation between the approximate image of the multiobjective optimization problem and a convex cone are also presented.     

Extended Lagrange and Penalty Functions in Optimization

We consider nonlinear Lagrange and penalty functions for optimization problems with a single constraint. The convolution of the objective function and the constraint is accomplished by an increasing positively homogeneous of the first degree function. We study necessary and also sufficient conditions for the validity of the zero duality gap property for both Lagrange and penalty functions and for the exact penalization. We also study the so-called regular weak separation functions.     

非凸向量集值优化Benson真有效解的最优性条件与对偶

在无需偏序锥内部非空的情况下给出了非凸约束向量集值优化Benaon真有效解一种加细的最优性条件，并建立了向量集值优化Benson真有效解一种改进的Lagrange乘子型对偶，它比已有的Lagrange乘子型对偶具有较好的对偶性。     

Image Space Analysis for Constrained Inverse Vector Variational Inequalities via Multiobjective Optimization

In this paper, we employ the image space analysis to study constrained inverse vector variational inequalities. First, sufficient and necessary optimality conditions for constrained inverse vector variational inequalities are established by using multiobjective optimization. A continuous nonlinear function is also introduced based on the oriented distance function and projection operator. This function is proven to be a weak separation function and a regular weak separation function under different parameter sets. Then, two alternative theorems are established, which lead directly to sufficient and necessary optimality conditions of the inverse vector variational inequalities. This provides a partial answer to an open question posed in Chen et al. (J Optim Theory Appl 166:460–479, 2015).     

A Unified Approach for Constrained Extremum Problems: Image Space Analysis

In this paper, by exploiting the image space analysis we investigate a class of constrained extremum problems, the constraining function of which is set-valued. We show that a (regular) linear separation in the image space is equivalent to the existence of saddle points of Lagrangian and generalized Lagrangian functions and we also give Lagrangian type optimality conditions for the class of constrained extremum problems under suitable generalized convexity and compactness assumptions. Moreover, we consider an exact penalty problem for the class of constrained extremum problems and prove that it is equivalent to the existence of a regular linear separation under suitable generalized convexity and compactness assumptions.     

Conjugate duality in vector optimization and some applications to the vector variational inequality

The aim of this paper is to extend the so-called perturbation approach in order to deal with conjugate duality for constrained vector optimization problems. To this end we use two conjugacy notions introduced in the past in the literature in the framework of set-valued optimization. As a particular case we consider a vector variational inequality which we rewrite in the form of a vector optimization problem. The conjugate vector duals introduced in the first part allow us to introduce new gap functions for the vector variational inequality. The properties in the definition of the gap functions are verified by using the weak and strong duality theorems.     

Saddle points and gap functions for vector equilibrium problems via conjugate duality in vector optimization

In this paper, two conjugate dual problems based on weak efficiency to a constrained vector optimization problem are introduced. Some inclusion relations between the dual objective mappings and the properties of the Lagrangian maps and their saddle points for primal problem are discussed. Gap functions for a vector equilibrium problem are established by using the weak and strong duality.     

Gap functions for constrained vector variational inequalities with applications

In this paper, the image space analysis is applied to investigate scalar-valued gap functions and their applications for a (parametric)-constrained vector variational inequality. Firstly, using a non-linear regular weak separation function in image space, a gap function of a constrained vector variational inequality is obtained without any assumptions. Then, as an application of the gap function, two error bounds for the constrained vector variational inequality are derived by means of the gap function under some mild assumptions. Further, a parametric gap function of a parametric constrained vector variational inequality is presented. As an application of the parametric gap function, a sufficient condition for the continuity of the solution map of the parametric constrained vector variational inequality is established within the continuity and strict convexity of the parametric gap function. These assumptions do not include any information on the solution set of the parametric constrained vector variational inequality.     

Duality in Vector Optimization Under Type 1 α-Invexity in Banach Spaces

The aim of this paper is to provide global optimality conditions and duality results for a class of nonconvex vector optimization problems posed on Banach spaces. In this paper, we introduce the concept of quasi type I α-invex, pseudo type I α-invex, quasi pseudo type I α-invex, and pseudo quasi type I α-invex functions in the setting of Banach spaces, and we consider a vector optimization problem with functions defined on Banach spaces. A few sufficient optimality conditions are given, and some results on duality are proved.     

向量最优化问题的Lagrange对偶与择一定理

本文讨论无限维向量最优化问题的Lagrange对偶与弱对偶，建立了若干鞍点定理与弱鞍点定理．作为研究对偶问题的工具，建立了一个新的择一定理．     

Nonlinear separation in the image space with applications to constrained optimization

In this paper, by means of the image space analysis, we obtain optimality conditions for vector optimization of objective multifunction with multivalued constraints based on disjunction of two suitable subsets of the image space. By the oriented distance function a nonlinear regular separation is introduced and some optimality conditions for the constrained extremum problem are obtained. It is shown that the existence of a nonlinear separation is equivalent to a saddle point condition for the generalized Lagrangian function.     

Lagrange Multiplier Rules for Weak Approximate Pareto Solutions of Constrained Vector Optimization Problems in Hilbert Spaces

In the Hilbert space case, in terms of proximal normal cone and proximal coderivative, we establish a Lagrange multiplier rule for weak approximate Pareto solutions of constrained vector optimization problems. In this case, our Lagrange multiplier rule improves the main result on vector optimization in Zheng and Ng (SIAM J. Optim. 21: 886–911, 2011). We also introduce a notion of a fuzzy proximal Lagrange point and prove that each Pareto (or weak Pareto) solution is a fuzzy proximal Lagrange point.