A comparison of alternative c-conjugate dual problems in infinite convex optimization

In this work, we obtain a Fenchel–Lagrange dual problem for an infinite dimensional optimization primal one, via perturbational approach and using a conjugation scheme called c-conjugation instead of classical Fenchel conjugation. This scheme is based on the generalized convex conjugation theory. We analyse some inequalities between the optimal values of Fenchel, Lagrange and Fenchel–Lagrange dual problems and we establish sufficient conditions under which they are equal. Examples where such inequalities are strictly fulfilled are provided. Finally, we study the relations between the optimal solutions and the solvability of the three mentioned dual problems.     

Characterizing global optimality for DC optimization problems under convex inequality constraints

Characterizations of global optimality are given for general difference convex (DC) optimization problems involving convex inequality constraints. These results are obtained in terms of -subdifferentials of the objective and constraint functions and do not require any regularity condition. An extension of Farkas' lemma is obtained for inequality systems involving convex functions and is used to establish necessary and sufficient optimality conditions. As applications, optimality conditions are also given for weakly convex programming problems, convex maximization problems and for fractional programming problems.This paper was presented at the Optimization Miniconference held at the University of Ballarat, Victoria, Australia, on July 14, 1994.     

Successive convex approximations to cardinality-constrained convex programs: a piecewise-linear DC approach

In this paper we consider cardinality-constrained convex programs that minimize a convex function subject to a cardinality constraint and other linear constraints. This class of problems has found many applications, including portfolio selection, subset selection and compressed sensing. We propose a successive convex approximation method for this class of problems in which the cardinality function is first approximated by a piecewise linear DC function (difference of two convex functions) and a sequence of convex subproblems is then constructed by successively linearizing the concave terms of the DC function. Under some mild assumptions, we establish that any accumulation point of the sequence generated by the method is a KKT point of the DC approximation problem. We show that the basic algorithm can be refined by adding strengthening cuts in the subproblems. Finally, we report some preliminary computational results on cardinality-constrained portfolio selection problems.     

New strong duality results for convex programs with separable constraints

It is known that convex programming problems with separable inequality constraints do not have duality gaps. However, strong duality may fail for these programs because the dual programs may not attain their maximum. In this paper, we establish conditions characterizing strong duality for convex programs with separable constraints. We also obtain a sub-differential formula characterizing strong duality for convex programs with separable constraints whenever the primal problems attain their minimum. Examples are given to illustrate our results.     

Second-order global optimality conditions for convex composite optimization

In recent years second-order sufficient conditions of an isolated local minimizer for convex composite optimization problems have been established. In this paper, second-order optimality conditions are obtained of aglobal minimizer for convex composite problems with a non-finite valued convex function and a twice strictly differentiable function by introducing a generalized representation condition. This result is applied to a minimization problem with a closed convex set constraint which is shown to satisfy the basic constraint qualification. In particular, second-order necessary and sufficient conditions of a solution for a variational inequality problem with convex composite inequality constraints are obtained. © 1998 The Mathematical Programming Society, Inc. Published by Elsevier Science B.V.     

Lagrange duality in canonical DC programming

We study Lagrange duality theorems for canonical DC programming problems. We show two types Lagrange duality results by using a decomposition method to infinite convex programming problems and by using a previous result by Lemaire (1998)  [6]. Also we observe these constraint qualifications for the duality theorems.     

Regularity conditions via generalized interiority notions in convex optimization: New achievements and their relation to some classical statements

For the existence of strong duality in convex optimization regularity conditions play an indisputable role. In this article we mainly deal with regularity conditions formulated by means of different generalizations of the notion of interior of a set. The primal–dual pair we investigate is a general one expressed in the language of a perturbation function and by employing its Fenchel–Moreau conjugate. After providing an overview on the generalized interior-point conditions that exist in the literature we introduce several new ones formulated by means of the quasi-interior and quasi-relative interior. We underline the advantages of the new conditions vis-á-vis the classical ones and illustrate our investigations by numerous examples. We conclude this article by particularizing the general approach to the classical Fenchel and Lagrange duality concepts.     

Lagrange-type duality in DC programming

We show a Lagrange-type duality theorem for a DC programming problem, which is a generalization of previous results by J.-E. Martínez-Legaz, M. Volle [5] and Y. Fujiwara, D. Kuroiwa [1] when all constraint functions are real-valued. To the purpose, we decompose the DC programming problem into certain infinite convex programming problems.     

A proximal point algorithm for generalized fractional programs

In this paper, the problem of solving generalized fractional programs will be addressed. This problem has been extensively studied and several algorithms have been proposed. In this work, we propose an algorithm that combines the proximal point method with a continuous min–max formulation of discrete generalized fractional programs. The proposed method can handle non-differentiable convex problems with possibly unbounded feasible constraints set, and solves at each iteration a convex program with unique dual solution. It generates two sequences that approximate the optimal value of the considered problem from below and from above at each step. For a class of functions, including the linear case, the convergence rate is at least linear.     

Generalized Lagrangian duality for nonconvex polynomial programs with polynomial multipliers

In this paper, under the existence of a certificate of nonnegativity of the objective function over the given constraint set, we present saddle-point global optimality conditions and a generalized Lagrangian duality theorem for (not necessarily convex) polynomial optimization problems, where the Lagrange multipliers are polynomials. We show that the nonnegativity certificate together with the archimedean condition guarantees that the values of the Lasserre hierarchy of semidefinite programming (SDP) relaxations of the primal polynomial problem converge asymptotically to the common primal–dual value. We then show that the known regularity conditions that guarantee finite convergence of the Lasserre hierarchy also ensure that the nonnegativity certificate holds and the values of the SDP relaxations converge finitely to the common primal–dual value. Finally, we provide classes of nonconvex polynomial optimization problems for which the Slater condition guarantees the required nonnegativity certificate and the common primal–dual value with constant multipliers and the dual problems can be reformulated as semidefinite programs. These classes include some separable polynomial programs and quadratic optimization problems with quadratic constraints that admit certain hidden convexity. We also give several numerical examples that illustrate our results.     

Stable zero duality gaps in convex programming: Complete dual characterisations with applications to semidefinite programs

The zero duality gap that underpins the duality theory is one of the central ingredients in optimisation. In convex programming, it means that the optimal values of a given convex program and its associated dual program are equal. It allows, in particular, the development of efficient numerical schemes. However, the zero duality gap property does not always hold even for finite-dimensional problems and it frequently fails for problems with non-polyhedral constraints such as the ones in semidefinite programming problems. Over the years, various criteria have been developed ensuring zero duality gaps for convex programming problems. In the present work, we take a broader view of the zero duality gap property by allowing it to hold for each choice of linear perturbation of the objective function of the given problem. Globalising the property in this way permits us to obtain complete geometric dual characterisations of a stable zero duality gap in terms of epigraphs and conjugate functions. For convex semidefinite programs, we establish necessary and sufficient dual conditions for stable zero duality gaps, as well as for a universal zero duality gap in the sense that the zero duality gap property holds for each choice of constraint right-hand side and convex objective function. Zero duality gap results for second-order cone programming problems are also given. Our approach makes use of elegant conjugate analysis and Fenchel's duality.     

Duality Principles for Optimization Problems Dealing with the Difference of Vector-Valued Convex Mappings

Using the concept of a subdifferential of a vector-valued convex mapping, we provide duality formulas for the minimization of nonconvex composite functions and related optimization problems such as the minimization of a convex function over a vectorial DC constraint.     

Scalar representation and conjugation of set-valued functions

We consider functions with values in the power set of a pre-ordered, separated locally convex space with closed convex images. To each such function, a family of scalarizations is given which completely characterizes the original function. A concept of a Legendre–Fenchel conjugate for set-valued functions is introduced and identified with the conjugates of the scalarizations. To the set-valued conjugate, a full calculus is provided, including a biconjugation theorem, a chain rule and weak and strong duality results of the Fenchel–Rockafellar type.     

Optimality and Duality for a Class of Nondifferentiable Multiobjective Fractional Programming Problems

In this paper, we consider a class of nondifferentiable multiobjective fractional programs in which each component of the objective function contains a term involving the support function of a compact convex set. We establish necessary and sufficient optimality conditions and duality results for weakly efficient solutions of nondifferentiable multiobjective fractional programming problems. This work was supported by Grant R01-2003-000-10825-0 from the Basic Research Program of KOSEF.     

Stable strong Fenchel and Lagrange duality for evenly convex optimization problems

By means of a conjugation scheme based on generalized convex conjugation theory instead of Fenchel conjugation, we build an alternative dual problem, using the perturbational approach, for a general optimization one defined on a separated locally convex topological space. Conditions guaranteeing strong duality for primal problems which are perturbed by continuous linear functionals and their respective dual problems, which is named stable strong duality, are established. In these conditions, the fact that the perturbation function is evenly convex will play a fundamental role. Stable strong duality will also be studied in particular for Fenchel and Lagrange primal–dual problems, obtaining a characterization for Fenchel case.     

On duality for square root convex programs

Conjugate function theory is used to develop dual programs for nonseparable convex programs involving the square root function. This function arises naturally in finance when one measures the risk of a portfolio by its variance–covariance matrix, in stochastic programming under chance constraints and in location theory.     

Solving continuous min max problem for single period portfolio selection with discrete constraints by DCA

In this article, we consider the application of a continuous min–max model with cardinality constraints to worst-case portfolio selection with multiple scenarios of risk, where the return forecast of each asset belongs to an interval. The problem can be formulated as minimizing a convex function under mixed integer variables with additional complementarity constraints. We first prove that the complementarity constraints can be eliminated and then use Difference of Convex functions (DC) programming and DC Algorithm (DCA), an innovative approach in non-convex programming frameworks, to solve the resulting problem. We reformulate it as a DC program and then show how to apply DCA to solve it. Numerical experiments on several test problems are reported that demonstrate the accuracy of the proposed algorithm.     

Necessary conditions for optimal control problems with state constraints

Necessary conditions of optimality are derived for optimal control problems with pathwise state constraints, in which the dynamic constraint is modelled as a differential inclusion. The novel feature of the conditions is the unrestrictive nature of the hypotheses under which these conditions are shown to be valid. An Euler Lagrange type condition is obtained for problems where the multifunction associated with the dynamic constraint has values possibly unbounded, nonconvex sets and satisfies a mild `one-sided' Lipschitz continuity hypothesis. We recover as a special case the sharpest available necessary conditions for state constraint free problems proved in a recent paper by Ioffe. For problems where the multifunction is convex valued it is shown that the necessary conditions are still valid when the one-sided Lipschitz hypothesis is replaced by a milder, local hypothesis. A recent `dualization' theorem permits us to infer a strengthened form of the Hamiltonian inclusion from the Euler Lagrange condition. The necessary conditions for state constrained problems with convex valued multifunctions are derived under hypotheses on the dynamics which are significantly weaker than those invoked by Loewen and Rockafellar to achieve related necessary conditions for state constrained problems, and improve on available results in certain respects even when specialized to the state constraint free case.

Proofs make use of recent `decoupling' ideas of the authors, which reduce the optimization problem to one to which Pontryagin's maximum principle is applicable, and a refined penalization technique to deal with the dynamic constraint.

     

First and Second Order Necessary Conditions for Stochastic Optimal Control Problems

In this work we consider a stochastic optimal control problem with either convex control constraints or finitely many equality and inequality constraints over the final state. Using the variational approach, we are able to obtain first and second order expansions for the state and cost function, around a local minimum. This fact allows us to prove general first order necessary condition and, under a geometrical assumption over the constraint set, second order necessary conditions are also established. We end by giving second order optimality conditions for problems with constraints on expectations of the final state.     

Sequential Lagrangian Conditions for Convex Programs with Applications to Semidefinite Programming

In this paper it is shown that, in the absence of any regularity condition, sequential Lagrangian optimality conditions as well as a sequential duality results hold for abstract convex programs. The significance of the results is that they yield the standard optimality and duality results for convex programs under a simple closed-cone condition that is much weaker than the well-known constraint qualifications. As an application, a sequential Lagrangian duality, saddle-point conditions, and stability results are derived for convex semidefinite programs.The authors are grateful to the referee and Professor Franco Giannessi for valuable comments and constructive suggestions which have contributed to the final preparation of the paper.