Lagrangian Duality in Set-Valued Optimization

In this paper, we study optimization problems where the objective function and the binding constraints are set-valued maps and the solutions are defined by means of set-relations among all the images sets (Kuroiwa, D. in Takahashi, W., Tanaka, T. (eds.) Nonlinear analysis and convex analysis, pp. 221–228, 1999). We introduce a new dual problem, establish some duality theorems and obtain a Lagrangian multiplier rule of nonlinear type under convexity assumptions. A necessary condition and a sufficient condition for the existence of saddle points are given. The authors thank the two referees for valuable comments and suggestions on early versions of the paper. The research of the first author was partially supported by Ministerio de Educación y Ciencia (Spain) Project MTM2006-02629 and by Junta de Castilla y León (Spain) Project VA027B06.     

A simple and elementary proof of the Karush–Kuhn–Tucker theorem for inequality-constrained optimization

We present an elementary proof of the Karush–Kuhn–Tucker Theorem for the problem with nonlinear inequality constraints and linear equality constraints. Most proofs in the literature rely on advanced optimization concepts such as linear programming duality, the convex separation theorem, or a theorem of the alternative for systems of linear inequalities. By contrast, the proof given here uses only basic facts from linear algebra and the definition of differentiability.     

Scope of stationary multi-objective evolutionary optimization: a case study on a hydro-thermal power dispatch problem

Many engineering design and developmental activities finally resort to an optimization task which must be solved to get an efficient and often an intelligent solution. Due to various complexities involved with objective functions, constraints, and decision variables, optimization problems are often not adequately suitable to be solved using classical point-by-point methodologies. Evolutionary optimization procedures use a population of solutions and stochastic update operators in an iteration in a manner so as to constitute a flexible search procedure thereby demonstrating promise to such difficult and practical problem-solving tasks. In this paper, we illustrate the power of evolutionary optimization algorithms in handling different kinds of optimization tasks on a hydro-thermal power dispatch optimization problem: (i) dealing with non-linear, non-differentiable objectives and constraints, (ii) dealing with more than one objectives and constraints, (iii) dealing with uncertainties in decision variables and other problem parameters, and (iv) dealing with a large number (more than 1,000) variables. The results on the static power dispatch optimization problem are compared with that reported in an existing simulated annealing based optimization procedure on a 24-variable version of the problem and new solutions are found to dominate the solutions of the existing study. Importantly, solutions found by our approach are found to satisfy theoretical Kuhn–Tucker optimality conditions by using the subdifferentials to handle non-differentiable objectives. This systematic and detail study demonstrates that evolutionary optimization procedures are not only flexible and scalable to large-scale optimization problems, but are also potentially efficient in finding theoretical optimal solutions for difficult real-world optimization problems. Kalyanmoy Deb, Deva Raj Chair Professor. Currently a Finland Distinguished Professor, Department of Business Technology, Helsinki School of Economics, 00101 Helsinki, Finland.     

Necessary Optimality Conditions for Bilevel Optimization Problems Using Convexificators

In this work, we use a notion of convexificator (Jeyakumar, V. and Luc, D.T. (1999), Journal of Optimization Theory and Applicatons, 101, 599–621.) to establish necessary optimality conditions for bilevel optimization problems. For this end, we introduce an appropriate regularity condition to help us discern the Lagrange–Kuhn–Tucker multipliers.     

On optimality and duality theorems of nonlinear disjunctive fractional minmax programs

This paper is concerned with the study of optimality conditions for disjunctive fractional minmax programming problems in which the decision set can be considered as a union of a family of convex sets. Dinkelbach’s global optimization approach for finding the global maximum of the fractional programming problem is discussed. Using the Lagrangian function definition for this type of problem, the Kuhn–Tucker saddle point and stationary-point problems are established. In addition, via the concepts of Mond–Weir type duality and Schaible type duality, a general dual problem is formulated and some weak, strong and converse duality theorems are proven.     

Constraint Qualifications Characterizing Lagrangian Duality in Convex Optimization

In convex optimization, a constraint qualification (CQ) is an essential ingredient for the elegant and powerful duality theory. Various constraint qualifications which are sufficient for the Lagrangian duality have been given in the literature. In this paper, we present constraint qualifications which characterize completely the Lagrangian duality.     

Lagrangian Duality and Cone Convexlike Functions

In this paper, we consider first the most important classes of cone convexlike vector-valued functions and give a dual characterization for some of these classes. It turns out that these characterizations are strongly related to the closely convexlike and Ky Fan convex bifunctions occurring within minimax problems. Applying the Lagrangian perturbation approach, we show that some of these classes of cone convexlike vector-valued functions show up naturally in verifying strong Lagrangian duality for finite-dimensional optimization problems. This is achieved by extending classical convexity results for biconjugate functions to the class of so-called almost convex functions. In particular, for a general class of finite-dimensional optimization problems, strong Lagrangian duality holds if some vector-valued function related to this optimization problem is closely K-convexlike and satisfies some additional regularity assumptions. For K a full-dimensional convex cone, it turns out that the conditions for strong Lagrangian duality simplify. Finally, we compare the results obtained by the Lagrangian perturbation approach worked out in this paper with the results achieved by the so-called image space approach initiated by Giannessi.     

Model and extended Kuhn–Tucker approach for bilevel multi-follower decision making in a referential-uncooperative situation

When multiple followers are involved in a bilevel decision problem, the leader’s decision will be affected, not only by the reactions of these followers, but also by the relationships among these followers. One of the popular situations within this bilevel multi-follower issue is where these followers are uncooperatively making their decisions while having cross reference to decision information of the other followers. This situation is called a referential-uncooperative situation in this paper. The well-known Kuhn–Tucker approach has been previously successfully applied to a one-leader-and-one-follower linear bilevel decision problem. This paper extends this approach to deal with the above-mentioned linear referential-uncooperative bilevel multi-follower decision problem. The paper first presents a decision model for this problem. It then proposes an extended Kuhn–Tucker approach to solve this problem. Finally, a numerical example illustrates the application of the extended Kuhn–Tucker approach.     

Duality for nonlinear multiple-criteria optimization problems

In this paper, we develop a duality theory for nonlinear multiple-criteria optimization problems. The theory associates to efficient points a matrix, rather than a vector, of dual variables. We introduce a saddle-point dual problem, study stability concepts and Kuhn-Tucker conditions, and provide an economic interpretation of the dual matrix. The results are compared to the classical approach of deriving duality, by applying nonlinear programming duality theory to a problem obtained by conveniently weighting the criteria. Possible directions for future research are discussed.This work was performed under Grant No. MCS-77-24654, National Science Foundation.The author is grateful to Professors S. C. Graves and T. L. Magnanti, and two anonymous referees for helpful comments on an earlier version of this paper.     

Uzawa block relaxation domain decomposition method for a two-body frictionless contact problem

We propose a Uzawa block relaxation domain decomposition method for a two-body frictionless contact problem. We introduce auxiliary variables to separate subdomains representing linear elastic bodies. Applying a Uzawa block relaxation algorithm to the corresponding augmented Lagrangian functional yields a domain decomposition algorithm in which we have to solve two uncoupled linear elasticity subproblems in each iteration while the auxiliary variables are computed explicitly using Kuhn–Tucker optimality conditions.     

Invex Functions and Generalized Convexity in Multiobjective Programming

Martin (Ref. 1) studied the optimality conditions of invex functions for scalar programming problems. In this work, we generalize his results making them applicable to vectorial optimization problems. We prove that the equivalence between minima and stationary points or Kuhn–Tucker points (depending on the case) remains true if we optimize several objective functions instead of one objective function. To this end, we define accurately stationary points and Kuhn–Tucker optimality conditions for multiobjective programming problems. We see that the Martin results cannot be improved in mathematical programming, because the new types of generalized convexity that have appeared over the last few years do not yield any new optimality conditions for mathematical programming problems.     

Duality in Vector Optimization in Banach Spaces with Generalized Convexity

We consider a vector optimization problem with functions defined on Banach spaces. A few sufficient optimality conditions are given and some results on duality are proved.     

Duality and Exact Penalization for Vector Optimization via Augmented Lagrangian

In this paper, we introduce an augmented Lagrangian function for a multiobjective optimization problem with an extended vector-valued function. On the basis of this augmented Lagrangian, set-valued dual maps and dual optimization problems are constructed. Weak and strong duality results are obtained. Necessary and sufficient conditions for uniformly exact penalization and exact penalization are established. Finally, comparisons of saddle-point properties are made between a class of augmented Lagrangian functions and nonlinear Lagrangian functions for a constrained multiobjective optimization problem.     

On Linear Programming Duality and Necessary and Sufficient Conditions in Minimax Theory

In this paper we discuss necessary and sufficient conditions for different minimax results to hold using only linear programming duality and the finite intersection property for compact sets. It turns out that these necessary and sufficient conditions have a clear interpretation within zero-sum game theory. We apply these results to derive necessary and sufficient conditions for strong duality for a general class of optimization problems. The authors like to thank the comments of the anonymous referees for their remarks, which greatly improved the presentation of this paper.     

On Duality Theorems for Nonsmooth Lipschitz Optimization Problems

A nonsmooth Lipschitz vector optimization problem (VP) is considered. Using the Fritz John type necessary optimality conditions for (VP), we formulate the Mond–Weir dual problem (VD) and establish duality theorems for (VP) and (VD) under (strict) pseudoinvexity assumptions on the functions. Our duality theorems do not require a constraint qualification.     

Saddle points and duality in generalized geometric programming

Extensions of the ordinary Lagrangian are used both in saddle-point characterizations of optimality and in a development of duality theory.This research was sponsored by the Air Force Office of Scientific Research, Air Force Systems Command, USAF, under Grant No. AFOSR-73-2516.     

An elementary proof of the Fritz-John and Karush–Kuhn–Tucker conditions in nonlinear programming

In this note we give an elementary proof of the Fritz-John and Karush–Kuhn–Tucker conditions for nonlinear finite dimensional programming problems with equality and/or inequality constraints. The proof avoids the implicit function theorem usually applied when dealing with equality constraints and uses a generalization of Farkas lemma and the Bolzano-Weierstrass property for compact sets.     

Approximate Solutions and Duality Theorems for Continuous-Time Linear Fractional Programming Problems

This article proposes a practical computational procedure to solve a class of continuous-time linear fractional programming problems by designing a discretized problem. Using the optimal solutions of proposed discretized problems, we construct a sequence of feasible solutions of continuous-time linear fractional programming problem and show that there exists a subsequence that converges weakly to a desired optimal solution. We also establish an estimate of the error bound. Finally, we provide two numerical examples to demonstrate the usefulness of this practical algorithm.     

On <Emphasis Type="Italic">G</Emphasis>-invex multiobjective programming. Part II. Duality

This paper represents the second part of a study concerning the so-called G-multiobjective programming. A new approach to duality in differentiable vector optimization problems is presented. The techniques used are based on the results established in the paper: On G-invex multiobjective programming. Part I. Optimality by T.Antczak. In this work, we use a generalization of convexity, namely G-invexity, to prove new duality results for nonlinear differentiable multiobjective programming problems. For such vector optimization problems, a number of new vector duality problems is introduced. The so-called G-Mond–Weir, G-Wolfe and G-mixed dual vector problems to the primal one are defined. Furthermore, various so-called G-duality theorems are proved between the considered differentiable multiobjective programming problem and its nonconvex vector G-dual problems. Some previous duality results for differentiable multiobjective programming problems turn out to be special cases of the results described in the paper.     

Strong Duality for Proper Efficiency in Vector Optimization

In this paper, we give counterexamples showing that the strong duality results obtained in Refs. 1–5 for several dual problems of multiobjective mathematical programs are false. We provide also the conditions under which correct results can be established.This research was supported by the Brain Korea 21 Project in 2003. The authors thank the referees for valuable remarks.