Connections Between Single-Level and Bilevel Multiobjective Optimization

The relationship between bilevel optimization and multiobjective optimization has been studied by several authors, and there have been repeated attempts to establish a link between the two. We unify the results from the literature and generalize them for bilevel multiobjective optimization. We formulate sufficient conditions for an arbitrary binary relation to guarantee equality between the efficient set produced by the relation and the set of optimal solutions to a bilevel problem. In addition, we present specially structured bilevel multiobjective optimization problems motivated by real-life applications and an accompanying binary relation permitting their reduction to single-level multiobjective optimization problems.     

Stochastic programming problems with generalized integrated chance constraints

If the constraints in an optimization problem are dependent on a random parameter, we would like to ensure that they are fulfilled with a high level of reliability. The most natural way is to employ chance constraints. However, the resulting problem is very hard to solve. We propose an alternative formulation of stochastic programs using penalty functions. The expectations of penalties can be left as constraints leading to generalized integrated chance constraints, or incorporated into the objective as a penalty term. We show that the penalty problems are asymptotically equivalent under quite mild conditions. We discuss applications of sample-approximation techniques to the problems with generalized integrated chance constraints and propose rates of convergence for the set of feasible solutions. We will direct our attention to the case when the set of feasible solutions is finite, which can appear in integer programming. The results are then extended to the bounded sets with continuous variables. Additional binary variables are necessary to solve sample-approximated chance-constrained problems, leading to a large mixed-integer non-linear program. On the other hand, the problems with penalties can be solved without adding binary variables; just continuous variables are necessary to model the penalties. The introduced approaches are applied to the blending problem leading to comparably reliable solutions.     

The Solution of Massive Generalized Set Partitioning Problems in Aircrew Rostering

The scheduling and rostering of personnel is a problem that occurs in many organizations. Aircrew scheduling has attracted considerable attention with many heuristic methods being proposed, but in recent times set partitioning optimization methods have become more popular. The aircrew rostering problem is discussed and formulated as a generalized set partitioning model. Because of the extremely large optimization models that are generated in practical situations, some special computational techniques have been developed to produce solutions efficiently. These techniques are used to solve problems arising from an airline application in which set partitioning models with more than 650 constraints and 200 000 binary variables are generated. The solutions are produced on a Motorola 68020 microprocessor in little more than three hours.     

Set optimization by means of variable order relations

We introduce several variable order relations to compare sets in a linear topological space and we consider set optimization problems equipped with these variable ordering structures. By considering a set approach, we introduce characterizations for optimal solutions and we provide a kind of vectorization result to obtain solutions of set optimization problems equipped with the introduced variable order relations.     

Valid inequalities for separable concave constraints with indicator variables

We study valid inequalities for optimization models that contain both binary indicator variables and separable concave constraints. These models reduce to a mixed-integer linear program (MILP) when the concave constraints are ignored, or to a nonconvex global optimization problem when the binary restrictions are ignored. In algorithms designed to solve these problems to global optimality, cutting planes to strengthen the relaxation are traditionally obtained using valid inequalities for the MILP only. We propose a technique to obtain valid inequalities that are based on both the MILP constraints and the concave constraints. We begin by characterizing the convex hull of a four-dimensional set consisting of a single binary indicator variable, a single concave constraint, and two linear inequalities. Using this analysis, we demonstrate how valid inequalities for the single node flow set and for the lot-sizing polyhedron can be “tilted” to give valid inequalities that also account for separable concave functions of the arc flows. We present computational results demonstrating the utility of the new inequalities for nonlinear transportation problems and for lot-sizing problems with concave costs. To our knowledge, this is one of the first works that simultaneously convexifies both nonconvex functions and binary variables to strengthen the relaxations of practical mixed-integer nonlinear programs.     

Characterizations of set order relations and constrained set optimization problems via oriented distance function

Set-valued optimization problems are important and fascinating field of optimization theory and widely applied to image processing, viability theory, optimal control and mathematical economics. There are two types of criteria of solutions for the set-valued optimization problems: the vector criterion and the set criterion. In this paper, we adopt the set criterion to study the optimality conditions of constrained set-valued optimization problems. We first present some characterizations of various set order relations using the classical oriented distance function without involving the nonempty interior assumption on the ordered cones. Then using the characterizations of set order relations, necessary and sufficient conditions are derived for four types of optimal solutions of constrained set optimization problem with respect to the set order relations. Finally, the image space analysis is employed to study the c-optimal solution of constrained set optimization problems, and then optimality conditions and an alternative result for the constrained set optimization problem are established by the classical oriented distance function.     

Stability of minimal solutions to parametric set optimization problems

In this paper we study the stability of the minimal solutions of set optimization problems. We provide sufficient conditions for the upper and lower semicontinuity and compactness of the minimal solutions of parametric set optimization problems whose objective values are not necessarily compact.     

Fuzzy Optimization Problems Based on Ordering Cones

The solution concepts of the fuzzy optimization problems using ordering cone (convex cone) are proposed in this paper. We introduce an equivalence relation to partition the set of all fuzzy numbers into the equivalence classes. We then prove that this set of equivalence classes turns into a real vector space under the settings of vector addition and scalar multiplication. The notions of ordering cone and partial ordering on a vector space are essentially equivalent. Therefore, the optimality notions in the set of equivalence classes (in fact, a real vector space) can be naturally elicited by using the similar concept of Pareto optimal solution in vector optimization problems. Given an optimization problem with fuzzy coefficients, we introduce its corresponding (usual) optimization problem. Finally, we prove that the optimal solutions of its corresponding optimization problem are the Pareto optimal solutions of the original optimization problem with fuzzy coefficients.     

Equivalences and differences in conic relaxations of combinatorial quadratic optimization problems

Various conic relaxations of quadratic optimization problems in nonnegative variables for combinatorial optimization problems, such as the binary integer quadratic problem, quadratic assignment problem (QAP), and maximum stable set problem have been proposed over the years. The binary and complementarity conditions of the combinatorial optimization problems can be expressed in several ways, each of which results in different conic relaxations. For the completely positive, doubly nonnegative and semidefinite relaxations of the combinatorial optimization problems, we discuss the equivalences and differences among the relaxations by investigating the feasible regions obtained from different representations of the combinatorial condition which we propose as a generalization of the binary and complementarity condition. We also study theoretically the issue of the primal and dual nondegeneracy, the existence of an interior solution and the size of the relaxations, as a result of different representations of the combinatorial condition. These characteristics of the conic relaxations affect the numerical efficiency and stability of the solver used to solve them. We illustrate the theoretical results with numerical experiments on QAP instances solved by SDPT3, SDPNAL+ and the bisection and projection method.     

Variable-sized uncertainty and inverse problems in robust optimization

In robust optimization, the general aim is to find a solution that performs well over a set of possible parameter outcomes, the so-called uncertainty set. In this paper, we assume that the uncertainty size is not fixed, and instead aim at finding a set of robust solutions that covers all possible uncertainty set outcomes. We refer to these problems as robust optimization with variable-sized uncertainty. We discuss how to construct smallest possible sets of min–max robust solutions and give bounds on their size.A special case of this perspective is to analyze for which uncertainty sets a nominal solution ceases to be a robust solution, which amounts to an inverse robust optimization problem. We consider this problem with a min–max regret objective and present mixed-integer linear programming formulations that can be applied to construct suitable uncertainty sets.Results on both variable-sized uncertainty and inverse problems are further supported with experimental data.     

K best solutions to combinatorial optimization problems

We review the Lawler-Murty [24,20] procedure for finding theK best solutions to combinatorial optimization problems. Then we introduce an alternative algorithm which is based on a binary search tree procedure. We apply both algorithms to the problems of finding theK best bases in a matroid, perfect matchings, and best cuts in a network.Partially supported by the National Science Foundation, No. ECS-8412926.     

Optimal Control of Elliptic Variational–Hemivariational Inequalities

This paper establishes a bridge between set optimization problems and vector Ky Fan inequality problems. We introduce a general model, called the bifunction-set optimization problem, that provides a unifying framework for the above-mentioned problems. An existence result in our model is obtained, with the help of KKM–Fan’s lemma. As applications, we derive some new or sharper existence results for set optimization problems and generalized vector Ky Fan inequalities with efficient solutions.     

Improved semidefinite bounding procedure for solving Max-Cut problems to optimality

We present an improved algorithm for finding exact solutions to Max-Cut and the related binary quadratic programming problem, both classic problems of combinatorial optimization. The algorithm uses a branch-(and-cut-)and-bound paradigm, using standard valid inequalities and nonstandard semidefinite bounds. More specifically, we add a quadratic regularization term to the strengthened semidefinite relaxation in order to use a quasi-Newton method to compute the bounds. The ratio of the tightness of the bounds to the time required to compute them depends on two real parameters; we show how adjusting these parameters and the set of strengthening inequalities gives us a very efficient bounding procedure. Embedding our bounding procedure in a generic branch-and-bound platform, we get a competitive algorithm: extensive experiments show that our algorithm dominates the best existing method.     

On Approximate Solutions in Vector Optimization Problems Via Scalarization

This work deals with approximate solutions in vector optimization problems. These solutions frequently appear when an iterative algorithm is used to solve a vector optimization problem. We consider a concept of approximate efficiency introduced by Kutateladze and widely used in the literature to study this kind of solutions. Necessary and sufficient conditions for Kutateladze’s approximate solutions are given through scalarization, in such a way that these points are approximate solutions for a scalar optimization problem. Necessary conditions are obtained by using gauge functionals while monotone functionals are considered to attain sufficient conditions. Two properties are then introduced to describe the idea of parametric representation of the approximate efficient set. Finally, through scalarization, characterizations and parametric representations for the set of approximate solutions in convex and nonconvex vector optimization problems are proved and the obtained results are applied to Pareto problems. AMS Classification:90C29, 49M37 This research was partially supported by Ministerio de Ciencia y Tecnología (Spain), project BFM2003-02194.     

Primal and dual algorithms for optimization over the efficient set

ABSTRACT

Optimization over the efficient set of a multi-objective optimization problem is a mathematical model for the problem of selecting a most preferred solution that arises in multiple criteria decision-making to account for trade-offs between objectives within the set of efficient solutions. In this paper, we consider a particular case of this problem, namely that of optimizing a linear function over the image of the efficient set in objective space of a convex multi-objective optimization problem. We present both primal and dual algorithms for this task. The algorithms are based on recent algorithms for solving convex multi-objective optimization problems in objective space with suitable modifications to exploit specific properties of the problem of optimization over the efficient set. We first present the algorithms for the case that the underlying problem is a multi-objective linear programme. We then extend them to be able to solve problems with an underlying convex multi-objective optimization problem. We compare the new algorithms with several state of the art algorithms from the literature on a set of randomly generated instances to demonstrate that they are considerably faster than the competitors.     

A preference-based approach to spanning trees and shortest paths problems****

Comparison of solutions in combinatorial problems is often based on an additive cost function inducing a complete order on solutions. We investigate here a generalization of the problem, where preferences take the form of a quasi-transitive binary relation defined on the solutions space. We first propose preference-based search algorithms for two classical combinatorial problems, namely the preferred spanning trees problem (a generalization of the minimum spanning tree problem) and the preferred paths problem (a generalization of the shortest path problem). Then, we introduce a very useful axiom for preference relations called independence. Using this axiom, we establish admissibility results concerning our preference-based search algorithms. Finally, we address the problem of dealing with non-independent preference relations and provide different possible solutions for different particular problems (e.g. lower approximation of the set of preferred solutions for multicriteria spanning trees problems, or relaxation of the independence axiom for interval-valued preferred path problems).     

Vector duality for convex vector optimization problems by means of the quasi-interior of the ordering cone

We define weakly minimal elements of a set with respect to a convex cone by means of the quasi-interior of the cone and characterize them via linear scalarization, generalizing the classical weakly minimal elements from the literature. Then we attach to a general vector optimization problem, a dual vector optimization problem with respect to (generalized) weakly efficient solutions and establish new duality results. By considering particular cases of the primal vector optimization problem, we derive vector dual problems with respect to weakly efficient solutions for both constrained and unconstrained vector optimization problems and the corresponding weak, strong and converse duality statements.     

Connectedness of efficient solutions in multiple criteria combinatorial optimization

In multiple criteria optimization an important research topic is the topological structure of the set X_e of efficient solutions. Of major interest is the connectedness of X_e, since it would allow the determination of Xe without considering non-efficient solutions in the process. We review general results on the subject, including the connectedness result for efficient solutions in multiple criteria linear programming. This result can be used to derive a definition of connectedness for discrete optimization problems. We present a counterexample to a previously stated result in this area, namely that the set of efficient solutions of the shortest path problem is connected. We will also show that connectedness does not hold for another important problem in discrete multiple criteria optimization: the spanning tree problem.     

Persistency in combinatorial optimization problems on matroids

Optimization problems on matroids are generalizations of such important combinatorial optimization problems like the problem of minimum spanning tree of a graph, the bipartite matching problem, flow problems, etc. We analyze algorithms for finding the maximum weight independent set of a matroid and for finding a maximum cardinality intersection of two matroids and extend them to obtain the so-called “persistency” partition of the basic set of the matroid, where contain elements belonging to all optimum solutions; contain elements not belonging to any optimum solution; contain elements that belong to some but not to all optimum solutions.     

Halpern- and Mann-Type Algorithms for Fixed Points and Inclusion Problems on Hadamard Manifolds

In this article, we consider an inclusion problem which is defined by means of a sum of a single-valued vector field and a set-valued vector field defined on a Hadamard manifold. We propose Halpern-type and Mann-type algorithms for finding a common point of the set of fixed points of a nonexpansive mapping and the set of solutions of the inclusion problem defined on a Hadamard manifold. Some particular cases of our problem and algorithm are also discussed. We study the convergence of the proposed algorithm to a common point of the set of fixed points of a nonexpansive mapping and the set of solutions of the inclusion problem defined on a Hadamard manifold. As applications of our results and algorithms, we derive the solution methods and their convergence results for the optimization problems, variational inequality problems and equilibrium problems in the setting of Hadamard manifolds.