On finding multiple Pareto-optimal solutions using classical and evolutionary generating methods

In solving multi-objective optimization problems, evolutionary algorithms have been adequately applied to demonstrate that multiple and well-spread Pareto-optimal solutions can be found in a single simulation run. In this paper, we discuss and put together various different classical generating methods which are either quite well-known or are in oblivion due to publication in less accessible journals and some of which were even suggested before the inception of evolutionary methodologies. These generating methods specialize either in finding multiple Pareto-optimal solutions in a single simulation run or specialize in maintaining a good diversity by systematically solving a number of scalarizing problems. Most classical generating methodologies are classified into four groups mainly based on their working principles and one representative method from each group is chosen in the present study for a detailed discussion and for its performance comparison with a state-of-the-art evolutionary method. On visual comparisons of the efficient frontiers obtained for a number of two and three-objective test problems, the results bring out interesting insights about the strengths and weaknesses of these approaches. The results should motivate researchers to design hybrid multi-objective optimization algorithms which may be better than each of the individual methods.     

Considering decision decentralizations to solve bi-level multi-objective decision-making problems: A fuzzy approach

This paper investigates decentralized bi-level multi-objective linear programming (DBL-MOLP) problems with a single decision-maker (DM) at the higher level and more than one DM at the lower level. Each DM can have more than one objective function, which is formulated as a fuzzy goal. To characterize the decision decentralization in a DBL-MOLP problem, this paper proposes an assignment scheme of relative satisfaction for the higher-level DM to ensure his leadership and therefore prevent the paradox problem reported in the literature, where lower-level DMs have higher satisfaction degrees than that of the higher-level DM. Through the assignment scheme, if the higher-level DM is not satisfied with the resulting solutions of objective functions, the re-solving process is easily conducted by adjusting the level of relative satisfaction for the associated lower-level DMs. A linearization transformation approach is also presented to facilitate the solution process. To emphasize some important fuzzy goals, a weighting scheme is considered in this paper. A numerical example is used for illustration, and comparisons with existing approaches are conducted to demonstrate the feasibility of the proposed method.     

Nonlinear goal programming using multi-objective genetic algorithms

Goal programming is a technique often used in engineering design activities primarily to find a compromised solution which will simultaneously satisfy a number of design goals. In solving goal programming problems, classical methods reduce the multiple goal-attainment problem into a single objective of minimizing a weighted sum of deviations from goals. This procedure has a number of known difficulties. First, the obtained solution to the goal programming problem is sensitive to the chosen weight vector. Second, the conversion to a single-objective optimization problem involves additional constraints. Third, since most real-world goal programming problems involve nonlinear criterion functions, the resulting single-objective optimization problem becomes a nonlinear programming problem, which is difficult to solve using classical optimization methods. In tackling nonlinear goal programming problems, although successive linearization techniques have been suggested, they are found to be sensitive to the chosen starting solution. In this paper, we pose the goal programming problem as a multi-objective optimization problem of minimizing deviations from individual goals and then suggest an evolutionary optimization algorithm to find multiple Pareto-optimal solutions of the resulting multi-objective optimization problem. The proposed approach alleviates all the above difficulties. It does not need any weight vector. It eliminates the need of having extra constraints needed with the classical formulations. The proposed approach is also suitable for solving goal programming problems having nonlinear criterion functions and having a non-convex trade-off region. The efficacy of the proposed approach is demonstrated by solving a number of nonlinear goal programming test problems and an engineering design problem. In all problems, multiple solutions (each corresponding to a different weight vector) to the goal programming problem are found in one single simulation run. The results suggest that the proposed approach is an effective and practical tool for solving real-world goal programming problems.     

Multi-objective optimization for a closed-loop network design problem using an improved genetic algorithm

This paper develops a multi-objective Mixed Integer Programming model for a closed-loop network design problem. In addition to the overall costs, the model optimizes overall carbon emissions and the responsiveness of the network. An improved genetic algorithm based on the framework of NSGA II is developed to solve the problem and obtain Pareto-optimal solutions. An example with 95 cities in China is presented to illustrate the approach. Through randomly generated examples with different sizes; the computational performance of the proposed algorithm is also compared with former genetic algorithms in the literature employing the weight-sum technique as a fitness evaluation strategy. Computational results indicate that the proposed algorithm can obtain superior Pareto-optimal solutions.     

An interactive evolutionary multi-objective optimization algorithm with a limited number of decision maker calls

This paper presents a preference-based method to handle optimization problems with multiple objectives. With an increase in the number of objectives the computational cost in solving a multi-objective optimization problem rises exponentially, and it becomes increasingly difficult for evolutionary multi-objective techniques to produce the entire Pareto-optimal front. In this paper, an evolutionary multi-objective procedure is combined with preference information from the decision maker during the intermediate stages of the algorithm leading to the most preferred point. The proposed approach is different from the existing approaches, as it tries to find the most preferred point with a limited budget of decision maker calls. In this paper, we incorporate the idea into a progressively interactive technique based on polyhedral cones. The idea is also tested on another progressively interactive approach based on value functions. Results are provided on two to five-objective unconstrained as well as constrained test problems.     

Multi-objective Pareto-optimal control: an application to wastewater management

This work treats, within a multi-objective framework, of an economical-ecological problem related to the optimal management of a wastewater treatment system consisting of several purifying plants. The problem is formulated as a multi-objective parabolic optimal control problem and it is studied from a cooperative point of view, looking for Pareto-optimal solutions. The weighting method is used here to characterize the Pareto solutions of our problem. To obtain them, a numerical algorithm—based in a characteristics-Galerkin discretization—is proposed and numerical results for a real world situation in the estuary of Vigo (NW Spain) are also presented.     

City-courier routing and scheduling problems

This research seeks to propose innovative routing and scheduling strategies to help city couriers reduce operating costs and enhance service level. The strategies are realized by constructing a new type of routing and scheduling problem. The problem directly takes into account the inherent physical and operating constraints associated with riding in city distribution networks, which makes the problem involve multiple objectives and visiting specified nodes and arcs. Through network transformations, this study first formulates the city-courier routing and scheduling problem as a multi-objective multiple traveling salesman problem with strict time windows (MOMTSPSTW) that is NP-hard and new to the literature, and then proposes a multi-objective Scatter Search framework that seeks to find the set of Pareto-optimal solutions to the problem. Various new and improved sub-procedures are embedded in the solution framework. This is followed by an empirical study that shows and analyzes the results of applying the proposed method to a real-life city-courier routing and scheduling problem.     

Maximal vectors and multi-objective optimization

Maximal vector andweak-maximal vector are the two basic notions underlying the various broader definitions (like efficiency, admissibility, vector maximum, noninferiority, Pareto's optimum, etc.) for optimal solutions of multi-objective optimization problems. Moreover, the understanding and characterization of maximal and weak-maximal vectors on the space of index vectors (vectors of values of the multiple objective functions) is fundamental and useful to the understanding and characterization of Pareto-optimal and weak-optimal solutions on the space of solutions.This paper is concerned with various characterizations of maximal and weak-maximal vectors in a general subset of the EuclideanN-space, and with necessary conditions for Pareto-optimal and weak-optimal solutions to a generalN-objective optimization problem having inequality, equality, and open-set constraints on then-space. A geometric method is described; the validity of scalarization by linear combination is studied, and weak conditioning by directional convexity is considered; local properties and a fundamental necessary condition are given. A necessary and sufficient condition for maximal vectors in a simplex or a polyhedral cone is derived. Necessary conditions for Pareto-optimal and weak-optimal solutions are given in terms of Lagrange multipliers, linearly independent gradients, Jacobian and Gramian matrices, and Jacobian determinants.Several advantages in approaching the multi-objective optimization problem in two steps (investigate optimal index vectors on the space of index vectors first, and study optimal solutions on the specific space of solutions next) are demonstrated in this paper.This work was supported by the National Science Foundation under Grant No. GK-32701.     

Empirical and analytical study of many-objective optimization problems: analysing distribution of nondominated solutions and population size for scalability of randomized heuristics

Nature inspired randomized heuristics have been used successfully for single-objective and multi-objective optimization problems. However, with increasing number of objectives, what are called as “dominance resistant solutions” present a challenge to heuristics because they make it harder to locate and converge to the Pareto-optimal front. In the present work, the scalability of population-based heuristics for many-objective problems is studied using techniques from probability theory. Work in this domain tends to be more problem-specific and is largely empirical. Here a more general theoretical framework to study the problem arising from escalation of objectives is developed. This framework allows application of probability concentration inequalities to complicated multiobjective optimization heuristics. It also helps isolate the effects of escalation of objective space dimension from those of problem structure and of design space dimension. It opens up the possibility of combining the framework with more problem-specific models and with empirical work, to tune algorithms and to make problems amenable to heuristic search.     

Multi-objective simulation-based evolutionary algorithm for an aircraft spare parts allocation problem

Simulation optimization has received considerable attention from both simulation researchers and practitioners. In this study, we develop a solution framework which integrates multi-objective evolutionary algorithm (MOEA) with multi-objective computing budget allocation (MOCBA) method for the multi-objective simulation optimization problem. We apply it on a multi-objective aircraft spare parts allocation problem to find a set of non-dominated solutions. The problem has three features: huge search space, multi-objective, and high variability. To address these difficulties, the solution framework employs simulation to estimate the performance, MOEA to search for the more promising designs, and MOCBA algorithm to identify the non-dominated designs and efficiently allocate the simulation budget. Some computational experiments are carried out to test the effectiveness and performance of the proposed solution framework.     

Pruned Pareto-optimal sets for the system redundancy allocation problem based on multiple prioritized objectives

In this paper, a new methodology is presented to solve different versions of multi-objective system redundancy allocation problems with prioritized objectives. Multi-objective problems are often solved by modifying them into equivalent single objective problems using pre-defined weights or utility functions. Then, a multi-objective problem is solved similar to a single objective problem returning a single solution. These methods can be problematic because assigning appropriate numerical values (i.e., weights) to an objective function can be challenging for many practitioners. On the other hand, methods such as genetic algorithms and tabu search often yield numerous non-dominated Pareto optimal solutions, which makes the selection of one single best solution very difficult. In this research, a tabu search meta-heuristic approach is used to initially find the entire Pareto-optimal front, and then, Monte-Carlo simulation provides a decision maker with a pruned and prioritized set of Pareto-optimal solutions based on user-defined objective function preferences. The purpose of this study is to create a bridge between Pareto optimality and single solution approaches.     

资源受限下森林火灾应急救援多目标调度优化

许多森林火灾由于救援资源受限而不能在第一时间扑灭,导致火灾扩大蔓延,进而造成更大的森林资源损失。因此,在救援资源受限情形下,如何对消防救援车辆进行合理的调度安排以快速和低成本地扑灭火灾已成为亟待解决的现实问题。本文研究了一类资源受限下森林火灾应急救援多目标调度优化问题,为该问题构建了多目标混合整数非线性规划模型,优化目标为同时最小化总灭火救援时间和救援车辆总行驶距离。为有效求解该问题,首先将上述非线性模型等价转化为线性模型。然后提出ε-约束法和模糊逻辑相结合的算法对问题进行求解。最后,以大兴安岭山发生的火灾案例和随机生成仿真算例对模型和算法有效性进行验证,结果表明所提出的模型和算法能够有效解决资源受限下森林火灾应急救援问题,并为决策者提供最优的消防调度方案。     

Quasiconcave vector maximization: Connectedness of the sets of Pareto-optimal and weak Pareto-optimal alternatives

We study the sets of Pareto-optimal and weakly Pareto-optimal solutions to a vector maximization problem defined by a continuous vector-valued quasiconcave criterion functionf and a closed convex set of alternativesS. IfS is compact, it is shown that the set of weakly Pareto-optimal alternatives is connected, but that the set of Pareto-optimal alternatives is not necessarily connected. However, the set of Pareto optima is shown to be connected for some important subclasses of quasiconcave functions. We also provide some reasonable conditions under which the compactness assumption onS may be relaxed and connectedness maintained.     

Pareto-optimal solutions for a wastewater treatment problem

In this paper we present an application of optimal control theory of partial differential equations combined with multi-objective optimization techniques to formulate and solve an economical-ecological problem related to the management of a wastewater treatment system. The problem is formulated as a parabolic multi-objective optimal control problem, and it is studied from a non-cooperative point of view (looking for a Nash equilibrium), and also from a cooperative point of view (looking for Pareto-optimal solutions “better” than the Nash equilibrium). In both cases we state the existence of solutions, give a useful characterization of them, and propose a numerical algorithm to solve the problem. Finally, a numerical experience for a real world situation in the estuary of Vigo (NW Spain) is presented.     

A Hybrid Meta-Heuristic for Multi-Objective Optimization: MOSATS

Real optimization problems often involve not one, but multiple objectives, usually in conflict. In single-objective optimization there exists a global optimum, while in the multi-objective case no optimal solution is clearly defined but rather a set of solutions, called the Pareto-optimal front. Thus, the goal of multi-objective strategies is to generate a set of non-dominated solutions as an approximation to this front. However, the majority of problems of this kind cannot be solved exactly because they have very large and highly complex search spaces. In recent years, meta-heuristics have become important tools for solving multi-objective problems encountered in industry as well as in the theoretical field. This paper presents a novel approach based on hybridizing Simulated Annealing and Tabu Search. Experiments on the Graph Partitioning Problem show that this new method is a better tool for approximating the efficient set than other strategies also based on these meta-heuristics.     

Primal and dual algorithms for optimization over the efficient set

ABSTRACT

Optimization over the efficient set of a multi-objective optimization problem is a mathematical model for the problem of selecting a most preferred solution that arises in multiple criteria decision-making to account for trade-offs between objectives within the set of efficient solutions. In this paper, we consider a particular case of this problem, namely that of optimizing a linear function over the image of the efficient set in objective space of a convex multi-objective optimization problem. We present both primal and dual algorithms for this task. The algorithms are based on recent algorithms for solving convex multi-objective optimization problems in objective space with suitable modifications to exploit specific properties of the problem of optimization over the efficient set. We first present the algorithms for the case that the underlying problem is a multi-objective linear programme. We then extend them to be able to solve problems with an underlying convex multi-objective optimization problem. We compare the new algorithms with several state of the art algorithms from the literature on a set of randomly generated instances to demonstrate that they are considerably faster than the competitors.     

Solving a new stochastic multi-mode p-hub covering location problem considering risk by a novel multi-objective algorithm

In this paper, we develop a novel stochastic multi-objective multi-mode transportation model for hub covering location problem under uncertainty. The transportation time between each pair of nodes is an uncertain parameter and also is influenced by a risk factor in the network. We extend the traditional comprehensive hub location problem by considering two new objective functions. So, our multi-objective model includes (i) minimization of total current investment costs and (ii) minimization of maximum transportation time between each origin–destination pair in the network. Besides, a novel multi-objective imperialist competitive algorithm (MOICA) is proposed to obtain the Pareto-optimal solutions of the problem. The performance of the proposed solution algorithm is compared with two well-known meta-heuristics, namely, non-dominated sorting genetic algorithm (NSGA-II) and Pareto archive evolution strategy (PAES). Computational results show that MOICA outperforms the other meta-heuristics.     

Machine duplication and part subcontracting in the presence of alternative cell locations in manufacturing cell design

In this paper a model and a solution algorithm are reported to simultaneously deal with the processes of machine duplication and part subcontracting in the presence of two significant design issues in cellular manufacturing systems: (i) alternative cell locations; and (ii) the maximum number of machines assigned to a cell. As the problem, formulated as a polynomial programming model, is shown NP-hard in the strong sense, a higher-level heuristic algorithm based upon a concept known as ‘tabu search’ is presented. An example (small) problem is solved to demonstrate the functionality of the algorithm. Additionally, the small problem is solved for its optimal solution under different scenarios, both with linear single-row and linear double-row layout arrangements, and the solutions obtained are shown to match with those obtained with the heuristic algorithm. A comparison of six different versions of tabu search-based heuristics (TSH 1–TSH 6) is performed to investigate the impact of long-term memory and the use of fixed versus variable tabu-list sizes. A carefully constructed statistical experiment, based on randomised complete-block design, is used to test the performance on three different problem structures, classified as small, medium and large. The results show that TSH 6 with variable tabu-list size and long-term memory based on minimal frequencies is preferred for the single-row layout, while TSH 4 with variable tabu-list size and no long-term memory is preferred for the double-row layout. When subject to budgetary restrictions, the proposed approach can be used by parts manufacturing companies to determine which of the following three actions should be undertaken for each bottleneck part: bottleneck part left as in the initial solution, all the bottleneck machines connected to it are duplicated, or the part subcontracted.     

Pareto optima for total weighted completion time and maximum lateness on a single machine

We consider the single-machine bicriterion scheduling problem of enumerating the Pareto-optimal sequences with respect to the total weighted completion time and the maximum lateness objectives. We show that the master sequence concept originally introduced for 1|r_j|∑w_jU_j by Dauzère-Pérès and Sevaux is also applicable to our problem and a large number of other sequencing problems. Our unified development is based on exploiting common order-theoretic structures present in all these problems. We also show that the master sequence implies the existence of global dominance orders for these scheduling problems. These dominance results were incorporated into a new branch and bound algorithm, which was able to enumerate all the Pareto optima for over 90% of the 1440 randomly generated problems with up to n=50 jobs. The identification of each Pareto optimum implicitly requires the optimal solution of a strongly NP-hard problem. The instances solved had hundreds of these Pareto solutions and to the best of our knowledge, this is the first algorithm capable of completely enumerating all Pareto sequences within reasonable time and space for a scheduling problem with such a large number of Pareto optima.     

Optimality conditions for a class of inverse optimal control problems with partial differential equations

ABSTRACT

We consider bilevel optimization problems which can be interpreted as inverse optimal control problems. The lower-level problem is an optimal control problem with a parametrized objective function. The upper-level problem is used to identify the parameters of the lower-level problem. Our main focus is the derivation of first-order necessary optimality conditions. We prove C-stationarity of local solutions of the inverse optimal control problem and give a counterexample to show that strong stationarity might be violated at a local minimizer.