Counterexample and Optimality Conditions in Differentiable Multiobjective Programming

Recently, sufficient optimality theorems for (weak) Pareto-optimal solutions of a multiobjective optimization problem (MOP) were stated in Theorems 3.1 and 3.3 of Ref. 1. In this note, we give a counterexample showing that the theorems of Ref. 1 are not true. Then, by modifying the assumptions of these theorems, we establish two new sufficient optimality theorems for (weak) Pareto-optimal solutions of (MOP); moreover, we give generalized sufficient optimality theorems for (MOP).     

Weak Pareto-optimal necessary conditions in a nondifferentiable multiobjective program on a Banach space

The nondifferentiable optimization theory with equality and inequality constraints is extended to a multiobjective program on a Banach space. We derive generalized conditions of the Fritz-John type given by Clarke's generalized gradient formula, which are necessary for weak Pareto-optimal solutions.     

Multi-strategy ensemble evolutionary algorithm for dynamic multi-objective optimization

Dynamic optimization and multi-objective optimization have separately gained increasing attention from the research community during the last decade. However, few studies have been reported on dynamic multi-objective optimization (dMO) and scarce effective dMO methods have been proposed. In this paper, we fulfill these gabs by developing new dMO test problems and new effective dMO algorithm. In the newly designed dMO problems, Pareto-optimal decision values (i.e., Pareto-optimal solutions: POS) or both POS and Pareto-optimal objective values (i.e., Pareto-optimal front: POF) change with time. A new multi-strategy ensemble multi-objective evolutionary algorithm (MS-MOEA) is proposed to tackle the challenges of dMO. In MS-MOEA, the convergence speed is accelerated by the new offspring creating mechanism powered by adaptive genetic and differential operators (GDM); a Gaussian mutation operator is employed to cope with premature convergence; a memory like strategy is proposed to achieve better starting population when a change takes place. In order to show the advantages of the proposed algorithm, we experimentally compare MS-MOEA with several algorithms equipped with traditional restart strategy. It is suggested that such a multi-strategy ensemble approach is promising for dealing with dMO problems.     

A Solution Concept for Fuzzy Multiobjective Programming Problems Based on Convex Cones

A solution concept for fuzzy multiobjective programming problems based on ordering cones (convex cones) is proposed in this paper. The notions of ordering cones and partial orderings on a vector space are essentially equivalent. Therefore, the optimality notions in a real vector space can be elicited naturally by invoking a concept similar to that of the Pareto-optimal solution in vector optimization problems. We introduce a corresponding multiobjective programming problem and a weighting problem of the original fuzzy multiobjective programming problem using linear functionals so that the optimal solution of its corresponding weighting problem is also the Pareto-optimal solution of the original fuzzy multiobjective programming problem.     

Empirical and analytical study of many-objective optimization problems: analysing distribution of nondominated solutions and population size for scalability of randomized heuristics

Nature inspired randomized heuristics have been used successfully for single-objective and multi-objective optimization problems. However, with increasing number of objectives, what are called as “dominance resistant solutions” present a challenge to heuristics because they make it harder to locate and converge to the Pareto-optimal front. In the present work, the scalability of population-based heuristics for many-objective problems is studied using techniques from probability theory. Work in this domain tends to be more problem-specific and is largely empirical. Here a more general theoretical framework to study the problem arising from escalation of objectives is developed. This framework allows application of probability concentration inequalities to complicated multiobjective optimization heuristics. It also helps isolate the effects of escalation of objective space dimension from those of problem structure and of design space dimension. It opens up the possibility of combining the framework with more problem-specific models and with empirical work, to tune algorithms and to make problems amenable to heuristic search.     

Hybrid biobjective evolutionary algorithms for the design of a hospital waste management network

Colombian environmental authorities are exploring new alternatives for improving the disposal of hospital waste generated in the Department of Boyacá (Colombia). To design this hospital waste management network we propose a biobjective obnoxious facility location problem (BOOFLP) that deals with the existing tradeoff between a low-cost operating network and the negative effect on the population living near the waste management facilities. To solve the BOOFLP we propose a hybrid approach that combines a multiobjective evolutionary algorithm (NSGA II) with a mixed-integer program. The algorithms are compared against the Noninferior Set Estimation (NISE) method and tested on data from Boyacá’s hospital waste management network and publicly available instances.     

Decentralized method for computing Pareto solutions in multiparty negotiations

This paper presents a decentralized method for computing Pareto-optimal solutions in multiparty negotiations over continuous issues. The method is based on the well known weighting method which is decomposed by introducing an own decision variable for each decision maker and by applying the dual decomposition method to the resulting problem. The method offers a systematic way for generating some or all Pareto-optimal solutions so that decision makers do not have to know each others' value functions. Under the assumption of quasilinear value function the requirement that a decision maker knows the explicit form for his value function can be relaxed. In that case the decision maker is asked to solve a series of multiobjective programming problems where an additional artificial decision variable is introduced.     

改进的多目标规划遗传算法

本讨论了[1]中多目标规划遗传算法存在的缺陷，并提出了相应改进策略．这些策略包括：引进精粹策略，杂交限制，终止条件，个体表示改进等方面，利用这些策略使算法能克服终止准则和小生境聚集的缺陷，使得算法能更快的收敛到Pareto最优解集同时又有好有分布的Pareto最优解集．     

A multiobjective immune algorithm based on a multiple-affinity model

This paper presents a new multiobjective immune algorithm based on a multiple-affinity model inspired by immune system (MAM-MOIA). The multiple-affinity model builds the relationship model among main entities and concepts in multiobjective problems (MOPs) and multiobjective evolutionary algorithms (MOEAs), including feasible solution, variable space, objective space, Pareto-optimal set, ranking and crowding distance. In the model, immune operators including clonal proliferation, hypermutation and immune suppression are designed to proliferate superior antibodies and suppress the inferiors. MAM-MOIA is compared with NSGA-II, SPEA2 and NNIA in solving the ZDT and DTLZ standard test problems. The experimental study based on three performance metrics including coverage of two sets, convergence and spacing proves that MAM-MOIA is effective for solving MOPs.     

The use of simulation in validating a multiobjective EMS location model

A location model is proposed for emergency medical service systems to solve the multiobjective location problem of minimizing mean response time and balancing facility workload. Location solutions generated from the model are tested with simulation and are shown to be quite realistic with regard to mean response time prediction and facility allocation. This efficiency is determined to be directly attributable to workload constraints.     

Pareto-optimality of oblique decision trees from evolutionary algorithms

This paper investigates the performance of evolutionary algorithms in the optimization aspects of oblique decision tree construction and describes their performance with respect to classification accuracy, tree size, and Pareto-optimality of their solution sets. The performance of the evolutionary algorithms is analyzed and compared to the performance of exhaustive (traditional) decision tree classifiers on several benchmark datasets. The results show that the classification accuracy and tree sizes generated by the evolutionary algorithms are comparable with the results generated by traditional methods in all the sample datasets and in the large datasets, the multiobjective evolutionary algorithms generate better Pareto-optimal sets than the sets generated by the exhaustive methods. The results also show that a classifier, whether exhaustive or evolutionary, that generates the most accurate trees does not necessarily generate the shortest trees or the best Pareto-optimal sets.     

Fast calculation of multiobjective probability of improvement and expected improvement criteria for Pareto optimization

The use of surrogate based optimization (SBO) is widely spread in engineering design to reduce the number of computational expensive simulations. However, “real-world” problems often consist of multiple, conflicting objectives leading to a set of competitive solutions (the Pareto front). The objectives are often aggregated into a single cost function to reduce the computational cost, though a better approach is to use multiobjective optimization methods to directly identify a set of Pareto-optimal solutions, which can be used by the designer to make more efficient design decisions (instead of weighting and aggregating the costs upfront). Most of the work in multiobjective optimization is focused on multiobjective evolutionary algorithms (MOEAs). While MOEAs are well-suited to handle large, intractable design spaces, they typically require thousands of expensive simulations, which is prohibitively expensive for the problems under study. Therefore, the use of surrogate models in multiobjective optimization, denoted as multiobjective surrogate-based optimization, may prove to be even more worthwhile than SBO methods to expedite the optimization of computational expensive systems. In this paper, the authors propose the efficient multiobjective optimization (EMO) algorithm which uses Kriging models and multiobjective versions of the probability of improvement and expected improvement criteria to identify the Pareto front with a minimal number of expensive simulations. The EMO algorithm is applied on multiple standard benchmark problems and compared against the well-known NSGA-II, SPEA2 and SMS-EMOA multiobjective optimization methods.     

Multi-start and path relinking methods to deal with multiobjective knapsack problems

This paper deals with a multiobjective combinatorial optimization problem called Extended Knapsack Problem. By applying multi-start search and path relinking we rapidly guide the search toward the most balanced zone of the Pareto-optimal front. The Pareto relation is applied in order to designate a subset of the best generated solutions to be the current efficient set of solutions. The max-min criterion with the Hamming distance is used as a measure of dissimilarity in order to find diverse solutions to be combined. The performance of our approach is compared with several state-of-the-art MOEAs for a suite test problems taken from the literature.     

Dimension reduction in multiobjective optimization

In multiobjective optimization there is often the problem of the existence of a large number of objectives. For more than two objectives there is a difficulty with the representation and visualization of the solutions in the objective space. Therefore, it is not clear for the decision maker the trade-off between the different alternative solutions. Thus, this creates enormous difficulties when choosing a solution from the Pareto-optimal set and constitutes a central question in the process of decision making. Based on statistical methods as Principle Component Analysis and Cluster Analysis, the problem of reduction of the number of objectives is addressed. Several test examples with different number of objectives have been studied in order to evaluate the process of decision making through these methods. Preliminary results indicate that this statistical approach can be a valuable tool on decision making in multiobjective optimization. (© 2008 WILEY-VCH Verlag GmbH & Co. KGaA, Weinheim)     

Quasiconcavity and nondominated solutions in multiobjective programming

In the multiobjective programming literature, the concavity of the objectives is usually assumed to be a sufficient condition in seeking Pareto-optimal solutions. This paper investigates nondominated solutions associated with dominance cones via the assumption of the quasiconcavity of the objectives. Necessary as well as sufficient conditions for such quasiconcave multiobjective programming problems are obtained.The author is indebted to one of the referees for detailed constructive comments and suggestions. Thanks are also due to the late Professor Abraham Charnes, University of Texas at Austin, and Professor Zhimin Huang, Adelphi University.     

Derived Sets for Weak Multiobjective Optimization Problems with State and Control Variables

The concept of a K-gradient, introduced in Ref. 1 in order to generalize the concept of a derived convex cone defined by Hestenes, is extended to weak multiobjective optimization problems including not only a state variable, but also a control variable. The new concept is employed to state multiplier rules for the local solutions of such dynamic multiobjective optimization problems. An application of these multiplier rules to the local solutions of an abstract multiobjective optimal control problem yields general necessary optimality conditions that can be used to derive concrete maximum principles for multiobjective optimal control problems, e.g., problems described by integral equations with additional functional constraints.     

Two-phase method and Lagrangian relaxation to solve the Bi-Objective Set Covering Problem

This paper deals with the Bi-Objective Set Covering Problem, which is a generalization of the well-known Set Covering Problem. The proposed approach is a two-phase heuristic method which has the particularity to be a constructive method using the primal-dual Lagrangian relaxation to solve single objective Set Covering problems. The results show that this algorithm finds several potentially supported and unsupported solutions. A comparison with an exact method (up to a medium size), shows that many Pareto-optimal solutions are retrieved and that the other solutions are well spread and close to the optimal ones. Moreover, the method developed compares favorably with the Pareto Memetic Algorithm proposed by Jaszkiewicz.     

Multiobjective optimization using differential evolution for real-world portfolio optimization

Portfolio optimization is an important aspect of decision-support in investment management. Realistic portfolio optimization, in contrast to simplistic mean-variance optimization, is a challenging problem, because it requires to determine a set of optimal solutions with respect to multiple objectives, where the objective functions are often multimodal and non-smooth. Moreover, the objectives are subject to various constraints of which many are typically non-linear and discontinuous. Conventional optimization methods, such as quadratic programming, cannot cope with these realistic problem properties. A valuable alternative are stochastic search heuristics, such as simulated annealing or evolutionary algorithms. We propose a new multiobjective evolutionary algorithm for portfolio optimization, which we call DEMPO??Differential Evolution for Multiobjective Portfolio Optimization. In our experimentation, we compare DEMPO with quadratic programming and another well-known evolutionary algorithm for multiobjective optimization called NSGA-II. The main advantage of DEMPO is its ability to tackle a portfolio optimization task without simplifications, while obtaining very satisfying results in reasonable runtime.     

A hybrid quantum-inspired immune algorithm for multiobjective optimization

This study suggests a novel quantum immune algorithm for finding Pareto-optimal solutions to multiobjective optimization problems based on quantum computing and immune system. In the proposed algorithm, there are distinct characteristics as follows. First, the encoding method is based on Q-bit representation, and thus a chaos-based approach is suggested to initialize the population. Second, a new chaos-based rotation gate and Q-gates are presented to perform mutation and improve the quality of the population, respectively. Finally, especially, a new truncation algorithm with similar individuals (TASI) is utilized to preserve the diversity of the population. Also, a new selection operator is proposed to create the new population based on TASI. Simulation results on six standard problems (ZDT6, CP, SP, VNT, OSY and KIT) show the proposed algorithm is able to find a much better spread of solutions and has better convergence near the true Pareto-optimal front compared to the vector immune algorithm (VIS) and the elitist non-dominated sorting genetic system (NSGA-II).     

Two-Sided Pareto Front Approximations

A new approach to derive Pareto front approximations with evolutionary computations is proposed here. At present, evolutionary multiobjective optimization algorithms derive a discrete approximation of the Pareto front (the set of objective maps of efficient solutions) by selecting feasible solutions such that their objective maps are close to the Pareto front. However, accuracy of such approximations is known only if the Pareto front is known, which makes their usefulness questionable. Here we propose to exploit also elements outside feasible sets to derive pairs of such Pareto front approximations that for each approximation pair the corresponding Pareto front lies, in a certain sense, in-between. Accuracies of Pareto front approximations by such pairs can be measured and controlled with respect to distance between elements of a pair. A rudimentary algorithm to derive pairs of Pareto front approximations is presented and the viability of the idea is verified on a limited number of test problems.