Multi-objective optimization method for learning thresholds in a decision-theoretic rough set model

For decision-theoretic rough sets, a key issue is determining the thresholds for the probabilistic rough set model by setting appropriate cost functions. However, it is not easy to obtain correct cost functions because of a lack of prior knowledge and few previous studies have addressed the determination of learning thresholds and cost functions from datasets. In the present study, a multi-objective optimization model is proposed for threshold learning. In our model, we integrate an objective function that minimizes the decision cost with another that decreases the size of the boundary region. The ranges of the thresholds and two types of F_measure are used as constraints. In addition, a multi-objective genetic algorithm is employed to obtain the Pareto optimal set. We used 12 UCI datasets to validate the performance of our method, where the experimental results demonstrated the trade-off between the two objectives as well as showing that the thresholds obtained by our method were more intuitive than those obtained using other methods. The classification abilities of the solutions were improved by the F_measure constraints.     

Multi-objective optimization of heat exchangers using a modified teaching-learning-based optimization algorithm

Teaching-learning-based optimization (TLBO) is a recently developed heuristic algorithm based on the natural phenomenon of teaching-learning process. In the present work, a modified version of the TLBO algorithm is introduced and applied for the multi-objective optimization of heat exchangers. Plate-fin heat exchanger and shell and tube heat exchanger are considered for the optimization. Maximization of heat exchanger effectiveness and minimization of total cost of the exchanger are considered as the objective functions. Two examples are presented to demonstrate the effectiveness and accuracy of the proposed algorithm. The results of optimization using the modified TLBO are validated by comparing with those obtained by using the genetic algorithm (GA).     

Improving the non-dominated sorting genetic algorithm using a gene-therapy method for multi-objective optimization

The non-dominate sorting genetic algorithmic-II (NSGA-II) is an effective algorithm for finding Pareto-optimal front for multi-objective optimization problems. To further enhance the advantage of the NSGA-II, this study proposes an evaluative-NSGA-II (E-NSGA-II) in which a novel gene-therapy method incorporates into the crossover operation to retain superior schema patterns in evolutionary population and enhance its solution capability. The merit of each select gene in a crossover chromosome is estimated by exchanging the therapeutic genes in both mating chromosomes and observing their fitness differentiation. Hence, the evaluative crossover operation can generate effective genomes based on the gene merit without explicitly analyzing the solution space. Experiments for nine unconstrained multi-objective benchmarks and four constrained problems show that E-NSGA-II can find Pareto-optimal solutions in all test cases with better convergence and diversity qualities than several existing algorithms.     

Reference point approximation method for the solution of bicriterial nonlinear optimization problems

This paper presents a reference point approximation algorithm which can be used for the interactive solution of bicriterial nonlinear optimization problems with inequality and equality constraints. The advantage of this method is that the decision maker may choose arbitrary reference points in the criteria space. Moreover, a special tunneling technique is given for the computation of global solutions of certain subproblems. Finally, the proposed method is applied to a mathematical example and a problem in mechanical engineering.     

Implementation of scatter search for multi-objective optimization: a comparative study

Interest in the design of efficient meta-heuristics for the application to combinatorial optimization problems is growing rapidly. The optimal design of water distribution networks is an important optimization problem which consists of finding the best way of conveying water from the sources to the users, thus satisfying their requirements. The efficient design of looped networks is a much more complex problem than the design of branched ones, but their greater reliability can compensate for the increase in cost when closing some loops. Mathematically, this is a non-linear optimization problem, constrained to a combinatorial space, since the diameters are discrete and it has a very large number of local solutions. Many works have dealt with the minimization of the cost of the network but few have considered their cost and reliability simultaneously. The aim of this paper is to evaluate the performance of an implementation of Scatter Search in a multi-objective formulation of this problem. Results obtained in three benchmark networks show that the method here proposed performs accurately well in comparison with other multi-objective approaches also implemented.     

A family of quasi-Newton methods for unconstrained optimization problems

ABSTRACT

In this paper, we present a class of approximating matrices as a function of a scalar parameter that includes the Davidon-Fletcher-Powell and Broyden-Fletcher-Goldfarb-Shanno methods as special cases. A powerful iterative descent method for finding a local minimum of a function of several variables is described. The new method maintains the positive definiteness of the approximating matrices. For a region in which the function depends quadratically on the variables, no more than n iterations are required, where n is the number of variables. A set of computational results that verifies the superiority of the new method are presented.     

Scope of stationary multi-objective evolutionary optimization: a case study on a hydro-thermal power dispatch problem

Many engineering design and developmental activities finally resort to an optimization task which must be solved to get an efficient and often an intelligent solution. Due to various complexities involved with objective functions, constraints, and decision variables, optimization problems are often not adequately suitable to be solved using classical point-by-point methodologies. Evolutionary optimization procedures use a population of solutions and stochastic update operators in an iteration in a manner so as to constitute a flexible search procedure thereby demonstrating promise to such difficult and practical problem-solving tasks. In this paper, we illustrate the power of evolutionary optimization algorithms in handling different kinds of optimization tasks on a hydro-thermal power dispatch optimization problem: (i) dealing with non-linear, non-differentiable objectives and constraints, (ii) dealing with more than one objectives and constraints, (iii) dealing with uncertainties in decision variables and other problem parameters, and (iv) dealing with a large number (more than 1,000) variables. The results on the static power dispatch optimization problem are compared with that reported in an existing simulated annealing based optimization procedure on a 24-variable version of the problem and new solutions are found to dominate the solutions of the existing study. Importantly, solutions found by our approach are found to satisfy theoretical Kuhn–Tucker optimality conditions by using the subdifferentials to handle non-differentiable objectives. This systematic and detail study demonstrates that evolutionary optimization procedures are not only flexible and scalable to large-scale optimization problems, but are also potentially efficient in finding theoretical optimal solutions for difficult real-world optimization problems. Kalyanmoy Deb, Deva Raj Chair Professor. Currently a Finland Distinguished Professor, Department of Business Technology, Helsinki School of Economics, 00101 Helsinki, Finland.     

On the projected subgradient method for nonsmooth convex optimization in a Hilbert space

We consider the method for constrained convex optimization in a Hilbert space, consisting of a step in the direction opposite to an _k -subgradient of the objective at a current iterate, followed by an orthogonal projection onto the feasible set. The normalized stepsizes _k are exogenously given, satisfying _{k=0 k} = , _{k=0 k} ² < , and _k is chosen so that _{k k} for some > 0. We prove that the sequence generated in this way is weakly convergent to a minimizer if the problem has solutions, and is unbounded otherwise. Among the features of our convergence analysis, we mention that it covers the nonsmooth case, in the sense that we make no assumption of differentiability off, and much less of Lipschitz continuity of its gradient. Also, we prove weak convergence of the whole sequence, rather than just boundedness of the sequence and optimality of its weak accumulation points, thus improving over all previously known convergence results. We present also convergence rate results. © 1998 The Mathematical Programming Society, Inc. Published by Elsevier Science B.V.Research of this author was partially supported by CNPq grant nos. 301280/86 and 300734/95-6.     

Multi-objective optimal design of feedback controls for dynamical systems with hybrid simple cell mapping algorithm

This paper presents a study of multi-objective optimal design of full state feedback controls. The goal of the design is to minimize several conflicting performance objective functions at the same time. The simple cell mapping method with a hybrid algorithm is used to find the multi-objective optimal design solutions. The multi-objective optimal design comes in a set of gains representing various compromises of the control system. Examples of regulation and tracking controls are presented to validate the control design.     

Particle swarm with equilibrium strategy of selection for multi-objective optimization

A new ranking scheme based on equilibrium strategy of selection is proposed for multi-objective particle swarm optimization (MOPSO), and the preference ordering is used to identify the “best compromise” in the ranking stage. This scheme increases the selective pressure, especially when the number of objectives is very large. The proposed algorithm has been compared with other multi-objective evolutionary algorithms (MOEAs). The experimental results indicate that our algorithm produces better convergence performance.     

Approximate Pareto sets of minimal size for multi-objective optimization problems

We are interested in a problem introduced by Vassilvitskii and Yannakakis (2005), the computation of a minimum set of solutions that approximates within an accuracy ε$\epsilon$ the Pareto set of a multi-objective optimization problem. We mainly establish a new 3-approximation algorithm for the bi-objective case. We also propose a study of the greedy algorithm performance for the tri-objective case when the points are given explicitly, answering an open question raised by Koltun and Papadimitriou in (2007).     

Design of cooperative algorithms for multi-objective optimization: application to the flow-shop scheduling problem

This is a summary of the main results presented in the author’s PhD thesis. This thesis was supervised by El-Ghazali Talbi, and defended on 21 June 2005 at the University of Lille (France). It is written in French and is available at http://www.lifl.fr/~basseur/These.pdf. This work deals with the conception of cooperative methods in order to solve multi-objective combinatorial optimization problems. Many cooperation schemes between exact and/or heuristic methods have been proposed in the literature. We propose a classification of such schemes. We propose a new heuristic called adaptive genetic algorithm (AGA), that is designed for an efficient exploration of the search space. We consider several cooperation schemes between AGA and other methods (exact or heuristic). The performance of these schemes are tested on a bi-objective permutation flow-shop scheduling problem, in order to evaluate the interest of each type of cooperation.     

A family of hybrid conjugate gradient methods for unconstrained optimization

Conjugate gradient methods are an important class of methods for unconstrained optimization, especially for large-scale problems. Recently, they have been much studied. This paper proposes a three-parameter family of hybrid conjugate gradient methods. Two important features of the family are that (i) it can avoid the propensity of small steps, namely, if a small step is generated away from the solution point, the next search direction will be close to the negative gradient direction; and (ii) its descent property and global convergence are likely to be achieved provided that the line search satisfies the Wolfe conditions. Some numerical results with the family are also presented.

     

Intuitionistic fuzzy optimization technique for Pareto optimal solution of manufacturing inventory models with shortages

This paper discusses a manufacturing inventory model with shortages where carrying cost, shortage cost, setup cost and demand quantity are considered as fuzzy numbers. The fuzzy parameters are transformed into corresponding interval numbers and then the interval objective function has been transformed into a classical multi-objective EPQ (economic production quantity) problem. To minimize the interval objective function, the order relation that represents the decision maker’s preference between interval objective functions has been defined by the right limit, left limit, center and half width of an interval. Finally, the transformed problem has been solved by intuitionistic fuzzy programming technique. The proposed method is illustrated with a numerical example and Pareto optimality test has been applied as well.     

A hybrid multi-objective artificial bee colony algorithm for burdening optimization of copper strip production

To achieve burdening process optimization of copper strips effectively, a nonlinear constrained multi-objective model is established on the principle of the actual burdening. The problem is formulated with two objectives of minimizing the total cost of raw materials and maximizing the amount of waste material thrown into melting furnace. In this paper, a novel approach called “hybrid multi-objective artificial bee colony” (HMOABC) to solve this model is proposed. The HMOABC algorithm is new swarm intelligence based multi-objective optimization technique inspired by the intelligent foraging behavior of honey bees, summation of normalized objective values and diversified selection (SNOV-DS) and nondominated sorting approach. Two test examples were studied and the performance of HMOABC is evaluated in comparison with other nature inspired techniques which includes nondominated sorting genetic algorithm II (NSGAII) and multi-objective particle swarm optimization (MOPSO). The numerical results demonstrate HMOABC approach is a powerful search and optimization technique for burdening optimization of copper strips.     

A method for minimizing the sum of a convex function and a continuously differentiable function

This paper presents a method for minimizing the sum of a possibly nonsmooth convex function and a continuously differentiable function. As in the convex case developed by the author, the algorithm is a descent method which generates successive search directions by solving quadratic programming subproblems. An inexact line search ensures global convergence of the method to stationary points.     

A convexification method for a class of global optimization problems with applications to reliability optimization

A convexification method is proposed for solving a class of global optimization problems with certain monotone properties. It is shown that this class of problems can be transformed into equivalent concave minimization problems using the proposed convexification schemes. An outer approximation method can then be used to find the global solution of the transformed problem. Applications to mixed-integer nonlinear programming problems arising in reliability optimization of complex systems are discussed and satisfactory numerical results are presented.     

Shape and topology optimization for elliptic boundary value problems using a piecewise constant level set method

The aim of this paper is to propose a variational piecewise constant level set method for solving elliptic shape and topology optimization problems. The original model is approximated by a two-phase optimal shape design problem by the ersatz material approach. Under the piecewise constant level set framework, we first reformulate the two-phase design problem to be a new constrained optimization problem with respect to the piecewise constant level set function. Then we solve it by the projection Lagrangian method. A gradient-type iterative algorithm is presented. Comparisons between our numerical results and those obtained by level set approaches show the effectiveness, accuracy and efficiency of our algorithm.     

Expected runtimes of a simple evolutionary algorithm for the multi-objective minimum spanning tree problem

Evolutionary algorithms are applied to problems that are not well understood as well as to problems in combinatorial optimization. The analysis of these search heuristics has been started for some well-known polynomial solvable problems. Such analyses are starting points for the analysis of evolutionary algorithms on difficult problems. We present the first runtime analysis of a multi-objective evolutionary algorithm on a NP-hard problem. The subject of our analysis is the multi-objective minimum spanning tree problem for which we give upper bounds on the expected time until a simple evolutionary algorithm has produced a population including for each extremal point of the Pareto front a corresponding spanning tree. These points are of particular interest as they give a 2-approximation of the Pareto front. We show that in expected pseudopolynomial time a population is produced that includes for each extremal point a corresponding spanning tree.     

Global optimization method using adaptive and parallel ensemble of surrogates for engineering design optimization

As a robust and efficient technique for global optimization, surrogate-based optimization method has been widely used in dealing with the complicated and computation-intensive engineering design optimization problems. It’s hard to select an appropriate surrogate model without knowing the behaviour of the real system a priori in most cases. To overcome this difficulty, a global optimization method using an adaptive and parallel ensemble of surrogates combining three representative surrogate models with optimized weight factors has been proposed. The selection of weight factors is treated as an optimization problem with the desired solution being one that minimizes the generalized mean square cross-validation error. The proposed optimization method is tested by considering several well-known numerical examples and one industrial problem compared with other optimization methods. The results show that the proposed optimization method can be a robust and efficient approach in surrogate-based optimization for locating the global optimum.