Differential evolution framework for big data optimization

During the last two decades, dealing with big data problems has become a major issue for many industries. Although, in recent years, differential evolution has been successful in solving many complex optimization problems, there has been research gaps on using it to solve big data problems. As a real-time big data problem may not be known in advance, determining the appropriate differential evolution operators and parameters to use is a combinatorial optimization problem. Therefore, in this paper, a general differential evolution framework is proposed, in which the most suitable differential evolution algorithm for a problem on hand is adaptively configured. A local search is also employed to increase the exploitation capability of the proposed algorithm. The algorithm is tested on the 2015 big data optimization competition problems (six single objective problems and six multi-objective problems). The results show the superiority of the proposed algorithm to several state-of-the-art algorithms.     

Hybrid immune algorithm with Lamarckian local search for multi-objective optimization

Lamarckian learning has been introduced into evolutionary computation as local search mechanism. The relevant research topic, memetic computation, has received significant amount of interests. In this study, a novel Lamarckian learning strategy is designed for improving the Nondominated Neighbor Immune Algorithm, a novel hybrid multi-objective optimization algorithm, Multi-objective Lamarckian Immune Algorithm (MLIA), is proposed. The Lamarckian learning performs a greedy search which proceeds towards the goal along the direction obtained by Tchebycheff approach and generates the improved progenies or improved decision vectors, so single individual will be optimized locally and the newcomers yield an enhanced exploitation around the nondominated individuals in less-crowded regions of the current trade-off front. Simulation results based on twelve benchmark problems show that MLIA outperforms the original immune algorithm and NSGA-II in approximating Pareto-optimal front in most of the test problems. When compared with the state of the art algorithm MOEA/D, MLIA shows better performance in terms of the coverage of two sets metric, although it is laggard in the hypervolume metric.     

Primal and dual algorithms for optimization over the efficient set

ABSTRACT

Optimization over the efficient set of a multi-objective optimization problem is a mathematical model for the problem of selecting a most preferred solution that arises in multiple criteria decision-making to account for trade-offs between objectives within the set of efficient solutions. In this paper, we consider a particular case of this problem, namely that of optimizing a linear function over the image of the efficient set in objective space of a convex multi-objective optimization problem. We present both primal and dual algorithms for this task. The algorithms are based on recent algorithms for solving convex multi-objective optimization problems in objective space with suitable modifications to exploit specific properties of the problem of optimization over the efficient set. We first present the algorithms for the case that the underlying problem is a multi-objective linear programme. We then extend them to be able to solve problems with an underlying convex multi-objective optimization problem. We compare the new algorithms with several state of the art algorithms from the literature on a set of randomly generated instances to demonstrate that they are considerably faster than the competitors.     

基于乌鸦喝水的元启发式优化算法

启发式优化算法已成为求解复杂优化问题的一种有效方法,可用于解决传统的优化方法难以求解的问题.受乌鸦喝水寓言故事启发,提出一种新型元启发式优化算法—乌鸦喝水算法,首先建立了乌鸦喝水算法数学模型;其次,给出实现该算法的详细步骤;最后,将该算法用于基准函数优化,并将该算法与乌鸦搜索算法、粒子群优化算法、多元宇宙优化算法、花授...     

Approximate and Widespread Pareto Solutions in the Structure-Control Design of Mechatronic Systems

The structure-control design approach of mechatronic systems requires a different design formulation where the mechanical structure and control system are simultaneously designed. Optimization problems are commonly stated to confront the structure-control design formulation. Nevertheless, these problems are often very complex with a highly nonlinear dependence between the design variables and performance functions. This fact has made the use of evolutionary algorithms, a feasible alternative to solve the highly nonlinear optimization problem; the method to find the best solution is an open issue in the structure-control design approach. Hence, this paper presents a mechanism to exhaustively exploit the solutions in the differential evolution (DE) algorithm in order to find more non-dominated solutions with uniformly distributed Pareto front and better trade-offs in the structure-control design framework. The proposed approach adopts an external population to retain the non-dominated solutions found during the evolutionary process and includes a mechanism to mutate the individuals in their corresponding external population region. As a study case, the structure-control design of a serial-parallel manipulator with its control system is stated as a dynamic optimization problem and is solved by using the proposed approach. A comparative analysis shows that the multi-objective exhaustive exploitation differential evolution obtained a superior performance in the structure-control design framework than a DE algorithm which did not consider the proposal. Hence, the resulting designs provide better trade-offs between the structure-control performance functions.     

Multiobjective big data optimization based on a hybrid salp swarm algorithm and differential evolution

This paper developed a multiobjective Big Data optimization approach based on a hybrid salp swarm algorithm and the differential evolution algorithm. The role of the differential evolution algorithm is to enhance the capability of the feature exploitation of the salp swarm algorithm because the operators of the differential evolution algorithm are used as local search operators. In general, the proposed method contains three stages. In the first stage, the population is generated, and the archive is initialized. The second stage updates the solutions using the hybrid salp swarm algorithm and the differential evolution algorithm, and the final stage determines the nondominated solutions and updates the archive. To assess the performance of the proposed approach, a series of experiments were performed. A set of single-objective and multiobjective problems from the 2015 Big Data optimization competition were tested; the dataset contained data with and without noise. The results of our experiments illustrated that the proposed approach outperformed other approaches, including the baseline nondominated sorting genetic algorithm, on all test problems. Moreover, for single-objective problems, the score value of the proposed method was better than that of the traditional multiobjective salp swarm algorithm. When compared with both algorithms, that is, the adaptive DE algorithm with external archive and the hybrid multiobjective firefly algorithm, its score was the largest. In contrast, for the multiobjective functions, the scores of the proposed algorithm were higher than that of the fireworks algorithm framework.     

A fuzzy multi-objective particle swarm optimization for effective data clustering

Data clustering, also called unsupervised learning, is a fundamental issue in data mining that is used to understand and mine the structure of an untagged assemblage of data into separate groups based on their similarity. Recent studies have shown that clustering techniques that optimize a single objective may not provide satisfactory result because no single validity measure works well on different kinds of data sets. Moreover, the performance of clustering algorithms degrades with more and more overlaps among clusters in a data set. These facts have motivated us to develop a fuzzy multi-objective particle swarm optimization framework in an innovative fashion for data clustering, termed as FMOPSO, which is able to deliver more effective results than state-of-the-art clustering algorithms. The key challenge in designing FMOPSO framework for data clustering is how to resolve cluster assignments confusion with such points in the data set which have significant belongingness to more than one cluster. The proposed framework addresses this problem by identification of points having significant membership to multiple classes, excluding them, and re-classifying them into single class assignments. To ascertain the superiority of the proposed algorithm, statistical tests have been performed on a variety of numerical and categorical real life data sets. Our empirical study shows that the performance of the proposed framework (in both terms of efficiency and effectiveness) significantly outperforms the state-of-the-art data clustering algorithms.     

The development of a multi-objective Tabu Search algorithm for continuous optimisation problems

While there have been many adaptations of some of the more popular meta-heuristics for continuous multi-objective optimisation problems, Tabu Search has received relatively little attention, despite its suitability and effectiveness on a number of real-world design optimisation problems. In this paper we present an adaptation of a single-objective Tabu Search algorithm for multiple objectives. Further, inspired by path relinking strategies common in discrete optimisation problems, we enhance our algorithm to allow it to handle problems with large numbers of design variables. This is achieved by a novel parameter selection strategy that, unlike a full parametric analysis, avoids the use of objective function evaluations, thus keeping the overall computational cost of the procedure to a minimum. We assess the performance of our two Tabu Search variants on a range of standard test functions and compare it to a leading multi-objective Genetic Algorithm, NSGA-II. The path relinking-inspired parameter selection scheme gives a clear performance improvement over the basic multi-objective Tabu Search adaptation and both variants perform comparably with the NSGA-II.     

Minmax robustness for multi-objective optimization problems

In real-world applications of optimization, optimal solutions are often of limited value, because disturbances of or changes to input data may diminish the quality of an optimal solution or even render it infeasible. One way to deal with uncertain input data is robust optimization, the aim of which is to find solutions which remain feasible and of good quality for all possible scenarios, i.e., realizations of the uncertain data. For single objective optimization, several definitions of robustness have been thoroughly analyzed and robust optimization methods have been developed. In this paper, we extend the concept of minmax robustness (Ben-Tal, Ghaoui, & Nemirovski, 2009) to multi-objective optimization and call this extension robust efficiency for uncertain multi-objective optimization problems. We use ingredients from robust (single objective) and (deterministic) multi-objective optimization to gain insight into the new area of robust multi-objective optimization. We analyze the new concept and discuss how robust solutions of multi-objective optimization problems may be computed. To this end, we use techniques from both robust (single objective) and (deterministic) multi-objective optimization. The new concepts are illustrated with some linear and quadratic programming instances.     

基于拟态物理学的约束多目标共轭梯度混合算法

在拟态物理学优化算法APO的基础上,将一种基于序值的无约束多目标算法RMOAPO的思想引入到约束多目标优化领域中.提出一种基于拟态物理学的约束多目标共轭梯度混合算法CGRMOAPA.算法采取外点罚函数法作为约束问题处理技术,并借鉴聚集函数法的思想,将约束多目标优化问题转化为单目标无约束优化问题,最终利用共轭梯度法进行求解.通过与CRMOAPO、MOGA、NSGA-II的实验对比,表明了算法CGRMOAPA具有较好的分布性能,也为约束多目标优化问题的求解提供了一种新的思路.     

Uniform Big Bang–Chaotic Big Crunch optimization

This study proposes methods to improve the convergence of the novel optimization method, Big Bang–Big Crunch (BB–BC). Uniform population method has been used to generate uniformly distributed random points in the Big Bang phase. Chaos has been utilized to rapidly shrink those points to a single representative point via a center of mass in the Big Crunch phase. The proposed algorithm has been named as Uniform Big Bang–Chaotic Big Crunch (UBB–CBC). The performance of the UBB–CBC optimization algorithm demonstrates superiority over the BB–BC optimization for the benchmark functions.     

Branch and probability bound methods in multi-objective optimization

An approach to non-convex multi-objective optimization problems is considered where only the values of objective functions are required by the algorithm. The proposed approach is a generalization of the probabilistic branch-and-bound approach well applicable to complicated problems of single-objective global optimization. In the present paper the concept of probabilistic branch-and-bound based multi-objective optimization algorithms is discussed, and some illustrations are presented.     

Dynamic algorithm selection for pareto optimal set approximation

This paper presents a meta-algorithm for approximating the Pareto optimal set of costly black-box multiobjective optimization problems given a limited number of objective function evaluations. The key idea is to switch among different algorithms during the optimization search based on the predicted performance of each algorithm at the time. Algorithm performance is modeled using a machine learning technique based on the available information. The predicted best algorithm is then selected to run for a limited number of evaluations. The proposed approach is tested on several benchmark problems and the results are compared against those obtained using any one of the candidate algorithms alone.     

A hybrid multi-objective artificial bee colony algorithm for burdening optimization of copper strip production

To achieve burdening process optimization of copper strips effectively, a nonlinear constrained multi-objective model is established on the principle of the actual burdening. The problem is formulated with two objectives of minimizing the total cost of raw materials and maximizing the amount of waste material thrown into melting furnace. In this paper, a novel approach called “hybrid multi-objective artificial bee colony” (HMOABC) to solve this model is proposed. The HMOABC algorithm is new swarm intelligence based multi-objective optimization technique inspired by the intelligent foraging behavior of honey bees, summation of normalized objective values and diversified selection (SNOV-DS) and nondominated sorting approach. Two test examples were studied and the performance of HMOABC is evaluated in comparison with other nature inspired techniques which includes nondominated sorting genetic algorithm II (NSGAII) and multi-objective particle swarm optimization (MOPSO). The numerical results demonstrate HMOABC approach is a powerful search and optimization technique for burdening optimization of copper strips.     

A new mechanism to maintain diversity in multi-objective metaheuristics

In this article, a new mechanism to spread the solutions generated by a multi-objective evolutionary algorithm is proposed. This approach is based on the use of stripes that are applied in objective function space and is independent of the search engine adopted. Additionally, it overcomes some of the drawbacks of other previous proposals such as the ?-dominance method. In order to validate the proposed approach, it is coupled to a multi-objective particle swarm optimizer and its performance is assessed with respect to that of state-of-the-art algorithms, using standard test problems and performance measures taken from the specialized literature. The results indicate that the proposed approach is a viable diversity maintenance mechanism that can be incorporated to any multi-objective metaheuristic used for multi-objective optimization.     

Local models—an approach to distributed multi-objective optimization

When solving real-world optimization problems, evolutionary algorithms often require a large number of fitness evaluations in order to converge to the global optima. Attempts have been made to find techniques to reduce the number of fitness function evaluations. We propose a novel framework in the context of multi-objective optimization where fitness evaluations are distributed by creating a limited number of adaptive spheres spanning the search space. These spheres move towards the global Pareto front as components of a swarm optimization system. We call this process localization. The contribution of the paper is a general framework for distributed evolutionary multi-objective optimization, in which the individuals in each sphere can be controlled by any existing evolutionary multi-objective optimization algorithm in the literature.     

网络团购环境下基于电子中介的商品交易优化模型

在网络团购环境下,如何考虑顾客、商家和电子中介三方主体的利益并实现商品交易最优化,这是一个值得关注的研究问题。本文针对基于电子中介的网络团购商品交易问题,依据商家与电子中介事先商定的团购商品的交易数量区间、交易数量折扣以及顾客和商家分别提交的商品的报价和保留价,在考虑顾客、商家和电子中介三方利益最大化的前提下,构建了多目标商品交易优化模型;进一步地,将多目标优化模型转化为单目标优化模型,并给出了求解优化模型的遗传算法。最后,通过一个算例说明了本文构建的模型及其求解算法的可行性和有效性。     

Genetic Algorithm Optimization of a Six Degree of Freedom Micro Parallel Robot

In this paper a mono–objective optimum design procedure for a six–degree of freedom parallel micro robot is outlined by using optimality criterion of workspace and numerical aspects. A mono–objective optimization problem is formulated by referring to a basic performance of parallel robots. Additional objective functions can be used to extend the proposed design procedure to more general but specific design problems. A kinematic optimization was performed to maximize the workspace of the mini parallel robot. Optimization was performed using Genetic Algorithms. (© 2008 WILEY-VCH Verlag GmbH & Co. KGaA, Weinheim)     

HMOAM: hybrid multi-objective genetic optimization for facial analysis by appearance model

Successful hybridization of single-objective evolutionary algorithm with gradient based methods has shown promising results. However, studies of hybridized Multi-Objective Evolutionary Algorithm are limited, especially in the domain of image analysis. This paper presents a novel methodology of hybridization of multi-objective genetic algorithm for the real world optimization problem of facial analysis of multiple camera images by 2.5D Appearance Model. Facial large lateral movements make acquisition and analysis of facial images by single camera inefficient. Moreover, non-convex multi-dimensional search space formed by the face search by appearance model requires an efficient optimization methodology. Currently, with wide availability of inexpensive cameras, a multi-view system is as practical as a single-view system. To manage these multiple informations, multi-objective genetic algorithm is employed to optimize the face search. To efficiently tackle the problem of non-convexity of the search space, hybridization of NSGA-II (Non-dominated Sorting Genetic Algorithm) with Gradient Descent is proposed in this paper. For this hybridization, we propose a gradient operator in NSGA-II, which computes gradients of the solutions in conjunction with the existing operator of mutation. Thus, it does not increase the computational cost of the system. Another proposition includes a unique method of calculating the relevant information of each camera in a multiple camera system which makes the hybridization procedure efficient and robust. Our proposed algorithm is applied on different facial poses of CMU-PIE database, webcam face images and synthetic face images, and the results are compared with a single view system and a non-hybrid multiple camera system. Simulation results validate the efficiency, accuracy and robustness achieved.