Particle swarm optimization: Hybridization perspectives and experimental illustrations

Metaheuristic optimization algorithms have become popular choice for solving complex and intricate problems which are otherwise difficult to solve by traditional methods. In the present study an attempt is made to review the hybrid optimization techniques in which one main algorithm is a well known metaheuristic; particle swarm optimization or PSO. Hybridization is a method of combining two (or more) techniques in a judicious manner such that the resulting algorithm contains the positive features of both (or all) the algorithms. Depending on the algorithm/s used we made three classifications as (i) Hybridization of PSO and genetic algorithms (ii) Hybridization of PSO with differential evolution and (iii) Hybridization of PSO with other techniques. Where, other techniques include various local and global search methods. Besides giving the review we also show a comparison of three hybrid PSO algorithms; hybrid differential evolution particle swarm optimization (DE-PSO), adaptive mutation particle swarm optimization (AMPSO) and hybrid genetic algorithm particle swarm optimization (GA-PSO) on a test suite of nine conventional benchmark problems.     

An Implementation for the Algorithm of Janet bases of Linear Differential Ideals in the Maple System

In this paper, an algorithm for computing the Janet bases of linear differential equations is described, which is the differential analogue of the algorithm JanetBasis improved by Gerdt. An implementation of the algorithm in Maple is given. The implemented algorithm includes some subalgorithms: Janet division,Pommaret division, the judgement of involutive divisor and reducible, the judgement of conventional divisor and reducible, involutive normal form and conventional normal form, involutive autoreduction and conventional autoreduction, PJ-autoreduction and so on. As an application, the Janet Bases of the determining system of classical Lie symmetries of some partial differential equations are obtained using our package.     

A Trigonometric Mutation Operation to Differential Evolution

Previous studies have shown that differential evolution is an efficient, effective and robust evolutionary optimization method. However, the convergence rate of differential evolution in optimizing a computationally expensive objective function still does not meet all our requirements, and attempting to speed up DE is considered necessary. In this paper, a new local search operation, trigonometric mutation, is proposed and embedded into the differential evolution algorithm. This modification enables the algorithm to get a better trade-off between the convergence rate and the robustness. Thus it can be possible to increase the convergence velocity of the differential evolution algorithm and thereby obtain an acceptable solution with a lower number of objective function evaluations. Such an improvement can be advantageous in many real-world problems where the evaluation of a candidate solution is a computationally expensive operation and consequently finding the global optimum or a good sub-optimal solution with the original differential evolution algorithm is too time-consuming, or even impossible within the time available. In this article, the mechanism of the trigonometric mutation operation is presented and analyzed. The modified differential evolution algorithm is demonstrated in cases of two well-known test functions, and is further examined with two practical training problems of neural networks. The obtained numerical simulation results are providing empirical evidences on the efficiency and effectiveness of the proposed modified differential evolution algorithm.     

Scheduling flow shops using differential evolution algorithm

This paper describes a novel optimization method based on a differential evolution (exploration) algorithm and its applications to solving non-linear programming problems containing integer and discrete variables. The techniques for handling discrete variables are described as well as the techniques needed to handle boundary constraints. In particular, the application of differential evolution algorithm to minimization of makespan, flowtime and tardiness in a flow shop manufacturing system is given in order to illustrate the capabilities and the practical use of the method. Experiments were carried out to compare results from the differential evolution algorithm and the genetic algorithm, which has a reputation for being very powerful. The results obtained have proven satisfactory in solution quality when compared with genetic algorithm. The novel method requires few control variables, is relatively easy to implement and use, effective, and efficient, which makes it an attractive and widely applicable approach for solving practical engineering problems. Future directions in terms of research and applications are given.     

Multiobjective big data optimization based on a hybrid salp swarm algorithm and differential evolution

This paper developed a multiobjective Big Data optimization approach based on a hybrid salp swarm algorithm and the differential evolution algorithm. The role of the differential evolution algorithm is to enhance the capability of the feature exploitation of the salp swarm algorithm because the operators of the differential evolution algorithm are used as local search operators. In general, the proposed method contains three stages. In the first stage, the population is generated, and the archive is initialized. The second stage updates the solutions using the hybrid salp swarm algorithm and the differential evolution algorithm, and the final stage determines the nondominated solutions and updates the archive. To assess the performance of the proposed approach, a series of experiments were performed. A set of single-objective and multiobjective problems from the 2015 Big Data optimization competition were tested; the dataset contained data with and without noise. The results of our experiments illustrated that the proposed approach outperformed other approaches, including the baseline nondominated sorting genetic algorithm, on all test problems. Moreover, for single-objective problems, the score value of the proposed method was better than that of the traditional multiobjective salp swarm algorithm. When compared with both algorithms, that is, the adaptive DE algorithm with external archive and the hybrid multiobjective firefly algorithm, its score was the largest. In contrast, for the multiobjective functions, the scores of the proposed algorithm were higher than that of the fireworks algorithm framework.     

Differential evolution framework for big data optimization

During the last two decades, dealing with big data problems has become a major issue for many industries. Although, in recent years, differential evolution has been successful in solving many complex optimization problems, there has been research gaps on using it to solve big data problems. As a real-time big data problem may not be known in advance, determining the appropriate differential evolution operators and parameters to use is a combinatorial optimization problem. Therefore, in this paper, a general differential evolution framework is proposed, in which the most suitable differential evolution algorithm for a problem on hand is adaptively configured. A local search is also employed to increase the exploitation capability of the proposed algorithm. The algorithm is tested on the 2015 big data optimization competition problems (six single objective problems and six multi-objective problems). The results show the superiority of the proposed algorithm to several state-of-the-art algorithms.     

Gbest-guided artificial bee colony algorithm for numerical function optimization

Artificial bee colony (ABC) algorithm invented recently by Karaboga is a biological-inspired optimization algorithm, which has been shown to be competitive with some conventional biological-inspired algorithms, such as genetic algorithm (GA), differential evolution (DE) and particle swarm optimization (PSO). However, there is still an insufficiency in ABC algorithm regarding its solution search equation, which is good at exploration but poor at exploitation. Inspired by PSO, we propose an improved ABC algorithm called gbest-guided ABC (GABC) algorithm by incorporating the information of global best (gbest) solution into the solution search equation to improve the exploitation. The experimental results tested on a set of numerical benchmark functions show that GABC algorithm can outperform ABC algorithm in most of the experiments.     

Parameter identification of Rossler’s chaotic system by an evolutionary algorithm

In this paper, a differential evolution (DE) algorithm is applied to parameter identification of Rossler’s chaotic system. The differential evolution has been shown to possess a powerful searching capability for finding the solutions for a given optimization problem, and it allows for parameter solution to appear directly in the form of floating point without further numerical coding or decoding. Three unknown parameters of Rossler’s Chaotic system are optimally estimated by using the DE algorithm. Finally, a numerical example is given to verify the effectiveness of the proposed method.     

基于微分进化算法的FCM图像分割算法

为提高模糊C均值(FCM)算法的自动化程度,提出基于微分进化算法的FCM图像分割算法(DEFCM),利用微分进化算法全局性和鲁棒性的特点自动确定分类数和初始聚类中心,再将其作为模糊c均值聚类的初始聚类中心,弥补FCM算法的不足.实验表明该算法不仅能够正确地对图像分类,而且能获得较好的图像分割效果和质量.     

A dynamic clustering based differential evolution algorithm for global optimization

A dynamic clustering based differential evolution algorithm (CDE) for global optimization is proposed to improve the performance of the differential evolution (DE) algorithm. With population evolution, CDE algorithm gradually changes from exploring promising areas at the early stages to exploiting solution with high precision at the later stages. Experiments on 28 benchmark problems, including 13 high dimensional functions, show that the new method is able to find near optimal solutions efficiently. Compared with other existing algorithms, CDE improves solution accuracy with less computational effort.     

Evolutionary algorithms for production planning problems with setup decisions

Production planning problems with setup decisions, which were formulated as mixed integer programmes (MIP), are solved in this study. The integer component of the MIP solution is determined by three evolution algorithms used in this study. Firstly, a traditional genetic algorithm (GA) uses conventional crossover and mutation operators for generating new chromosomes (solutions). Secondly, a modified GA uses not only the conventional operators but also a sibling operator, which stochastically produces new chromosomes from old ones using the sensitivity information of an associated linear programme. Thirdly, a sibling evolution algorithm uses only the sibling operator to reproduce. Based on the experiments done in this study, the sibling evolution algorithm performs the best among all the algorithms used in this study.     

基于精英区域学习的多种群自适应的差分进化算法

为了进一步提高差分进化算法的收敛速度、算法精度和稳定性,采用多种群技术来增加算法收敛速度和降低复杂度;利用精英区域学习策略来对算法的全局搜索能力和算法精度进一步提升,引进自适应免疫搜索策略,以实现自适应修正差分算法的变异因子和交叉因子。通过五个测试函数,把本文算法与最新文献中的算法进行对比,表明算法在收敛速度、精度和高维问题寻优能力方面的优越性。     

The classic differential evolution algorithm and its convergence properties

Differential evolution algorithms represent an up to date and efficient way of solving complicated optimization tasks. In this article we concentrate on the ability of the differential evolution algorithms to attain the global minimum of the cost function. We demonstrate that although often declared as a global optimizer the classic differential evolution algorithm does not in general guarantee the convergence to the global minimum. To improve this weakness we design a simple modification of the classic differential evolution algorithm. This modification limits the possible premature convergence to local minima and ensures the asymptotic global convergence. We also introduce concepts that are necessary for the subsequent proof of the asymptotic global convergence of the modified algorithm. We test the classic and modified algorithm by numerical experiments and compare the efficiency of finding the global minimum for both algorithms. The tests confirm that the modified algorithm is significantly more efficient with respect to the global convergence than the classic algorithm.     

Bare bones differential evolution

The barebones differential evolution (BBDE) is a new, almost parameter-free optimization algorithm that is a hybrid of the barebones particle swarm optimizer and differential evolution. Differential evolution is used to mutate, for each particle, the attractor associated with that particle, defined as a weighted average of its personal and neighborhood best positions. The performance of the proposed approach is investigated and compared with differential evolution, a Von Neumann particle swarm optimizer and a barebones particle swarm optimizer. The experiments conducted show that the BBDE provides excellent results with the added advantage of little, almost no parameter tuning. Moreover, the performance of the barebones differential evolution using the ring and Von Neumann neighborhood topologies is investigated. Finally, the application of the BBDE to the real-world problem of unsupervised image classification is investigated. Experimental results show that the proposed approach performs very well compared to other state-of-the-art clustering algorithms in all measured criteria.     

Improved versions of the LEDE algorithm for constrained global optimization

Two modified versions of the authors’ recent differential evolution algorithm for constrained global optimization are proposed. They incorporate a filter set which results in more efficient implementations of the original algorithm. Numerical results are presented which suggest that the new algorithms are competitive.     

A numerical study of some modified differential evolution algorithms

Modifications in mutation and localization in acceptance rule are suggested to the differential evolution algorithm for global optimization. Numerical experiments indicate that the resulting algorithms are considerably better than the original differential evolution algorithm. Therefore, they offer a reasonable alternative to many currently available stochastic algorithms, especially for problems requiring ‘direct search type’ methods. Numerical study is carried out using a set of 50 test problems many of which are inspired by practical applications.     

Bakhvalov-Shishkin网格上求解边界层问题的差分进化算法

该文在Bakhvalov-Shishkin网格上求解具有左边界层或右边界层的对流扩散方程,并采用差分进化算法对Bakhvalov-Shishkin网格中的参数进行优化,获得了该网格上具有最优精度的数值解.对三个算例进行了数值模拟,数值结果表明:采用差分进化算法求解具有较高的计算精度和收敛性,特别是边界层的数值解精度明显...     

考虑资源约束和数量折扣的联合补货-选址库存协同优化研究

本文构建了一种基于联合补货策略的配送中心选址-库存协同优化新模型,该模型允许缺货,有资源约束且考虑数量折扣;同时设计了一种融合模拟退火思想的双种群独立进化的自适应差分算法(Adaptive Simulated Annealing Differential Algorithm,ASADE)对该模型进行求解,并通过算例与自适应差分算法、改进的蛙跳算法进行对比,证实了ASADE算法的有效性。最后进行了敏感性分析,讨论相关参数变动对总成本的影响,可为管理者更好决策提供有益的依据。     

基于混合果蝇优化算法的选址-库存-配送集成优化研究

本文面向企业运营管理实践,构建了一种基于联合补货策略的选址-库存-配送集成优化新模型。作为典型的NP-hard问题,传统算法难以高效稳定地求解,故本文设计了一种新的混合果蝇优化算法(Fruit Fly Optimization Algorithm, FOA),通过引入进化算法的信息交换、变异、选择操作来增强算法局部寻优能力,采取概率性飞行策略来平衡算法的全局寻优与局部寻优。算例结果表明,新混合FOA算法的准确性和稳定性较标准FOA有了明显的改善,与差分进化、自适应混合差分进化、粒子群优化相比也具有比较优势。     

Inspired grey wolf optimizer for solving large-scale function optimization problems

Grey wolf optimizer algorithm was recently presented as a new heuristic search algorithm with satisfactory results in real-valued and binary encoded optimization problems that are categorized in swarm intelligence optimization techniques. This algorithm is more effective than some conventional population-based algorithms, such as particle swarm optimization, differential evolution and gravitational search algorithm. Some grey wolf optimizer variants were developed by researchers to improve the performance of the basic grey wolf optimizer algorithm. Inspired by particle swarm optimization algorithm, this study investigates the performance of a new algorithm called Inspired grey wolf optimizer which extends the original grey wolf optimizer by adding two features, namely, a nonlinear adjustment strategy of the control parameter, and a modified position-updating equation based on the personal historical best position and the global best position. Experiments are performed on four classical high-dimensional benchmark functions, four test functions proposed in the IEEE Congress on Evolutionary Computation 2005 special session, three well-known engineering design problems, and one real-world problem. The results show that the proposed algorithm can find more accurate solutions and has higher convergence rate and less number of fitness function evaluations than the other compared techniques.