Particle swarm optimization with age-group topology for multimodal functions and data clustering

This paper proposes particle swarm optimization with age-group topology (PSOAG), a novel age-based particle swarm optimization (PSO). In this work, we present a new concept of age to measure the search ability of each particle in local area. To keep population diversity during searching, we separate particles to different age-groups by their age and particles in each age-group can only select the ones in younger groups or their own groups as their neighbourhoods. To allow search escape from local optima, the aging particles are regularly replaced by new and randomly generated ones. In addition, we design an age-group based parameter setting method, where particles in different age-groups have different parameters, to accelerate convergence. This algorithm is applied to nonlinear function optimization and data clustering problems for performance evaluation. In comparison against several PSO variants and other EAs, we find that the proposed algorithm provides significantly better performances on both the function optimization problems and the data clustering tasks.     

免疫逃避型粒子群优化算法

针对基本粒子群优化算法容易陷入局部极值的缺陷,提出了一种免疫逃避型粒子群优化算法.其基本思想是将初始粒子群划分为寄生与宿主两个种群以模拟生物寄生行为,对寄生种群的粒子采用精英学习策略,对宿主群的粒子采用探索策略,再引入免疫系统的高频变异对寄生群采用相应的免疫逃避机制,以增强群体逃离局部极值、提高算法的全局寻优能力.采用标准测试函数的实验结果表明,该算法在收敛速度和求解精度方面均有显著改进.     

求解旅行商问题的基于类Kruskal的混合粒子群算法

本文针对求解旅行商问题的标准粒子群算法所存在的早熟和低效的问题,提出一种基于Greedy Heuristic的初始解与粒子群相结合的混合粒子群算法(SKHPSO)。该算法通过本文给出的类Kruskal算法作为Greedy Heuristic的具体实现手段,产生一个较优的初始可行解,作为粒子群中的一员,然后再用改进的混合粒子群算法进行启发式搜索。SKHPSO的局部搜索借鉴了Lin-Kernighan邻域搜索,而全局搜索结合了遗传算法中的交叉及置换操作。应用该算法对TSPLIB中的典型算例进行了算法测试分析,结果表明:SKHPSO可明显提高求解的质量和效率。     

A dynamic global and local combined particle swarm optimization algorithm

Particle swarm optimization (PSO) algorithm has been developing rapidly and many results have been reported. PSO algorithm has shown some important advantages by providing high speed of convergence in specific problems, but it has a tendency to get stuck in a near optimal solution and one may find it difficult to improve solution accuracy by fine tuning. This paper presents a dynamic global and local combined particle swarm optimization (DGLCPSO) algorithm to improve the performance of original PSO, in which all particles dynamically share the best information of the local particle, global particle and group particles. It is tested with a set of eight benchmark functions with different dimensions and compared with original PSO. Experimental results indicate that the DGLCPSO algorithm improves the search performance on the benchmark functions significantly, and shows the effectiveness of the algorithm to solve optimization problems.     

Application of particle swarm optimization in chaos synchronization in noisy environment in presence of unknown parameter uncertainty

In this paper, particle swarm optimization (PSO) is applied to synchronize chaotic systems in presence of parameter uncertainties and measurement noise. Particle swarm optimization is an evolutionary algorithm which is introduced by Kennedy and Eberhart. This algorithm is inspired by birds flocking. Optimization algorithms can be applied to control by defining an appropriate cost function that guarantees stability of system. In presence of environment noise and parameter uncertainty, robustness plays a crucial role in succeed of controller. Since PSO needs only rudimentary information about the system, it can be a suitable algorithm for this case. Simulation results confirm that the proposed controller can handle the uncertainty and environment noise without any extra information about them. A comparison with some earlier works is performed during simulations.     

A hybrid particle swarm optimization and bacterial foraging for power system stability enhancement

A novel hybrid approach involving particle swarm optimization (PSO) and bacterial foraging optimization algorithm (BFOA) called bacterial swarm optimization (BSO) is illustrated for designing static var compensator (SVC) in a multimachine power system. In BSO, the search directions of tumble behavior for each bacterium are oriented by the individual's best location and the global best location of PSO. The proposed hybrid algorithm has been extensively compared with the original BFOA algorithm and the PSO algorithm. Simulation results have shown the validity of the proposed BSO in tuning SVC compared with BFOA and PSO. Moreover, the results are presented to demonstrate the effectiveness of the proposed controller to improve the power system stability over a wide range of loading conditions. © 2014 Wiley Periodicals, Inc. Complexity 21: 245–255, 2015     

基于PSO-AFSA混合算法的模糊投资组合问题的研究

针对模糊不确定的证券市场,用可能性均值、下可能性方差和协方差分别替换了投资组合模型中概率均值、方差和协方差,构建了双目标均值-方差投资组合模型。然后采用线性加权法将双目标模型转化为单目标模型,进而提出了一个PSO-AFSA混合算法对其求解。该混合算法中,将粒子群算法搜索的结果作为人工鱼群算法初始鱼群,进一步搜索,这样能有效的避免粒子群算法陷入局部最优。同时,将人工鱼群中的最好位置反馈到粒子群算法的速度更新公式中,指引粒子运动,加快算法收敛。最后,进行实例分析,结果表明:PSO-AFSA混合算法是有效的,混合算法搜索到的全局最优值好于基本粒子群算法搜索到的全局最优值。     

Balanced fuzzy particle swarm optimization

In the present study an extension of particle swarm optimization (PSO) algorithm which is in conformity with actual nature is introduced for solving combinatorial optimization problems. Development of this algorithm is essentially based on balanced fuzzy sets theory. The classical fuzzy sets theory cannot distinguish differences between positive and negative information of membership functions, while in the new method both kinds of information “positive and negative” about membership function are equally important. The balanced fuzzy particle swarm optimization algorithm is used for fundamental optimization problem entitled traveling salesman problem (TSP). For convergence inspecting of new algorithm, method was used for TSP problems. Convergence curves were represented fast convergence in restricted and low iterations for balanced fuzzy particle swarm optimization algorithm (BF-PSO) comparison with fuzzy particle swarm optimization algorithm (F-PSO).     

超越方程的优化解法

针对粒子群算法局部搜索能力差,后期收敛速度慢等缺点,提出了一种改进的粒子群算法,该算法是在粒子群算法后期加入拟牛顿方法,充分发挥了粒子群算法的全局搜索性和拟牛顿法的局部精细搜索性,从而克服了粒子群算法的不足,把超越方程转化为函数优化的问题,利用该算法求解,数值实验结果表明,算法有较高的收敛速度和求解精度。     

Enhanced speciation in particle swarm optimization for multi-modal problems

In this paper, we present a novel multi-modal optimization algorithm for finding multiple local optima in objective function surfaces. We build from Species-based particle swarm optimization (SPSO) by using deterministic sampling to generate new particles during the optimization process, by implementing proximity-based speciation coupled with speciation of isolated particles, and by including “turbulence regions” around already found solutions to prevent unnecessary function evaluations. Instead of using error threshold values, the new algorithm uses the particle’s experience, geometric mean, and “exclusion factor” to detect local optima and stop the algorithm. The performance of each extension is assessed with leave-it-out tests, and the results are discussed. We use the new algorithm called Isolated-Speciation-based particle swarm optimization (ISPSO) and a benchmark algorithm called Niche particle swarm optimization (NichePSO) to solve a six-dimensional rainfall characterization problem for 192 rain gages across the United States. We show why it is important to find multiple local optima for solving this real-world complex problem by discussing its high multi-modality. Solutions found by both algorithms are compared, and we conclude that ISPSO is more reliable than NichePSO at finding optima with a significantly lower objective function value.     

A hybrid simplex search and particle swarm optimization for unconstrained optimization

This paper proposes the hybrid NM-PSO algorithm based on the Nelder–Mead (NM) simplex search method and particle swarm optimization (PSO) for unconstrained optimization. NM-PSO is very easy to implement in practice since it does not require gradient computation. The modification of both the Nelder–Mead simplex search method and particle swarm optimization intends to produce faster and more accurate convergence. The main purpose of the paper is to demonstrate how the standard particle swarm optimizers can be improved by incorporating a hybridization strategy. In a suite of 20 test function problems taken from the literature, computational results via a comprehensive experimental study, preceded by the investigation of parameter selection, show that the hybrid NM-PSO approach outperforms other three relevant search techniques (i.e., the original NM simplex search method, the original PSO and the guaranteed convergence particle swarm optimization (GCPSO)) in terms of solution quality and convergence rate. In a later part of the comparative experiment, the NM-PSO algorithm is compared to various most up-to-date cooperative PSO (CPSO) procedures appearing in the literature. The comparison report still largely favors the NM-PSO algorithm in the performance of accuracy, robustness and function evaluation. As evidenced by the overall assessment based on two kinds of computational experience, the new algorithm has demonstrated to be extremely effective and efficient at locating best-practice optimal solutions for unconstrained optimization.     

A novel particle swarm optimization algorithm based on particle migration

Inspired by the migratory behavior in the nature, a novel particle swarm optimization algorithm based on particle migration (MPSO) is proposed in this work. In this new algorithm, the population is randomly partitioned into several sub-swarms, each of which is made to evolve based on particle swarm optimization with time varying inertia weight and acceleration coefficients (LPSO-TVAC). At periodic stage in the evolution, some particles migrate from one complex to another to enhance the diversity of the population and avoid premature convergence. It further improves the ability of exploration and exploitation. Simulations for benchmark test functions illustrate that the proposed algorithm possesses better ability to find the global optima than other variants and is an effective global optimization tool.     

A rank based particle swarm optimization algorithm with dynamic adaptation

The particle swarm optimization (PSO) technique is a powerful stochastic evolutionary algorithm that can be used to find the global optimum solution in a complex search space. This paper presents a variation on the standard PSO algorithm called the rank based particle swarm optimizer, or PSO_rank, employing cooperative behavior of the particles to significantly improve the performance of the original algorithm. In this method, in order to efficiently control the local search and convergence to global optimum solution, the γ best particles are taken to contribute to the updating of the position of a candidate particle. The contribution of each particle is proportional to its strength. The strength is a function of three parameters: strivness, immediacy and number of contributed particles. All particles are sorted according to their fitness values, and only the γ best particles will be selected. The value of γ decreases linearly as the iteration increases. A time-varying inertia weight decreasing non-linearly is introduced to improve the performance. PSO_rank is tested on a commonly used set of optimization problems and is compared to other variants of the PSO algorithm presented in the literature. As a real application, PSO_rank is used for neural network training. The PSO_rank strategy outperformed all the methods considered in this investigation for most of the functions. Experimental results show the suitability of the proposed algorithm in terms of effectiveness and robustness.     

一种改进粒子群优化算法及其在投资规划中的应用

粒子群优化算法(PSO)是模拟生物群体智能的优化算法,具有良好的优化性能.但是群体收缩过快和群体多样性降低导致早熟收敛.本文引入了多样性指标和收敛因子模型来改进PSO算法,形成多样性收敛因子PSO算法(DCPSO),并且对现代资产投资的多目标规划问题进行了优化,简化了多目标规划的问题,并且表现出了比传统PSO算法更好性能.     

非线性约束优化问题的混合粒子群算法

把处理约束条件的一个外点方法和改进的粒子群优化算法相结合,提出了一种求解非线性约束优化问题的混合粒子群优化算法.该方法兼顾了粒子群优化和外点法的优点,对算法迭代过程中出现不可行粒子,利用外点法处理后产生可行粒子.数值实验表明了提出的新算法具有有效性、通用性和稳健性.     

An evolutionary game based particle swarm optimization algorithm

Particle swarm optimization (PSO) is an evolutionary algorithm used extensively. This paper presented a new particle swarm optimizer based on evolutionary game (EGPSO). We map particles’ finding optimal solution in PSO algorithm to players’ pursuing maximum utility by choosing strategies in evolutionary games, using replicator dynamics to model the behavior of particles. And in order to overcome premature convergence a multi-start technique was introduced. Experimental results show that EGPSO can overcome premature convergence and has great performance of convergence property over traditional PSO.     

Particle swarm optimization with chaotic opposition-based population initialization and stochastic search technique

Particle swarm optimization (PSO) is a relatively new optimization algorithm that has been applied to a variety of problems. However, it may easily get trapped in a local optima when solving complex multimodal problems. To address this concerning issue, we propose a novel PSO called as CSPSO to improve the performance of PSO on complex multimodal problems in the paper. Specifically, a stochastic search technique is used to execute the exploration in PSO, so as to help the algorithm to jump out of the likely local optima. In addition, to enhance the global convergence, when producing the initial population, both opposition-based learning method and chaotic maps are employed. Moreover, numerical simulation and comparisons with some typical existing algorithms demonstrate the superiority of the proposed algorithm.     

Improved particle swarm optimization combined with chaos

As a novel optimization technique, chaos has gained much attention and some applications during the past decade. For a given energy or cost function, by following chaotic ergodic orbits, a chaotic dynamic system may eventually reach the global optimum or its good approximation with high probability. To enhance the performance of particle swarm optimization (PSO), which is an evolutionary computation technique through individual improvement plus population cooperation and competition, hybrid particle swarm optimization algorithm is proposed by incorporating chaos. Firstly, adaptive inertia weight factor (AIWF) is introduced in PSO to efficiently balance the exploration and exploitation abilities. Secondly, PSO with AIWF and chaos are hybridized to form a chaotic PSO (CPSO), which reasonably combines the population-based evolutionary searching ability of PSO and chaotic searching behavior. Simulation results and comparisons with the standard PSO and several meta-heuristics show that the CPSO can effectively enhance the searching efficiency and greatly improve the searching quality.     

一种加入创新粒子的粒子群

粒子群算法是一种基于群体智能的随机并行算法,它在很多优化问题中都得到了比较好的应用。本文针对粒子群容易陷入局部最优解,提出了一种加入创新粒子的粒子群,实验模拟结果表明加入创新粒子的粒子群有更好的结果和收敛速度。     

PSOHS: an efficient two-stage approach for data clustering

Cluster analysis is an important task in data mining and refers to group a set of objects such that the similarities among objects within the same group are maximal while similarities among objects from different groups are minimal. The particle swarm optimization algorithm (PSO) is one of the famous metaheuristic optimization algorithms, which has been successfully applied to solve the clustering problem. However, it has two major shortcomings. The PSO algorithm converges rapidly during the initial stages of the search process, but near global optimum, the convergence speed will become very slow. Moreover, it may get trapped in local optimum if the global best and local best values are equal to the particle’s position over a certain number of iterations. In this paper we hybridized the PSO with a heuristic search algorithm to overcome the shortcomings of the PSO algorithm. In the proposed algorithm, called PSOHS, the particle swarm optimization is used to produce an initial solution to the clustering problem and then a heuristic search algorithm is applied to improve the quality of this solution by searching around it. The superiority of the proposed PSOHS clustering method, as compared to other popular methods for clustering problem is established for seven benchmark and real datasets including Iris, Wine, Crude Oil, Cancer, CMC, Glass and Vowel.