Novel inertia weight strategies for particle swarm optimization

The performance of PSO algorithm depends greatly on the appropriate parameter selection strategies for fine tuning its parameters. This paper proposes three new nonlinear strategies for selecting inertia weight which plays a significant role in particle’s foraging behaviour. The PSO variants implying these strategies are named as: fine grained inertia weight PSO (FGIWPSO); Double Exponential Self Adaptive IWPSO (DESIWPSO) and Double Exponential Dynamic IWPSO (DEDIWPSO). In FGIWPSO, inertia weight is obtained adaptively, depending on particle’s iteration wise performance and decreases exponentially. DESIWPSO and DEDIWPSO employ Gompertz function, a double exponential function for selecting inertia weight. In DESIWPSO the particles’ iteration wise performance is fed as input to the Gompertz function. On the other hand DEDIWPSO evaluates the inertia weight for whole swarm iteratively using Gompertz function where relative iteration is fed as input. The efficacy and efficiency of proposed approaches is validated on a suite of benchmark functions. The proposed variants are compared with non linear inertia weight and exponential inertia weight strategies. Experimental results assert that the proposed modifications help in improving PSO performance in terms of solution quality as well as convergence rate.     

A kernel extreme learning machine algorithm based on improved particle swam optimization

Kernel extreme learning machine (KELM) increases the robustness of extreme learning machine (ELM) by turning linearly non-separable data in a low dimensional space into a linearly separable one. However, the internal power parameters of ELM are initialized at random, causing the algorithm to be unstable. In this paper, we use the active operators particle swam optimization algorithm (APSO) to obtain an optimal set of initial parameters for KELM, thus creating an optimal KELM classifier named as APSO-KELM. Experiments on standard genetic datasets show that APSO-KELM has higher classification accuracy when being compared to the existing ELM, KELM, and these algorithms combining PSO/APSO with ELM/KELM, such as PSO-KELM, APSO-ELM, PSO-ELM, etc. Moreover, APSO-KELM has good stability and convergence, and is shown to be a reliable and effective classification algorithm.     

混合变异粒子群优化算法及其应用

为改善粒子群优化算法在解决复杂优化问题时收敛质量不高的不足,提出了一种改进的粒子群优化算法,即混合变异粒子群优化算法(HMPSO).HMPSO算法采用了带有随机因子的惯性权重取值更新策略,降低了标准粒子群优化算法中由于粒子飞行速度过大而错过最优解的概率,从而加速了算法的收敛速度.此外,通过混合变异进化环节的引入,缓解了...     

The model of chaotic sequences based on adaptive particle swarm optimization arithmetic combined with seasonal term

Within a competitive electric power market, electricity price is one of the core elements, which is crucial to all the market participants. Accurately forecasting of electricity price becomes highly desirable. This paper propose a forecasting model of electricity price using chaotic sequences for forecasting of short term electricity price in the Australian power market. One modified model is applies seasonal adjustment and another modified model is employed seasonal adjustment and adaptive particle swarm optimization (APSO) that determines the parameters for the chaotic system. The experimental results show that the proposed methods performs noticeably better than the traditional chaotic algorithm.     

Chaos-enhanced accelerated particle swarm optimization

There are more than two dozen variants of particle swarm optimization (PSO) algorithms in the literature. Recently, a new variant, called accelerated PSO (APSO), shows some extra advantages in convergence for global search. In the present study, we will introduce chaos into the APSO in order to further enhance its global search ability. Firstly, detailed studies are carried out on benchmark problems with twelve different chaotic maps to find out the most efficient one. Then the chaotic APSO (CAPSO) will be compared with some other chaotic PSO algorithms presented in the literature. The performance of the CAPSO algorithm is also validated using three engineering problems. The results show that the CAPSO with an appropriate chaotic map can clearly outperform standard APSO, with very good performance in comparison with other algorithms and in application to a complex problem.     

Online identification of Takagi–Sugeno fuzzy models based on self-adaptive hierarchical particle swarm optimization algorithm

This paper presents an approach for online learning of Takagi–Sugeno (T-S) fuzzy models. A novel learning algorithm based on a Hierarchical Particle Swarm Optimization (HPSO) is introduced to automatically extract all fuzzy logic system (FLS)’s parameters of a T–S fuzzy model. During online operation, both the consequent parameters of the T–S fuzzy model and the PSO inertia weight are continually updated when new data becomes available. By applying this concept to the learning algorithm, a new type T–S fuzzy modeling approach is constructed where the proposed HPSO algorithm includes an adaptive procedure and becomes a self-adaptive HPSO (S-AHPSO) algorithm usable in real-time processes. To improve the computational time of the proposed HPSO, particles positions are initialized by using an efficient unsupervised fuzzy clustering algorithm (UFCA). The UFCA combines the K-nearest neighbour and fuzzy C-means methods into a fuzzy modeling method for partitioning of the input–output data and identifying the antecedent parameters of the fuzzy system, enhancing the HPSO’s tuning. The approach is applied to identify the dynamical behavior of the dissolved oxygen concentration in an activated sludge reactor within a wastewater treatment plant. The results show that the proposed approach can identify nonlinear systems satisfactorily, and reveal superior performance of the proposed methods when compared with other state of the art methods. Moreover, the methodologies proposed in this paper can be involved in wider applications in a number of fields such as model predictive control, direct controller design, unsupervised clustering, motion detection, and robotics.     

Advanced particle swarm assisted genetic algorithm for constrained optimization problems

A novel hybrid evolutionary algorithm is developed based on the particle swarm optimization (PSO) and genetic algorithms (GAs). The PSO phase involves the enhancement of worst solutions by using the global-local best inertia weight and acceleration coefficients to increase the efficiency. In the genetic algorithm phase, a new rank-based multi-parent crossover is used by modifying the crossover and mutation operators which favors both the local and global exploration simultaneously. In addition, the Euclidean distance-based niching is implemented in the replacement phase of the GA to maintain the population diversity. To avoid the local optimum solutions, the stagnation check is performed and the solution is randomized when needed. The constraints are handled using an effective feasible population based approach. The parameters are self-adaptive requiring no tuning based on the type of problems. Numerical simulations are performed first to evaluate the current algorithm for a set of 24 benchmark constrained nonlinear optimization problems. The results demonstrate reasonable correlation and high quality optimum solutions with significantly less function evaluations against other state-of-the-art heuristic-based optimization algorithms. The algorithm is also applied to various nonlinear engineering optimization problems and shown to be excellent in searching for the global optimal solutions.     

基于改进的PSO-SVM的音频信号特征识别和分类

针对音频信号准确性分类的问题,提出一种基于改进的的粒子群优化算法(PSO)的支持向量机(SVM)音频信号分类的方法,简称IPSO-SVM.首先用Mel倒谱系数法对4种音频信号进行特征提取.其次在PSO中引入自适应变异因子,能够成功地跳出局部极小值点;然后对PSO中的惯性权重进行了改进,将惯性权重由常数变为指数型递减函数.随着迭代的进行,使权重逐渐减小,这样做有利于粒子进行局部寻优.最后用改进的PSO不断优化SVM中的惩罚因子c和核函数参数g来提高预测精度.实验结果表明,与传统的SVM、PSO-SVM、GA-SVM相比,我们提出的IPSO-SVM算法分类结果更精确.     

A novel particle swarm optimization algorithm based on particle migration

Inspired by the migratory behavior in the nature, a novel particle swarm optimization algorithm based on particle migration (MPSO) is proposed in this work. In this new algorithm, the population is randomly partitioned into several sub-swarms, each of which is made to evolve based on particle swarm optimization with time varying inertia weight and acceleration coefficients (LPSO-TVAC). At periodic stage in the evolution, some particles migrate from one complex to another to enhance the diversity of the population and avoid premature convergence. It further improves the ability of exploration and exploitation. Simulations for benchmark test functions illustrate that the proposed algorithm possesses better ability to find the global optima than other variants and is an effective global optimization tool.     

A rank based particle swarm optimization algorithm with dynamic adaptation

The particle swarm optimization (PSO) technique is a powerful stochastic evolutionary algorithm that can be used to find the global optimum solution in a complex search space. This paper presents a variation on the standard PSO algorithm called the rank based particle swarm optimizer, or PSO_rank, employing cooperative behavior of the particles to significantly improve the performance of the original algorithm. In this method, in order to efficiently control the local search and convergence to global optimum solution, the γ best particles are taken to contribute to the updating of the position of a candidate particle. The contribution of each particle is proportional to its strength. The strength is a function of three parameters: strivness, immediacy and number of contributed particles. All particles are sorted according to their fitness values, and only the γ best particles will be selected. The value of γ decreases linearly as the iteration increases. A time-varying inertia weight decreasing non-linearly is introduced to improve the performance. PSO_rank is tested on a commonly used set of optimization problems and is compared to other variants of the PSO algorithm presented in the literature. As a real application, PSO_rank is used for neural network training. The PSO_rank strategy outperformed all the methods considered in this investigation for most of the functions. Experimental results show the suitability of the proposed algorithm in terms of effectiveness and robustness.     

Parameter-less algorithm for evolutionary-based optimization

The development of a simple, adaptive, parameter-less search algorithm was initiated by the need for an algorithm that is able to find optimal solutions relatively quick, and without the need for a control-parameter-setting specialist. Its control parameters are calculated during the optimization process, according to the progress of the search. The algorithm is intended for continuous and combinatorial problems. The efficiency of the proposed parameter-less algorithm was evaluated using one theoretical and three real-world industrial optimization problems. A comparison with other evolutionary approaches shows that the presented adaptive parameter-less algorithm has a competitive convergence with regards to the comparable algorithms. Also, it proves algorithm’s ability to finding the optimal solutions without the need for predefined control parameters.     

改进的布谷鸟算法求解物流配送中心选址问题

针对基本布谷鸟算法求解物流配送中心选址问题时存在搜索精度低、易陷入局部最优值的缺陷,提出一种改进的布谷鸟算法.算法采用基于寄生巢适应度值排序的自适应方法改进基本布谷鸟算法的惯性权重,以平衡算法的全局开发能力和局部探索能力;利用NEH领域搜索以提高算法的搜索精度和收敛速度;引入停止阻止策略对全局最优寄生巢位置进行变异避免算法陷入局部最优值、增加种群的多样性.通过实验仿真表明,改进的布谷鸟算法在求解物流配送中心选址问题上要优与基本布谷鸟算法以及其它智群算法,是一种有效的算法.     

Multi-objective design optimization of an engine accessory drive system with a robustness analysis

Designing a good engine accessory drive system becomes a hard work with its increasingly complicated configuration and high demands on its dynamic characteristics. In this work, a hybrid mutation particle swarm optimization (HMPSO) algorithm is presented to optimize the key structure parameters of an engine accessory drive system for its vibration control. The superiority of the HMPSO algorithm against several other concerned metaheuristic algorithms in terms of solution quality and stability are verified by non-parametric statistical tests on ten benchmark functions. The design problem of the engine accessory drive system is a multi-objective optimization problem; the weighted sum method and main target method are applied to convert it to a single-objective one. Optimization on an example engine accessory drive system using the HMPSO algorithm demonstrates obvious improvement in system vibration after optimization. A robustness analysis is conducted to identify the robustness of dynamic responses of the engine accessory drive system with respect to small variations of the design variables relative to the optimal design in the design space, and suggestions on design of an engine accessory drive system are given according to it.     

种群规模自适应粒子群在配送中心连续型选址中的应用

本文依照更具有现实意义的“加工厂—配送中心—用户”的模式建立物流配送中心连续型选址模型,并针对较大规模的选址问题提出求解算法。该算法是将具有较强鲁棒性的自适应粒子算法和改进的ALA(Alert Location-Allocation)方法结合而得,该算法中种群规模自适应变化,对经典粒子移动方程进行改进,消除了学习因子,惯性因子随粒子适应值自适应变化,改进的ALA方法提高了算法计算效率。数值试验表明,本文所建模型具有一定的实践优越性,所提出的算法能有效避免陷入局部最优,寻优能力和鲁棒性均较强。     

Managing pharmaceuticals delivery service using a hybrid particle swarm intelligence approach

Medicines or drugs have unique characteristics of short life cycle, small size, light weight, restrictive distribution time and the need of temperature and humidity control (selected items only). Thus, logistics companies often use different types of vehicles with different carrying capacities, and considering fixed and variable costs in service delivery, which make the vehicle assignment and route optimization more complicated. In this study, we formulate the problem to a multi-type vehicle assignment and mixed integer programming route optimization model with fixed fleet size under the constraints of distribution time and carrying capacity. Given non-deterministic polynomial hard and optimal algorithm can only be used to solve small-size problem, a hybrid particle swarm intelligence (PSI) heuristic approach, which adopts the crossover and mutation operators from genetic algorithm and 2-opt local search strategy, is proposed to solve the problem. We also adapt a principle based on cost network and Dijkstra’s algorithm for vehicle scheduling to balance the distribution time limit and the high loading rate. We verify the relative performance of the proposed method against several known optimal or heuristic solutions using a standard data set for heterogeneous fleet vehicle routing problem. Additionally, we compare the relative performance of our proposed Hybrid PSI algorithm with two intelligent-based algorithms, Hybrid Population Heuristic algorithm and Improved Genetic Algorithm, using a real-world data set to illustrate the practical and validity of the model and algorithm.

     

Real-coded genetic algorithm for system identification and controller tuning

This paper presents an application of real-coded genetic algorithm (RGA) for system identification and controller tuning in process plants. The genetic algorithm is applied sequentially for system identification and controller tuning. First GA is applied to identify the changes in system parameters. Once the process parameters are identified, the optimal controller parameters are identified using GA. In the proposed genetic algorithm, the optimization variables are represented as floating point numbers. Also, cross over and mutation operators that can directly deal with the floating point numbers are used. The proposed approach has been applied for system identification and controller tuning in nonlinear pH process. The simulation results show that the GA based approach is effective in identifying the parameters of the system and the nonlinearity at various operating points in the nonlinear system.     

Improved particle swarm optimization combined with chaos

As a novel optimization technique, chaos has gained much attention and some applications during the past decade. For a given energy or cost function, by following chaotic ergodic orbits, a chaotic dynamic system may eventually reach the global optimum or its good approximation with high probability. To enhance the performance of particle swarm optimization (PSO), which is an evolutionary computation technique through individual improvement plus population cooperation and competition, hybrid particle swarm optimization algorithm is proposed by incorporating chaos. Firstly, adaptive inertia weight factor (AIWF) is introduced in PSO to efficiently balance the exploration and exploitation abilities. Secondly, PSO with AIWF and chaos are hybridized to form a chaotic PSO (CPSO), which reasonably combines the population-based evolutionary searching ability of PSO and chaotic searching behavior. Simulation results and comparisons with the standard PSO and several meta-heuristics show that the CPSO can effectively enhance the searching efficiency and greatly improve the searching quality.     

An inverse problem for the acoustics equations: A multilevel adaptive algorithm

A numerical solution to an inverse problem for the acoustic equations using an optimization method for a stratified medium is presented. With the distribution of an acoustic wave field on the medium’s surface, the 1D distributions of medium’s density, as well as the velocity and absorption coefficient of the acoustic wave, are determined. Absorption in a Voigt body model is considered. The conjugate gradients and the Newton method are used for minimization. To increase the efficiency of the numerical method, a multilevel adaptive algorithm is proposed. The algorithm is based on a division of the whole procedure of solving the inverse problem into a series of consecutive levels. Each level is characterized by the number of parameters to be determined at the level. In moving from one level to another, the number of parameters changes adaptively according to the functional minimized and the convergence rate. The minimization parameters are chosen as illustrated by results of solving the inverse problem in a spectral domain, where the desired quantities are presented as Chebyshev polynomial series and minimization is carried out with respect to the coefficients of these series. The method is compared in efficiency with a nonadaptive method. The optimal parameters of the multilevel method are chosen. It is shown that the multilevel algorithm offers several advantages over the one without partitioning into levels. The algorithm produces primarily a more accurate solution to the inverse problem.     

An optimal homotopy analysis method based on particle swarm optimization: application to fractional-order differential equation

This paper describes a new problem-solving mentality of finding optimal parameters in optimal homotopy analysis method (optimal HAM). We use particle swarm optimization (PSO) to minimize the exact square residual error in optimal HAM. All optimal convergence-control parameters can be found concurrently. This method can deal with optimal HAM which has finite convergence-control parameters. Two nonlinear fractional-order differential equations are given to illustrate the proposed algorithm. The comparison reveals that optimal HAM combined with PSO is effective and reliable. Meanwhile, we give a sufficient condition for convergence of the optimal HAM for solving fractional-order equation, and try to put forward a new calculation method for the residual error.     

基于改进粒子群算法的复杂现实约束投资组合研究

基于可能性理论,假设各资产的未来收益率均为梯形模糊数,本文构建了带有V-型交易费用、投资比例上下限和基数约束限制的均值-方差-Yager熵模型。本文采用了带有宽容量的逐步宽容法使构建的三目标模型转化为单目标模型,通过调整宽容量的大小来控制收益和风险的大小,从而使得投资者根据自己的偏好选择适合自己的投资决策。此外,本文通过非线性惯性权重来刻画搜索速度,通过对个体最优适应度值较差的部分粒子进行初始化处理,提出了改进的粒子群算法,从而降低了陷入局部最优的可能性;同时通过0-1矩阵和放缩因子处理了基数约束和上下限约束,使得模型的求解更加有效。最后,通过实例说明了算法的可行性和有效性,给出了投资模型的有效前沿,分析了收益/风险宽容量不变时,风险/收益宽容量变化的作用,从而给投资者提供了更多的决策方案。