An efficient multi-objective PSO algorithm assisted by Kriging metamodel for expensive black-box problems

The huge computational overhead is the main challenge in the application of community based optimization methods, such as multi-objective particle swarm optimization and multi-objective genetic algorithm, to deal with the multi-objective optimization involving costly simulations. This paper proposes a Kriging metamodel assisted multi-objective particle swarm optimization method to solve this kind of expensively black-box multi-objective optimization problems. On the basis of crowding distance based multi-objective particle swarm optimization algorithm, the new proposed method constructs Kriging metamodel for each expensive objective function adaptively, and then the non-dominated solutions of the metamodels are utilized to guide the update of particle population. To reduce the computational cost, the generalized expected improvements of each particle predicted by metamodels are presented to determine which particles need to perform actual function evaluations. The suggested method is tested on 12 benchmark functions and compared with the original crowding distance based multi-objective particle swarm optimization algorithm and non-dominated sorting genetic algorithm-II algorithm. The test results show that the application of Kriging metamodel improves the search ability and reduces the number of evaluations. Additionally, the new proposed method is applied to the optimal design of a cycloid gear pump and achieves desirable results.     

热传导(对流-扩散)方程源项识别的粒子群优化算法

提出了利用粒子群优化(PSO)算法反演热传导方程与对流-扩散方程源项的一种新方法,在已有文献方法的基础上,求解出这两类方程正问题的解析解,再把源项识别问题转化为最优化问题,结合粒子群优化算法寻优求解.通过数值模拟与统计检验,结果表明,此方法可快速有效地实现热传导方程与对流-扩散方程源项的识别,并可推广应用到其它数学物理方程的源项或参数的反演识别.     

A Particle Swarm Optimization Algorithm with Path Relinking for the Location Routing Problem

This paper introduces a new hybrid algorithmic nature inspired approach based on particle swarm optimization, for solving successfully one of the most popular logistics management problems, the location routing problem (LRP). The proposed algorithm for the solution of the location routing problem, the hybrid particle swarm optimization (HybPSO-LRP), combines a particle swarm optimization (PSO) algorithm, the multiple phase neighborhood search – greedy randomized adaptive search procedure (MPNS-GRASP) algorithm, the expanding neighborhood search (ENS) strategy and a path relinking (PR) strategy. The algorithm is tested on a set of benchmark instances. The results of the algorithm are very satisfactory for these instances and for six of them a new best solution has been found.      

An improved approach to attribute reduction with ant colony optimization

Attribute reduction problem (ARP) in rough set theory (RST) is an NPhard one, which is difficult to be solved via traditionally analytical methods. In this paper, we propose an improved approach to ARP based on ant colony optimization (ACO) algorithm, named the improved ant colony optimization (IACO). In IACO, a new state transition probability formula and a new pheromone traps updating formula are developed in view of the differences between a traveling salesman problem and ARP. The experimental results demonstrate that IACO outperforms classical ACO as well as particle swarm optimization used for attribute reduction.     

Balanced fuzzy particle swarm optimization

In the present study an extension of particle swarm optimization (PSO) algorithm which is in conformity with actual nature is introduced for solving combinatorial optimization problems. Development of this algorithm is essentially based on balanced fuzzy sets theory. The classical fuzzy sets theory cannot distinguish differences between positive and negative information of membership functions, while in the new method both kinds of information “positive and negative” about membership function are equally important. The balanced fuzzy particle swarm optimization algorithm is used for fundamental optimization problem entitled traveling salesman problem (TSP). For convergence inspecting of new algorithm, method was used for TSP problems. Convergence curves were represented fast convergence in restricted and low iterations for balanced fuzzy particle swarm optimization algorithm (BF-PSO) comparison with fuzzy particle swarm optimization algorithm (F-PSO).     

基于可信性理论的均值-熵-偏度投资组合模型及其算法求解

本文考虑到证券市场的投资者往往面临着随机和模糊两种不确定性的情形,在模糊随机环境下把证券的收益率视作三角模糊变量,在可信性理论基础上建立了带融资约束条件的均值-熵-偏度三目标投资组合决策模型,拓展了基于可信性理论的投资组合决策模型的研究内容,同时通过对约束条件处理方法,外部档案维护方法等关键算子的改良,提出了一种新的约束多目标粒子群算法。本文运用该算法对模型进行求解,把得到的最优解与传统的多目标粒子群算法得到的最优解进行对比,结果表明新算法得到的最优解的质量会显著地优于传统的多目标粒子群算法的最优解,从而验证了算法的有效性和准确性。该算法可以在三维空间中得到一个分布性和逼近性较好的Pareto最优曲面,满足投资者对不同目标的差异需求,为投资者提供合理的投资组合决策方案。     

基于改进粒子群算法的模糊聚类-概率神经网络模型的企业财务危机预警模型研究

为了充分发挥概率神经网络在企业财务危机预警中的作用,克服概率神经网络平滑参数难以确定和空间复杂度高的不足,本文提出一类新的参数动态调整的粒子群算法优化概率神经网络的平滑参数,进而采用改进粒子群算法优化初始隶属度矩阵的模糊聚类方法实现对样本的选择,解决了概率神经网络平滑参数的确定及空间结构复杂的问题。提出了基于改进粒子群算法的模糊聚类-概率神经网络企业财务危机预警模型,并以我国上市公司作为研究对象进行了实证研究。结果表明,经过模糊聚类和改进粒子群算法优化的概率神经网络具有更优的预测性能,并在企业财务危机长期预警方面具有一定效用。     

B-spline curve fitting with invasive weed optimization

B-spline curves and surfaces are generally used in computer aided design (CAD), data visualization, virtual reality, surface modeling and many other fields. Especially, data fitting with B-splines is a challenging problem in reverse engineering. In addition to this, B-splines are the most preferred approximating curve because they are very flexible and have powerful mathematical properties and, can represent a large variety of shapes efficiently [1]. The selection of the knots in B-spline approximation has an important and considerable effect on the behavior of the final approximation. Recently, in literature, there has been a considerable attention paid to employing algorithms inspired by natural processes or events to solve optimization problems such as genetic algorithms, simulated annealing, ant colony optimization and particle swarm optimization. Invasive weed optimization (IWO) is a novel optimization method inspired from ecological events and is a phenomenon used in agriculture. In this paper, optimal knots are selected for B-spline curve fitting through invasive weed optimization method. Test functions which are selected from the literature are used to measure performance. Results are compared with other approaches used in B-spline curve fitting such as Lasso, particle swarm optimization, the improved clustering algorithm, genetic algorithms and artificial immune system. The experimental results illustrate that results from IWO are generally better than results from other methods.     

The block diagram method for designing the particle swarm optimization algorithm

In this paper, the block diagram method of the dispersed control system is proposed for designing or improving the normal particle swarm optimization algorithms (PSO), that is, it uses the Jury-test of the control theory to compare the block diagrams getting from existing particle swarm optimization methods and finds out some defects of the existing particle swarm optimization methods, for example, the premature convergence of PSO algorithm, and so on. Thus a new particle swarm algorithm is also proposed for improving these defects, that is, the speed iteration and position iteration formulas of PSO are revised for both adjusting its convergence speed and jumping out of the local minimum points. To show effectiveness of the proposed method, the simulations of 13 benchmark examples are carried out, as a result, it indicates that the proposed method is very useful.     

Structural Damage Identification Using an Adaptive Multi-stage Optimization Method Based on a Modified Particle Swarm Algorithm

An adaptive multi-stage optimization method utilizing a modified particle swarm optimization (MPSO) is proposed here to identify the multiple damage cases of structural systems. First the structural damage problem is defined as a standard optimization problem. An efficient objective function considering the first few natural frequencies of a structure, before and after damage, is utilized for optimization. A modified particle swarm optimization (MPSO) dealing with real values of damage variables is introduced to solve the optimization problem. In order to assess the performance of the proposed method, some illustrative examples with and without considering the measurement noise are tested. Numerical results demonstrate the high accuracy of the method proposed for determining the site and severity of multiple damage cases in the structural systems.     

Optimal multiple-objective resource allocation using hybrid particle swarm optimization and adaptive resource bounds technique

The multiple-objective resource allocation problem (MORAP) seeks for an allocation of resource to a number of activities such that a set of objectives are optimized simultaneously and the resource constraints are satisfied. MORAP has many applications, such as resource distribution, project budgeting, software testing, health care resource allocation, etc. This paper addresses the nonlinear MORAP with integer decision variable constraint. To guarantee that all the resource constraints are satisfied, we devise an adaptive-resource-bound technique to construct feasible solutions. The proposed method employs the particle swarm optimization (PSO) paradigm and presents a hybrid execution plan which embeds a hill-climbing heuristic into the PSO for expediting the convergence. To cope with the optimization problem with multiple objectives, we evaluate the candidate solutions based on dominance relationship and a score function. Experimental results manifest that the hybrid PSO derives solution sets which are very close to the exact Pareto sets. The proposed method also outperforms several representatives of the state-of-the-art algorithms on a simulation data set of the MORAP.     

Optimal Noncollapsing Space-Filling Designs for Irregular Experimental Regions

Space-filling and noncollapsing are two important properties in designing computer experiments. We study how the noncollapsing, space-filling designs for irregular experimental regions can be generated efficiently by the proposed metaheuristic methods. We solve this optimal design problem using variants of the discrete particle swarm optimization (DPSO) approaches. Numerical results, including an application in data center thermal management, are used to illustrate the performances of the proposed algorithms. Based on these numerical results, we assert that the most efficient approach is to reformulate the target optimal design problem as a constrained optimization problem and then use a modified DPSO to solve the constrained optimization problem.     

求解旅行商问题的基于类Kruskal的混合粒子群算法

本文针对求解旅行商问题的标准粒子群算法所存在的早熟和低效的问题,提出一种基于Greedy Heuristic的初始解与粒子群相结合的混合粒子群算法(SKHPSO)。该算法通过本文给出的类Kruskal算法作为Greedy Heuristic的具体实现手段,产生一个较优的初始可行解,作为粒子群中的一员,然后再用改进的混合粒子群算法进行启发式搜索。SKHPSO的局部搜索借鉴了Lin-Kernighan邻域搜索,而全局搜索结合了遗传算法中的交叉及置换操作。应用该算法对TSPLIB中的典型算例进行了算法测试分析,结果表明:SKHPSO可明显提高求解的质量和效率。     

置换流水车间调度问题的中心引力优化算法求解

目前求解置换流水车间调度问题的智能优化算法都是随机型优化方法,存在的一个问题是解的稳定性较差。针对该问题,本文给出一种确定型智能优化算法——中心引力优化算法的求解方法。为处理基本中心引力优化算法对初始解选择要求高的问题,利用低偏差序列生成初始解,提高初始解质量;利用加速度和位置迭代方程更新解的状态;利用两位置交换排序法进行局部搜索,提高算法的优化性能。采用置换流水车间调度问题标准测试算例进行数值实验,并和基本中心引力优化算法、NEH启发式算法、微粒群优化算法和萤火虫算法进行比较。结果表明该算法不仅具有更好的解的稳定性,而且具有更高的计算精度,为置换流水车间调度问题的求解提供了一种可行有效的方法。     

合作博弈的粒子群算法求解

随着局中人人数的增加,利用传统的“占优”方法和“估值”方法进行合作博弈求解无论从逻辑上还是计算上都变得非常困难。针对此问题,将合作博弈的求解看作是局中人遵照有效性和个体理性提出分配方案,并按照一定规则不断迭代调整直至所有方案趋向一致的过程。依据该思路,对合作博弈粒子群算法模型进行构建,确定适应度函数,设置速度公式中的参数。通过算例分析,利用粒子群算法收敛快、精度高、容易实现的特点,可以迅速得到合作博弈的唯一分配值,这为求解合作博弈提供了新的方法和工具。     

Balancing two-sided U-type assembly lines using modified particle swarm optimization algorithm

In this paper, a new two-sided U-type assembly line balancing (TUALB) procedure and a new algorithm based on the particle swarm optimization algorithm to solve the TUALB problem are proposed. The proposed approach minimizes the number of stations for a given cycle time as the primary objective and it minimizes the number of positions as a secondary objective. The proposed approach is illustrated with an example problem. In order to evaluate the efficiency of the proposed algorithm, the test problems available in the literature are used. The experimental results show that the proposed approach performs well.     

A competitive and cooperative co-evolutionary approach to multi-objective particle swarm optimization algorithm design

Multi-objective particle swarm optimization (MOPSO) is an optimization technique inspired by bird flocking, which has been steadily gaining attention from the research community because of its high convergence speed. On the other hand, in the face of increasing complexity and dimensionality of today’s application coupled with its tendency of premature convergence due to the high convergence speeds, there is a need to improve the efficiency and effectiveness of MOPSO. In this paper a competitive and cooperative co-evolutionary approach is adapted for multi-objective particle swarm optimization algorithm design, which appears to have considerable potential for solving complex optimization problems by explicitly modeling the co-evolution of competing and cooperating species. The competitive and cooperative co-evolution model helps to produce the reasonable problem decompositions by exploiting any correlation, interdependency between components of the problem. The proposed competitive and cooperative co-evolutionary multi-objective particle swarm optimization algorithm (CCPSO) is validated through comparisons with existing state-of-the-art multi-objective algorithms using established benchmarks and metrics. Simulation results demonstrated that CCPSO shows competitive, if not better, performance as compared to the other algorithms.     

Random fuzzy EOQ model with imperfect quality items

This paper investigates an economic order quantity (EOQ) problem with imperfect quality items, where the percentage of imperfect quality items in each lot is characterized as a random fuzzy variable while the setup cost per lot, the holding cost of each unit item per day, and the inspection cost of each unit item are characterized as fuzzy variables, respectively. In order to maximize the expected long-run average profit, a random fuzzy EOQ model is constructed. Since it is almost impossible to find an analytic method to solve the proposed model, a particle swarm optimization (PSO) algorithm based on the random fuzzy simulation is designed. Finally, the effectiveness of the designed algorithm is illustrated by a numerical example.     

基于粒子群算法的模糊层次分析法改进及其应用研究

提出了基于粒子群算法(Particle Swarm Optimization)的模糊层次分析法(Fuzzy Analytic Hierarchy Process)模型,简称PSO-FAHP,将模糊判断矩阵一致性的检验、修正及各元素权重值的计算过程转化成非线性带约束系统优化问题,并利用粒子群算法实现了该问题的求解。构建了制造企业供应商选择评价指标体系,最后将该模型应用于制造企业供应商选择评价,结果表明,此模型能有效帮助企业选择较佳的供应商,对供应链构建有一定的指导意义。     

Inspired grey wolf optimizer for solving large-scale function optimization problems

Grey wolf optimizer algorithm was recently presented as a new heuristic search algorithm with satisfactory results in real-valued and binary encoded optimization problems that are categorized in swarm intelligence optimization techniques. This algorithm is more effective than some conventional population-based algorithms, such as particle swarm optimization, differential evolution and gravitational search algorithm. Some grey wolf optimizer variants were developed by researchers to improve the performance of the basic grey wolf optimizer algorithm. Inspired by particle swarm optimization algorithm, this study investigates the performance of a new algorithm called Inspired grey wolf optimizer which extends the original grey wolf optimizer by adding two features, namely, a nonlinear adjustment strategy of the control parameter, and a modified position-updating equation based on the personal historical best position and the global best position. Experiments are performed on four classical high-dimensional benchmark functions, four test functions proposed in the IEEE Congress on Evolutionary Computation 2005 special session, three well-known engineering design problems, and one real-world problem. The results show that the proposed algorithm can find more accurate solutions and has higher convergence rate and less number of fitness function evaluations than the other compared techniques.