Inspired grey wolf optimizer for solving large-scale function optimization problems

Grey wolf optimizer algorithm was recently presented as a new heuristic search algorithm with satisfactory results in real-valued and binary encoded optimization problems that are categorized in swarm intelligence optimization techniques. This algorithm is more effective than some conventional population-based algorithms, such as particle swarm optimization, differential evolution and gravitational search algorithm. Some grey wolf optimizer variants were developed by researchers to improve the performance of the basic grey wolf optimizer algorithm. Inspired by particle swarm optimization algorithm, this study investigates the performance of a new algorithm called Inspired grey wolf optimizer which extends the original grey wolf optimizer by adding two features, namely, a nonlinear adjustment strategy of the control parameter, and a modified position-updating equation based on the personal historical best position and the global best position. Experiments are performed on four classical high-dimensional benchmark functions, four test functions proposed in the IEEE Congress on Evolutionary Computation 2005 special session, three well-known engineering design problems, and one real-world problem. The results show that the proposed algorithm can find more accurate solutions and has higher convergence rate and less number of fitness function evaluations than the other compared techniques.     

Bare bones differential evolution

The barebones differential evolution (BBDE) is a new, almost parameter-free optimization algorithm that is a hybrid of the barebones particle swarm optimizer and differential evolution. Differential evolution is used to mutate, for each particle, the attractor associated with that particle, defined as a weighted average of its personal and neighborhood best positions. The performance of the proposed approach is investigated and compared with differential evolution, a Von Neumann particle swarm optimizer and a barebones particle swarm optimizer. The experiments conducted show that the BBDE provides excellent results with the added advantage of little, almost no parameter tuning. Moreover, the performance of the barebones differential evolution using the ring and Von Neumann neighborhood topologies is investigated. Finally, the application of the BBDE to the real-world problem of unsupervised image classification is investigated. Experimental results show that the proposed approach performs very well compared to other state-of-the-art clustering algorithms in all measured criteria.     

Reliability-Based Optimization Using Differential Evolution and Inverse Reliability Analysis for Engineering System Design

In this contribution, a new methodology based on a double-loop iteration process is proposed for the treatment of uncertainties in engineering system design. The inner optimization loop is used to find the solution associated with the highest probability value (inverse reliability analysis), and the outer loop is the regular optimization loop used to solve the considered reliability problem through differential evolution and multi-objective optimization differential evolution algorithms. The proposed methodology is applied to mathematical functions and to the design of classical engineering systems according to both mono- and multi-objective contexts. The obtained results are compared with those obtained by classical approaches and demonstrate that the proposed strategy represents an interesting alternative to reliability design of engineering systems.     

Differential evolution for sequencing and scheduling optimization

This paper presents a stochastic method based on the differential evolution (DE) algorithm to address a wide range of sequencing and scheduling optimization problems. DE is a simple yet effective adaptive scheme developed for global optimization over continuous spaces. In spite of its simplicity and effectiveness the application of DE on combinatorial optimization problems with discrete decision variables is still unusual. A novel solution encoding mechanism is introduced for handling discrete variables in the context of DE and its performance is evaluated over a plethora of public benchmarks problems for three well-known NP-hard scheduling problems. Extended comparisons with the well-known random-keys encoding scheme showed a substantially higher performance for the proposed. Furthermore, a simple slight modification in the acceptance rule of the original DE algorithm is introduced resulting to a more robust optimizer over discrete spaces than the original DE.     

Efficient strategy for reliability-based optimization design of multidisciplinary coupled system with interval parameters

Non-probabilistic reliability based multidisciplinary design optimization has been widely acknowledged as an advanced methodology for complex system design when the data is insufficient. In this work, the uncertainty propagation analysis method in multidisciplinary system based on subinterval theory is firstly studied to obtain the uncertain responses. Then, based on the non-probabilistic set theory, the interval reliability based multidisciplinary design optimization model is established. Considering that the gradient information of interval reliability cannot be acquired in the whole design domain, which causes convergence difficulties and prohibitive computation, an interval reliability displacement based multidisciplinary design optimization method is proposed to address the issue. In the proposed method, the interval reliability displacement is introduced to measure the degree of interval reliability. By doing so, not only the connotation of the interval reliability is guaranteed, but more importantly, the partial gradient region for interval reliability is equivalently converted into full gradient region for reliability displacement. Consequently, the gradient information can be acquired under any circumstances and thus the convergence process is highly accelerated by utilizing the gradient optimization algorithms.     

A numerical approach to design control invariant sets for constrained nonlinear discrete-time systems with guaranteed optimality

A numerical approach to design control invariant sets for constrained nonlinear discrete-time systems with guaranteed optimality is proposed in this paper. The addressed approach is based on the fact that zonotopes are more flexible for representing sets than boxes in interval analysis. Then the solver of set inversion via interval analysis is extended to set inversion via zonotope geometry by introducing the novel idea of bisecting zonotopes. The main feature of the extended solver of set inversion is the bisection and the evolution of a zonotope rather than a box. Thus the shape of admissible domains for set inversion can be broadened from boxes to zonotopes and the wrapping effect can be reduced as well by using the zonotope evolution instead of the interval evolution. Combined with global optimization via interval analysis, the extended solver of set inversion via zonotope geometry is further applied to design control invariant sets for constrained nonlinear discrete-time systems in a numerical way. Finally, the numerical design of a control invariant set and its application to the terminal control of the dual-mode model predictive control are fulfilled on a benchmark Continuous-Stirred Tank Reactor example.     

粒子群优化与差分进化混合算法的综述与分类

优化算法的性能改进长期以来一直是算法研究者们追求的一个重要目标,对不同算法进行混合以期利用算法的互补优势来获得性能更优异的算法代表了一类典型的设计思想.针对两类基于群体演化的优化算法——粒子群优化(PSO)与差分进化(DE)算法,对基于二者的各种混合算法(DEPSO)进行了系统而全面的综述,并在此基础上提出了一种混合策...     

The classic differential evolution algorithm and its convergence properties

Differential evolution algorithms represent an up to date and efficient way of solving complicated optimization tasks. In this article we concentrate on the ability of the differential evolution algorithms to attain the global minimum of the cost function. We demonstrate that although often declared as a global optimizer the classic differential evolution algorithm does not in general guarantee the convergence to the global minimum. To improve this weakness we design a simple modification of the classic differential evolution algorithm. This modification limits the possible premature convergence to local minima and ensures the asymptotic global convergence. We also introduce concepts that are necessary for the subsequent proof of the asymptotic global convergence of the modified algorithm. We test the classic and modified algorithm by numerical experiments and compare the efficiency of finding the global minimum for both algorithms. The tests confirm that the modified algorithm is significantly more efficient with respect to the global convergence than the classic algorithm.     

A direct solution framework for structural optimization problems with interval uncertainties

A direct solution framework based on multi-objective evolutionary algorithm is developed to solve the structural optimization problems with interval uncertainties. The midpoint and radius of the uncertain original objective are treated as two equally important objectives, which are solved by a multi-objective evolutionary algorithm. The satisfaction value of interval possibility degree model is utilized to deal with nonlinear uncertain constraints and then the degree of constraint violation based on this model is calculated to judge the design vector individuals which one is feasible or infeasible. Subsequently, a selection strategy based on interval constrained-domination rule is utilized to realize the ranking of different design vectors. Finally, two numerical examples and the structural design of augmented reality glasses are investigated to verify the applicability and effectiveness of the proposed method.     

An interval algorithm for sensitivity analysis of coupled vibro-acoustic systems

Sensitivity analysis is a vital part in the optimization design of coupled vibro-acoustic systems. A new interval sensitivity-analysis method for vibro-acoustic systems is proposed in this paper. This method relies on only interval perturbation analysis instead of partial derivatives and difference operations. For strongly nonlinear systems, in particular, this methodology requires parameter variation over narrower ranges in comparison with other methods. To implement sensitivity analysis based on this method, the interval ranges of the responses of the vibro-acoustic system with interval parameters should first be obtained. Therefore, an interval perturbation-analysis method is presented for obtaining the interval bounds of the sound-pressure responses of a coupled vibro-acoustic system with interval parameters. The interval perturbation method is then compared with the Monte Carlo method, which can be taken as the benchmark for comparative accuracy. Two numerical examples involving sensitivity analysis of vibro-acoustic systems illustrate the feasibility and effectiveness of the proposed interval-based method.     

Generalized particle swarm optimization algorithm - Theoretical and empirical analysis with application in fault detection

A generalization of the particle swarm optimization (PSO) algorithm is presented in this paper. The novel optimizer, the Generalized PSO (GPSO), is inspired by linear control theory. It enables direct control over the key aspects of particle dynamics during the optimization process. A detailed theoretical and empirical analysis is presented, and parameter-tuning schemes are proposed. GPSO is compared to the classical PSO and genetic algorithm (GA) on a set of benchmark problems. The results clearly demonstrate the effectiveness of the proposed algorithm. Finally, an application of the GPSO algorithm to the fine-tuning of the support vector machines classifier for electrical machines fault detection is presented.     

New simulation-based frameworks for multi-objective reliability-based design optimization of structures

In the present study, two new simulation-based frameworks are proposed for multi-objective reliability-based design optimization (MORBDO). The first is based on hybrid non-dominated sorting weighted simulation method (NSWSM) in conjunction with iterative local searches that is efficient for continuous MORBDO problems. According to NSWSM, uniform samples are generated within the design space and, then, the set of feasible samples are separated. Thereafter, the non-dominated sorting operator is employed to extract the approximated Pareto front. The iterative local sample generation is then performed in order to enhance the accuracy, diversity, and increase the extent of non-dominated solutions. In the second framework, a pseudo-double loop algorithm is presented based on hybrid weighted simulation method (WSM) and the Non-dominated Sorting Genetic Algorithm II (NSGA-II) that is efficient for problems including both discrete and continuous variables. According to hybrid WSM-NSGA-II, proper non-dominated solutions are produced in each generation of NSGA-II and, subsequently, WSM evaluates the reliability level of each candidate solution until the algorithm converges to the true Pareto solutions. The valuable characteristic of presented approaches is that only one simulation run is required for WSM during entire optimization process, even if solutions for different levels of reliability be desired. Illustrative examples indicate that NSWSM with the proposed local search strategy is more efficient for small dimension continuous problems. However, WSM-NSGA-II outperforms NSWSM in terms of solutions quality and computational efficiency, specifically for discrete MORBDOs. Employing global optimizer in WSM-NSGA-II provided more accurate results with lower samples than NSWSM.     

A Comparison of Global Optimization Methods for the Design of a High-speed Civil Transport

The conceptual design of aircraft often entails a large number of nonlinear constraints that result in a nonconvex feasible design space and multiple local optima. The design of the high-speed civil transport (HSCT) is used as an example of a highly complex conceptual design with 26 design variables and 68 constraints. This paper compares three global optimization techniques on the HSCT problem and two test problems containing thousands of local optima and noise: multistart local optimizations using either sequential quadratic programming (SQP) as implemented in the design optimization tools (DOT) program or Snyman's dynamic search method, and a modified form of Jones' DIRECT global optimization algorithm. SQP is a local optimizer, while Snyman's algorithm is capable of moving through shallow local minima. The modified DIRECT algorithm is a global search method based on Lipschitzian optimization that locates small promising regions of design space and then uses a local optimizer to converge to the optimum. DOT and the dynamic search algorithms proved to be superior for finding a single optimum masked by noise of trigonometric form. The modified DIRECT algorithm was found to be better for locating the global optimum of functions with many widely separated true local optima.     

Adaptive surrogate-based design optimization with expected improvement used as infill criterion

A prominent advantage of using surrogate models in structural design optimization is that computational effort can be greatly reduced without significantly compromising model accuracy. The essential goal is to perform the design optimization with fewer evaluations of the typically finite element analysis and ensuring accuracy of the optimization results. An adaptive surrogate based design optimization framework is proposed, in which Latin hypercube sampling and Kriging are used to build surrogate models. Accuracy of the models is improved adaptively using an infill criterion called expected improvement (EI). It is the anticipated improvement that an interpolation point will lead to the current surrogate models. The point that will lead to the maximum EI is searched and used as infill points at each iteration. For constrained optimization problems, the surrogate of constraint is also utilized to form a constrained EI as the corresponding infill criterion. Computational trials on mathematical test functions and on a three-dimensional aircraft wing model are carried out to test the feasibility of this method. Compared with the traditional surrogate base design optimization and direct optimization methods, this method can find the optimum design with fewer evaluations of the original system model and maintain good accuracy.     

A hybrid multiagent approach for global trajectory optimization

In this paper we consider a global optimization method for space trajectory design problems. The method, which actually aims at finding not only the global minimizer but a whole set of low-lying local minimizers (corresponding to a set of different design options), is based on a domain decomposition technique where each subdomain is evaluated through a procedure based on the evolution of a population of agents. The method is applied to two space trajectory design problems and compared with existing deterministic and stochastic global optimization methods.     

Approximate and Widespread Pareto Solutions in the Structure-Control Design of Mechatronic Systems

The structure-control design approach of mechatronic systems requires a different design formulation where the mechanical structure and control system are simultaneously designed. Optimization problems are commonly stated to confront the structure-control design formulation. Nevertheless, these problems are often very complex with a highly nonlinear dependence between the design variables and performance functions. This fact has made the use of evolutionary algorithms, a feasible alternative to solve the highly nonlinear optimization problem; the method to find the best solution is an open issue in the structure-control design approach. Hence, this paper presents a mechanism to exhaustively exploit the solutions in the differential evolution (DE) algorithm in order to find more non-dominated solutions with uniformly distributed Pareto front and better trade-offs in the structure-control design framework. The proposed approach adopts an external population to retain the non-dominated solutions found during the evolutionary process and includes a mechanism to mutate the individuals in their corresponding external population region. As a study case, the structure-control design of a serial-parallel manipulator with its control system is stated as a dynamic optimization problem and is solved by using the proposed approach. A comparative analysis shows that the multi-objective exhaustive exploitation differential evolution obtained a superior performance in the structure-control design framework than a DE algorithm which did not consider the proposal. Hence, the resulting designs provide better trade-offs between the structure-control performance functions.     

一种求解约束优化问题的改进差分进化算法

针对在处理约束优化问题时约束条件难以处理的问题,提出了一种求解约束优化问题的改进差分进化算法.即在每代进化前将群体分为可行个体和不可行个体两类,对不可行个体,用差量法将其逐个转化为可行个体,并保持种群规模不变,经过一序列的进化后,计算所有可行个体的适应度并找到问题的最优解.对5个经典函数进行了优化测试,测试结果表明提出的算法对求解约束优化问题是有效的.     

Self-adaptive differential evolution incorporating a heuristic mixing of operators

A considerable number of differential evolution variants have been proposed in the last few decades. However, no variant was able to consistently perform over a wide range of test problems. In this paper, propose two novel differential evolution based algorithms are proposed for solving constrained optimization problems. Both algorithms utilize the strengths of multiple mutation and crossover operators. The appropriate mix of the mutation and crossover operators, for any given problem, is determined through an adaptive learning process. In addition, to further accelerate the convergence of the algorithm, a local search technique is applied to a few selected individuals in each generation. The resulting algorithms are named as Self-Adaptive Differential Evolution Incorporating a Heuristic Mixing of Operators. The algorithms have been tested by solving 60 constrained optimization test instances. The results showed that the proposed algorithms have a competitive, if not better, performance in comparison to the-state-of-the-art algorithms.     

基于种群自适应调整的多目标差分进化算法

为提高已有多目标进化算法在求解复杂多目标优化问题上的收敛性和解集分布性,提出一种基于种群自适应调整的多目标差分进化算法。该算法设计一个种群扩增策略,它在决策空间生成一些新个体帮助搜索更优的非支配解;设计了一个种群收缩策略,它依据对非支配解集的贡献程度淘汰较差的个体以减少计算负荷,并预留一些空间给新的带有种群多样性的扰动个体;引入精英学习策略,防止算法陷入局部收敛。通过典型的多目标优化函数对算法进行测试验证,结果表明所提算法相对于其他算法具有明显的优势,其性能优越,能够在保证良好收敛性的同时,使获得的Pareto最优解集具有更均匀的分布性和更广的覆盖范围,尤其适合于高维复杂多目标优化问题的求解。     

Optimal coordination of directional over-current relays using informative differential evolution algorithm

Growing interconnection in distribution system creates new problem for protection engineers. Particularly the design of overcurrent relay coordination in such system is an independent area of research. With the availability of new artificial based optimization algorithm relay coordination research gain a new momentum. Well established artificial based optimization algorithm such as genetic and particle swam optimization are successfully applied for such applications. This paper discusses the application of informative differential evolution algorithm with self adaptive re-clustering technique for selection of TDS and PSM for optimal coordination of directional overcurrent relays. Both continuous as well as discrete version of informative differential evolution algorithm are used for optimization of relay setting. Proper combination of backup relays for each primary relay are identified by using LINKNET graph theory approach. Coordination of directional overcurrent is developed for 9 bus and IEEE 30 bus distribution systems. The aim of problem is to minimize the total operating time of primary relays and eliminate the miscoordination among the primary and backup relay pairs. Discrete types of settings for electromechanical types of relay are also discussed in this paper. Moreover, the relay coordination problem is modified for providing optimal coordination time interval between 0.2 and 0.8 s among all primary and backup relays pairs. The results are compared with hybrid of genetic algorithm – nonlinear programming and sequential quadratic programming. Digsilient power factory software is used for verification of result.