A novel hybrid differential evolution and particle swarm optimization algorithm for unconstrained optimization

An algorithm called DE-PSO is proposed which incorporates concepts from DE and PSO, updating particles not only by DE operators but also by mechanisms of PSO. The proposed algorithm is tested on several benchmark functions. Numerical comparisons with different hybrid meta-heuristics demonstrate its effectiveness and efficiency.     

A dynamic clustering based differential evolution algorithm for global optimization

A dynamic clustering based differential evolution algorithm (CDE) for global optimization is proposed to improve the performance of the differential evolution (DE) algorithm. With population evolution, CDE algorithm gradually changes from exploring promising areas at the early stages to exploiting solution with high precision at the later stages. Experiments on 28 benchmark problems, including 13 high dimensional functions, show that the new method is able to find near optimal solutions efficiently. Compared with other existing algorithms, CDE improves solution accuracy with less computational effort.     

Empirical analysis of self-adaptive differential evolution

Differential evolution (DE) is generally considered as a reliable, accurate, robust and fast optimization technique. DE has been successfully applied to solve a wide range of numerical optimization problems. However, the user is required to set the values of the control parameters of DE for each problem. Such parameter tuning is a time consuming task. In this paper, a self-adaptive DE (SDE) algorithm which eliminates the need for manual tuning of control parameters is empirically analyzed. The performance of SDE is investigated and compared with other well-known approaches. The experiments conducted show that SDE generally outperform other DE algorithms in all the benchmark functions. Moreover, the performance of SDE using the ring neighborhood topology is investigated.     

A hybrid shuffled complex evolution approach based on differential evolution for unconstrained optimization

Numerous optimization methods have been proposed for the solution of the unconstrained optimization problems, such as mathematical programming methods, stochastic global optimization approaches, and metaheuristics. In this paper, a metaheuristic algorithm called Modified Shuffled Complex Evolution (MSCE) is proposed, where an adaptation of the Downhill Simplex search strategy combined with the differential evolution method is proposed. The efficiency of the new method is analyzed in terms of the mean performance and computational time, in comparison with the genetic algorithm using floating-point representation (GAF) and the classical shuffled complex evolution (SCE-UA) algorithm using six benchmark optimization functions. Simulation results and the comparisons with SCE-UA and GAF indicate that the MSCE improves the search performance on the five benchmark functions of six tested functions.     

Quasi-sure analysis of two-parameter stochastic differential equations

We prove a Stroock-Varadhan type quasi-sure limit theorem for stochastic differential equations in the plane.     

New mutation schemes for differential evolution algorithm and their application to the optimization of directional over-current relay settings

Differential evolution is a novel evolutionary approach capable of handling non-differentiable, nonlinear and multimodal objective functions. It has been consistently ranked as one of the best search algorithm for solving global optimization problems in several case studies. In the present study we propose five new mutation schemes for the basic DE algorithm. The corresponding versions are termed as MDE1, MDE2, MDE3, MDE4 and MDE5. These new schemes make use of the absolute weighted difference between the two points and instead of using a fixed scaling factor F, use a scaling factor following the Laplace distribution. The performance of the proposed schemes is validated empirically on a suit of ten benchmark problems having box constraints. Numerical analysis of results shows that the proposed schemes improves the convergence rate of the DE algorithm and also maintains the quality of solution. Efficiency of the proposed schemes is further validated by applying it to a real life electrical engineering problem dealing with the optimization of directional over-current relay settings. It is a highly constrained nonlinear optimization problem. A constraint handling mechanism based on repair methods is used for handling the constraints. Once again the simulation results show the compatibility of the proposed schemes for solving the real life problem.     

A variance reduction technique for use with the extrapolated Euler method for numerical solution of stochastic differential equations

A simple, effective technique is described and tested for reducing the variation in estimated expectations of functions of functions of solutions of stochastic differential equations. The technique is implemented with extrapolated Euler method for numerical solution of stochastic differential equations     

A hybrid differential evolution algorithm to vehicle routing problem with fuzzy demands

In this paper, the vehicle routing problem with fuzzy demands (VRPFD) is considered, and a fuzzy chance constrained program model is designed, based on fuzzy credibility theory. Then stochastic simulation and differential evolution algorithm are integrated to design a hybrid intelligent algorithm to solve the fuzzy chance constrained program model. Moreover, the influence of the dispatcher preference index on the final objective of the problem is discussed using stochastic simulation, and the best value of the dispatcher preference index is obtained.     

A stochastic manpower planning model under varying class sizes

Solution related to different types of manpower planning problems arising in different industries and organizations are very much helpful for proper planning and implementation of different objectives. Previously those type of problems are mostly solved under the deterministic set up. Gradually several scientists have developed different types of stochastic models appropriate for solving such types of problems. The present study is an attempt to develop a stochastic manpower planning model under the set up where the classes are of varying sizes and promotion occurs only on the basis of seniority. The work of second author was supported by a research fellowship from Council of Scientific and Industrial Research (Sanction No. 9/28(611)/2003-EMR-I), India.     

Convergence analysis of a global optimization algorithm using stochastic differential equations

We establish the convergence of a stochastic global optimization algorithm for general non-convex, smooth functions. The algorithm follows the trajectory of an appropriately defined stochastic differential equation (SDE). In order to achieve feasibility of the trajectory we introduce information from the Lagrange multipliers into the SDE. The analysis is performed in two steps. We first give a characterization of a probability measure (Π) that is defined on the set of global minima of the problem. We then study the transition density associated with the augmented diffusion process and show that its weak limit is given by Π.     

Bare bones differential evolution

The barebones differential evolution (BBDE) is a new, almost parameter-free optimization algorithm that is a hybrid of the barebones particle swarm optimizer and differential evolution. Differential evolution is used to mutate, for each particle, the attractor associated with that particle, defined as a weighted average of its personal and neighborhood best positions. The performance of the proposed approach is investigated and compared with differential evolution, a Von Neumann particle swarm optimizer and a barebones particle swarm optimizer. The experiments conducted show that the BBDE provides excellent results with the added advantage of little, almost no parameter tuning. Moreover, the performance of the barebones differential evolution using the ring and Von Neumann neighborhood topologies is investigated. Finally, the application of the BBDE to the real-world problem of unsupervised image classification is investigated. Experimental results show that the proposed approach performs very well compared to other state-of-the-art clustering algorithms in all measured criteria.     

Using Competitive Population Evaluation in a differential evolution algorithm for dynamic environments

This paper proposes two adaptations to DynDE, a differential evolution-based algorithm for solving dynamic optimization problems. The first adapted algorithm, Competitive Population Evaluation (CPE), is a multi-population DE algorithm aimed at locating optima faster in the dynamic environment. This adaptation is based on allowing populations to compete for function evaluations based on their performance. The second adapted algorithm, Reinitialization Midpoint Check (RMC), is aimed at improving the technique used by DynDE to maintain populations on different peaks in the search space. A combination of the CPE and RMC adaptations is investigated. The new adaptations are empirically compared to DynDE using various problem sets. The empirical results show that the adaptations constitute an improvement over DynDE and compares favorably to other approaches in the literature. The general applicability of the adaptations is illustrated by incorporating the combination of CPE and RMC into another Differential Evolution-based algorithm, jDE, which is shown to yield improved results.     

Linearized perturbation method for stochastic analysis of a rill erosion model

The linearization and correction method (LCM) proposed by He is a simple and effective perturbation technique to solve nonlinear equations. To analyze the random properties of rill erosion model, a new stochastic perturbation technique called linearized perturbation method is developed by combining the traditional stochastic perturbation method with the LCM. Comparisons between the numerical results obtained by the linearized perturbation method and those obtained by Monte Carlo method indicated an excellent agreement. However, the calculation efficiency of the linearized perturbation method is higher.     

Gbest-guided artificial bee colony algorithm for numerical function optimization

Artificial bee colony (ABC) algorithm invented recently by Karaboga is a biological-inspired optimization algorithm, which has been shown to be competitive with some conventional biological-inspired algorithms, such as genetic algorithm (GA), differential evolution (DE) and particle swarm optimization (PSO). However, there is still an insufficiency in ABC algorithm regarding its solution search equation, which is good at exploration but poor at exploitation. Inspired by PSO, we propose an improved ABC algorithm called gbest-guided ABC (GABC) algorithm by incorporating the information of global best (gbest) solution into the solution search equation to improve the exploitation. The experimental results tested on a set of numerical benchmark functions show that GABC algorithm can outperform ABC algorithm in most of the experiments.     

Optimal coordination of directional over-current relays using informative differential evolution algorithm

Growing interconnection in distribution system creates new problem for protection engineers. Particularly the design of overcurrent relay coordination in such system is an independent area of research. With the availability of new artificial based optimization algorithm relay coordination research gain a new momentum. Well established artificial based optimization algorithm such as genetic and particle swam optimization are successfully applied for such applications. This paper discusses the application of informative differential evolution algorithm with self adaptive re-clustering technique for selection of TDS and PSM for optimal coordination of directional overcurrent relays. Both continuous as well as discrete version of informative differential evolution algorithm are used for optimization of relay setting. Proper combination of backup relays for each primary relay are identified by using LINKNET graph theory approach. Coordination of directional overcurrent is developed for 9 bus and IEEE 30 bus distribution systems. The aim of problem is to minimize the total operating time of primary relays and eliminate the miscoordination among the primary and backup relay pairs. Discrete types of settings for electromechanical types of relay are also discussed in this paper. Moreover, the relay coordination problem is modified for providing optimal coordination time interval between 0.2 and 0.8 s among all primary and backup relays pairs. The results are compared with hybrid of genetic algorithm – nonlinear programming and sequential quadratic programming. Digsilient power factory software is used for verification of result.     

Differential evolution with preferential crossover

We study the mutation operation of the differential evolution algorithm. In particular, we study the effect of the scaling parameter of the differential vector in mutation. We derive the probability density function of points generated by mutation and thereby identify some drawbacks of the scaling parameter. We also visualize the drawbacks using simulation. We then propose a crossover rule, called the preferential crossover rule, to reduce the drawbacks. The preferential crossover rule uses points from an auxiliary population set. We also introduce a variable scaling parameter in mutation. Motivations for these changes are provided. A numerical study is carried out using 50 test problems, many of which are inspired by practical applications. Numerical results suggest that the proposed modification reduces the number of function evaluations and cpu time considerably.     

Multi-innovation stochastic gradient algorithm for multiple-input single-output systems using the auxiliary model

In order to reduce computational burden and improve the convergence rate of identification algorithms, an auxiliary model based multi-innovation stochastic gradient (AM-MISG) algorithm is derived for the multiple-input single-output systems by means of the auxiliary model identification idea and multi-innovation identification theory. The basic idea is to replace the unknown outputs of the fictitious subsystems in the information vector with the outputs of the auxiliary models and to present an auxiliary model based stochastic gradient algorithm, and then to derive the AM-MISG algorithm by expanding the scalar innovation to innovation vector and introducing the innovation length. The simulation example shows that the proposed algorithms work quite well.     

Convergence of a stochastic approximation algorithm for the GI/G/1 queue using infinitesimal perturbation analysis

Discrete-event systems to which the technique of infinitesimal perturbation analysis (IPA) is applicable are natural candidates for optimization via a Robbins-Monro type stochastic approximation algorithm. We establish a simple framework for single-run optimization of systems with regenerative structure. The main idea is to convert the original problem into one in which unbiased estimators can be derived from strongly consistent IPA gradient estimators. Standard stochastic approximation results can then be applied. In particular, we consider the GI/G/1 queue, for which IPA gives strongly consistent estimators for the derivative of the mean system time. Convergence (w.p.1) proofs for the problem of minimizing the mean system time with respect to a scalar service time parameter are presented.     

Employing stochastic differential equations to model wildlife motion

The concern is with the properties of stochastic differential equations (SDEs) describing the motion of particles in 3 dimensional space, on the sphere or in the plane. There is consideration of the case where the drift function comes from a potential function. There is study of SDEs whose parameters are periodic in time. These are useful for incorporating circadian rhythm in the behavior. The cases of a seal in a frozen lake in Alaska, an elephant seal migrating a great distance in the Pacific Ocean and of a group of "free-ranging" elk in a reserve in Oregon are referred to. For the elk nonparametric estimates of the drift and variance terms of an SDE model are discussed and evaluated and the fit of the model assessed. One issue is how to include explanatories, beyond location and time, in the model. A number of questions motivated by the wildlife motion concerning diffusion processes of the type considered are posed at the end of the paper. Received: 25 April 2002     

A multistage differential transformation method for approximate solution of Hantavirus infection model

The goal of this study is presented a reliable algorithm based on the standard differential transformation method (DTM), which is called the multi-stage differential transformation method (MsDTM) for solving Hantavirus infection model. The results obtanied by using MsDTM are compared to those obtained by using the Runge-Kutta method (R-K-method). The proposed technique is a hopeful tool to solving for a long time intervals in this kind of systems.