A novel evolution strategy for multiobjective optimization problem

Recent literatures have suggested that multiobjective evolutionary algorithms (MOEAs) can serve as a more exploratory and effective tool in solving multiobjective optimization problems (MOPs) than traditional optimizers. In order to contain a good approximation of Pareto optimal set with wide diversity associated with the inherent characters and variability of MOPs, this paper proposes a new evolutionary approach—(μ, λ) multiobjective evolution strategy ((μ, λ)-MOES). Following the highlight of how to balance proximity and diversity of individuals in exploration and exploitation stages respectively, some cooperative techniques are devised. Firstly, a novel combinatorial exploration operator that develops strong points from Gaussian mutation of proximity exploration and from Cauchy mutation of diversity preservation is elaborately designed. Additionally, we employ a complete nondominance selection so as to ensure maximal pressure for proximity exploitation while a fitness assignment determined by dominance and population diversity information is simultaneous used to ensure maximal diversity preservation. Moreover, a dynamic external archive is introduced to store elitist individuals as well as relatively better individuals and exchange information with the current population when performing archive increase scheme and archive decrease scheme. By graphical presentation and examination of selected performance metrics on three prominent benchmark test functions, (μ, λ)-MOES is found to outperform SPEA-II to some extent in terms of finding a near-optimal, well-extended and uniformly diversified Pareto optimal front.     

A novel grey forecasting model and its optimization

Although the grey forecasting model has been successfully employed in many fields and demonstrated promising results, its prediction results may be inaccurate sometimes. For the purposes of enhancing the predictive performance of grey forecasting model and enlarging its suitable ranges, this paper puts forward a novel grey forecasting model termed NGM model and its optimized model, develops a calculative formula for solving the parameters of the novel NGM model through the least squares method, and obtains the time response sequence of NGM model by using differential equation as a procedure for reasoning. It performs a numerical demonstration on the prediction accuracy of NGM model and its optimized models. As shown in the results, the proposed model and it optimized model can enhance the prediction accuracy. Numerical results illustrate that the proposed NGM model and its optimized model are effective. They are suitable for predicting the data sequence with the characteristics of non-homogeneous exponential law. This work makes important contribution to the enrichment of grey prediction theory.     

A travel demand management strategy: The downtown space reservation system

In this paper, a Travel Demand Management strategy known as the Downtown Space Reservation System (DSRS) is introduced. The purpose of this system is to facilitate the mitigation of traffic congestion in a cordon-based downtown area by requiring people who want to drive into this area to make reservations in advance. An integer programming formulation is provided to obtain the optimal mix of vehicles and trips that are characterized by a series of factors such as vehicle occupancy, departure time, and trip length with an objective of maximizing total system throughput and revenue. Based upon the optimal solution, an “intelligent” module is built using artificial neural networks that enables the transportation authority to make decisions in real time on whether to accept an incoming request. An example is provided that demonstrates that the solution of the “intelligent” module resembles the optimal solution with an acceptable error rate. Finally, implementation issues of the DSRS are addressed.     

Stock repurchase with an adaptive reservation price: A study of the greedy policy

We consider the problem of stock repurchase over a finite time horizon. We assume that a firm has a reservation price for the stock, which is the highest price that the firm is willing to pay to repurchase its own stock. We characterize the optimal policy for the trader to maximize the total number of shares that they can buy over a fixed time horizon. In particular, we study a greedy policy, which involves in each period buying a quantity that drives stock price to the reservation price.     

A global optimization algorithm using adaptive random search

A new random-search global optimization is described in which the variance of the step-size distribution is periodically optimized. By searching over a variance range of 8 to 10 decades, the algorithm finds the step-size distribution that yields the best local improvement in the criterion function. The variance search is then followed by a specified number of iterations of local random search where the step-size variance remains fixed. Periodic wide-range searches are introduced to ensure that the process does not stop at a local minimum. The sensitivity of the complete algorithm to various search parameters is investigated experimentally for a specific test problem. The ability of the method to locate global minima is illustrated by an example. The method also displays considerable problem independence, as demonstrated by two large and realistic example problems: (1) the identification of 25 parameters in a nonlinear model of a five-degrees-of-freedom mechanical dynamic system and (2) solution of a 24-parameter inverse problem required to identify a pulse train whose frequency spectrum matched a desired reference spectrum.     

A new adaptive Barzilai and Borwein method for unconstrained optimization

In this paper we view the Barzilai and Borwein (BB) method from a new angle, and present a new adaptive Barzilai and Borwein (NABB) method with a nonmonotone line search for general unconstrained optimization. In the proposed method, the scalar approximation to the Hessian matrix is updated by the Broyden class formula to generate an adaptive stepsize. It is remarkable that the new stepsize is chosen adaptively in the interval which contains the two well-known BB stepsizes. Moreover, for the negative curvature direction, a strategy for the choice of the stepsize is designed to accelerate the convergence rate of the NABB method. Furthermore, we apply the NABB method without any line search to strictly convex quadratic minimization. The numerical experiments show the NABB method is very promising.     

Pure adaptive search in global optimization

Pure adaptive seach iteratively constructs a sequence of interior points uniformly distributed within the corresponding sequence of nested improving regions of the feasible space. That is, at any iteration, the next point in the sequence is uniformly distributed over the region of feasible space containing all points that are strictly superior in value to the previous points in the sequence. The complexity of this algorithm is measured by the expected number of iterations required to achieve a given accuracy of solution. We show that for global mathematical programs satisfying the Lipschitz condition, its complexity increases at mostlinearly in the dimension of the problem.This work was supported in part by NATO grant 0119/89.     

A cooperative strategy for solving dynamic optimization problems

Optimization in dynamic environments is a very active and important area which tackles problems that change with time (as most real-world problems do). In this paper we present a new centralized cooperative strategy based on trajectory methods (tabu search) for solving Dynamic Optimization Problems (DOPs). Two additional methods are included for comparison purposes. The first method is a Particle Swarm Optimization variant with multiple swarms and different types of particles where there exists an implicit cooperation within each swarm and competition among different swarms. The second method is an explicit decentralized cooperation scheme where multiple agents cooperate to improve a grid of solutions. The main goals are: firstly, to assess the possibilities of trajectory methods in the context of DOPs, where populational methods have traditionally been the recommended option; and secondly, to draw attention on explicitly including cooperation schemes in methods for DOPs. The results show how the proposed strategy can consistently outperform the results of the two other methods.     

A fully adaptive hybrid optimization of aircraft engine blades

A new fully adaptive hybrid optimization method (AHM) has been developed and applied to an industrial problem in the field of the aircraft engine industry. The adaptivity of the coupling between a global search by a population-based method (Genetic Algorithms or Evolution Strategies) and the local search by a descent method has been particularly emphasized. On various analytical test cases, the AHM method overperforms the original global search method in terms of computational time and accuracy. The results obtained on the industrial case have also confirmed the interest of AHM for the design of new and original solutions in an affordable time.     

A novel elitist multiobjective optimization algorithm: Multiobjective extremal optimization

Recently, a general-purpose local-search heuristic method called extremal optimization (EO) has been successfully applied to some NP-hard combinatorial optimization problems. This paper presents an investigation on EO with its application in numerical multiobjective optimization and proposes a new novel elitist (1 + λ) multiobjective algorithm, called multiobjective extremal optimization (MOEO). In order to extend EO to solve the multiobjective optimization problems, the Pareto dominance strategy is introduced to the fitness assignment of the proposed approach. We also present a new hybrid mutation operator that enhances the exploratory capabilities of our algorithm. The proposed approach is validated using five popular benchmark functions. The simulation results indicate that the proposed approach is highly competitive with the state-of-the-art multiobjective evolutionary algorithms. Thus MOEO can be considered a good alternative to solve numerical multiobjective optimization problems.     

A new adaptive trust region algorithm for optimization problems

It is well known that trust region methods are very effective for optimization problems. In this article, a new adaptive trust region method is presented for solving unconstrained optimization problems. The proposed method combines a modified secant equation with the BFGS updated formula and an adaptive trust region radius, where the new trust region radius makes use of not only the function information but also the gradient information. Under suitable conditions, global convergence is proved, and we demonstrate the local superlinear convergence of the proposed method. The numerical results indicate that the proposed method is very efficient.     

A novel bee swarm optimization algorithm for numerical function optimization

The optimization algorithms which are inspired from intelligent behavior of honey bees are among the most recently introduced population based techniques. In this paper, a novel algorithm called bee swarm optimization, or BSO, and its two extensions for improving its performance are presented. The BSO is a population based optimization technique which is inspired from foraging behavior of honey bees. The proposed approach provides different patterns which are used by the bees to adjust their flying trajectories. As the first extension, the BSO algorithm introduces different approaches such as repulsion factor and penalizing fitness (RP) to mitigate the stagnation problem. Second, to maintain efficiently the balance between exploration and exploitation, time-varying weights (TVW) are introduced into the BSO algorithm. The proposed algorithm (BSO) and its two extensions (BSO–RP and BSO–RPTVW) are compared with existing algorithms which are based on intelligent behavior of honey bees, on a set of well known numerical test functions. The experimental results show that the BSO algorithms are effective and robust; produce excellent results, and outperform other algorithms investigated in this consideration.     

Axiomatic characterization of a global optimization algorithm and investigation of its search strategy

A new axiomatic characterization of a rational algorithm for global minimization based on a statistical model of the objective function is suggested. The globality of the search strategy of such an algorithm is investigated as well as the convergence of the algorithm.     

A novel hybrid differential evolution and particle swarm optimization algorithm for unconstrained optimization

An algorithm called DE-PSO is proposed which incorporates concepts from DE and PSO, updating particles not only by DE operators but also by mechanisms of PSO. The proposed algorithm is tested on several benchmark functions. Numerical comparisons with different hybrid meta-heuristics demonstrate its effectiveness and efficiency.     

Pure adaptive search in monte carlo optimization

Pure adaptive search constructs a sequence of points uniformly distributed within a corresponding sequence of nested regions of the feasible space. At any stage, the next point in the sequence is chosen uniformly distributed over the region of feasible space containing all points that are equal or superior in value to the previous points in the sequence. We show that for convex programs the number of iterations required to achieve a given accuracy of solution increases at most linearly in the dimension of the problem. This compares to exponential growth in iterations required for pure random search.     

Embedding evolutionary strategy in ordinal optimization for hard optimization problems

This work proposes a method for embedding evolutionary strategy (ES) in ordinal optimization (OO), abbreviated as ESOO, for solving real-time hard optimization problems with time-consuming evaluation of the objective function and a huge discrete solution space. Firstly, an approximate model that is based on a radial basis function (RBF) network is utilized to evaluate approximately the objective value of a solution. Secondly, ES associated with the approximate model is applied to generate a representative subset from a huge discrete solution space. Finally, the optimal computing budget allocation (OCBA) technique is adopted to select the best solution in the representative subset as the obtained “good enough” solution. The proposed method is applied to a hotel booking limits (HBL) problem, which is formulated as a stochastic combinatorial optimization problem with a huge discrete solution space. The good enough booking limits, obtained by the proposed method, have promising solution quality, and the computational efficiency of the method makes it suitable for real-time applications. To demonstrate the computational efficiency of the proposed method and the quality of the obtained solution, it is compared with two competing methods – the canonical ES and the genetic algorithm (GA). Test results demonstrate that the proposed approach greatly outperforms the canonical ES and GA.     

A study of singular spectrum analysis with global optimization techniques

Singular spectrum analysis has recently become an attractive tool in a broad range of applications. Its main mechanism of alternating between rank reduction and Hankel projection to produce an approximation to a particular component of the original time series, however, deserves further mathematical justification. One paramount question to ask is how good an approximation that such a straightforward apparatus can provide when comparing to the absolute optimal solution. This paper reexamines this issue by exploiting a natural parametrization of a general Hankel matrix via its Vandermonde factorization. Such a formulation makes it possible to recast the notion of singular spectrum analysis as a semi-linear least squares problem over a compact feasible set, whence global optimization techniques can be employed to find the absolute best approximation. This framework might not be immediately suitable for practical application because global optimization is expectedly more expensive, but it does provide a theoretical baseline for comparison. As such, our empirical results indicate that the simpler SSA algorithm usually is amazingly sufficient as a handy tool for constructing exploratory model. The more complicated global methods could be used as an alternative of rigorous affirmative procedure for verifying or assessing the quality of approximation.     

A multi-start opposition-based particle swarm optimization algorithm with adaptive velocity for bound constrained global optimization

In this paper we present a multi-start particle swarm optimization algorithm for the global optimization of a function subject to bound constraints. The procedure consists of three main steps. In the initialization phase, an opposition learning strategy is performed to improve the search efficiency. Then a variant of the adaptive velocity based on the differential operator enhances the optimization ability of the particles. Finally, a re-initialization strategy based on two diversity measures for the swarm is act in order to avoid premature convergence and stagnation. The strategy uses the super-opposition paradigm to re-initialize particles in the swarm. The algorithm has been evaluated on a set of 100 global optimization test problems. Comparisons with other global optimization methods show the robustness and effectiveness of the proposed algorithm.