A hybrid method for quantum global optimization

This paper gives a quantum algorithm for global optimization. The heart of such approaches employ Grover’s database search (1996; Phys Rev Lett 79(23):4709–4712, 1997a; 79(2):325–328, 1997b). Chi and Kim (1998) show that when the phases of the generalized Grover database search operator are optimally chosen, it is capable of finding a solution by a single query. To apply this method to global optimization requires knowledge of the number of marked points m to calculate the optimal phases, but this value is seldom known. This paper focuses on overcoming this hurdle by showing that an estimate of the optimal phases can be found and used to replace the optimal phases while maintaining a high probability of finding a solution. Merging this finding with a recently discovered dynamic quantum global optimization algorithm (BBW2D) that reduces the problem to finding successively improving regions using Grover’s search, we present a hybrid method that improves the efficiency and reduces the variance of the search algorithm when empirically compared to other existing quantum search algorithms.     

Implementing pure adaptive search for global optimization using Markov chain sampling

The Pure Adaptive Search (PAS) algorithm for global optimization yields a sequence of points, each of which is uniformly distributed in the level set corresponding to its predecessor. This algorithm has the highly desirable property of solving a large class of global optimization problems using a number of iterations that increases at most linearly in the dimension of the problem. Unfortunately, PAS has remained of mostly theoretical interest due to the difficulty of generating, in each iteration, a point uniformly distributed in the improving feasible region. In this article, we derive a coupling equivalence between generating an approximately uniformly distributed point using Markov chain sampling, and generating an exactly uniformly distributed point with a certain probability. This result is used to characterize the complexity of a PAS-implementation as a function of (a) the number of iterations required by PAS to achieve a certain solution quality guarantee, and (b) the complexity of the sampling algorithm used. As an application, we use this equivalence to show that PAS, using the so-called Random ball walk Markov chain sampling method for generating nearly uniform points in a convex region, can be used to solve most convex programming problems in polynomial time.     

Reliability and Performance of UEGO, a Clustering-based Global Optimizer

UEGO is a general clustering technique capable of accelerating and/or parallelizing existing search methods. UEGO is an abstraction of GAS, a genetic algorithm (GA) with subpopulation support, so the niching (i.e. clustering) technique of GAS can be applied along with any kind of optimizers, not only genetic algorithm. The aim of this paper is to analyze the behavior of the algorithm as a function of different parameter settings and types of functions and to examine its reliability with the help of Csendes' method. Comparisons to other methods are also presented.     

A new hybrid classical-quantum algorithm for continuous global optimization problems

Grover’s algorithm can be employed in global optimization methods providing, in some cases, a quadratic speedup over classical algorithms. This paper describes a new method for continuous global optimization problems that uses a classical algorithm for finding a local minimum and Grover’s algorithm to escape from this local minimum. Such algorithms will be useful when quantum computers of reasonable size are available. Simulations with testbed functions and comparisons with algorithms from the literature are presented.     

Two new algorithms for solving optimization problems with one linear objective function and finitely many constraints of fuzzy relation inequalities

This paper studies the optimization model of a linear objective function subject to a system of fuzzy relation inequalities (FRI) with the max-Einstein composition operator. If its feasible domain is non-empty, then we show that its feasible solution set is completely determined by a maximum solution and a finite number of minimal solutions. Also, an efficient algorithm is proposed to solve the model based on the structure of FRI path, the concept of partial solution, and the branch-and-bound approach. The algorithm finds an optimal solution of the model without explicitly generating all the minimal solutions. Some sufficient conditions are given that under them, some of the optimal components of the model are directly determined. Some procedures are presented to reduce the search domain of an optimal solution of the original problem based on the conditions. Then the reduced domain is decomposed (if possible) into several sub-domains with smaller dimensions that finding the components of the optimal solution in each sub-domain is very easy. In order to obtain an optimal solution of the original problem, we propose another more efficient algorithm which combines the first algorithm, these procedures, and the decomposition method. Furthermore, sufficient conditions are suggested that under them, the problem has a unique optimal solution. Also, a comparison between the recently proposed algorithm and the known ones will be made.     

Descent Direction Stochastic Approximation Algorithm with Adaptive Step Sizes

A stochastic approximation (SA) algorithm with new adaptive step sizes for solving unconstrained minimization problems in noisy environment is proposed. New adaptive step size scheme uses ordered statistics of fixed number of previous noisy function values as a criterion for accepting good and rejecting bad steps. The scheme allows the algorithm to move in bigger steps and avoid steps proportional to $1/k$ when it is expected that larger steps will improve the performance. An algorithm with the new adaptive scheme is defined for a general descent direction. The almost sure convergence is established. The performance of new algorithm is tested on a set of standard test problems and compared with relevant algorithms. Numerical results support theoretical expectations and verify efficiency of the algorithm regardless of chosen search direction and noise level. Numerical results on problems arising in machine learning are also presented. Linear regression problem is considered using real data set. The results suggest that the proposed algorithm shows promise.     

A globally convergent version of the Polak-Ribière conjugate gradient method

In this paper we propose a new line search algorithm that ensures global convergence of the Polak-Ribière conjugate gradient method for the unconstrained minimization of nonconvex differentiable functions. In particular, we show that with this line search every limit point produced by the Polak-Ribière iteration is a stationary point of the objective function. Moreover, we define adaptive rules for the choice of the parameters in a way that the first stationary point along a search direction can be eventually accepted when the algorithm is converging to a minimum point with positive definite Hessian matrix. Under strong convexity assumptions, the known global convergence results can be reobtained as a special case. From a computational point of view, we may expect that an algorithm incorporating the step-size acceptance rules proposed here will retain the same good features of the Polak-Ribière method, while avoiding pathological situations. This research was supported by Agenzia Spaziale Italiana, Rome, Italy.     

A finite concave minimization algorithm using branch and bound and neighbor generation

In this article we present a new finite algorithm for globally minimizing a concave function over a compact polyhedron. The algorithm combines a branch and bound search with a new process called neighbor generation. It is guaranteed to find an exact, extreme point optimal solution, does not require the objective function to be separable or even analytically defined, requires no nonlinear computations, and requires no determinations of convex envelopes or underestimating functions. Linear programs are solved in the branch and bound search which do not grow in size and differ from one another in only one column of data. Some preliminary computational experience is also presented.     

Convergence guarantees for generalized adaptive stochastic search methods for continuous global optimization

This paper presents some simple technical conditions that guarantee the convergence of a general class of adaptive stochastic global optimization algorithms. By imposing some conditions on the probability distributions that generate the iterates, these stochastic algorithms can be shown to converge to the global optimum in a probabilistic sense. These results also apply to global optimization algorithms that combine local and global stochastic search strategies and also those algorithms that combine deterministic and stochastic search strategies. This makes the results applicable to a wide range of global optimization algorithms that are useful in practice. Moreover, this paper provides convergence conditions involving the conditional densities of the random vector iterates that are easy to verify in practice. It also provides some convergence conditions in the special case when the iterates are generated by elliptical distributions such as the multivariate Normal and Cauchy distributions. These results are then used to prove the convergence of some practical stochastic global optimization algorithms, including an evolutionary programming algorithm. In addition, this paper introduces the notion of a stochastic algorithm being probabilistically dense in the domain of the function and shows that, under simple assumptions, this is equivalent to seeing any point in the domain with probability 1. This, in turn, is equivalent to almost sure convergence to the global minimum. Finally, some simple results on convergence rates are also proved.     

一类拟牛顿非单调信赖域算法及其收敛性

本文提出了一类求解无约束最优化问题的非单调信赖域算法.将非单调Wolfe线搜索技术与信赖域算法相结合,使得新算-法不仅不需重解子问题,而且在每步迭代都满足拟牛顿方程同时保证目标函数的近似Hasse阵Bk的正定性.在适当的条件下,证明了此算法的全局收敛性.数值结果表明该算法的有效性.     

A Hybrid Particle Swarm Optimization Algorithm for the Redundancy Allocation Problem

The Redundancy Allocation Problem generally involves the selection of components with multiple choices and redundancy levels that produce maximum system reliability given various system level constraints as cost and weight. In this paper we investigate the series–parallel redundant reliability problems, when a mixing of components was considered. In this type of problem both the number of redundancy components and the corresponding component reliability in each subsystem are to be decided simultaneously so as to maximise the reliability of system. A hybrid algorithm is based on particle swarm optimization and local search algorithm. In addition, we propose an adaptive penalty function which encourages our algorithm to explore within the feasible region and near feasible region, and discourage search beyond that threshold. The effectiveness of our proposed hybrid PSO algorithm is proved on numerous variations of three different problems and compared to Tabu Search and Multiple Weighted Objectives solutions.     

Importance of search-domain reduction in random optimization

The importance of incorporating systematic search-domain reduction into random optimization is illustrated. In the absence of domain reduction, even an enormous number of function evaluations does not ensure convergence sufficiently close to the optimum as was recently reported by Sarma. However, when the search domain is reduced systematically after every iteration as recommended by Luus and Jaakola, convergence is obtained in a relatively small number of function evaluations, even when the initial search region is large and the starting point is far from the optimum.     

A Line Search and Trust Region Algorithm with Trust Region Radius Converging to Zero

In this paper, we present a new line search and trust region algorithm for unconstrained optimization problem with the trust region radius converging to zero. The new trust region algorithm performs a backtracking line search from the failed, point instead of resolving the subproblem when the trial step results in an increase in the objective function. We show that the algorithm preserves the convergence properties of the traditional trust region algorithms. Numerical results are also given.     

Eigenvalues of Quantum Walks of Grover and Fourier Types

A necessary and sufficient conditions for a certain class of periodic unitary transition operators to have eigenvalues are given. Applying this, it is shown that Grover walks in any dimension has both of \(\pm \, 1\) as eigenvalues and it has no other eigenvalues. It is also shown that the lazy Grover walks in any dimension has 1 as an eigenvalue, and it has no other eigenvalues. As a result, a localization phenomenon occurs for these quantum walks. A general conditions for the existence of eigenvalues can be applied also to certain quantum walks of Fourier type. It is shown that the two-dimensional Fourier walk does not have eigenvalues and hence it is not localized at any point. Some other topics, such as Grover walks on the triangular lattice, products and deformations of Grover walks, are also discussed.

     

CFD-based optimization of fuel injection strategies in a diesel engine using an adaptive gradient method

A computationally efficient computational fluid dynamics (CFD)-based optimization method with the capability of finding optimal engine operating conditions with respect to emissions and fuel consumption has been developed. The approach taken uses a steepest descent method for an adaptive cost function, where the line search is performed with a backtracking algorithm. The backtracking algorithm utilizes quadratic and cubic polynomials to accelerate the convergence, and the initial backtracking step employs an adaptive step size mechanism which depends on the steepness of the search direction. The adaptive cost function is based on the penalty method such that the penalty term is stiffened after every line search. The engine simulations are performed with a KIVA-3-based CFD code which is equipped with well-established spray, combustion and emission models. The application of this optimization tool is demonstrated for a non-road, medium-speed DI diesel engine which, for these simulations, utilizes a multi-orifice, asynchronous injection system. It has been demonstrated that this new injection method has a large potential for reducing emissions while maintaining a low fuel consumption. In addition, this optimization approach is computationally very efficient when good enough initial values are available.     

A Modification to the New Version of the Price’s Algorithm for Continuous Global Optimization Problems

This paper presents an algorithm for finding a global minimum of a multimodal, multivariate and nondifferentiable function. The algorithm is a modification to the new version of the Price’s algorithm given in Brachetti et al. [J. Global Optim. 10, 165–184 (1997)]. Its distinguishing features include: (1) The number-theoretic method is applied to generate the initial population so that the points in the initial population are uniformly scattered, and therefore the algorithm could explore uniformly the region of interest at the initial iteration; (2) The simplified quadratic approximation with the three best points is employed to improve the local search ability and the accuracy of the minimum function value, and to reduce greatly the computational overhead of the algorithm. Two sets of experiments are carried out to illustrate the efficiency of the number-theoretic method and the simplified quadratic model separately. The proposed algorithm has also been compared with the original one by solving a wide set of benchmark problems. Numerical results show that the proposed algorithm requires a smaller number of function evaluations and, in many cases, yields a smaller or more accurate minimum function value. The algorithm can also be used to deal with the medium size optimization problems.     

Backtracking Adaptive Search: Distribution of Number of Iterations to Convergence

Backtracking adaptive search is a simplified stochastic optimiza-tion procedure which permits the acceptance of worsening objective function values. It generalizes the hesitant adaptive search, which in turn is a gener-alization of the pure adaptive search. In this paper, we use ideas from the theory of stochastic processes to determine the full distribution of the number of iterations to convergence for the backtracking adaptive search.Communicated by P. M. PardalosThe authors thank theMarsden Fund of the Royal Society of New Zealand for support of this research. The fourth author was supported by a Bright Future Scholarship administered by the Foundation for Research, Science and Technology.     

一类带线搜索的非单调信赖域新算法

结合非单调信赖域方法,和非单调线搜索技术,提出了一种新的无约束优化算法.信赖域方法的每一步采用线搜索,使得迭代每一步都充分下降加快了迭代速度.在一定条件下,证明了算法具有全局收敛性和局部超线性.收敛速度.数值试验表明算法是十分有效的.     

Adaptive nonmonotone line search method for unconstrained optimization

In this paper, an adaptive nonmonotone line search method for unconstrained minimization problems is proposed. At every iteration, the new algorithm selects only one of the two directions: a Newton-type direction and a negative curvature direction, to perform the line search. The nonmonotone technique is included in the backtracking line search when the Newton-type direction is the search direction. Furthermore, if the negative curvature direction is the search direction, we increase the steplength under certain conditions. The global convergence to a stationary point with second-order optimality conditions is established. Some numerical results which show the efficiency of the new algorithm are reported.      

Floating boundary particle swarm optimization algorithm

A new modification to the particle swarm optimization (PSO) algorithm is proposed aiming to make the algorithm less sensitive to selection of the initial search domain. To achieve this goal, we release the boundaries of the search domain and enable each boundary to drift independently, guided by the number of collisions with particles involved in the optimization process. The gradual modification of the active search domain range enables us to prevent particles from revisiting less promising regions of the search domain and also to explore the areas located outside the initial search domain. With time, the search domain shrinks around a region holding a global extremum. This helps improve the quality of the final solution obtained. It also makes the algorithm less sensitive to initial choice of the search domain ranges. The effectiveness of the proposed Floating Boundary PSO (FBPSO) is demonstrated using a set of standard test functions. To control the performance of the algorithm, new parameters are introduced. Their optimal values are determined through numerical examples.