A discrete dynamic convexized method for nonlinear integer programming

In this paper, we consider the box constrained nonlinear integer programming problem. We present an auxiliary function, which has the same discrete global minimizers as the problem. The minimization of the function using a discrete local search method can escape successfully from previously converged discrete local minimizers by taking increasing values of a parameter. We propose an algorithm to find a global minimizer of the box constrained nonlinear integer programming problem. The algorithm minimizes the auxiliary function from random initial points. We prove that the algorithm can converge asymptotically with probability one. Numerical experiments on a set of test problems show that the algorithm is efficient and robust.     

A cut-peak function method for global optimization

A new method is proposed for solving box constrained global optimization problems. The basic idea of the method is described as follows: Constructing a so-called cut-peak function and a choice function for each present minimizer, the original problem of finding a global solution is converted into an auxiliary minimization problem of finding local minimizers of the choice function, whose objective function values are smaller than the previous ones. For a local minimum solution of auxiliary problems this procedure is repeated until no new minimizer with a smaller objective function value could be found for the last minimizer. Construction of auxiliary problems and choice of parameters are relatively simple, so the algorithm is relatively easy to implement, and the results of the numerical tests are satisfactory compared to other methods.     

A Sequential Convexification Method (SCM) for Continuous Global Optimization

A new method for continuous global minimization problems, acronymed SCM, is introduced. This method gives a simple transformation to convert the objective function to an auxiliary function with gradually fewer local minimizers. All Local minimizers except a prefixed one of the auxiliary function are in the region where the function value of the objective function is lower than its current minimal value. Based on this method, an algorithm is designed which uses a local optimization method to minimize the auxiliary function to find a local minimizer at which the value of the objective function is lower than its current minimal value. The algorithm converges asymptotically with probability one to a global minimizer of the objective function. Numerical experiments on a set of standard test problems with several problems' dimensions up to 50 show that the algorithm is very efficient compared with other global optimization methods.     

总体优化一类双参数填充函数算法的改进

求解无约束总体优化问题的一类双参数填充函数算法需要假设该问题的局部极小解的个数只有有限个，而且填充函数中参数的选取与局部极小解的谷域的半径有关．该文对其填充函数作了适当改进，使得新的填充函数算法不仅无需对问题的局部极小解的个数作假设，而且填充函数中参数的选取与局部极小解的谷域的半径无关．数值试验表明算法是有效的．     

Characterization of energy minimizers in micromagnetics

We present a new characterization of minimizing sequences and possible minimizers (all called the minimizing magnetizations) for a nonlocal micromagnetic-like energy (without the exchange energy). Our method is to replace the nonlocal energy functional and its relaxation with certain local integral functionals on divergence-free fields obtained by a two-step minimization of some auxiliary augmented functionals. Through this procedure, the minimization problem becomes equivalent to the minimization of a new local variational functional, called the dual variational functional, which has a unique minimizer. We then precisely characterize the minimizing magnetizations of original nonlocal functionals in terms of the unique minimizer of the dual variational functional. Finally, we give some remarks and ideas on solving the dual minimization problem.     

带有不等式约束的非线性规划问题的一个精确增广Lagrange函数

对求解带有不等式约束的非线性非凸规划问题的一个精确增广Lagrange函数进行了研究．在适当的假设下,给出了原约束问题的局部极小点与增广Lagrange函数,在原问题变量空间上的无约束局部极小点之间的对应关系．进一步地,在对全局解的一定假设下,还提供了原约束问题的全局最优解与增广Lagrange函数,在原问题变量空间的一个紧子集上的全局最优解之间的一些对应关系．因此,从理论上讲,采用该文给出的增广Lagrange函数作为辅助函数的乘子法,可以求得不等式约束非线性规划问题的最优解和对应的Lagrange乘子．     

Discrete global descent method for discrete global optimization and nonlinear integer programming

A novel method, entitled the discrete global descent method, is developed in this paper to solve discrete global optimization problems and nonlinear integer programming problems. This method moves from one discrete minimizer of the objective function f to another better one at each iteration with the help of an auxiliary function, entitled the discrete global descent function. The discrete global descent function guarantees that its discrete minimizers coincide with the better discrete minimizers of f under some standard assumptions. This property also ensures that a better discrete minimizer of f can be found by some classical local search methods. Numerical experiments on several test problems with up to 100 integer variables and up to 1.38 × 10¹⁰⁴ feasible points have demonstrated the applicability and efficiency of the proposed method.     

一类不依赖于局部极小解个数的填充函数

求解无约束总体优化问题的一类单参数填充函数需要假设问题的局部极小解的个数只有有限个,而且填充函数中参数的选取与局部极小解的谷域的半径有关.本文对填充函数的定义作适当改进,而且对已有的这一类填充函数作改进,构造了一类双参数填充函数.新的填充函数不仅无须对问题的局部极小解的个数作假设,而且其中参数的选取与局部极小解的谷域的半径无关.     

A filled function method for constrained global optimization

In this paper, a filled function method for solving constrained global optimization problems is proposed. A filled function is proposed for escaping the current local minimizer of a constrained global optimization problem by combining the idea of filled function in unconstrained global optimization and the idea of penalty function in constrained optimization. Then a filled function method for obtaining a global minimizer or an approximate global minimizer of the constrained global optimization problem is presented. Some numerical results demonstrate the efficiency of this global optimization method for solving constrained global optimization problems.     

Concurrent stochastic methods for global optimization

The global optimization problem, finding the lowest minimizer of a nonlinear function of several variables that has multiple local minimizers, appears well suited to concurrent computation. This paper presents a new parallel algorithm for the global optimization problem. The algorithm is a stochastic method related to the multi-level single-linkage methods of Rinnooy Kan and Timmer for sequential computers. Concurrency is achieved by partitioning the work of each of the three main parts of the algorithm, sampling, local minimization start point selection, and multiple local minimizations, among the processors. This parallelism is of a coarse grain type and is especially well suited to a local memory multiprocessing environment. The paper presents test results of a distributed implementation of this algorithm on a local area network of computer workstations. It also summarizes the theoretical properties of the algorithm.Research supported by AFOSR grant AFOSR-85-0251, ARO contract DAAG 29-84-K-0140, NSF grant DCR-8403483, and NSF cooperative agreement DCR-8420944.     

Total variation-penalized Poisson likelihood estimation for ill-posed problems

The noise contained in data measured by imaging instruments is often primarily of Poisson type. This motivates, in many cases, the use of the Poisson negative-log likelihood function in place of the ubiquitous least squares data fidelity when solving image deblurring problems. We assume that the underlying blurring operator is compact, so that, as in the least squares case, the resulting minimization problem is ill-posed and must be regularized. In this paper, we focus on total variation regularization and show that the problem of computing the minimizer of the resulting total variation-penalized Poisson likelihood functional is well-posed. We then prove that, as the errors in the data and in the blurring operator tend to zero, the resulting minimizers converge to the minimizer of the exact likelihood function. Finally, the practical effectiveness of the approach is demonstrated on synthetically generated data, and a nonnegatively constrained, projected quasi-Newton method is introduced.     

Stability of the Minimizers of Least Squares with a Non-Convex Regularization. Part II: Global Behavior

We address estimation problems where the sought-after solution is defined as the minimizer of an objective function composed of a quadratic data-fidelity term and a regularization term. We especially focus on non-convex and possibly non-smooth regularization terms because of their ability to yield good estimates. This work is dedicated to the stability of the minimizers of such piecewise C^m, with m ≥ 2, non-convex objective functions. It is composed of two parts. In the previous part of this work we considered general local minimizers. In this part we derive results on global minimizers. We show that the data domain contains an open, dense subset such that for every data point therein, the objective function has a finite number of local minimizers, and a unique global minimizer. It gives rise to a global minimizer function which is C^m-1 everywhere on an open and dense subset of the data domain.     

Finding the Strictly Local and $\epsilon $-Global Minimizers of Concave Minimization with Linear Constraints

This paper considers the concave minimization problem with linear constraints, proposes a technique which may avoid the unsuitable Karush-Kuhn-Tucker points, then combines this technique with Frank-Wolfe method and simplex method to form a pivoting method which can determine a strictly local minimizer of the problem in a finite number of iterations. Based on strictly local minimizers, a new cutting plane method is proposed. Under some mild conditions, the new cutting plane method is proved to be finitely terminated at an $\epsilon $-global minimizer of the problem.     

An Approach to Finding a Global Minimization with Equality and Inequality Constraints

We give an approach for finding a global minimization with equality and inequality Constraints.Our approach is to construct an exact penalty function, and prove that the global minimal points of this exact penalty function are the primal constrained global minimal points. Thus we convert the problem of global constrained optimization into a problem of global unconstrained optimization. Furthermore, the integral approach for finding a global minimization for a class of discontinuous functions is used and an implementable algorithm is given.     

A Locally-Biased form of the DIRECT Algorithm

In this paper we propose a form of the DIRECT algorithm that is strongly biased toward local search. This form should do well for small problems with a single global minimizer and only a few local minimizers. We motivate our formulation with some results on how the original formulation of the DIRECT algorithm clusters its search near a global minimizer. We report on the performance of our algorithm on a suite of test problems and observe that the algorithm performs particularly well when termination is based on a budget of function evaluations.     

Theoretical and Practical Convergence of a Self-Adaptive Penalty Algorithm for Constrained Global Optimization

This paper proposes a self-adaptive penalty function and presents a penalty-based algorithm for solving nonsmooth and nonconvex constrained optimization problems. We prove that the general constrained optimization problem is equivalent to a bound constrained problem in the sense that they have the same global solutions. The global minimizer of the penalty function subject to a set of bound constraints may be obtained by a population-based meta-heuristic. Further, a hybrid self-adaptive penalty firefly algorithm, with a local intensification search, is designed, and its convergence analysis is established. The numerical experiments and a comparison with other penalty-based approaches show the effectiveness of the new self-adaptive penalty algorithm in solving constrained global optimization problems.     

Dynamic Globally Concavized Filled Function Method for Continuous Global Optimization

We consider a box-constrained continuous global minimization problem. A new definition of filled function, namely that of globally concavized filled function, is proposed. A new two-parameter class of globally concavized filled functions A(x,k,p) is constructed, which has the same global minimizers as the problem on the solution domain if p is large enough. The minimization of A(x,k,p) can escape successfully from a previously converged local minimizer by taking increasing values of k. A dynamic globally concavized filled function method is designed based on these functions and the convergence property is proved. Numerical experiments on a set of standard testing functions show that the resulting method is competitive with some well-known global minimization methods. This research was supported partially by the NSFC under Grants 60773126 and 10301009, the NKBRSF of China under Grant 2006CB805900, and the Natural Science Foundation of Fujian province under Grant 2006J0030.     

求整体优化问题全部解的胞腔排除法

其中X~0为一各边平行于坐标轴的立方体(以下将这类立方体简称为胞腔),X~0的最大边长度称为网径,记为W(X~0).在本文中,X(?)X~0表示任一胞腔,f(X)={f(x):x∈X}表示f在X上的值域,f在X~0上的整体极小值记为f~*,f在X~0上全部整体极小点集合记为M.以下恒假定M仅由有限个孤立点组成,且M中所有点含于X~O内部.于是,(?)x~*∈M,有     

关于约束极小化问题的一个新的简单精确罚函数

针对等式及不等式约束极小化问题,通过对原问题添加一个变量,给出一个新的简单精确罚函数,即在该精确罚函数表达式中,不含有目标函数及约束函数的梯度．在满足某些约束品性的条件下,可以证明:当罚参数充分大时,所给出的罚问题的局部极小点是原问题的局部极小点．     

Global minimization of difference of quadratic and convex functions over box or binary constraints

In this paper, we present necessary as well as sufficient conditions for a given feasible point to be a global minimizer of the difference of quadratic and convex functions subject to bounds on the variables. We show that the necessary conditions become necessary and sufficient for global minimizers in the case of a weighted sum of squares minimization problems. We obtain sufficient conditions for global optimality by first constructing quadratic underestimators and then by characterizing global minimizers of the underestimators. We also derive global optimality conditions for the minimization of the difference of quadratic and convex functions over binary constraints. We discuss several numerical examples to illustrate the significance of the optimality conditions. The authors are grateful to the referees for their helpful comments and valuable suggestions which have contributed to the final preparation of the paper.