A branch-and-cut algorithm for nonconvex quadratic programs with box constraints

We present the implementation of a branch-and-cut algorithm for bound constrained nonconvex quadratic programs. We use a class of inequalities developed in [12] as cutting planes. We present various branching strategies and compare the algorithm to several other methods to demonstrate its effectiveness.Mathematics Subject Classification (2000): 90C26, 90C27, 90C20     

On nonconvex optimization problems with separated nonconvex variables

A mathematical programming problem is said to have separated nonconvex variables when the variables can be divided into two groups: x=(x ₁,...,x _n ) and y=( y ₁,...,y _n ), such that the objective function and any constraint function is a sum of a convex function of (x, y) jointly and a nonconvex function of x alone. A method is proposed for solving a class of such problems which includes Lipschitz optimization, reverse convex programming problems and also more general nonconvex optimization problems.     

A Lagrangean based branch-and-cut algorithm for global optimization of nonconvex mixed-integer nonlinear programs with decomposable structures

In this work we present a global optimization algorithm for solving a class of large-scale nonconvex optimization models that have a decomposable structure. Such models, which are very expensive to solve to global optimality, are frequently encountered in two-stage stochastic programming problems, engineering design, and also in planning and scheduling. A generic formulation and reformulation of the decomposable models is given. We propose a specialized deterministic branch-and-cut algorithm to solve these models to global optimality, wherein bounds on the global optimum are obtained by solving convex relaxations of these models with certain cuts added to them in order to tighten the relaxations. These cuts are based on the solutions of the sub-problems obtained by applying Lagrangean decomposition to the original nonconvex model. Numerical examples are presented to illustrate the effectiveness of the proposed method compared to available commercial global optimization solvers that are based on branch and bound methods.     

A branch-and-cut method for the obnoxious p-median problem

The obnoxious p-median (OpM) problem is the repulsive counterpart of the ore known attractive p-median problem. Given a set I of cities and a set J of possible locations for obnoxious plants, a p-cardinality subset Q of J is sought, such that the sum of the distances between each city of I and the nearest obnoxious site in Q is maximised. We formulate (OpM) as a {0,1} linear programming problem and propose three families of valid inequalities whose separation problem is polynomial. We describe a branch-and-cut approach based on these inequalities and apply it to a set of instances found in the location literature. The computational results presented show the effectiveness of these inequalities for (OpM). The work of the first author has been partially supported by the Coordinated Project C.A.M.P.O. and that of the third author by a short mobility grant, both of the Italian National Research Council.     

Linear M-estimation with bounded variables

A subproblem in the trust region algorithm for non-linear M-estimation by Ekblom and Madsen is to find the restricted step. It is found by calculating the M-estimator of the linearized model, subject to anL ₂-norm bound on the variables. In this paper it is shown that this subproblem can be solved by applying Hebden-iterations to the minimizer of the Lagrangian function. The new method is compared with an Augmented Lagrange implementation.     

A MINIMIZING ALGORITHM FOR COMPLEX NONCONVEX NONDIFFERENTIABLE FUNCTIONS

The minimization of nonconvex, nondifferentiable functions that are compositions of max-type functions formed by nondifferentiable convex functions is discussed in this paper. It is closely related to practical engineering problems. By utilizing the globality of ε-subdifferential and the theory of quasidifferential, and by introducing a new scheme which selects several search directions and consider them simultaneously at each iteration, a minimizing algorithm is derived. It is simple in structure, implementable, numerically efficient and has global convergence. The shortcomings of the existing algorithms are thus overcome both in theory and in application.     

Matrix minor reformulation and SOCP-based spatial branch-and-cut method for the AC optimal power flow problem

Alternating current optimal power flow (AC OPF) is one of the most fundamental optimization problems in electrical power systems. It can be formulated as a semidefinite program (SDP) with rank constraints. Solving AC OPF, that is, obtaining near optimal primal solutions as well as high quality dual bounds for this non-convex program, presents a major computational challenge to today’s power industry for the real-time operation of large-scale power grids. In this paper, we propose a new technique for reformulation of the rank constraints using both principal and non-principal 2-by-2 minors of the involved Hermitian matrix variable and characterize all such minors into three types. We show the equivalence of these minor constraints to the physical constraints of voltage angle differences summing to zero over three- and four-cycles in the power network. We study second-order conic programming (SOCP) relaxations of this minor reformulation and propose strong cutting planes, convex envelopes, and bound tightening techniques to strengthen the resulting SOCP relaxations. We then propose an SOCP-based spatial branch-and-cut method to obtain the global optimum of AC OPF. Extensive computational experiments show that the proposed algorithm significantly outperforms the state-of-the-art SDP-based OPF solver and on a simple personal computer is able to obtain on average a \(0.71\%\) optimality gap in no more than 720 s for the most challenging power system instances in the literature.     

Shooting method for the numerical solution of optimal control problems with bounded state variables

Abtract Various methods have been proposed for the numerical solution of optimal control problems with bounded state variables. In this paper, a new method is put forward and compared with two other methods, one of which makes use of adjoint variables whereas the other does not. Some conclusions are drawn on the usefulness of the three methods involved.     

Nonlinear programming with cumulatively bounded variables

The problem [maximize f(x), subject to x₁ + … + x_j ? b_j for j = 1, …, N] is solved by a feasible direction method that takes advantage of its special structure. A direction vector that approximates the vector of Lagrange multipliers is used. In the one-dimensional subproblem the direction vector is bent every time a constraint becomes active. Convergence to a K-T point is proven. McCormick has used a similar method for the problem [maximize f(x), subject to x ? 0], with the gradient as direction vector. A computationally implementable algorithm is given, with a finite stepsize procedure and a finite stopping rule. Observations from numerous applications to a recurring banking problem are discussed. Related techniques might be useful in other situations.     

On problems with bounded state variables

A set of first-order necessary conditions is obtained for the general control problem of Bolza with bounded state constraints of the form (t, x)0, =1,...,m. With the solution required to satisfy the vector differential equationsx=f(t, x, u), whereu is control, an important feature of this paper is in relaxing the assumption on the rank of the matrix _x f _u generally made in attacking problems of this type. This is accomplished even though the solution may have an infinite number of intervals satisfying (t, x)=0 for various .The preparation of this paper was sponsored in part by the US Army Research Office, Grant No. DA-31-214-ARO(D)-355.     

A breakpoint search approach for convex resource allocation problems with bounded variables

We present an efficient approach to solve resource allocation problems with a single resource, a convex separable objective function, a convex separable resource-usage constraint, and variables that are bounded below and above. Through a combination of function evaluations and median searches, information on whether or not the upper- and lowerbounds are binding is obtained. Once this information is available for all upper and lower bounds, it remains to determine the optimum of a smaller problem with unbounded variables. This can be done through a multiplier search procedure. The information gathered allows for alternative approaches for the multiplier search which can reduce the complexity of this procedure.     

A branch-and-cut method for 0-1 mixed convex programming

We generalize the disjunctive approach of Balas, Ceria, and Cornuéjols [2] and devevlop a branch-and-cut method for solving 0-1 convex programming problems. We show that cuts can be generated by solving a single convex program. We show how to construct regions similar to those of Sherali and Adams [20] and Lovász and Schrijver [12] for the convex case. Finally, we give some preliminary computational results for our method. Received January 16, 1996 / Revised version received April 23, 1999?Published online June 28, 1999     

On some classes of bounded univalent mappings in several complex variables

Let B ⁿ be the Euclidean unit ball in C ⁿ . In this paper, we study several properties of strongly starlike mappings of order α (0 < α < 1) and bounded convex mappings on B ⁿ . We prove that K-quasiregular strongly starlike mappings of order α on B ⁿ have continuous and univalent extensions to ${\overline{B}^n}$ . We show that bounded convex mappings on B ⁿ are strongly starlike of some order α. We give a coefficient estimate for K-quasiregular strongly starlike mappings of order α on B ⁿ . Finally, we give examples of strongly starlike mappings of order α and bounded convex mappings on B ⁿ .     

On general problems with bounded state variables

This paper serves as the sequel to a recent article by the author concerned with a certain canonical control problem. The present paper extends the first-order necessary conditions obtained there to a general form of the control problem of Bolza with inequality state constraints of the type (t, x)0, =1,...,m.The preparation of this paper was sponsored in part by the U.S. Army Research Office under Grant No. DA-31-124-ARO(D)-355.     

有界变量线性规划的基线算法

本文对有界变量线性规划的算法进行了研究，得到了一种解此问题的新算法。文中根据基线算法的算法原理，通过对BL表的旋转，在各变量满足界约束的条件下，使目标函数值不断增大，直至得到有界硬上界，从而得到问题的最优解。文中给出了有界变量线性规划基线算法的计算步骤，并给出了一个例子。与单纯形法相比，采用基线算法解有界变量线性规划操作更简单。迭代次数少，解题速度更快。     

A spline smoothing homotopy method for nonconvex nonlinear programming

Homotopy methods are globally convergent under weak conditions and robust; however, the efficiency of a homotopy method is closely related with the construction of the homotopy map and the path tracing algorithm. Different homotopies may behave very different in performance even though they are all theoretically convergent. In this paper, a spline smoothing homotopy method for nonconvex nonlinear programming is developed using cubic spline to smooth the max function of the constraints of nonlinear programming. Some properties of spline smoothing function are discussed and the global convergence of spline smoothing homotopy under the weak normal cone condition is proven. The spline smoothing technique uses a smooth constraint instead of m constraints and acts also as an active set technique. So the spline smoothing homotopy method is more efficient than previous homotopy methods like combined homotopy interior point method, aggregate constraint homotopy method and other probability one homotopy methods. Numerical tests with the comparisons to some other methods show that the new method is very efficient for nonlinear programming with large number of complicated constraints.     

Necessary conditions for problems with higher derivative bounded state variables

This paper combines the separate works of two authors. Tan proves a set of necessary conditions for a control problem with second-order state inequality constraints (see Ref. 1). Russak proves necessary conditions for an extended version of that problem. Specifically, the extended version augments the original problem by including state equality constraints, differential and isopermetric equality and inequality constraints, and endpoint constraints. In addition, Russak (i) relaxes the solvability assumption on the state constraints, (ii) extends the maximum principle to a larger set, (iii) obtains modified forms of the relationH =H _t and of the transversality relation usually obtained in problems of this type, and (iv) proves a condition concerning (t ¹), the derivative of the multiplier functions at the final time.Russak's work was supported by a NPS Foundation Grant.Tan is indebted to his thesis advisor, Professor M. R. Hestenes, for suggesting the topic and for his help and guidance in the development of his work. Tan's work was supported by the Army Research Office, Contract No. DA-ARO-D-31-124-71-G18.     

A stochastic extra-step quasi-Newton method for nonsmooth nonconvex optimization

In this paper, a novel stochastic extra-step quasi-Newton method is developed to solve a class of nonsmooth nonconvex composite optimization problems. We assume that the gradient of the smooth part of the objective function can only be approximated by stochastic oracles. The proposed method combines general stochastic higher order steps derived from an underlying proximal type fixed-point equation with additional stochastic proximal gradient steps to guarantee convergence. Based on suitable bounds on the step sizes, we establish global convergence to stationary points in expectation and an extension of the approach using variance reduction techniques is discussed. Motivated by large-scale and big data applications, we investigate a stochastic coordinate-type quasi-Newton scheme that allows to generate cheap and tractable stochastic higher order directions. Finally, numerical results on large-scale logistic regression and deep learning problems show that our proposed algorithm compares favorably with other state-of-the-art methods.