An interval branch and bound algorithm for bound constrained optimization problems

In this paper, we propose modifications to a prototypical branch and bound algorithm for nonlinear optimization so that the algorithm efficiently handles constrained problems with constant bound constraints. The modifications involve treating subregions of the boundary identically to interior regions during the branch and bound process, but using reduced gradients for the interval Newton method. The modifications also involve preconditioners for the interval Gauss-Seidel method which are optimal in the sense that their application selectively gives a coordinate bound of minimum width, a coordinate bound whose left endpoint is as large as possible, or a coordinate bound whose right endpoint is as small as possible. We give experimental results on a selection of problems with different properties.     

A superlinearly convergent strongly sub-feasible SSLE-type algorithm with working set for nonlinearly constrained optimization

In this paper, by means of a new efficient identification technique of active constraints and the method of strongly sub-feasible direction, we propose a new sequential system of linear equations (SSLE) algorithm for solving inequality constrained optimization problems, in which the initial point is arbitrary. At each iteration, we first yield the working set by a pivoting operation and a generalized projection; then, three or four reduced linear equations with a same coefficient are solved to obtain the search direction. After a finite number of iterations, the algorithm can produced a feasible iteration point, and it becomes the method of feasible directions. Moreover, after finitely many iterations, the working set becomes independent of the iterates and is essentially the same as the active set of the KKT point. Under some mild conditions, the proposed algorithm is proved to be globally, strongly and superlinearly convergent. Finally, some preliminary numerical experiments are reported to show that the algorithm is practicable and effective.     

A tight bound for the boolean quadratic optimization problem and its use in a branch and bound algorithm 1

Known duality statements are used to find tight bounds for the branch and bound process in solving Boolean quadratic optimization problems. To solve the corresponding continuous partial problem, a NEWTON-like procedure is indicated. Superlinear convergence, however, is only obtained in partial cases.     

A new branching rule for the branch and bound algorithm for solving nonlinear integer programming problems

We examine a branch and bound algorithm for solving nonlinear (convex) integer programming problems. In this note we generalize previous results for the quadratic case. The variables are branched in such a way that the number of branch and bound nodes checked in the process is small. Numerical results confirm the efficiency.     

A method combining norm-relaxed QP subproblems with systems of linear equations for constrained optimization

Based on the ideas of norm-relaxed sequential quadratic programming (SQP) method and the strongly sub-feasible direction method, we propose a new SQP algorithm for the solution of nonlinear inequality constrained optimization. Unlike the previous work, at each iteration, the norm-relaxed quadratic programming subproblem (NRQPS) in our algorithm only consists of the constraints corresponding to an estimate of the active set, and the high-order correction direction (used to avoid the Maratos effect) is obtained by solving a system of linear equations (SLE) which also only consists of such a subset of constraints and gradients. Moreover, the line search technique can effectively combine the initialization process with the optimization process, and therefore (if the starting point is not feasible) the iteration points always get into the feasible set after a finite number of iterations. The global convergence is proved under the Mangasarian–Fromovitz constraint qualification (MFCQ), and the superlinear convergence is obtained without assuming the strict complementarity. Finally, the numerical experiments show that the proposed algorithm is effective and promising for the test problems.     

Solving optimal control problems for the unsteady Burgers equation in COMSOL Multiphysics

The optimal control of unsteady Burgers equation without constraints and with control constraints are solved using the high-level modelling and simulation package COMSOL Multiphysics. Using the first-order optimality conditions, projection and semi-smooth Newton methods are applied for solving the optimality system. The optimality system is solved numerically using the classical iterative approach by integrating the state equation forward in time and the adjoint equation backward in time using the gradient method and considering the optimality system in the space-time cylinder as an elliptic equation and solving it adaptively. The equivalence of the optimality system to the elliptic partial differential equation (PDE) is shown by transforming the Burgers equation by the Cole-Hopf transformation to a linear diffusion type equation. Numerical results obtained with adaptive and nonadaptive elliptic solvers of COMSOL Multiphysics are presented both for the unconstrained and the control constrained case.     

A nondegenerate fuzzy optimality condition for constrained optimization problems without qualification conditions

Fuzzy optimization conditions in terms of the Fréchet subdifferential for reflexive spaces were investigated by Borwein, Treiman and Zhu (1998) in [1]. To achieve the nondegenerate form, it is well known that some qualification conditions should be assumed. In this paper, we are going to prove that the nondegenerate fuzzy optimality condition even holds with no qualification conditions in Asplund spaces (in particular, reflexive spaces) for optimization problems with semi-continuous and continuous data. The results are even new in finite-dimensional frameworks.     

Algorithms for bound constrained quadratic programming problems

Summary We present an algorithm which combines standard active set strategies with the gradient projection method for the solution of quadratic programming problems subject to bounds. We show, in particular, that if the quadratic is bounded below on the feasible set then termination occurs at a stationary point in a finite number of iterations. Moreover, if all stationary points are nondegenerate, termination occurs at a local minimizer. A numerical comparison of the algorithm based on the gradient projection algorithm with a standard active set strategy shows that on mildly degenerate problems the gradient projection algorithm requires considerable less iterations and time than the active set strategy. On nondegenerate problems the number of iterations typically decreases by at least a factor of 10. For strongly degenerate problems, the performance of the gradient projection algorithm deteriorates, but it still performs better than the active set method.Work supported in part by the Applied Mathematical Sciences subprogram of the Office of Energy Research of the U.S. Department of Energy under Contract W-31-109-Eng-38     

A multigrid method for constrained optimal control problems

We consider the fast and efficient numerical solution of linear-quadratic optimal control problems with additional constraints on the control. Discretization of the first-order conditions leads to an indefinite linear system of saddle point type with additional complementarity conditions due to the control constraints. The complementarity conditions are treated by a primal-dual active set strategy that serves as outer iteration. At each iteration step, a KKT system has to be solved. Here, we develop a multigrid method for its fast solution. To this end, we use a smoother which is based on an inexact constraint preconditioner.We present numerical results which show that the proposed multigrid method possesses convergence rates of the same order as for the underlying (elliptic) PDE problem. Furthermore, when combined with a nested iteration, the solver is of optimal complexity and achieves the solution of the optimization problem at only a small multiple of the cost for the PDE solution.     

Two modified HS type conjugate gradient methods for unconstrained optimization problems

Based on the modified secant equation, we propose two new HS type conjugate gradient formulas. Their forms are similar to the original HS conjugate gradient formula and inherit all nice properties of the HS method. By utilizing the technique of the three-term HS method in Zhang et al. (2007) [15], without the requirement of truncation and convexity of the objective function, we show that one with Wolfe line search and the other with Armijo line search are globally convergent. Moreover, under some mild conditions, the linear convergence rate of the two modified methods is established. The numerical results show that the proposed methods are efficient.     

Mesh-independence of semismooth Newton methods for Lavrentiev-regularized state constrained nonlinear optimal control problems

A class of nonlinear elliptic optimal control problems with mixed control-state constraints arising, e.g., in Lavrentiev-type regularized state constrained optimal control is considered. Based on its first order necessary optimality conditions, a semismooth Newton method is proposed and its fast local convergence in function space as well as a mesh-independence principle for appropriate discretizations are proved. The paper ends by a numerical verification of the theoretical results including a study of the algorithm in the case of vanishing Lavrentiev-parameter. The latter process is realized numerically by a combination of a nested iteration concept and an extrapolation technique for the state with respect to the Lavrentiev-parameter.     

Modelling of topological derivatives for contact problems

The problem of topology optimization is considered for free boundary problems of thin obstacle types. The formulae for the first term of asymptotics for energy functionals are derived. The precision of obtained terms is verified numerically. The topological differentiability of solutions to variational inequalities is established. In particular, the so-called outer asymptotic expansion for solutions of contact problems in elasticity with respect to singular perturbation of geometrical domain depending on small parameter are derived by an application of nonsmooth analysis. Such results lead to the topological derivatives of shape functionals for contact problems. The topological derivatives are used in numerical methods of simultaneous shape and topology optimization. Partially supported by the grant 4 T11A 01524 of the State Committee for the Scientific Research of the Republic of Poland     

Partitioned quasi-Newton methods for nonlinear equality constrained optimization

We derive new quasi-Newton updates for the (nonlinear) equality constrained minimization problem. The new updates satisfy a quasi-Newton equation, maintain positive definiteness on the null space of the active constraint matrix, and satisfy a minimum change condition. The application of the updates is not restricted to a small neighbourhood of the solution. In addition to derivation and motivational remarks, we discuss various numerical subtleties and provide results of numerical experiments.Research partially supported by the Applied Mathematical Sciences Research Program (KC-04-02) of the Office of Energy Research of the US Department of Energy under grant DE-FG02-86ER25013.A000, and by the US Army Research Office through the Mathematical Sciences Institute, Cornell University.     

A new trust region method for unconstrained optimization

In this paper, we propose a new trust region method for unconstrained optimization problems. The new trust region method can automatically adjust the trust region radius of related subproblems at each iteration and has strong global convergence under some mild conditions. We also analyze the global linear convergence, local superlinear and quadratic convergence rate of the new method. Numerical results show that the new trust region method is available and efficient in practical computation.     

Closed-form solutions of a general inequality-constrained lq optimal control problem

A general linear quadratic (LQ) optimal control problem, with the dynamic system being governed by a higher-order vector-valued ordinary differential equation and with inequality-constraints on the state vector and/or the control input, is studied. Based on an explicit characterization result, optimal solutions are obtained in closed-form. A constructive method for finding the closed-form optimal solutions is proposed, and two illustrative examples are included     

Affine scaling interior Levenberg–Marquardt method for bound-constrained semismooth equations under local error bound conditions

We develop and analyze a new affine scaling Levenberg–Marquardt method with nonmonotonic interior backtracking line search technique for solving bound-constrained semismooth equations under local error bound conditions. The affine scaling Levenberg–Marquardt equation is based on a minimization of the squared Euclidean norm of linear model adding a quadratic affine scaling matrix to find a solution that belongs to the bounded constraints on variable. The global convergence results are developed in a very general setting of computing trial directions by a semismooth Levenberg–Marquardt method where a backtracking line search technique projects trial steps onto the feasible interior set. We establish that close to the solution set the affine scaling interior Levenberg–Marquardt algorithm is shown to converge locally Q-superlinearly depending on the quality of the semismooth and Levenberg–Marquardt parameter under an error bound assumption that is much weaker than the standard nonsingularity condition, that is, BD-regular condition under nonsmooth case. A nonmonotonic criterion should bring about speed up the convergence progress in the contours of objective function with large curvature.     

A multivariate spectral projected gradient method for bound constrained optimization

In this paper, we consider a multivariate spectral projected gradient (MSPG) method for bound constrained optimization. Combined with a quasi-Newton property, the multivariate spectral projected gradient method allows an individual adaptive step size along each coordinate direction. On the basis of nonmonotone line search, global convergence is established. A numerical comparison with the traditional SPG method shows that the method is promising.     

An interior point type QP-free algorithm with superlinear convergence for inequality constrained optimization

A feasible interior point type algorithm is proposed for the inequality constrained optimization. Iterate points are prevented from leaving to interior of the feasible set. It is observed that the algorithm is merely necessary to solve three systems of linear equations with the same coefficient matrix. Under some suitable conditions, superlinear convergence rate is obtained. Some numerical results are also reported.     

A decomposition-dualization approach for solving constrained convex minimization problems with applications to discretized obstacle problems

Summary In this paper, we shall be concerned with the solution of constrained convex minimization problems. The constrained convex minimization problems are proposed to be transformable into a convex-additively decomposed and almost separable form, e.g. by decomposition of the objective functional and the restrictions. Unconstrained dual problems are generated by using Fenchel-Rockafellar duality. This decomposition-dualization concept has the advantage that the conjugate functionals occuring in the derived dual problem are easily computable. Moreover, the minimum point of the primal constrained convex minimization problem can be obtained from any maximum point of the corresponding dual unconstrained concave problem via explicit return-formulas. In quadratic programming the decomposition-dualization approach considered here becomes applicable if the quadratic part of the objective functional is generated byH-matrices. Numerical tests for solving obstacle problems in ¹ discretized by using piecewise quadratic finite elements and in ² by using the five-point difference approximation are presented.