The Lagrange-Newton method for state constrained optimal control problems

Local convergence of the Lagrange-Newton method for optimization problems with two-norm discrepancy in abstract Banach spaces is investigated. Based on stability analysis of optimization problems with two-norm discrepancy, sufficient conditions for local superlinear convergence are derived. The abstract results are applied to optimal control problems for nonlinear ordinary differential equations subject to control and state constraints.This research was completed while the second author was a visitor at the University of Bayreuth, Germany, supported by grant No. CIPA3510CT920789 from the Commission of the European Communities.     

An SQP method for optimal control of weakly singular Hammerstein integral equations

We investigate local convergence of an SQP method for nonlinear optimal control of weakly singular Hammerstein integral equations. Sufficient conditions for local quadratic convergence of the method are discussed.     

Connections between the covector mapping theorem and convergence of pseudospectral methods for optimal control

In recent years, many practical nonlinear optimal control problems have been solved by pseudospectral (PS) methods. In particular, the Legendre PS method offers a Covector Mapping Theorem that blurs the distinction between traditional direct and indirect methods for optimal control. In an effort to better understand the PS approach for solving control problems, we present consistency results for nonlinear optimal control problems with mixed state and control constraints. A set of sufficient conditions is proved under which a solution of the discretized optimal control problem converges to the continuous solution. Convergence of the primal variables does not necessarily imply the convergence of the duals. This leads to a clarification of the Covector Mapping Theorem in its relationship to the convergence properties of PS methods and its connections to constraint qualifications. Conditions for the convergence of the duals are described and illustrated. An application of the ideas to the optimal attitude control of NPSAT1, a highly nonlinear spacecraft, shows that the method performs well for real-world problems. The research was supported in part by NPS, the Secretary of the Air Force, and AFOSR under grant number, F1ATA0-60-6-2G002.     

Globalizing a nonsmooth Newton method via nonmonotone path search

We give a framework for the globalization of a nonsmooth Newton method. In part one we start with recalling B. Kummer’s approach to convergence analysis of a nonsmooth Newton method and state his results for local convergence. In part two we give a globalized version of this method. Our approach uses a path search idea to control the descent. After elaborating the single steps, we analyze and prove the global convergence resp. the local superlinear or quadratic convergence of the algorithm. In the third part we illustrate the method for nonlinear complementarity problems.     

A globally convergent semi-smooth Newton method for control-state constrained DAE optimal control problems

We investigate a semi-smooth Newton method for the numerical solution of optimal control problems subject to differential-algebraic equations (DAEs) and mixed control-state constraints. The necessary conditions are stated in terms of a local minimum principle. By use of the Fischer-Burmeister function the local minimum principle is transformed into an equivalent nonlinear and semi-smooth equation in appropriate Banach spaces. This nonlinear and semi-smooth equation is solved by a semi-smooth Newton method. We extend known local and global convergence results for ODE optimal control problems to the DAE optimal control problems under consideration. Special emphasis is laid on the calculation of Newton steps which are given by a linear DAE boundary value problem. Regularity conditions which ensure the existence of solutions are provided. A regularization strategy for inconsistent boundary value problems is suggested. Numerical illustrations for the optimal control of a pendulum and for the optimal control of discretized Navier-Stokes equations conclude the article.     

Convergence of the control parameterization Ritz method for nonlinear optimal control problems

This paper studies the local convergence properties of the control parameterization Ritz method in which the control variable is approximated over a finite-dimensional subspace. The nonlinear free-endpoint optimal control problem is considered, and error bounds are derived for both the cost functional and state-control convergence. Explicit error bounds are obtained for the particular case of approximations over spline spaces. On specializing the general results to the linear-quadratic regulator problem, global convergence results are obtained. Computational results supporting the theoretically derived error bounds are presented.This research was supported by the University Grants Committee of New Zealand.     

最优控制问题参数化研究—基于勒让德正交多项式逼近

使用勒让德正交多项式逼近方法,将Lagrange型最优控制问题转化为非线性规划问题.采用序列二次规划方法对此非线性规划问题的求解,并对多项式逼近和非线性规划求解后得到的解是否收敛给出了证明和实例分析.     

Local Convergence of the Interior-Point Newton Method for General Nonlinear Programming

In this paper, a formulation for an interior-point Newton method of general nonlinear programming problems is presented. The formulation uses the Coleman-Li scaling matrix. The local convergence and the q-quadratic rate of convergence for the method are established under the standard assumptions of the Newton method for general nonlinear programming.     

A unified approach to global convergence of trust region methods for nonsmooth optimization

This paper investigates the global convergence of trust region (TR) methods for solving nonsmooth minimization problems. For a class of nonsmooth objective functions called regular functions, conditions are found on the TR local models that imply three fundamental convergence properties. These conditions are shown to be satisfied by appropriate forms of Fletcher's TR method for solving constrained optimization problems, Powell and Yuan's TR method for solving nonlinear fitting problems, Zhang, Kim and Lasdon's successive linear programming method for solving constrained problems, Duff, Nocedal and Reid's TR method for solving systems of nonlinear equations, and El Hallabi and Tapia's TR method for solving systems of nonlinear equations. Thus our results can be viewed as a unified convergence theory for TR methods for nonsmooth problems.Research supported by AFOSR 89-0363, DOE DEFG05-86ER25017 and ARO 9DAAL03-90-G-0093.Corresponding author.     

Local convergence of quasi-Newton methods for B-differentiable equations

We study local convergence of quasi-Newton methods for solving systems of nonlinear equations defined by B-differentiable functions. We extend the classical linear and superlinear convergence results for general quasi-Newton methods as well as for Broyden's method. We also show how Broyden's method may be applied to nonlinear complementarity problems and illustrate its computational performance on two small examples.     

Deterministic Global Optimization in Nonlinear Optimal Control Problems

The accurate solution of optimal control problems is crucial in many areas of engineering and applied science. For systems which are described by a nonlinear set of differential-algebraic equations, these problems have been shown to often contain multiple local minima. Methods exist which attempt to determine the global solution of these formulations. These algorithms are stochastic in nature and can still get trapped in local minima. There is currently no deterministic method which can solve, to global optimality, the nonlinear optimal control problem. In this paper a deterministic global optimization approach based on a branch and bound framework is introduced to address the nonlinear optimal control problem to global optimality. Only mild conditions on the differentiability of the dynamic system are required. The implementa-tion of the approach is discussed and computational studies are presented for four control problems which exhibit multiple local minima.     

On some optimal control problems and their finite difference approximations and regularization for quasilinear elliptic equations with controls in the coefficients

Mathematical statements of the optimal control problems for quasilinear elliptic equations with the controls in the variable coefficients of the equation of state are considered. Both local and integral constraints on the controls are considered. The objective functionals correspond to the optimization with respect to a certain number of quality indexes. Finite difference approximations of optimization problems are constructed, and estimates of the approximation error with respect to the state and to the objective functional are established. The weak convergence in control is proved. The approximations are regularized after Tikhonov. Interesting examples of some applied optimization problems that naturally lead to the nonlinear optimal control problems examined in this paper are considered.     

Combined Newton-Kurchatov method for solving nonlinear operator equations

We investigate local and semi-local convergence of the combined Newton-Kurchatov method under the classical and generalized Lipschitz conditions for solving nonlinear equations. The convergence order of the method is examined and the uniqueness ball for the solution of the nonlinear equation is proved. Numerical experiments are conducted on test problems. (© 2016 Wiley-VCH Verlag GmbH & Co. KGaA, Weinheim)     

The convergence analysis of inexact Gauss–Newton methods for nonlinear problems

In this paper, inexact Gauss–Newton methods for nonlinear least squares problems are studied. Under the hypothesis that derivative satisfies some kinds of weak Lipschitz conditions, the local convergence properties of inexact Gauss–Newton and inexact Gauss–Newton like methods for nonlinear problems are established with the modified relative residual control. The obtained results can provide an estimate of convergence ball for inexact Gauss–Newton methods.     

Convergence analysis of a proximal Gauss-Newton method

An extension of the Gauss-Newton algorithm is proposed to find local minimizers of penalized nonlinear least squares problems, under generalized Lipschitz assumptions. Convergence results of local type are obtained, as well as an estimate of the radius of the convergence ball. Some applications for solving constrained nonlinear equations are discussed and the numerical performance of the method is assessed on some significant test problems.     

Relationships between different types of initial conditions for simultaneous root finding methods

The construction of initial conditions of an iterative method is one of the most important problems in solving nonlinear equations. In this paper, we obtain relationships between different types of initial conditions that guarantee the convergence of iterative methods for simultaneously finding all zeros of a polynomial. In particular, we show that any local convergence theorem for a simultaneous method can be converted into a convergence theorem with computationally verifiable initial conditions which is of practical importance. Thus, we propose a new approach for obtaining semilocal convergence results for simultaneous methods via local convergence results.     

Convergence analysis of the general Gauss-Newton algorithm

Summary The convergence of the Gauss-Newton algorithm for solving discrete nonlinear approximation problems is analyzed for general norms and families of functions. Aquantitative global convergence theorem and several theorems on the rate of local convergence are derived. A general stepsize control procedure and two regularization principles are incorporated. Examples indicate the limits of the convergence theorems.     

Pseudospectral Chebyshev Optimal Control of Constrained Nonlinear Dynamical Systems

A pseudospectral method for generating optimal trajectories of linear and nonlinear constrained dynamic systems is proposed. The method consists of representing the solution of the optimal control problem by an mth degree interpolating polynomial, using Chebyshev nodes, and then discretizing the problem using a cell-averaging technique. The optimal control problem is thereby transformed into an algebraic nonlinear programming problem. Due to its dynamic nature, the proposed method avoids many of the numerical difficulties typically encountered in solving standard optimal control problems. Furthermore, for discontinuous optimal control problems, we develop and implement a Chebyshev smoothing procedure which extracts the piecewise smooth solution from the oscillatory solution near the points of discontinuities. Numerical examples are provided, which confirm the convergence of the proposed method. Moreover, a comparison is made with optimal solutions obtained by closed-form analysis and/or other numerical methods in the literature.     

求解非线性方程组的L-M方法

本文研究了求解奇异非线性方程组的Levenberg-Marquardt方法的收敛性.利用选取新的迭代参数求解非线性方程组的L-M方法,获得点列的超线性收敛性和二阶收敛性,并把试验结果与文献[19,20]的结果进行了比较.     

On an Augmented Lagrangian SQP Method for a Class of Optimal Control Problems in Banach Spaces

An augmented Lagrangian SQP method is discussed for a class of nonlinear optimal control problems in Banach spaces with constraints on the control. The convergence of the method is investigated by its equivalence with the generalized Newton method for the optimality system of the augmented optimal control problem. The method is shown to be quadratically convergent, if the optimality system of the standard non-augmented SQP method is strongly regular in the sense of Robinson. This result is applied to a test problem for the heat equation with Stefan-Boltzmann boundary condition. The numerical tests confirm the theoretical results.