An improved approximate Newton method for implicit Runge-Kutta formulas

Implicit Runge-Kutta (IRK) methods (such as the s-stage Radau IIA method with s=3,5, or 7) for solving stiff ordinary differential equation systems have excellent stability properties and high solution accuracy orders, but their high computing costs in solving their nonlinear stage equations have seriously limited their applications to large scale problems. To reduce such a cost, several approximate Newton algorithms were developed, including a commonly used one called the simplified Newton method. In this paper, a new approximate Jacobian matrix and two new test rules for controlling the updating of approximate Jacobian matrices are proposed, yielding an improved approximate Newton method. Theoretical and numerical analysis show that the improved approximate Newton method can significantly improve the convergence and performance of the simplified Newton method.     

Path-following barrier and penalty methods for linearly constrained problems

In the present paper some barrier and penalty methods (e.g. logarithmic barriers, SUMT, exponential penalties), which define a continuously differentiable primal and dual path, applied to linearly constrained convex problems are studied, in particular, the radius of convergence of Newton’s method depending on the barrier and penalty para-meter is estimated, Unlike using self-concordance properties the convergence bounds are derived by direct estimations of the solutions of the Newton equations. The obtained results establish parameter selection rules which guarantee the overall convergence of the considered barrier and penalty techniques with only a finite number of Newton steps at each parameter level. Moreover, the obtained estimates support scaling method which uses approximate dual multipliers as available in barrier and penalty methods     

Smoothing Newton method for operator equations in Banach spaces

In this paper, the global and superlinear convergence of smoothing Newton method for solving nonsmooth operator equations in Banach spaces are shown. The feature of smoothing Newton method is to use a smooth function to approximate the nonsmooth mapping. Under suitable assumptions, we prove that the smoothing Newton method is superlinearly convergent. As an application, we use the smoothing Newton method to solve a constrained optimal control problem.     

Applying a Power Penalty Method to Numerically Pricing American Bond Options

In this paper, we aim to develop a numerical scheme to price American options on a zero-coupon bond based on a power penalty approach. This pricing problem is formulated as a variational inequality problem (VI) or a complementarity problem (CP). We apply a fitted finite volume discretization in space along with an implicit scheme in time, to the variational inequality problem, and obtain a discretized linear complementarity problem (LCP). We then develop a power penalty approach to solve the LCP by solving a system of nonlinear equations. The unique solvability and convergence of the penalized problem are established. Finally, we carry out numerical experiments to examine the convergence of the power penalty method and to testify the efficiency and effectiveness of our numerical scheme.     

On the convergence of inexact Newton methods for discrete-time algebraic Riccati equations

In this paper, we present a convergence analysis of the inexact Newton method for solving Discrete-time algebraic Riccati equations (DAREs) for large and sparse systems. The inexact Newton method requires, at each iteration, the solution of a symmetric Stein matrix equation. These linear matrix equations are solved approximatively by the alternating directions implicit (ADI) or Smith?s methods. We give some new matrix identities that will allow us to derive new theoretical convergence results for the obtained inexact Newton sequences. We show that under some necessary conditions the approximate solutions satisfy some desired properties such as the d-stability. The theoretical results developed in this paper are an extension to the discrete case of the analysis performed by Feitzinger et al. (2009) [8] for the continuous-time algebraic Riccati equations. In the last section, we give some numerical experiments.     

Gauss–Newton methods with approximate projections for solving constrained nonlinear least squares problems

This paper is concerned with algorithms for solving constrained nonlinear least squares problems. We first propose a local Gauss–Newton method with approximate projections for solving the aforementioned problems and study, by using a general majorant condition, its convergence results, including results on its rate. By combining the latter method and a nonmonotone line search strategy, we then propose a global algorithm and analyze its convergence results. Finally, some preliminary numerical experiments are reported in order to illustrate the advantages of the new schemes.     

Superlinearly convergent approximate Newton methods for LC1 optimization problems

In the literature, the proof of superlinear convergence of approximate Newton or SQP methods for solving nonlinear programming problems requires twice smoothness of the objective and constraint functions. Sometimes, the second-order derivatives of those functions are required to be Lipschitzian. In this paper, we present approximate Newton or SQP methods for solving nonlinear programming problems whose objective and constraint functions have locally Lipschitzian derivatives, and establishQ-superlinear convergence of these methods under the assumption that these derivatives are semismooth. This assumption is weaker than the second-order differentiability. The extended linear-quadratic programming problem in the fully quadratic case is an example of nonlinear programming problems whose objective functions have semismooth but not smooth derivatives.This work is supported by the Australian Research Council.This paper is dedicated to Professor O.L. Mangasarian on the occasion of his 60th birthday.     

求解半光滑方程组的近似Newton法

本文提出了求解半光滑方程组的近似Newton法，并证明了该算法的局部超线性收敛性。数值结果表明 该算法是有效的。     

A Generalized Univariate Newton Method Motivated by Proximal Regularization

We devise a new generalized univariate Newton method for solving nonlinear equations, motivated by Bregman distances and proximal regularization of optimization problems. We prove quadratic convergence of the new method, a special instance of which is the classical Newton method. We illustrate the possible benefits of the new method over the classical Newton method by means of test problems involving the Lambert W function, Kullback?CLeibler distance, and a polynomial. These test problems provide insight as to which instance of the generalized method could be chosen for a given nonlinear equation. Finally, we derive a closed-form expression for the asymptotic error constant of the generalized method and make further comparisons involving this constant.     

A regularized Newton method for solving equilibrium programming problems with an inexactly specified set

Unstable equilibrium problems are examined in which the objective function and the set where the equilibrium point is sought are specified inexactly. A regularized Newton method, combined with penalty functions, is proposed for solving such problems, and its convergence is analyzed. A regularizing operator is constructed.     

An implementable augmented Lagrange method for solving fixed point problems with coupled constraints

An augmented Lagrange function method for solving fixed point problems with coupled constraints is studied, and a theorem of its global convergence is demonstrated. The semismooth Newton method is used to solve the inner problems for obtaining approximate solutions, and numerical results are reported to verify the effectiveness of the augmented Lagrange function method for solving three examples with more than 1000 variables.     

Approximate Newton Methods for Nonsmooth Equations

We develop general approximate Newton methods for solving Lipschitz continuous equations by replacing the iteration matrix with a consistently approximated Jacobian, thereby reducing the computation in the generalized Newton method. Locally superlinear convergence results are presented under moderate assumptions. To construct a consistently approximated Jacobian, we introduce two main methods: the classic difference approximation method and the -generalized Jacobian method. The former can be applied to problems with specific structures, while the latter is expected to work well for general problems. Numerical tests show that the two methods are efficient. Finally, a norm-reducing technique for the global convergence of the generalized Newton method is briefly discussed.     

一维凸函数牛顿法的全局收敛性及其应用

牛顿法是求解非线性方程F（x)＝0的一种经典方法。在一般假设条件下，牛顿法只具有局部收敛性。本文证明了一维凸函数牛顿法的全局收敛性，并且给出了它在全局优化积分水平集方法中的应用。     

A modified Newton method for solving non-symmetric algebraic Riccati equations arising in transport theory

Liang Bao ^{The non-symmetric algebraic Riccati equation arising in transporttheory can be rewritten as a vector equation and the minimalpositive solution of the non-symmetric algebraic Riccati equationcan be obtained by solving the vector equation. In this paper,we apply the modified Newton method to solve the vector equation.Some convergence results are presented. Numerical tests showthat the modified Newton method is feasible and effective, andoutperforms the Newton method.}     

A power penalty approach to a mixed quasilinear elliptic complementarity problem

In this paper, a power penalty approximation method is proposed for solving a mixed quasilinear elliptic complementarity problem. The mixed complementarity problem is first reformulated as a double obstacle quasilinear elliptic variational inequality problem. A nonlinear elliptic partial differential equation is then defined to approximate the resulting variational inequality by using a power penalty approach. The existence and uniqueness of the solution to the partial differential penalty equation are proved. It is shown that, under some mild assumptions, the sequence of solutions to the penalty equations converges to the unique solution of the variational inequality problem as the penalty parameter tends to infinity. The error estimates of the convergence of this penalty approach are also derived. At last, numerical experimental results are presented to show that the power penalty approximation method is efficient and robust.

     

A PENALTY TECHNIQUE FOR NONLINEAR COMPLEMENTARITY PROBLEMS

1.IntroductionConsiderthefollowingnonlinearcomplementarityproblemsNCP(F)offindinganxER",suchthatwhereFisamappingfromR"intoitself.ItisanimportantformofthefollowingvariationalinequalityVI(F,X)offindinganxEX,suchthatwhereXCReisaclosedconvexset.WhenX=R7,(1.1)…     

Semismooth Newton Schwarz iterative methods for the linear complementarity problem

Semismooth Newton method is an effective method for solving a nonsmooth equation, which arises from a reformulation of the complementarity problem. Under appropriate conditions, we verify the monotone convergence of the method. We also present semismooth Newton Schwarz iterative methods for the nonsmooth equation. Under suitable conditions, the methods exhibit monotone and superlinear convergence properties.     

Directional secant method for nonlinear equations

We present a directional secant method, a secant variant of the directional Newton method, for solving a single nonlinear equation in several variables. Under suitable assumptions, we prove the convergence and the quadratic convergence speed of this new method. Numerical examples show that the directional secant method is feasible and efficient, and has better numerical behaviour than the directional Newton method.     

Iterative Approximate Factorization of Difference Operators of High-Order Accurate Bicompact Schemes for Multidimensional Nonhomogeneous Quasilinear Hyperbolic Systems

For solving equations of multidimensional bicompact schemes, an iterative method based on approximate factorization of their difference operators is proposed. The method is constructed in the general case of systems of two- and three-dimensional quasilinear nonhomogeneous hyperbolic equations. The unconditional convergence of the method is proved as applied to the two-dimensional scalar linear advection equation with a source term depending only on time and space variables. By computing test problems, it is shown that the new iterative method performs much faster than Newton’s method and preserves a high order of accuracy.     

A semismooth Newton method for a class of semilinear optimal control problems with box and volume constraints

In this paper we consider optimal control problems subject to a semilinear elliptic state equation together with the control constraints 0≤u≤1 and ∫u=m. Optimality conditions for this problem are derived and reformulated as a nonlinear, nonsmooth equation which is solved using a semismooth Newton method. A regularization of the nonsmooth equation is necessary to obtain the superlinear convergence of the semismooth Newton method. We prove that the solutions of the regularized problems converge to a solution of the original problem and a path-following technique is used to ensure a constant decrease rate of the residual. We show that, in certain situations, the optimal controls take 0–1 values, which amounts to solving a topology optimization problem with volume constraint.