Local convergence theorems for Newton methods

Affine invariant sufficient conditions are given for two local convergence theorems involving inexact Newton-like methods. The first uses conditions on the first Fréchet-derivative whereas the second theorem employs hypotheses on themth (m ≥ 2 an integer). Radius of convergence as well as rate of convergence results are derived. Results involving superlinear convergence and known to be true for inexact Newton methods are extended here. Moreover, we show that under hypotheses on the mth Fréchet-derivative our radius of convergence can sometimes be larger than the corresponding one in [10]. This allows a wider choice for the initial guess. A numerical example is also provided to show that our radius of convergence is larger than the one in [10].     

Affine invariant local convergence theorems for inexact Newton-like methods

Affine invariant sufficient conditions are given for two local convergence theorems involving inexact Newton-like methods. The first uses conditions on the first Fréchet-derivative whereas the second theorem employs hypotheses on the second. Radius of convergence as well as rate of convergence results are derived. Results involving superlinear convergence and known to be true for inexact Newton methods are extended here. Moreover, we show that under hypotheses on the second Fréchet-derivative our radius of convergence is larger than the corresponding one in [10]. This allows a wider choice for the initial guess. A numerical example is also provided to show that our radius of convergence is larger than the one in [10].     

Semilocal convergence theorems for a certain class of iterative procedures

We provide semilocal convergence theorems for Newton-like methods in Banach space using outer and generalized inverses. In contrast to earlier results we use hypotheses on the second instead of the first Fréchet-derivative. This way our Newton-Kantorovich hypotheses differ from earlier ones. Our results can be used to solve undetermined systems, nonlinear least square problems and ill-posed nonlinear operator equations.     

The effect of rounding errors on Newton methods

In this study we are concerned with the problem of approximating a solution of a nonlinear equation in Banach space using Newtonlike methods. Due to rounding errors the sequence of iterates generated on a computer differs from the sequence produced in theory. Using Lipschitztype hypotheses on the second Fréchet-derivative instead of the first one, we provide sufficient convergence conditions for the inexact Newton-like method that is actually generated on the computer. Moreover, we show that the ratio of convergence improves under our conditions. Furthermore, we provide a wider choice of initial guesses than before. Finally, a numerical example is provided to show that our results compare favorably with earlier ones.     

Semilocal Convergence Theorems for Newton’s Method Using Outer Inverses and Hypotheses on the Second Fréchet-Derivative

 We provide semilocal convergence theorems for Newton’s method in Banach space using outer or generalized inverses. In contrast to earlier results we use hypotheses on the second instead of the first Fréchet-derivative. This way our Newton-Kantorovich hypotheses differ from earlier ones. Our results can be used to solve undetermined systems, nonlinear least squares problems and ill-posed nonlinear operator equations. We complete our study with some very simple examples to show that our results apply, where others fail.     

On the Convergence of Newton’s Method for Polynomial Equations and Applications in Radiative Transfer

 Newton’s method is used to approximate a locally unique zero of a polynomial operator F of degree in Banach space. So far, convergence conditions have been found for Newton’s method based on the Newton-Kantorovich hypothesis that uses Lipschitz-type conditions and information only on the first Fréchet-derivative of F. Here we provide a new semilocal convergence theorem for Newton’s method that uses information on all Fréchet-derivatives of F except the first. This way, we obtain sufficient convergence conditions different from the Newton-Kantorovich hypothesis. Our results are extended to include the case when F is a nonlinear operator whose kth Fréchet-derivative satisfies a H?lder continuity condition. An example is provided to show that our conditions hold where all previous ones fail. Moreover, some applications of our results to the solution of polynomial systems and differential equations are suggested. Furthermore, our results apply to solve a nonlinear integral equation appearing in radiative transfer in connection with the problem of determination of the angular distribution of the radiant-flux emerging from a plane radiation field. Received 9 December 1997 in revised form 30 March 1998     

Semilocal Convergence Theorems for Newton’s Method Using Outer Inverses and Hypotheses on the Second Fréchet-Derivative

 We provide semilocal convergence theorems for Newton’s method in Banach space using outer or generalized inverses. In contrast to earlier results we use hypotheses on the second instead of the first Fréchet-derivative. This way our Newton-Kantorovich hypotheses differ from earlier ones. Our results can be used to solve undetermined systems, nonlinear least squares problems and ill-posed nonlinear operator equations. We complete our study with some very simple examples to show that our results apply, where others fail. (Received 26 April 2000; in final form 17 November 2000)     

Local convergence theorems of Newton's method for nonlinear equations using outer or generalized inverses

We provide local convergence theorems for Newton's method in Banach space using outer or generalized inverses. In contrast to earlier results we use hypotheses on the second instead of the first Fréchet-derivative. This way our convergence balls differ from earlier ones. In fact we show that with a simple numerical example that our convergence ball contains earlier ones. This way we have a wider choice of initial guesses than before. Our results can be used to solve undetermined systems, nonlinear least squares problems and ill-posed nonlinear operator equations.     

Concerning the radius of convergence of Newton’s method and applications

We present local and semilocal convergence results for Newton’s method in a Banach space setting. In particular, using Lipschitz-type assumptions on the second Fréchet-derivative we find results concerning the radius of convergence of Newton’s method. Such results are useful in the context of predictor-corrector continuation procedures. Finally, we provide numerical examples to show that our results can apply where earlier ones using Lipschitz assumption on the first Fréchet-derivative fail.     

On the Convergence of Newton-Like Methods Based on M-Fréchet Differentiable Operators and Applications in Radiative Transfer

In this study we approximate a locally unique solution of a nonlinear operator equation in Banach space using Newton-like methods. A complete error analysis of our method is also given. Our new theorem uses Lipschitz or Hölder continuity assumptions on m-Fréchet-differentiable operators where m 2 is a positive integer. A numerical example is given to show that our results provide a better information on the location of the solution as well as finer error bounds on the distances involved than earlier results. A second numerical example shows how to solve a nonlinear integral equation appearing in radiative transfer.     

Chebysheff-Halley-like methods in Banach spaces

Chebysheff-Halley methods are probably the best known cubically convergent iterative procedures for solving nonlinear equations. These methods however require an evaluation of the second Fréchet-derivative at each step which means a number of function evaluations proportional to the cube of the dimension of the space. To reduce the computational cost we replace the second Fréchet derivative with a fixed bounded bilinear operator. Using the majorant method and Newton-Kantorovich type hypotheses we provide sufficient conditions for the convergence of our method to a locally unique solution of a nonlinear equation in Banach space. Our method is shown to be faster than Newton’s method under the same computational cost. Finally we apply our results to solve nonlinear integral equations appearing in radiative transfer in connection with the problem of determination of the angular distribution of the radiant-flux emerging from a plane radiation field.     

Enlarging the domain of starting points for Newton’s method under center conditions on the first Fréchet-derivative

We analyze the semilocal convergence of Newton’s method under center conditions on the first Fréchet-derivative of the operator involved. We see that we can extend the known results so far, since we provide different starting points from the point where the first Fréchet-derivative is centered (that is the situation usually considered by other authors), so that the domain of starting points is enlarged for Newton’s method. We also illustrate the theoretical results obtained with some mildly nonlinear elliptic equations.     

A unifying local-semilocal convergence analysis and applications for two-point Newton-like methods in Banach space

We provide a local as well as a semilocal convergence analysis for two-point Newton-like methods in a Banach space setting under very general Lipschitz type conditions. Our equation contains a Fréchet differentiable operator F and another operator G whose differentiability is not assumed. Using more precise majorizing sequences than before we provide sufficient convergence conditions for Newton-like methods to a locally unique solution of equation F(x)+G(x)=0. In the semilocal case we show under weaker conditions that our error estimates on the distances involved are finer and the information on the location of the solution at least as precise as in earlier results. In the local case a larger radius of convergence is obtained. Several numerical examples are provided to show that our results compare favorably with earlier ones. As a special case we show that the famous Newton-Kantorovich hypothesis is weakened under the same hypotheses as the ones contained in the Newton-Kantorovich theorem.     

Weak sufficient convergence conditions and applications for newton methods

The famous Newton—Kantorovich hypothesis has been used for a long time as a sufficient condition for the convergence of Newton method to a solution of an equation in connection with the Lipschitz continuity of the Fréchet-derivative of the operator involved. Using Lipschitz and center-Lipschitz conditions we show that the Newton—Kantorovich hypothesis is weakened. The error bounds obtained under our semilocal convergence result are finer and the information on the location of the solution more precise than the corresponding ones given by the dominating Newton— Kantorovich theorem, and under the same hypotheses/computational cost, since the evaluation of the Lipschitz also requires the evaluation of the center-Lipschitz constant. In the case of local convergence we obtain a larger convergence radius than before. This observation is important in computational mathematics and can be used in connection to projection methods and in the construction of optimum mesh independence refinement strategies.     

A stable approach to Newton's method for general mathematical programming problems inR n

The usual approach to Newton's method for mathematical programming problems with equality constraints leads to the solution of linear systems ofn +m equations inn +m unknowns, wheren is the dimension of the space andm is the number of constraints. Moreover, these linear systems are never positive definite. It is our feeling that this approach is somewhat artificial, since in the unconstrained case the linear systems are very often positive definite. With this in mind, we present an alternate Newton-like approach for the constrained problem in which all the linear systems are of order less than or equal ton. Furthermore, when the Hessian of the Lagrangian at the solution is positive definite (a situation frequently occurring), all our systems will be positive definite. Hence, in all cases, our Newton-like method offers greater numerical stability. We demonstrate that the convergence properties of this Newton-like method are superior to those of the standard approach to Newton's method. The operation count for the new method using Gaussian elimination is of the same order as the operation count for the standard method. However, if the Hessian of the Lagrangian at the solution is positive definite and we use Cholesky decomposition, then the order of the operation count for the new method is half that for the standard approach to Newton's method. This theory is generalized to problems with both equality and inequality constraints.     

Newton–Kantorovich approximations under weak continuity conditions

The paper is concerned with the application of Kantorovich-type majorants for the convergence of Newton’s method to a locally unique solution of a nonlinear equation in a Banach space setting. The Fréchet-derivative of the operator involved satisfies only a rather weak continuity condition. Using our new idea of recurrent functions, we obtain sufficient convergence conditions, as well as error estimates. The results compare favorably to earlier ones (Ezquerro, Hernández in IMA J. Numer. Anal. 22:187–205, 2002 and Proinov in J. Complex. 26:3–42, 2010).     

A Newton-like method for nonsmooth variational inequalities

We present new results for the local convergence of the Newton-like method to a unique solution of nondifferentiable variational inclusions in a Banach space setting using the Lipschitz-like property of set-valued mappings and the concept of slant differentiability hypothesis on the operator involved, as was introduced by X. Chen, Z. Nashed and L. Qi. The linear convergence of the Newton-like method is also established. Our results extend the applicability of the Newton-like method (Argyros and Hilout, 2009 [5] and Chen, Nashed and Qi, 2000 [7]) to variational inclusions.     

Convergence of Newton-like-iterative methods

Summary Newton-like methods in which the intermediate systems of linear equations are solved by iterative techniques are examined. By applying the theory of inexact Newton methods radius of convergence and rate of convergence results are easily obtained. The analysis is carried out in affine invariant terms. The results are applicable to cases where the underlying Newton-like method is, for example, a difference Newton-like or update-Newton method.     

Multilevel least-change Newton-like methods for equality constrained optimization problems

This paper deals with the application of multilevel least-change Newton-like methods for solving twice continuously differentiable equality constrained optimization problems. We define multilevel partial-inverse least-change updates, multilevel least-change Newton-like methods without derivatives and multilevel projections of fragments of the matrix for Newton-like methods without derivatives. Local andq-superlinear convergence of these methods is proved. The theorems here also imply local andq-superlinear convergence of many standard Newton-like methods for nonconstrained and equality constraine optimization problems.     

On the convergence and application of Newton-like methods for analytic operators

We provide local and semilocal theorems for the convergence of Newton-like methods to a locally unique solution of an equation in a Banach space. The analytic property of the operator involved replaces the usual domain condition for Newton-like methods. In the case of the local results we show that the radius of convergence can be enlarged. A numerical example is given to justify our claim. This observation is important and finds applications in steplength selection in predictor-corrector continuation procedures.