On the convergence of Newton's method for a class of nonsmooth operators

We provide an analog of the Newton–Kantorovich theorem for a certain class of nonsmooth operators. This class includes smooth operators as well as nonsmooth reformulations of variational inequalities. It turns out that under weaker hypotheses we can provide under the same computational cost over earlier works [S.M. Robinson, Newton's method for a class of nonsmooth functions, Set-Valued Anal. 2 (1994) 291–305] a semilocal convergence analysis with the following advantages: finer error bounds on the distances involved and a more precise information on the location of the solution. In the local case not examined in [S.M. Robinson, Newton's method for a class of nonsmooth functions, Set-Valued Anal. 2 (1994) 291–305] we can show how to enlarge the radius of convergence and also obtain finer error estimates. Numerical examples are also provided to show that in the semilocal case our results can apply where others [S.M. Robinson, Newton's method for a class of nonsmooth functions, Set-Valued Anal. 2 (1994) 291–305] fail, whereas in the local case we can obtain a larger radius of convergence than before [S.M. Robinson, Newton's method for a class of nonsmooth functions, Set-Valued Anal. 2 (1994) 291–305].     

Mathematical foundations of nonsmooth embedding methods

This paper establishes a mathematical foundation for application of the well known classical embedding approach to a class of nonsmooth functions, using a recently developed analogue of the derivative in cases where the functions involved fail to be differentiable in the usual sense. As part of this development we show how to obtain an extension to this case of the classical Hadamard theorem giving conditions for a map of ⁿ to itself to be a homeomorphism.The research reported here was sponsored by the National Science Foundation under Grant CCR-8801489, and by the Air Force Systems Command, USAF, under Grants AFOSR-88-0090 and AFOSR-89-0058. The US Government has certain rights in this material, and is authorized to reproduce and distribute reprints for Governmental purposes notwithstanding any copyright notation thereon.     

Some quadrature-based versions of the generalized Newton method for solving nonsmooth equations

In this paper, modifications of a generalized Newton method based on some rules of quadrature are studied. The methods considered are Newton-like iterative schemes for numerical solving systems of nonsmooth equations. Some mild conditions are given that ensure superlinear convergence to a solution. Moreover, a parameterized version of the midpoint version is presented. Finally, results of numerical tests are established.     

Convergence theorems for inertial KM-type algorithms

This paper deals with the convergence analysis of a general fixed point method which unifies KM-type (Krasnoselskii–Mann) iteration and inertial type extrapolation. This strategy is intended to speed up the convergence of algorithms in signal processing and image reconstruction that can be formulated as KM iterations. The convergence theorems established in this new setting improve known ones and some applications are given regarding convex feasibility problems, subgradient methods, fixed point problems and monotone inclusions.     

A fixed point theorem for discontinuous functions

Any function from a non-empty polytope into itself that is locally gross direction preserving is shown to have the fixed point property. Brouwer's fixed point theorem for continuous functions is a special case. We discuss the application of the result in the area of non-cooperative game theory.     

Majorizing functions and two-point Newton-type methods

The semi-local convergence of a Newton-type method used to solve nonlinear equations in a Banach space is studied. We also give, as two important applications, convergence analyses of two classes of two-point Newton-type methods including a method mentioned in [5] and the midpoint method studied in [1], [2] and [12]. Recently, interest has been shown in such methods [3] and [4].     

Fixed point iterations coupled with relaxation factors and inertial effects

This paper deals with a general fixed point method which unifies relaxation factors and a two step inertial type extrapolation. These strategies are intended to improve the convergence of many existing algorithms. A convergence theorem, which improves the known ones, is established in this new setting.     

A method based on Rayleigh quotient gradient flow for extreme and interior eigenvalue problems

Recently, a continuous method has been proposed by Golub and Liao as an alternative way to solve the minimum and interior eigenvalue problems. According to their numerical results, their method seems promising. This article is an extension along this line. In this article, firstly, we convert an eigenvalue problem to an equivalent constrained optimization problem. Secondly, using the Karush-Kuhn-Tucker conditions of this equivalent optimization problem, we obtain a variant of the Rayleigh quotient gradient flow, which is formulated by a system of differential-algebraic equations. Thirdly, based on the Rayleigh quotient gradient flow, we give a practical numerical method for the minimum and interior eigenvalue problems. Finally, we also give some numerical experiments of our method, the Golub and Liao method, and EIGS (a Matlab implementation for computing eigenvalues using restarted Arnoldi’s method) for some typical eigenvalue problems. Our numerical experiments indicate that our method seems promising for most test problems.     

On a class of higher order methods for simultaneous rootfinding of generalized polynomials

Summary Using the argument principle higher order methods for simultaneous computation of all zeros of generalized polynomials (like algebraic, trigonometric and exponential polynomials or exponential sums) are derived. The methods can also be derived following the continuation principle from [3]. Thereby, the unified approach of [7] is enlarged to arbitrary orderN. The local convergence as well as a-priori and a-posteriori error estimates for these methods are treated on a general level. Numerical examples are included.     

A novel method for robust minimisation of univariate functions with quadratic convergence

We describe a novel method for minimisation of univariate functions which exhibits an essentially quadratic convergence and whose convergence interval is only limited by the existence of near maxima. Minimisation is achieved through a fixed-point iterative algorithm, involving only the first and second-order derivatives, that eliminates the effects of near inflexion points on convergence, as usually observed in other minimisation methods based on the quadratic approximation. Comparative numerical studies against the standard quadratic and Brent's methods demonstrate clearly the high robustness, high precision and convergence rate of the new method, even when a finite difference approximation is used in the evaluation of the second-order derivative.     

On a class of Newton-like methods for solving nonlinear equations

We provide a semilocal convergence analysis for a certain class of Newton-like methods considered also in [I.K. Argyros, A unifying local-semilocal convergence analysis and applications for two-point Newton-like methods in Banach space, J. Math. Anal. Appl. 298 (2004) 374–397; I.K. Argyros, Computational theory of iterative methods, in: C.K. Chui, L. Wuytack (Eds.), Series: Studies in Computational Mathematics, vol. 15, Elsevier Publ. Co, New York, USA, 2007; J.E. Dennis, Toward a unified convergence theory for Newton-like methods, in: L.B. Rall (Ed.), Nonlinear Functional Analysis and Applications, Academic Press, New York, 1971], in order to approximate a locally unique solution of an equation in a Banach space.     

Newton's method and complex dynamical systems

This article is devoted to the discussion of Newton's method. Beginning with the old results of A.Cayley and E.Schröder we proceed to the theory of complex dynamical systems on the sphere, which was developed by G.Julia and P.Fatou at the beginning of this century, and continued by several mathematicians in recent years.     

Recurrence relations for a Newton-like method in Banach spaces

The convergence of iterative methods for solving nonlinear operator equations in Banach spaces is established from the convergence of majorizing sequences. An alternative approach is developed to establish this convergence by using recurrence relations. For example, the recurrence relations are used in establishing the convergence of Newton's method [L.B. Rall, Computational Solution of Nonlinear Operator Equations, Robert E. Krieger, New York, 1979] and the third order methods such as Halley's, Chebyshev's and super Halley's [V. Candela, A. Marquina, Recurrence relations for rational cubic methods I: the Halley method, Computing 44 (1990) 169–184; V. Candela, A. Marquina, Recurrence relations for rational cubic methods II: the Halley method, Computing 45 (1990) 355–367; J.A. Ezquerro, M.A. Hernández, Recurrence relations for Chebyshev-type methods, Appl. Math. Optim. 41 (2000) 227–236; J.M. Gutiérrez, M.A. Hernández, Third-order iterative methods for operators with bounded second derivative, J. Comput. Appl. Math. 82 (1997) 171–183; J.M. Gutiérrez, M.A. Hernández, Recurrence relations for the Super–Halley method, Comput. Math. Appl. 7(36) (1998) 1–8; M.A. Hernández, Chebyshev's approximation algorithms and applications, Comput. Math. Appl. 41 (2001) 433–445 [10]].     

A simply constructed third-order modifications of Newton's method

In this paper, we present a simple and easily applicable approach to construct some third-order modifications of Newton's method for solving nonlinear equations. It is shown by way of illustration that existing third-order methods can be employed to construct new third-order iterative methods. The proposed approach is applied to the classical Chebyshev–Halley methods to derive their second-derivative-free variants. Numerical examples are given to support that the methods thus obtained can compete with known third-order methods.     

Convergence of the variants of the Chebyshev–Halley iteration family under the Hölder condition of the first derivative

The present paper is concerned with the convergence problem of the variants of the Chebyshev–Halley iteration family with parameters for solving nonlinear operator equations in Banach spaces. Under the assumption that the first derivative of the operator satisfies the Hölder condition of order p$p$, a convergence criterion of order 1+p$1+p$ for the iteration family is established. An application to a nonlinear Hammerstein integral equation of the second kind is provided.     

A Semilocal Convergence of a Secant–Type Method for Solving Generalized Equations

In this paper we present a study of the existence and the convergence of a secant–type method for solving abstract generalized equations in Banach spaces. With different assumptions for divided differences, we obtain a procedure that have superlinear convergence. This study follows the recent results of semilocal convergence related to the resolution of nonlinear equations (see [11])     

Partitioned quasi-Newton methods for nonlinear equality constrained optimization

We derive new quasi-Newton updates for the (nonlinear) equality constrained minimization problem. The new updates satisfy a quasi-Newton equation, maintain positive definiteness on the null space of the active constraint matrix, and satisfy a minimum change condition. The application of the updates is not restricted to a small neighbourhood of the solution. In addition to derivation and motivational remarks, we discuss various numerical subtleties and provide results of numerical experiments.Research partially supported by the Applied Mathematical Sciences Research Program (KC-04-02) of the Office of Energy Research of the US Department of Energy under grant DE-FG02-86ER25013.A000, and by the US Army Research Office through the Mathematical Sciences Institute, Cornell University.     

Convergence theorems of common elements for equilibrium problems and fixed point problems in Banach spaces

The purpose of this paper is to introduce hybrid projection algorithms for finding a common element of the set of common fixed points of two quasi-?$?$-nonexpansive mappings and the set of solutions of an equilibrium problem in the framework of Banach spaces. Our results improve and extend the corresponding results announced by many others.     

BFGS trust-region method for symmetric nonlinear equations

In this paper, we propose a BFGS trust-region method for solving symmetric nonlinear equations. The global convergence and the superlinear convergence of the presented method will be established under favorable conditions. Numerical results show that the new algorithm is effective.