On the convergence of modified Newton methods for solving equations containing a non-differentiable term

We provide a semilocal convergence analysis for certain modified Newton methods for solving equations containing a non-differentiable term. The sufficient convergence conditions of the corresponding Newton methods are often taken as the sufficient conditions for the modified Newton methods. That is why the latter methods are not usually treated separately from the former. However, here we show that weaker conditions, as well as a finer error analysis than before can be obtained for the convergence of modified Newton methods. Numerical examples are also provided.     

Extending the Newton-Kantorovich hypothesis for solving equations

The famous Newton-Kantorovich hypothesis (Kantorovich and Akilov, 1982 [3], Argyros, 2007 [2], Argyros and Hilout, 2009 [7]) has been used for a long time as a sufficient condition for the convergence of Newton’s method to a solution of an equation in connection with the Lipschitz continuity of the Fréchet-derivative of the operator involved. Here, using Lipschitz and center-Lipschitz conditions, and our new idea of recurrent functions, we show that the Newton-Kantorovich hypothesis can be weakened, under the same information. Moreover, the error bounds are tighter than the corresponding ones given by the dominating Newton-Kantorovich theorem (Argyros, 1998 [1]; [2] and [7]; Ezquerro and Hernández, 2002 [11]; [3]; Proinov 2009, 2010 [16] and [17]).Numerical examples including a nonlinear integral equation of Chandrasekhar-type (Chandrasekhar, 1960 [9]), as well as a two boundary value problem with a Green’s kernel (Argyros, 2007 [2]) are also provided in this study.     

On the convergence of Newton's method for a class of nonsmooth operators

We provide an analog of the Newton–Kantorovich theorem for a certain class of nonsmooth operators. This class includes smooth operators as well as nonsmooth reformulations of variational inequalities. It turns out that under weaker hypotheses we can provide under the same computational cost over earlier works [S.M. Robinson, Newton's method for a class of nonsmooth functions, Set-Valued Anal. 2 (1994) 291–305] a semilocal convergence analysis with the following advantages: finer error bounds on the distances involved and a more precise information on the location of the solution. In the local case not examined in [S.M. Robinson, Newton's method for a class of nonsmooth functions, Set-Valued Anal. 2 (1994) 291–305] we can show how to enlarge the radius of convergence and also obtain finer error estimates. Numerical examples are also provided to show that in the semilocal case our results can apply where others [S.M. Robinson, Newton's method for a class of nonsmooth functions, Set-Valued Anal. 2 (1994) 291–305] fail, whereas in the local case we can obtain a larger radius of convergence than before [S.M. Robinson, Newton's method for a class of nonsmooth functions, Set-Valued Anal. 2 (1994) 291–305].     

Newton's method for a class of nonsmooth functions

This paper presents and justifies a Newton iterative process for finding zeros of functions admitting a certain type of approximation. This class includes smooth functions as well as nonsmooth reformulations of variational inequalities. We prove for this method an analogue of the fundamental local convergence theorem of Kantorovich including optimal error bounds.The research reported here was sponsored by the National Science Foundation under Grants CCR-8801489 and CCR-9109345, by the Air Force Systems Command, USAF, under Grants AFOSR-88-0090 and F49620-93-1-0068, by the U. S. Army Research Office under Grant No. DAAL03-92-G-0408, and by the U. S. Army Space and Strategic Defense Command under Contract No. DASG60-91-C-0144. The U. S. Government has certain rights in this material, and is authorized to reproduce and distribute reprints for Governmental purposes notwithstanding any copyright notation thereon.     

On a class of Newton-like methods for solving nonlinear equations

We provide a semilocal convergence analysis for a certain class of Newton-like methods considered also in [I.K. Argyros, A unifying local-semilocal convergence analysis and applications for two-point Newton-like methods in Banach space, J. Math. Anal. Appl. 298 (2004) 374–397; I.K. Argyros, Computational theory of iterative methods, in: C.K. Chui, L. Wuytack (Eds.), Series: Studies in Computational Mathematics, vol. 15, Elsevier Publ. Co, New York, USA, 2007; J.E. Dennis, Toward a unified convergence theory for Newton-like methods, in: L.B. Rall (Ed.), Nonlinear Functional Analysis and Applications, Academic Press, New York, 1971], in order to approximate a locally unique solution of an equation in a Banach space.     

A generalized Jacobian based Newton method for semismooth block-triangular system of equations

This paper will consider the problem of solving the nonlinear system of equations with block-triangular structure. A generalized block Newton method for semismooth sparse system is presented and a locally superlinear convergence is proved. Moreover, locally linear convergence of some parameterized Newton method is shown.     

A semismooth Newton method for topology optimization

This paper deals with elliptic optimal control problems for which the control function is constrained to assume values in {0, 1}. Based on an appropriate formulation of the optimality system, a semismooth Newton method is proposed for the solution. Convergence results are proved, and some numerical tests illustrate the efficiency of the method.     

On the semilocal convergence of inexact Newton methods in Banach spaces

We provide two types of semilocal convergence theorems for approximating a solution of an equation in a Banach space setting using an inexact Newton method [I.K. Argyros, Relation between forcing sequences and inexact Newton iterates in Banach spaces, Computing 63 (2) (1999) 134–144; I.K. Argyros, A new convergence theorem for the inexact Newton method based on assumptions involving the second Fréchet-derivative, Comput. Appl. Math. 37 (7) (1999) 109–115; I.K. Argyros, Forcing sequences and inexact Newton iterates in Banach space, Appl. Math. Lett. 13 (1) (2000) 77–80; I.K. Argyros, Local convergence of inexact Newton-like iterative methods and applications, Comput. Math. Appl. 39 (2000) 69–75; I.K. Argyros, Computational Theory of Iterative Methods, in: C.K. Chui, L. Wuytack (Eds.), in: Studies in Computational Mathematics, vol. 15, Elsevier Publ. Co., New York, USA, 2007; X. Guo, On semilocal convergence of inexact Newton methods, J. Comput. Math. 25 (2) (2007) 231–242]. By using more precise majorizing sequences than before [X. Guo, On semilocal convergence of inexact Newton methods, J. Comput. Math. 25 (2) (2007) 231–242; Z.D. Huang, On the convergence of inexact Newton method, J. Zheijiang University, Nat. Sci. Ed. 30 (4) (2003) 393–396; L.V. Kantorovich, G.P. Akilov, Functional Analysis, Pergamon Press, Oxford, 1982; X.H. Wang, Convergence on the iteration of Halley family in weak condition, Chinese Sci. Bull. 42 (7) (1997) 552–555; T.J. Ypma, Local convergence of inexact Newton methods, SIAM J. Numer. Anal. 21 (3) (1984) 583–590], we provide (under the same computational cost) under the same or weaker hypotheses: finer error bounds on the distances involved; an at least as precise information on the location of the solution. Moreover if the splitting method is used, we show that a smaller number of inner/outer iterations can be obtained.     

On constrained Newton linearization and multigrid for variational inequalities

Summary. We consider the fast solution of a class of large, piecewise smooth minimization problems. For lack of smoothness, usual Newton multigrid methods cannot be applied. We propose a new approach based on a combination of convex minization with constrained Newton linearization. No regularization is involved. We show global convergence of the resulting monotone multigrid methods and give polylogarithmic upper bounds for the asymptotic convergence rates. Efficiency is illustrated by numerical experiments. Received March 22, 1999 / Revised version received February 24, 2001 / Published online October 17, 2001     

Mathematical foundations of nonsmooth embedding methods

This paper establishes a mathematical foundation for application of the well known classical embedding approach to a class of nonsmooth functions, using a recently developed analogue of the derivative in cases where the functions involved fail to be differentiable in the usual sense. As part of this development we show how to obtain an extension to this case of the classical Hadamard theorem giving conditions for a map of ⁿ to itself to be a homeomorphism.The research reported here was sponsored by the National Science Foundation under Grant CCR-8801489, and by the Air Force Systems Command, USAF, under Grants AFOSR-88-0090 and AFOSR-89-0058. The US Government has certain rights in this material, and is authorized to reproduce and distribute reprints for Governmental purposes notwithstanding any copyright notation thereon.     

On the Newton method for set-valued maps

The Newton method is one of the most powerful tools used to solve systems of nonlinear equations. Its set-valued generalization, considered in this work, allows one to solve also nonlinear equations with geometric constraints and systems of inequalities in a unified manner. The emphasis is given to systems of linear inequalities. The study of the well-posedness of the algorithm and of its convergence is fulfilled in the framework of modern variational analysis.     

Waveform relaxation for reaction-diffusion equations

We report a new waveform relaxation (WR) algorithm for general semi-linear reaction-diffusion equations. The superlinear rate of convergence of the new WR algorithm is proved, and we also show the advantages of the new approach superior to the classical WR algorithms by the estimation on iteration errors. The corresponding discrete WR algorithm for reaction-diffusion equations is presented, and further the parallelism of the discrete WR algorithm is analyzed. Moreover, the new approach is extended to handle the coupled reaction-diffusion equations. Numerical experiments are carried out to verify the effectiveness of the theoretic work.     

On an iterative algorithm with superquadratic convergence for solving nonlinear operator equations

We study an iterative method with order for solving nonlinear operator equations in Banach spaces. Algorithms for specific operator equations are built up. We present the received new results of the local and semilocal convergence, in case when the first-order divided differences of a nonlinear operator are Hölder continuous. Moreover a quadratic nonlinear majorant for a nonlinear operator, according to the conditions laid upon it, is built. A priori and a posteriori estimations of the method’s error are received. The method needs almost the same number of computations as the classical Secant method, but has a higher order of convergence. We apply our results to the numerical solving of a nonlinear boundary value problem of second-order and to the systems of nonlinear equations of large dimension.     

Mesh-independence of semismooth Newton methods for Lavrentiev-regularized state constrained nonlinear optimal control problems

A class of nonlinear elliptic optimal control problems with mixed control-state constraints arising, e.g., in Lavrentiev-type regularized state constrained optimal control is considered. Based on its first order necessary optimality conditions, a semismooth Newton method is proposed and its fast local convergence in function space as well as a mesh-independence principle for appropriate discretizations are proved. The paper ends by a numerical verification of the theoretical results including a study of the algorithm in the case of vanishing Lavrentiev-parameter. The latter process is realized numerically by a combination of a nested iteration concept and an extrapolation technique for the state with respect to the Lavrentiev-parameter.     

A cyclic iterative method for solving Multiple Sets Split Feasibility Problems in Banach Spaces

In this paper, we construct an iterative scheme and prove strong convergence theorem of the sequence generated to an approximate solution to a multiple sets split feasibility problem in a p-uniformly convex and uniformly smooth real Banach space. Some numerical experiments are given to study the efficiency and implementation of our iteration method. Our result complements the results of F. Wang (A new algorithm for solving the multiple-sets split feasibility problem in Banach spaces, Numerical Functional Anal. Optim. 35 (2014), 99–110), F. Scho¨pfer et al. (An iterative regularization method for the solution of the split feasibility problem in Banach spaces, Inverse Problems 24 (2008), 055008) and many important recent results in this direction.     

Affine scaling interior Levenberg–Marquardt method for bound-constrained semismooth equations under local error bound conditions

We develop and analyze a new affine scaling Levenberg–Marquardt method with nonmonotonic interior backtracking line search technique for solving bound-constrained semismooth equations under local error bound conditions. The affine scaling Levenberg–Marquardt equation is based on a minimization of the squared Euclidean norm of linear model adding a quadratic affine scaling matrix to find a solution that belongs to the bounded constraints on variable. The global convergence results are developed in a very general setting of computing trial directions by a semismooth Levenberg–Marquardt method where a backtracking line search technique projects trial steps onto the feasible interior set. We establish that close to the solution set the affine scaling interior Levenberg–Marquardt algorithm is shown to converge locally Q-superlinearly depending on the quality of the semismooth and Levenberg–Marquardt parameter under an error bound assumption that is much weaker than the standard nonsingularity condition, that is, BD-regular condition under nonsmooth case. A nonmonotonic criterion should bring about speed up the convergence progress in the contours of objective function with large curvature.     

A perturbed version of an inexact generalized Newton method for solving nonsmooth equations

In this paper, we present the combination of the inexact Newton method and the generalized Newton method for solving nonsmooth equations F(x)?=?0, characterizing the local convergence in terms of the perturbations and residuals. We assume that both iteration matrices taken from the B-differential and vectors F(x ^(k)) are perturbed at each step. Some results are motivated by the approach of C?tina? regarding to smooth equations. We study the conditions, which determine admissible magnitude of perturbations to preserve the convergence of method. Finally, the utility of these results is considered based on some variant of the perturbed inexact generalized Newton method for solving some general optimization problems.     

A characteristic finite element method for optimal control problems governed by convection-diffusion equations

In this paper we analyze a characteristic finite element approximation of convex optimal control problems governed by linear convection-dominated diffusion equations with pointwise inequality constraints on the control variable, where the state and co-state variables are discretized by piecewise linear continuous functions and the control variable is approximated by either piecewise constant functions or piecewise linear discontinuous functions. A priori error estimates are derived for the state, co-state and the control. Numerical examples are given to show the efficiency of the characteristic finite element method.     

Improved local convergence of Newton’s method under weak majorant condition

We provide a local convergence analysis for Newton’s method under a weak majorant condition in a Banach space setting. Our results provide under the same information a larger radius of convergence and tighter error estimates on the distances involved than before [14]. Special cases and numerical examples are also provided in this study.     

A modified accelerated monotone iterative method for finite difference reaction-diffusion-convection equations

This paper is concerned with monotone algorithms for the finite difference solutions of a class of nonlinear reaction-diffusion-convection equations with nonlinear boundary conditions. A modified accelerated monotone iterative method is presented to solve the finite difference systems for both the time-dependent problem and its corresponding steady-state problem. This method leads to a simple and yet efficient linear iterative algorithm. It yields two sequences of iterations that converge monotonically from above and below, respectively, to a unique solution of the system. The monotone property of the iterations gives concurrently improving upper and lower bounds for the solution. It is shown that the rate of convergence for the sum of the two sequences is quadratic. Under an additional requirement, quadratic convergence is attained for one of these two sequences. In contrast with the existing accelerated monotone iterative methods, our new method avoids computing local maxima in the construction of these sequences. An application using a model problem gives numerical results that illustrate the effectiveness of the proposed method.