Newton Methods for Quasidifferentiable Equations and Their Convergence

The Newton method and the inexact Newton method for solving quasidifferentiable equations via the quasidifferential are investigated. The notion of Q-semismoothness for a quasidifferentiable function is proposed. The superlinear convergence of the Newton method proposed by Zhang and Xia is proved under the Q-semismooth assumption. An inexact Newton method is developed and its linear convergence is shown.Project sponsored by Shanghai Education Committee Grant 04EA01 and by Shanghai Government Grant T0502.     

Representative of Quasidifferentials and Its Formula for a Quasidifferentiable Function

The quasidifferential of a quasidifferentiable function in the sense of Demyanov and Rubinov is not uniquely defined. Xia proposed the notion of the kernelled quasidifferential, which is expected to be a representative for the equivalent class of quasidifferentials. In the 2-dimensional case, the existence of the kernelled quasidifferential was shown. In this paper, the existence of the kernelled quasidifferential in the n-dimensional space (n>2) is proved under the assumption that the Minkowski difference and the Demyanov difference of subdifferential and minus superdifferential coincide. In particular, given a quasidifferential, the kernelled quasidifferential can be formulated. Applications to two classes of generalized separable quasidifferentiable functions are developed. Mathematics Subject Classifications (2000) 49J52, 54C60, 90C26. This work was supported by Shanghai Education Committee (04EA01).     

Superlinear Convergence of a Newton-Type Algorithm for Monotone Equations

We consider the problem of finding solutions of systems of monotone equations. The Newton-type algorithm proposed in Ref. 1 has a very nice global convergence property in that the whole sequence of iterates generated by this algorithm converges to a solution, if it exists. Superlinear convergence of this algorithm is obtained under a standard nonsingularity assumption. The nonsingularity condition implies that the problem has a unique solution; thus, for a problem with more than one solution, such a nonsingularity condition cannot hold. In this paper, we show that the superlinear convergence of this algorithm still holds under a local error-bound assumption that is weaker than the standard nonsingularity condition. The local error-bound condition may hold even for problems with nonunique solutions. As an application, we obtain a Newton algorithm with very nice global and superlinear convergence for the minimum norm solution of linear programs.This research was supported by the Singapore-MIT Alliance and the Australian Research Council.     

Globally Convergent Broyden-Like Methods for Semismooth Equations and Applications to VIP, NCP and MCP

In this paper, we propose a general smoothing Broyden-like quasi-Newton method for solving a class of nonsmooth equations. Under appropriate conditions, the proposed method converges to a solution of the equation globally and superlinearly. In particular, the proposed method provides the possibility of developing a quasi-Newton method that enjoys superlinear convergence even if strict complementarity fails to hold. We pay particular attention to semismooth equations arising from nonlinear complementarity problems, mixed complementarity problems and variational inequality problems. We show that under certain conditions, the related methods based on the perturbed Fischer–Burmeister function, Chen–Harker–Kanzow–Smale smoothing function and the Gabriel–Moré class of smoothing functions converge globally and superlinearly.     

Optimal Secant-Type Methods for Operator Equations

We prove an existence and uniqueness theorem for operator equations in Banach spaces with (generally non-differentiable) operators whose divided differences are Lipschitz continuous on operator's domain. The theorem makes possible to apply the concept of entropy optimality of iterative methods introduced in our earlier work to the class of secant-type methods. Using this concept, we show that it is feasible to get a method that needs the same information (one value of the operator) per iteration but exhibits a faster convergence than the secant and secant-update methods.     

Hybrid Newton-Type Method for a Class of Semismooth Equations

In this paper, we present a hybrid method for the solution of a class of composite semismooth equations encountered frequently in applications. The method is obtained by combining a generalized finite-difference Newton method to an inexpensive direct search method. We prove that, under standard assumptions, the method is globally convergent with a local rate of convergence which is superlinear or quadratic. We report also several numerical results obtained applying the method to suitable reformulations of well-known nonlinear complementarity problems.     

Banach空间中半光滑算子方程的不精确牛顿法(英文)

本文主要解决Banach空间中抽象的半光滑算子方程的解法.提出了两种不精确牛顿法,它们的收敛性同时得到了证明.这两种方法可以看作是有限维空间中已存在的解半光滑算子方程的方法的延伸.     

Newton Methods for Solving Two Classes of Nonsmooth Equations

The paper is devoted to two systems of nonsmooth equations. One is the system of equations of max-type functions and the other is the system of equations of smooth compositions of max-type functions. The Newton and approximate Newton methods for these two systems are proposed. The Q-superlinear convergence of the Newton methods and the Q-linear convergence of the approximate Newton methods are established. The present methods can be more easily implemented than the previous ones, since they do not require an element of Clarke generalized Jacobian, of B-differential, or of b-differential, at each iteration point.     

非光滑方程的方向牛顿法

通过引入广义梯度,将求解含n个未知量方程的方向牛顿法推广到非光滑的情形.证明了该方法在半光滑条件下的收敛性定理,给出了解的存在性以及先验误差界.     

Lagrangian Globalization Methods for Nonlinear Complementarity Problems

This paper extends the Lagrangian globalization (LG) method to the nonsmooth equation arising from a nonlinear complementarity problem (NCP) and presents a descent algorithm for the LG phase. The aim of this paper is not to present a new method for solving the NCP, but to find such that when the NCP has a solution and is a stationary point but not a solution.     

延迟微分方程隐式Euler方法的收敛性

本文讨论了用隐式Euler方法求解一类延迟量满足Lipschitz条件且Lipschitz常数小于1的非线性变延迟微分方程初值问题的收敛性.获得了带线性插值的隐式Euler方法的收敛性结果.     

解非光滑方程组的Krylov子空间迭代法

给出了求解非光滑方程组的Newton-FOM算法和Newton-GMRES算法,证明了这些Krylov子空间方法的局部平方收敛性．数值结果表明了算法的有效性．     

Newton Linearized Methods for Semilinear Parabolic Equations

In this study, Newton linearized finite element methods are presented for solving semi-linear parabolic equations in two- and three-dimensions. The proposed scheme is a one-step, linearized and second-order method in temporal direction, while the usual linearized second-order schemes require at least two starting values. By using a temporal-spatial error splitting argument, the fully discrete scheme is proved to be convergent without time-step restrictions dependent on the spatial mesh size. Numerical examples are given to demonstrate the efficiency of the methods and to confirm the theoretical results.     

ODE Methods in Non-Local Equations

Non-local equations cannot be treated using classical ODE theorems. Nevertheless, several new methods have been introduced in the non-local gluing scheme of our previous article; we survey and improve those, and present new applications as well. First, from the explicit symbol of the conformal fractional Laplacian, a variation of constants formula is obtained for fractional Hardy operators. We thus develop, in addition to a suitable extension in the spirit of Caffarelli–Silvestre, an equivalent formulation as an infinite system of second order constant coefficient ODEs. Classical ODE quantities like the Hamiltonian and Wrońskian may then be utilized. As applications, we obtain a Frobenius theorem and establish new Pohožaev identities. We also give a detailed proof for the non-degeneracy of the fast-decay singular solution of the fractional Lane–Emden equation.     

A new eighth-order iterative method for solving nonlinear equations

In this paper we present an improvement of the fourth-order Newton-type method for solving a nonlinear equation. The new Newton-type method is shown to converge of the order eight. Per iteration the new method requires three evaluations of the function and one evaluation of its first derivative and therefore the new method has the efficiency index of , which is better than the well known Newton-type methods of lower order. We shall examine the effectiveness of the new eighth-order Newton-type method by approximating the simple root of a given nonlinear equation. Numerical comparisons are made with several other existing methods to show the performance of the presented method.     

The Lagrangian Globalization Method for Nonsmooth Constrained Equations

The difficulty suffered in optimization-based algorithms for the solution of nonlinear equations lies in that the traditional methods for solving the optimization problem have been mainly concerned with finding a stationary point or a local minimizer of the underlying optimization problem, which is not necessarily a solution of the equations. One method to overcome this difficulty is the Lagrangian globalization (LG for simplicity) method. This paper extends the LG method to nonsmooth equations with bound constraints. The absolute system of equations is introduced. A so-called Projected Generalized-Gradient Direction (PGGD) is constructed and proved to be a descent direction of the reformulated nonsmooth optimization problem. This projected approach keeps the feasibility of the iterates. The convergence of the new algorithm is established by specializing the PGGD. Numerical tests are given. This author's work was done when she was visiting The Hong Kong Polytechnic University. His work is also supported by the Research Grant Council of Hong Kong.     

Multi-Step Maruyama Methods for Stochastic Delay Differential Equations

Abstract

In this article the numerical approximation of solutions of Itô stochastic delay differential equations is considered. We construct stochastic linear multi-step Maruyama methods and develop the fundamental numerical analysis concerning their 𝕃 _p -consistency, numerical 𝕃 _p -stability and 𝕃 _p -convergence. For the special case of two-step Maruyama schemes we derive conditions guaranteeing their mean-square consistency.     

比例延迟微分方程的连续有限元法

利用连续有限元法求解比例延迟微分方程,在一致网格下,给出比例延迟微分方程连续有限元解的整体收敛阶,数值实验验证了理论结果的正确性.     

A Survey of Quasi-Newton Equations and Quasi-Newton Methods for Optimization

Quasi-Newton equations play a central role in quasi-Newton methods for optimization and various quasi-Newton equations are available. This paper gives a survey on these quasi-Newton equations and studies properties of quasi-Newton methods with updates satisfying different quasi-Newton equations. These include single-step quasi-Newton equations that use only gradient information and that use both gradient and function value information in one step, and multi-step quasi-Newton equations that use the gradient information in last m steps. Main properties of quasi-Newton methods with updates satisfying different quasi-Newton equations are studied. These properties include the finite termination property, invariance, heredity of positive definite updates, consistency of search directions, global convergence and local superlinear convergence properties.     

Fourth-Order Splitting Methods for Time-Dependant Differential Equations

This study was suggested by previous work on the simulation of evolution equations with scale-dependent processes,e.g.,wave-propagation or heat-transfer,that are modeled by wave equations or heat equations.Here,we study both parabolic and hyperbolic equations.We focus on ADI (alternating direction implicit) methods and LOD (locally one-dimensional) methods,which are standard splitting methods of lower order,e.g.second-order.Our aim is to develop higher-order ADI methods,which are performed by Richardson extrapolation,Crank-Nicolson methods and higher-order LOD methods,based on locally higher-order methods.We discuss the new theoretical results of the stability and consistency of the ADI methods.The main idea is to apply a higher- order time discretization and combine it with the ADI methods.We also discuss the dis- cretization and splitting methods for first-order and second-order evolution equations. The stability analysis is given for the ADI method for first-order time derivatives and for the LOD (locally one-dimensional) methods for second-order time derivatives.The higher-order methods are unconditionally stable.Some numerical experiments verify our results.