A variant of Steffensen’s method of fourth-order convergence and its applications

In this paper, a variant of Steffensen’s method of fourth-order convergence for solving nonlinear equations is suggested. Its error equation and asymptotic convergence constant are proven theoretically and demonstrated numerically. The derivative-free method only uses three evaluations of the function per iteration to achieve fourth-order convergence. Its applications on systems of nonlinear equations and boundary-value problems of nonlinear ODEs are showed as well in the numerical examples.     

A Steffensen-like method and its higher-order variants

For solving nonlinear equations, we suggest a second-order parametric Steffensen-like method, which is derivative free and only uses two evaluations of the function in one step. We also suggest a variant of the Steffensen-like method which is still derivative free and uses four evaluations of the function to achieve cubic convergence. Moreover, a fast Steffensen-like method with super quadratic convergence and a fast variant of the Steffensen-like method with super cubic convergence are proposed by using a parameter estimation. The error equations and asymptotic convergence constants are obtained for the discussed methods. The numerical results and the basins of attraction support the proposed methods.     

A comparison of the Newton-Krylov method with high order Newton-like methods to solve nonlinear systems

We compare the CPU time and error estimates of some variants of Newton method of the third and fourth-order convergence with those of the Newton-Krylov method used to solve systems of nonlinear equations. By expanding some numerical experiments we show that the use of Newton-Krylov method is better in the cost and accuracy points of view than the use of other high order Newton-like methods when the system is sparse and its size is large.     

Third-order iterative methods free from second derivatives for nonlinear equation

In this paper, we suggest and analyze a new two-step iterative method for solving nonlinear equations, which is called the modified Householder method without second derivatives for nonlinear equation. We also prove that the modified method has cubic convergence. Several examples are given to illustrate the efficiency and the performance of the new method. New method can be considered as an alternative to the present cubic convergent methods for solving nonlinear equations.     

非线性不等式约束最优化一个超线性与二次收敛的强次可行方法

本文讨论非线性不等式约束最优化问题，借助于序列线性方程组技术和强次可行方法思想，建立了问题的一个初始点任意的快速收敛新算法．在每次迭代中，算法只需解一个结构简单的线性方程组．算法的初始迭代点不仅可以是任意的，而且不使用罚函数和罚参数，在迭代过程中，迭代点列的可行性单调不减．在相对弱的假设下，算法具有较好的收敛性和收敛速度，即具有整体与强收敛性，超线性与二次收敛性．文中最后给出一些数值试验结果．     

Existence theorems of periodic solutions for fourth-order nonlinear functional difference equations

By using of the critical point method, the existence of periodic solutions for fourth-order nonlinear functional difference equations is obtained. The main approaches used in our paper are variational techniques and the Saddle Point Theorem. The problem is to solve the existence of periodic solutions of fourth-order nonlinear functional difference equations. Results obtained generalize and complement the existing one.     

An efficient analytic approach for solving two‐point nonlinear boundary value problems by homotopy analysis method

In this paper, we use homotopy analysis method (HAM) to solve two‐point nonlinear boundary value problems that have at least one solution. The new approach provides the solution in the form of a rapidly convergent series with easily computable components using symbolic computation software. The scheme shows importance of choice of convergence‐control parameter ? to guarantee the convergence of the solutions of nonlinear differential equations. This scheme is tested on three nonlinear exactly solvable differential equations. Two of the examples are practical in science and engineering. The results demonstrate reliability, simplicity and efficiency of the algorithm developed. Copyright © 2011 John Wiley & Sons, Ltd.     

Convergence analysis of modified Newton-HSS method for solving systems of nonlinear equations

Hermitian and skew-Hermitian splitting(HSS) method has been proved quite successfully in solving large sparse non-Hermitian positive definite systems of linear equations. Recently, by making use of HSS method as inner iteration, Newton-HSS method for solving the systems of nonlinear equations with non-Hermitian positive definite Jacobian matrices has been proposed by Bai and Guo. It has shown that the Newton-HSS method outperforms the Newton-USOR and the Newton-GMRES iteration methods. In this paper, a class of modified Newton-HSS methods for solving large systems of nonlinear equations is discussed. In our method, the modified Newton method with R-order of convergence three at least is used to solve the nonlinear equations, and the HSS method is applied to approximately solve the Newton equations. For this class of inexact Newton methods, local and semilocal convergence theorems are proved under suitable conditions. Moreover, a globally convergent modified Newton-HSS method is introduced and a basic global convergence theorem is proved. Numerical results are given to confirm the effectiveness of our method.     

Convergence and spectral analysis of the Frontini-Sormani family of multipoint third order methods from quadrature rule

Point of attraction theory is an important tool to analyze the local convergence of iterative methods for solving systems of nonlinear equations. In this work, we prove a generalized form of Ortega-Rheinbolt result based on point of attraction theory. The new result guarantees that the solution of the nonlinear system is a point of attraction of iterative scheme, especially multipoint iterations. We then apply it to study the attraction theorem of the Frontini-Sormani family of multipoint third order methods from Quadrature Rule. Error estimates are given and compared with existing ones. We also obtain the radius of convergence of the special members of the family. Two numerical examples are provided to illustrate the theory. Further, a spectral analysis of the Discrete Fourier Transform of the numerical errors is conducted in order to find the best method of the family. The convergence and the spectral analysis of a multistep version of one of the special member of the family are studied.     

On a numerical technique for finding multiple zeros and its dynamic

An optimal method is developed for approximating the multiple zeros of a nonlinear function, when the multiplicity is known. Analysis of convergence for the proposed technique is studied to reveal the fourth-order convergence. We further investigate the dynamics of such multiple zero finders by using basins of attraction and their corresponding fractals in the complex plane. A fourth-order method will also be presented, when the multiplicity m is not known. Numerical comparisons will be made to support the underlying theory of this paper.     

一种新的迭代收敛阶数的证明与推广

迭代方法是求解非线性方程近似根的重要方法.本文基于隐函数存在定理,提出了一种新的迭代方法收敛性和收敛阶数的证明方法,并分别对牛顿(Newton)和柯西(Cauchy)迭代方法迭代收敛性和收敛阶数进行了证明.最后,利用本文提出的证明方法,证明了基于三次泰勒(Taylor)展式构成的迭代格式是收敛的,收敛阶数至少为4,并提出猜想,基于n次泰勒展式构成的迭代格式是收敛的,收敛阶数至少为(n+1).     

Variants of Steffensen-secant method and applications

In this paper, a parametric variant of Steffensen-secant method and three fast variants of Steffensen-secant method for solving nonlinear equations are suggested. They achieve cubic convergence or super cubic convergence for finding simple roots by only using three evaluations of the function per step. Their error equations and asymptotic convergence constants are deduced. Modified Steffensen’s method and modified parametric variant of Steffensen-secant method for finding multiple roots are also discussed. In the numerical examples, the suggested methods are supported by the solution of nonlinear equations and systems of nonlinear equations, and the application in the multiple shooting method.     

Fast and Robust Sixth Order Multigrid Computation for 3D Convection Diffusion Equation

We present a sixth-order explicit compact finite difference scheme to solve the three-dimensional (3D) convection-diffusion equation. We first use a multiscale multigrid method to solve the linear systems arising from a 19-point fourth-order discretization scheme to compute the fourth-order solutions on both a coarse grid and a fine grid. Then an operator-based interpolation scheme combined with an extrapolation technique is used to approximate the sixth-order accurate solution on the fine grid. Since the multigrid method using a standard point relaxation smoother may fail to achieve the optimal grid-independent convergence rate for solving convection-diffusion equations with a high Reynolds number, we implement the plane relaxation smoother in the multigrid solver to achieve better grid independency. Supporting numerical results are presented to demonstrate the efficiency and accuracy of the sixth-order compact (SOC) scheme, compared with the previously published fourth-order compact (FOC) scheme.     

Analysis of two Chebyshev-like third order methods free from second derivatives for solving systems of nonlinear equations

In this paper, two Chebyshev-like third order methods free from second derivatives are considered and analyzed for systems of nonlinear equations. The methods can be obtained by having different approximations to the second derivatives present in the Chebyshev method. We study the local and third order convergence of the methods using the point of attraction theory. The computational aspects of the methods are also studied using some numerical experiments including an application to the Chandrasekhar integral equations in Radiative Transfer.     

Use of Halley's Method in the Nonlinear Finite Element Analysis

Halley's method is a higher order iteration method for the solution of nonlinear systems of equations. Unlike Newton's method, which converges quadratically in the vicinity of the solution, Halley's method can exhibit a cubic order of convergence. The equations of Halley's method for multiple dimensions are derived using Padé approximants and inverse one-point interpolation, as proposed by Cuyt. The investigation of the performance of Halley's method concentrates on eight-node volume elements for nonlinear deformations using Staint Venant-Kirchhoff's constitutive law, as well as a geometric linear theory of von Mises plasticity. The comparison with Newton's method reveals the sensibility of Halley's method, in view of the radius of attraction but also demonstrates the advantages of Halley's method considering simulation costs and the order of convergence. (© 2010 Wiley-VCH Verlag GmbH & Co. KGaA, Weinheim)     

Fourth-order compact finite difference method for fourth-order nonlinear elliptic boundary value problems

A compact finite difference method with non-isotropic mesh is proposed for a two-dimensional fourth-order nonlinear elliptic boundary value problem. The existence and uniqueness of its solutions are investigated by the method of upper and lower solutions, without any requirement of the monotonicity of the nonlinear term. Three monotone and convergent iterations are provided for resolving the resulting discrete systems efficiently. The convergence and the fourth-order accuracy of the proposed method are proved. Numerical results demonstrate the high efficiency and advantages of this new approach.     

A Constrained Optimization Approach for LCP

In this paper, LCP is converted to an equivalent nonsmooth nonlinear equation system H(x,y) = 0 by using the famous NCP function-Fischer-Burmeister function. Note that some equations in H(x, y) = 0 are nonsmooth and nonlinear hence difficult to solve while the others are linear hence easy to solve. Then we further convert the nonlinear equation system H(x, y) = 0 to an optimization problem with linear equality constraints. After that we study the conditions under which the K-T points of the optimization problem are the solutions of the original LCP and propose a method to solve the optimization problem. In this algorithm, the search direction is obtained by solving a strict convex programming at each iterative point, However, our algorithm is essentially different from traditional SQP method. The global convergence of the method is proved under mild conditions. In addition, we can prove that the algorithm is convergent superlinearly under the conditions: M is P0 matrix and the limit point is a strict complementarity solution of LCP. Preliminary numerical experiments are reported with this method.     

Some improvements of Jarratt’s method with sixth-order convergence

In this paper, we present a one-parameter family of variants of Jarratt’s fourth-order method for solving nonlinear equations. It is shown that the order of convergence of each family member is improved from four to six even though it adds one evaluation of the function at the point iterated by Jarratt’s method per iteration. Several numerical examples are given to illustrate the performance of the presented methods.     

Über die näherungsweise Lösung nichtlinearer Integralgleichungen

Summary In this paper we study the iterative solvability of nonlinear systems of equations which arise from the discretization of Hammerstein integral equations. It is shown that, for a large class of equations satisfying monotonicity assumptions, it is possible to solve these systems by means of a linearly convergent iteration method. Moreover, for general monotone operators on a Hilbert space a globally convergent variant of Newton's method is given. Finally it is shown that this method effectively can be applied in a natural way to the systems of equations under consideration.     

A modified SSOR iterative method for augmented systems

Golub, Wu and Yuan [G.H. Golub, X. Wu, J.Y. Yuan, SOR-like methods for augmented systems, BIT 41 (2001) 71–85] have presented the SOR-like algorithm to solve augmented systems. In this paper, we present the modified symmetric successive overrelaxation (MSSOR) method for solving augmented systems, which is based on Darvishi and Hessari’s work above. We derive its convergence under suitable restrictions on the iteration parameter, determine its optimal iteration parameter and the corresponding optimal convergence factor under certain conditions. Finally, we apply the MSSOR method to solve augmented systems.