m步非线性多重分裂Newton法的收敛性

本文讨论了多重分裂算法在求解一类非线性方程组的全局收敛性和单侧收敛性．当用研步Newton法来代替求得每个非线性多重分裂子问题的近似解时，同样给出相应收敛性结论．数值算例证实了算法的有效性．     

超线性与二次收敛序列线性方程组算法

本文,在无严格互补条件下,对非线性不等式约束最优化问题提出了一个新的序列线性方程组(简称SSLE)算法．算法有两个重要特征:首先,每次迭代,只须求解一个线性方程组或一个广义梯度投影阵,且线性方程组可以无解．其次,初始点可以任意选取．在无严格互补条件下,算法仍有全局收敛性、强收敛性、超线性收敛性及二次收敛性．文章的最后,还对算法进行了初步的数值实验．     

修正Hestenes-Stiefel共轭梯度算法

本文探讨了Hestenes－Stiefel（HS）共轭梯度算法的收敛性条件．在无充分下降性条件下，证明了一种修正的HS共轭梯度算法的整体收敛性．     

求解伪单调变分不等式的两种投影算法

本文提出了两种求解伪单调变分不等式的定步长的投影算法．这与Solodov ＆ Tseng(1996)和He(1997)的变步长策略不同．我们证明了算法的全局收敛性，并且还在一定条件下证明了算法的Q-线性收敛性．     

大步长非单调线搜索规则的Lampariello修正对角稀疏拟牛顿算法的全局收敛性

本文在ZhangH．C．的非单调线搜索规则基础上，结合ShiZ．J．大步长线搜索技巧提出了新的大步长的非单调线搜索规则，设计了求解无约束最优化问题的大步长非单调线搜索规则的Lampariello修正对角稀疏拟牛顿算法，在△f（x）一致连续的条件下给出了算法的全局收敛性和超线性收敛性分析．数值例子表明算法是有效的，适合求解大规模问题．     

三项记忆梯度法及其投影算法的收敛性分析

对于无约束优化问题,提出了一类新的三项记忆梯度算法．这类算法是在参数满足某些假设的条件下,确定它的取值范围,从而保证三项记忆梯度方向是使目标函数充分下降的方向．在非单调步长搜索下讨论了算法的全局收敛性．为了得到具有更好收敛性质的算法,结合Solodov and Svaiter(2000)中的部分技巧,提出了一种新的记忆梯度投影算法,并证明了该算法在函数伪凸的情况下具有整体收敛性．     

非线性约束最优化一族超线性收敛的可行方法

本文建立求解非线性不等式约束最优化一族含参数的可行方法．算法每次迭代仅需解一个规模较小的二次规划．在一定的假设条件下,证明了算法族的全局收敛性和超线性收敛性．     

不等式约束最优化超线性与二次收敛的强次可行SQP算法

利用ＳＱＰ方法、广义投影技术和强次可行方（向）法思想,建立不等式约束优化一个新的初始点任意的快速收敛算法． 算法每次迭代仅需解一个总存在可行解的二次子规划,或用广义投影计算“一阶”强次可行下降辅助搜索方向;采用曲线搜索与直线搜索相结合的方法产生步长． 在较温和的条件下,算法具有全局收敛性、强收敛性、超线性与二次收敛性． 给出了算法有效的数值试验．     

Goldstein线搜索下混合共轭梯度法的全局收敛性

本文结合FR算法和DY算法,给出了一类新的杂交共轭梯度算法,并结合Goldstein线搜索,在较弱的条件下证明了算法的收敛性．数值实验表明了新算法的有效性．     

非线性不等式约束最优化一个超线性与二次收敛的强次可行方法

本文讨论非线性不等式约束最优化问题，借助于序列线性方程组技术和强次可行方法思想，建立了问题的一个初始点任意的快速收敛新算法．在每次迭代中，算法只需解一个结构简单的线性方程组．算法的初始迭代点不仅可以是任意的，而且不使用罚函数和罚参数，在迭代过程中，迭代点列的可行性单调不减．在相对弱的假设下，算法具有较好的收敛性和收敛速度，即具有整体与强收敛性，超线性与二次收敛性．文中最后给出一些数值试验结果．     

Nonlinear Schwarz iterations with reduced rank extrapolation

Extrapolation methods can be a very effective technique used for accelerating the convergence of vector sequences. In this paper, these methods are used to accelerate the convergence of Schwarz iterative methods for nonlinear problems. A new implementation of the reduced-rank-extrapolation (RRE) method is introduced. Some convergence analysis is presented, and it is shown numerically that certain extrapolation methods can indeed be very effective in accelerating the convergence of Schwarz methods.     

Necessary and sufficient conditions for the convergence of two- and three-point Newton-type iterations

Necessary and sufficient conditions under which two- and three-point iterative methods have the order of convergence р (2 ≤ р ≤ 8) are formulated for the first time. These conditions can be effectively used to prove the convergence of iterative methods. In particular, the order of convergence of some known optimal methods is verified using the proposed sufficient convergence tests. The optimal set of parameters making it possible to increase the order of convergence is found. It is shown that the parameters of the known iterative methods with the optimal order of convergence have the same asymptotic behavior. The simplicity of choosing the parameters of the proposed methods is an advantage over the other known methods.     

Convergence analysis of multigrid methods with residual scaling techniques

In this paper, multigrid methods with residual scaling techniques for symmetric positive definite linear systems are considered. The idea of perturbed two-grid methods proposed in [7] is used to estimate the convergence factor of multigrid methods with residual scaled by positive constant scaling factors. We will show that if the convergence factors of the two-grid methods are uniformly bounded by σ (σ<0.5), then the convergence factors of the W-cycle multigrid methods are uniformly bounded by σ/(1−σ), whether the residuals are scaled at some or all levels. This result extends Notay’s Theorem 3.1 in [7] to more general cases. The result also confirms the viewpoint that the W-cycle multigrid method will converge sufficiently well as long as the convergence factor of the two-grid method is small enough. In the case where the convergence factor of the two-grid method is not small enough, by appropriate choice of the cycle index γ, we can guarantee that the convergence factor of the multigrid methods with residual scaling techniques still has a uniform bound less than σ/(1−σ). Numerical experiments are provided to show that the performance of multigrid methods can be improved by scaling the residual with a constant factor. The convergence rates of the two-grid methods and the multigrid methods show that the W-cycle multigrid methods perform better if the convergence rate of the two-grid method becomes smaller. These numerical experiments support the proposed theoretical results in this paper.     

On efficient two-parameter methods for solving nonlinear equations

Derivative free methods for solving nonlinear equations of Steffensen’s type are presented. Using two self-correcting parameters, calculated by Newton’s interpolatory polynomials of second and third degree, the order of convergence is increased from 2 to 3.56. This method is used as a corrector for a family of biparametric two-step derivative free methods with and without memory with the accelerated convergence rate up to order 7. Significant acceleration of convergence is attained without any additional function calculations, which provides very high computational efficiency of the proposed methods. Another advantage is a convenient fact that the proposed methods do not use derivatives. Numerical examples are given to demonstrate excellent convergence behavior of the proposed methods and good coincidence with theoretical results.     

Multiplier convergence in trust-region methods with application to convergence of decomposition methods for MPECs

We study piecewise decomposition methods for mathematical programs with equilibrium constraints (MPECs) for which all constraint functions are linear. At each iteration of a decomposition method, one step of a nonlinear programming scheme is applied to one piece of the MPEC to obtain the next iterate. Our goal is to understand global convergence to B-stationary points of these methods when the embedded nonlinear programming solver is a trust-region scheme, and the selection of pieces is determined using multipliers generated by solving the trust-region subproblem. To this end we study global convergence of a linear trust-region scheme for linearly-constrained NLPs that we call a trust-search method. The trust-search has two features that are critical to global convergence of decomposition methods for MPECs: a robustness property with respect to switching pieces, and a multiplier convergence result that appears to be quite new for trust-region methods. These combine to clarify and strengthen global convergence of decomposition methods without resorting either to additional conditions such as eventual inactivity of the trust-region constraint, or more complex methods that require a separate subproblem for multiplier estimation.      

On the convergence of modified Newton methods for solving equations containing a non-differentiable term

We provide a semilocal convergence analysis for certain modified Newton methods for solving equations containing a non-differentiable term. The sufficient convergence conditions of the corresponding Newton methods are often taken as the sufficient conditions for the modified Newton methods. That is why the latter methods are not usually treated separately from the former. However, here we show that weaker conditions, as well as a finer error analysis than before can be obtained for the convergence of modified Newton methods. Numerical examples are also provided.     

Stepsize analysis for descent methods

The convergence rates of descent methods with different stepsize rules are compared. Among the stepsize rules considered are: constant stepsize, exact minimization along a line, Goldstein-Armijo rules, and stepsize equal to that which yields the minimum of certain interpolatory polynomials. One of the major results shown is that the rate of convergence of descent methods with the Goldstein-Armijo stepsize rules can be made as close as desired to the rate of convergence of methods that require exact minimization along a line. Also, a descent algorithm that combines a Goldstein-Armijo stepsize rule with a secant-type step is presented. It is shown that this algorithm has a convergence rate equal to the convergence of descent methods that require exact minimization along a line and that, eventually (i.e., near the minimum), it does not require a search to determine an acceptable stepsize.     

Analysis of Convergence for Improved Chebyshev–Halley Methods Under Different Conditions

In this paper, we study a class of improved Chebyshev–Halley methods in Banach spaces and prove the semilocal convergence for these methods. Compared with the super-Halley method, these methods need one less inversion of an operator, and the R-order of these methods is also higher than the one of super-Halley method under the same conditions. Using recurrence relations, we analyze the semilocal convergence for these methods under two different convergence conditions. The convergence theorems are proved to show the existence and uniqueness of a solution. We also give some numerical results to show our approach.     

Efficient methods for the inclusion of polynomial zeros

Using a suitable zero-relation and the inclusion isotonicity property, new interval iterative methods for the simultaneous inclusion of simple complex zeros of a polynomial are derived. These methods produce disks in the complex plane that contain the polynomial zeros in each iteration, providing in this manner an information about upper error bounds of approximations. Starting from the basic method of the fourth order, two accelerated methods with Newton’s and Halley’s corrections, having the order of convergence five and six respectively, are constructed. This increase of the convergence rate is obtained without any additional operations, which means that the methods with corrections are very efficient. The convergence analysis of the basic method and the methods with corrections is performed under computationally verifiable initial conditions, which is of practical importance. Two numerical examples are presented to demonstrate the convergence behavior of the proposed interval methods.     

Nongradient minimization methods for parallel processing computers,part 2

This paper analyzes the mathematical behavior of nongradient parallel minimization algorithms. The convergence of parallel synchronous iterative procedures corresponding to linearly independent direction methods and to mutually conjugate direction methods is discussed. For the latter, convergence with finite termination on quadratic objective functions and convergence on sufficiently smooth nonquadratic objective functions is proved.