一类共轭梯度法的全局收敛性

共轭梯度法是求解大规模元约束优化同题的一种有效方法，本文提出一种新的共轭梯度法，证明了在推广的Wolfe线搜索条件下方法具有全局收敛性。最后对算法进行了数值试验，试验结果表明该算法具有良好的收敛性和有效性。     

无约束优化问题的精细修正牛顿算法

针对牛顿法在求解一般非凸函数极小值过程中,迭代点处Hessian矩阵不一定正定的情况,提出了一种精细修正的牛顿法.该方法充分利用迭代点处目标函数的一阶、二阶信息,合适选取搜索方向,是最速下降法、牛顿法和已有修正牛顿法相混合的一种方法.在较弱的条件下建立了算法的全局收敛性.进一步的数值实验验证了提出的算法比以往同类算法计...     

求解非线性互补问题的一类光滑Broyden-like方法

非线性互补问题可以等价地转换为光滑方程组来求解. 基于一种新的非单调线搜索准则, 提出了求解非线性互补问题等价光滑方程组的一类新的非单调光滑 Broyden-like 算法.在适当的假设条件下, 证明了该算法的全局收敛性与局部超线性收敛性. 数值实验表明所提出的算法是有效的.     

一种求解非线性鞍点问题的交替投影方法

本文针对一类连续非线性Max-Min优化所对应的鞍点问题,提出了一种交替投影算法,证明了算法的收敛性.初步的数值实验表明本文所提出的算法比已有的同类算法具有更高的计算效率.     

矩阵分裂的单调收敛性

本文在非负矩阵分裂条件下证明了迭代算法(3)的单调收敛性,它不仅推广了[1]～[5]中的相应结果,而且在比[7]中定理较弱的条件下,得到了广义AOR迭代法的单调收敛性。本文最后还给出了一个数值例子。     

解无约束优化的一种新的共轭梯度法

本文提出了一种新的解无约束优化的共轭梯度算法,分析了算法的收敛性,并对算法进行了数值实验.数值实验的结果表明算法是有效的.     

求解非线性P_0互补问题的非单调磨光算法

提出了一种新的磨光函数,在分析它与已有磨光函数不同特性的基础上,研究了将它用于求解非线性P_0互补问题时,其磨光路径的存在性和连续性,进而设计了求解一类非线性P_0互补问题的非单调磨光算法.在适当的假设条件下,证明了该算法的全局收敛性和局部超线性收敛性.数值算例验证了算法的有效性.     

一种具有全局收敛性的求解二阶锥规划的非精确光滑算法

在方程组方法框架下,给出了一种求解二阶锥规划的非精确光滑算法.在适当的条件下,证明了该算法具有全局收敛性.数值试验表明该算法对求解中大规模二阶锥规划是有效的.     

一族新的共轭梯度法的全局收敛性

共轭梯度法是求解无约束优化问题的一种重要的方法,尤其适用于大规模优化问题的求解。本文提出一族新的共轭梯度法,证明了其在推广的Wolfe非精确线搜索条件下具有全局收敛性。最后对算法进行了数值试验,试验结果验证了该算法的有效性。     

一种基于新锥模型的自适应信赖域算法

本文提出一种自动确定信赖域半径的新锥模型信赖域算法.该算法在每步迭代中利用以前迭代点的二次信息和水平向量信息自动产生一个信赖域半径.且证明了全局收敛性及超线性收敛性,数值结果验证了新算法的有效性.     

A globally convergent BFGS method for nonlinear monotone equations without any merit functions

Since 1965, there has been significant progress in the theoretical study on quasi-Newton methods for solving nonlinear equations, especially in the local convergence analysis. However, the study on global convergence of quasi-Newton methods is relatively fewer, especially for the BFGS method. To ensure global convergence, some merit function such as the squared norm merit function is typically used. In this paper, we propose an algorithm for solving nonlinear monotone equations, which combines the BFGS method and the hyperplane projection method. We also prove that the proposed BFGS method converges globally if the equation is monotone and Lipschitz continuous without differentiability requirement on the equation, which makes it possible to solve some nonsmooth equations. An attractive property of the proposed method is that its global convergence is independent of any merit function.We also report some numerical results to show efficiency of the proposed method.

     

Gauss-Newton-based BFGS method with filter for unconstrained minimization

One class of the lately developed methods for solving optimization problems are filter methods. In this paper we attached a multidimensional filter to the Gauss-Newton-based BFGS method given by Li and Fukushima [D. Li, M. Fukushima, A globally and superlinearly convergent Gauss-Newton-based BFGS method for symmetric nonlinear equations, SIAM Journal of Numerical Analysis 37(1) (1999) 152-172] in order to reduce the number of backtracking steps. The proposed filter method for unconstrained minimization problems converges globally under the standard assumptions. It can also be successfully used in solving systems of symmetric nonlinear equations. Numerical results show reasonably good performance of the proposed algorithm.     

A Globally Convergent Trust-Region Method for Large-Scale Symmetric Nonlinear Systems

This study presents a novel adaptive trust-region method for solving symmetric nonlinear systems of equations. The new method uses a derivative-free quasi-Newton formula in place of the exact Jacobian. The global convergence and local quadratic convergence of the new method are established without the nondegeneracy assumption of the exact Jacobian. Using the compact limited memory BFGS, we adapt a version of the new method for solving large-scale problems and develop the dogleg scheme for solving the associated trust-region subproblems. The sufficient decrease condition for the adapted dogleg scheme is established. While the efficiency of the present trust-region approach can be improved by using adaptive radius techniques, utilizing the compact limited memory BFGS adjusts this approach to handle large-scale symmetric nonlinear systems of equations. Preliminary numerical results for both medium- and large-scale problems are reported.     

A class of conjugate gradient methods for convex constrained monotone equations

The recent designed non-linear conjugate gradient method of Dai and Kou [SIAM J Optim. 2013;23:296–320] is very efficient currently in solving large-scale unconstrained minimization problems due to its simpler iterative form, lower storage requirement and its closeness to the scaled memoryless BFGS method. Just because of these attractive properties, this method was extended successfully to solve higher dimensional symmetric non-linear equations in recent years. Nevertheless, its numerical performance in solving convex constrained monotone equations has never been explored. In this paper, combining with the projection method of Solodov and Svaiter, we develop a family of non-linear conjugate gradient methods for convex constrained monotone equations. The proposed methods do not require the Jacobian information of equations, and even they do not store any matrix in each iteration. They are potential to solve non-smooth problems with higher dimensions. We prove the global convergence of the class of the proposed methods and establish its R-linear convergence rate under some reasonable conditions. Finally, we also do some numerical experiments to show that the proposed methods are efficient and promising.     

凸约束伪单调方程组的无导数投影算法

基于HS共轭梯度法的结构,本文在弱假设条件下建立了一种求解凸约束伪单调方程组问题的迭代投影算法.该算法不需要利用方程组的任何梯度或Jacobian矩阵信息,因此它适合求解大规模问题.算法在每一次迭代中都能产生充分下降方向,且不依赖于任何线搜索条件.特别是,我们在不需要假设方程组满足Lipschitz条件下建立了算法的全...     

A BFGS algorithm for solving symmetric nonlinear equations

In this article, we propose a BFGS method for solving symmetric nonlinear equations. The presented method possesses some favourable properties: (a) the generated sequence of iterates is norm descent; (b) the generated sequence of the quasi-Newton matrix is positive definite and (c) this method possesses the global convergence and superlinear convergence. Numerical results show that the presented method is interesting.     

An improved nonlinear conjugate gradient method with an optimal property

Conjugate gradient methods have played a special role in solving large scale nonlinear problems. Recently, the author and Dai proposed an efficient nonlinear conjugate gradient method called CGOPT, through seeking the conjugate gradient direction closest to the direction of the scaled memoryless BFGS method. In this paper, we make use of two types of modified secant equations to improve CGOPT method. Under some assumptions, the improved methods are showed to be globally convergent. Numerical results are also reported.     

解可分离结构变分不等式的一种新的交替方向法

交替方向法是求解可分离结构变分不等式问题的经典方法之一, 它将一个大型的变分不等式问题分解成若干个小规模的变分不等式问题进行迭代求解. 但每步迭代过程中求解的子问题仍然摆脱不了求解变分不等式子问题的瓶颈. 从数值计算上来说, 求解一个变分不等式并不是一件容易的事情.因此, 本文提出一种新的交替方向法, 每步迭代只需要求解一个变分不等式子问题和一个强单调的非线性方程组子问题. 相对变分不等式问题而言, 我们更容易、且有更多的有效算法求解一个非线性方程组问题. 在与经典的交替方向法相同的假设条件下, 我们证明了新算法的全局收敛性. 进一步的数值试验也验证了新算法的有效性.     

The Global Convergence of Self-Scaling BFGS Algorithm with Nonmonotone Line Search for Unconstrained Nonconvex Optimization Problems

The self-scaling quasi-Newton method solves an unconstrained optimization problem by scaling the Hessian approximation matrix before it is updated at each iteration to avoid the possible large eigenvalues in the Hessian approximation matrices of the objective function. It has been proved in the literature that this method has the global and superlinear convergence when the objective function is convex （or even uniformly convex）. We propose to solve unconstrained nonconvex optimization problems by a self-scaling BFGS algorithm with nonmonotone linear search. Nonmonotone line search has been recognized in numerical practices as a competitive approach for solving large-scale nonlinear problems. We consider two different nonmonotone line search forms and study the global convergence of these nonmonotone self-scale BFGS algorithms. We prove that, under some weaker condition than that in the literature, both forms of the self-scaling BFGS algorithm are globally convergent for unconstrained nonconvex optimization problems.     

一个四阶收敛的牛顿类方法

A fourth-order convergence method of solving roots for nonlinear equation,which is a variant of Newton's method given.Its convergence properties is proved.It is at least fourth-order convergence near simple roots and one order convergence near multiple roots. In the end,numerical tests are given and compared with other known Newton and Newtontype methods.The results show that the proposed method has some more advantages than others.It enriches the methods to find the roots of non-linear equations and it ...