一个新的无约束优化超记忆梯度算法

本文提出一种新的无约束优化超记忆梯度算法,算法利用当前点的负梯度和前一点的负梯度的线性组合为搜索方向,以精确线性搜索和Armijo搜索确定步长．在很弱的条件下证明了算法具有全局收敛性和线性收敛速度．因算法中避免了存贮和计算与目标函数相关的矩阵,故适于求解大型无约束优化问题．数值实验表明算法比一般的共轭梯度算法有效．     

非凸函数极小问题的BFGS算法

本对于非凸函数的无约束优化问题，给出一类修正的BFGS算法。算法的思想是对非凸函数的近似Hesse矩阵进行修正，得到下降方向，并且保证拟牛顿条件成立，当步长采用线性搜索一般模型时，证明了该算法的局部收敛性。     

大步长非单调线搜索规则的Lampariello修正对角稀疏拟牛顿算法的全局收敛性

本文在ZhangH．C．的非单调线搜索规则基础上，结合ShiZ．J．大步长线搜索技巧提出了新的大步长的非单调线搜索规则，设计了求解无约束最优化问题的大步长非单调线搜索规则的Lampariello修正对角稀疏拟牛顿算法，在△f（x）一致连续的条件下给出了算法的全局收敛性和超线性收敛性分析．数值例子表明算法是有效的，适合求解大规模问题．     

一类非单调算法的收敛性质

1.搜索步长和搜索方向对于无约束最优化问题(?)f(x),其中f:R~n→R~1,f∈C~1,一般采用形如x_(k 1)=x_k λ_kd_k(k=1,2,…)的迭代算法来求解,这里λ_k为搜索步长,d_k为搜索方向.     

一类非单调算法的收敛性质

1.搜索步长和搜索方向对于无约束最优化问题(?)f(x),其中f:R~n→R~1,f∈C~1,一般采用形如x_(k+1)=x_k+λ_kd_k(k=1,2,…)的迭代算法来求解,这里λ_k为搜索步长,d_k为搜索方向.     

Armijo线性搜索下的多步下降算法

本文研究无约束优化问题.利用前面多步迭代点的信息产生下降方向以及Armijo线性搜索产生步长,得到了一类新的多步下降算法,并且在较弱条件下证明了算法具有全局收敛性和线性收敛速率.初步的数值试验表明算法是有效的.     

一类新的曲线搜索下的记忆梯度法

提出一类新的求解无约束优化问题的记忆梯度法,在较弱条件下证明了算法具有全局收敛性和线性收敛速率.算法采用曲线搜索方法,在每一步同时确定搜索方向和步长,收敛稳定,并且不需计算和存储矩阵,适于求解大规模优化问题.数值试验表明算法是有效的.     

一类新的求解无约束优化问题的记忆梯度法

本文研究了无约束优化问题.利用当前和前面迭代点的信息产生下降方向以及Armijo线性搜索确定步长,得到了一类新的记忆梯度法.在较弱条件下证明了算法具有全局收敛性和线性收敛速率.数值试验表明算法是有效的.     

新非单调线搜索规则的Lampariello修正对角稀疏拟牛顿算法

本文设计了求解无约束最优化问题的新的非单调线搜索规则的Lampariello修正对角稀疏拟牛顿算法.新的步长规则类似于Grippo非单调线搜索规则并包含Grippo非单调线搜索规则作为特例.新的步长规则在每一次线搜索时得到一个相对于Grippo非单调线搜索规则的较大步长,同时保证算法的全局收敛性.数值例子表明算法是有效的,适合求解大规模问题.     

广义拟牛顿算法对一般目标函数的收敛性

本文证明了求解无约束最优化的广义拟牛顿算法在Goldstein非精确线搜索下对一般目标函数的全局收敛性，并在一定条件下证明了算法的局部超线性收敛性。     

Stopping criteria for linesearch methods without derivatives

In this paper acceptability criteria for the linesearch stepsize are introduced which require only function values. Simple algorithm models based on these criteria are presented. Some modifications of criteria based on the knowledge of the directional derivative are also illustrated. This paper was written while this author was visiting CRAI.     

关于外梯度法的步长规则

１．引言 设为Ｒｎ中的一个非空闭凸集,Ｆ（ｘ）为Ｒｎ　Ｒｎ中的一个连续向量函数．变分不等式问题（Ｆ,）就是：找一向量ｘ　使得当 ＝Ｒ时,（１．１）退化成非线性互补问题。在这篇文章中总假定：（Ｈ１） ,这里表示（１．１）的解集;（Ｈ２）Ｆ（ｘ）是单调的,即对,（ｘ－ｙ）（Ｆ（ｘ）－Ｆ（ｘ）－Ｆ（ｙ））． 这类问题出现在工程物理、经济管理等领域,有着极为广泛的应用．因此,其数值解近年来受到重视,提出许多有效算法,见综述［１, ２］．在现有的算法中, Ｋｏｒｐｅｌｅｖｉｃｈ的外梯度法［３］（何炳生称它为投影…     

带扰动项的FR共轭梯度法

本文提出了两种搜索方向带有扰动项的Fletcher-Reeves (abbr. FR)共轭梯度法.其迭代公式为xk 1=xk αk(sk ωk),其中sk由共轭梯度迭代公式确定,ωk为扰动项,αk采用线搜索确定而不是必须趋于零.我们在很一般的假设条件下证明了两种算法的全局收敛性,而不需要目标函数有下界或水平集有界等有界性条件.     

Analysis of Stepsize Selection Schemes for Runge-Kutta Codes

Conditions on Runge-Kutta algorithms can be obtained which ensuresmooth stepsize selection when stability of the algorithm isrestricting the stepsize. Some recently derived results areshown to hold for a more general test problem.     

Wolfe步长规则下约束优化问题的共轭梯度投影算法

本文研究了约束优化问题min x∈Ωf(x).利用共轭梯度算法与GLP梯度投影思想相结合的方法,构造了一个新的共轭梯度投影算法,并在Wolfe线搜索下获得了该算法的全局收敛性结果.     

A new stepsize rule in He and Zhou's alternating direction method

In this paper, we propose a new stepsize rule in He and Zhou's alternating direction method. Under this new stepsize strategy, we extend their method for solving convex quadratic minimization problems to also monotone linear variational inequality problems.     

在一个新步长规则下梯度投影算法的全局收敛性

考虑约束最优化问题：minx∈Ωf(x)其中:f:R^n→R是连续可微函数，Ω是一闭凸集。本文研究了解决此问题的梯度投影方法，在步长的选取时采用了一种新的策略，在较弱的条件下，证明了梯度投影响方法的全局收敛性。     

Bregman operator splitting with variable stepsize for total variation image reconstruction

This paper develops a Bregman operator splitting algorithm with variable stepsize (BOSVS) for solving problems of the form $\min\{\phi(Bu) +1/2\|Au-f\|_{2}^{2}\}$ , where ? may be nonsmooth. The original Bregman Operator Splitting (BOS) algorithm employed a fixed stepsize, while BOSVS uses a line search to achieve better efficiency. These schemes are applicable to total variation (TV)-based image reconstruction. The stepsize rule starts with a Barzilai-Borwein (BB) step, and increases the nominal step until a termination condition is satisfied. The stepsize rule is related to the scheme used in SpaRSA (Sparse Reconstruction by Separable Approximation). Global convergence of the proposed BOSVS algorithm to a solution of the optimization problem is established. BOSVS is compared with other operator splitting schemes using partially parallel magnetic resonance image reconstruction problems. The experimental results indicate that the proposed BOSVS algorithm is more efficient than the BOS algorithm and another split Bregman Barzilai-Borwein algorithm known as SBB.     

A nonmonotone truncated Newton–Krylov method exploiting negative curvature directions, for large scale unconstrained optimization

We propose a new truncated Newton method for large scale unconstrained optimization, where a Conjugate Gradient (CG)-based technique is adopted to solve Newton’s equation. In the current iteration, the Krylov method computes a pair of search directions: the first approximates the Newton step of the quadratic convex model, while the second is a suitable negative curvature direction. A test based on the quadratic model of the objective function is used to select the most promising between the two search directions. Both the latter selection rule and the CG stopping criterion for approximately solving Newton’s equation, strongly rely on conjugacy conditions. An appropriate linesearch technique is adopted for each search direction: a nonmonotone stabilization is used with the approximate Newton step, while an Armijo type linesearch is used for the negative curvature direction. The proposed algorithm is both globally and superlinearly convergent to stationary points satisfying second order necessary conditions. We carry out a significant numerical experience in order to test our proposal.