一类非单调曲线搜索方法及其收敛性

本文提出一类求解无约束优化问题的非单调曲线搜索方法, 在较弱条件下证明了其收敛性.该算法有如下特点:(1)采用曲线搜索方法, 在每步迭代时同时确定下降方向和步长;(2)采用非单调搜索技巧, 产生较大的迭代步长, 降低了算法的计算量;(3)利用当前和前面迭代点的信息产生下降方向, 无需计算和存储矩阵, 适于求解大型优化问题.     

一个充分下降的改进HS共轭梯度法

共轭梯度法是求解大规模无约束优化问题最有效的方法之一.对HS共轭梯度法参数公式进行改进,得到了一个新公式,并以新公式建立一个算法框架.在不依赖于任何线搜索条件下,证明了由算法框架产生的迭代方向均满足充分下降条件,且在标准Wolfe线搜索条件下证明了算法的全局收敛性.最后,对新算法进行数值测试,结果表明所改进的方法是有效的.     

求解无约束优化问题的两类修正的WYL共轭梯度方法

针对无约束优化问题,通过修正共轭梯度参数,构造新的搜索方向,提出两类修正的WYL共轭梯度法.在每次迭代过程中,两类算法产生的搜索方向均满足充分下降性.在适当条件下,证明了算法的全局收敛性.数值结果表明算法是可行的和有效的.     

一类新的记忆梯度法及其全局收敛性

研究了求解无约束优化问题的记忆梯度法,利用当前和前面迭代点的信息产生下降方向,得到了一类新的无约束优化算法,在Wolfe线性搜索下证明了其全局收敛性.新算法结构简单,不用计算和存储矩阵,适于求解大型优化问题.数值试验表明算法有效.     

Armijo线性搜索下的多步下降算法

本文研究无约束优化问题.利用前面多步迭代点的信息产生下降方向以及Armijo线性搜索产生步长,得到了一类新的多步下降算法,并且在较弱条件下证明了算法具有全局收敛性和线性收敛速率.初步的数值试验表明算法是有效的.     

不等式约束最优化超线性与二次收敛的强次可行SQP算法

利用ＳＱＰ方法、广义投影技术和强次可行方（向）法思想,建立不等式约束优化一个新的初始点任意的快速收敛算法． 算法每次迭代仅需解一个总存在可行解的二次子规划,或用广义投影计算“一阶”强次可行下降辅助搜索方向;采用曲线搜索与直线搜索相结合的方法产生步长． 在较温和的条件下,算法具有全局收敛性、强收敛性、超线性与二次收敛性． 给出了算法有效的数值试验．     

无约束最优化的微分下降法

本文利用曲线线性搜索法和最优化的微分梯度法的特点,提出了一种一般的曲线搜索方式:微分下降法。这种方法通过下降方向对确定迭代矩阵,由初值微分方程的解析解确定迭代搜索曲线。本文给出了算法的整体收敛性证明,并给出了满意的数值实验结果。     

非单调多步曲线搜索方法的收敛性

提出一种求解无约束优化问题的非单调多步曲线搜索方法.此方法具有如下特点:(1)算法在产生下一个迭代点时不仅利用了当前迭代点的信息,而且还可能利用前m个迭代点的信息.这就是多步法;(2)下降方向和步长同时确定,而不是先找到方向,再由线性搜索寻找步长.这就是曲线搜索技术;(3)采用非单调搜索技巧.在较弱的条件下,我们证明了此方法的收敛性.     

一类新的具有充分下降条件和强收敛性的共轭梯度法

本文研究了求解无约束优化问题的WYL共轭梯度法.利用修正迭代格式,得到了算法在每步迭代能产生不依赖于搜索条件的充分下降方向.同时,在原算法中关于Wolfe条件中参数去掉的情况下,获得了本文算法是强收敛的.数值实验说明本文算法可以有效求解测试问题.     

一种改进的求解支持向量机模型的坐标梯度下降算法

针对支持向量机模型问题,给出了一种新的坐标梯度下降算法.算法首先求解一个特殊的二次规划问题,将所得的结果进行分解后,得到每次迭代所需要的工作集,然后,求解一个降维的二次规划子问题得到下降方向.新算法无需进行线搜索,避免了线搜索带来的时间和空间上的开销,使得计算量大大减少.最后,在较弱的条件下证明了算法的全局收敛性,并利用数值实验证明了算法的可行性和有效性.     

New spectral PRP conjugate gradient method for unconstrained optimization

In this paper, a new spectral PRP conjugate gradient algorithm has been developed for solving unconstrained optimization problems, where the search direction was a kind of combination of the gradient and the obtained direction, and the steplength was obtained by the Wolfe-type inexact line search. It was proved that the search direction at each iteration is a descent direction of objective function. Under mild conditions, we have established the global convergence theorem of the proposed method. Numerical results showed that the algorithm is promising, particularly, compared with the existing several main methods.     

On the eigenvalues of the saddle point matrices discretized from Navier–Stokes equations

In this paper, we proposed an implementation of stochastic perturbation of reduced gradient and bisection (SPRGB) method for optimizing a non-convex differentiable function subject to linear equality constraints and non-negativity bounds on the variables. In particular, at each iteration, we compute a search direction by reduced gradient, and optimal line search by bisection algorithm along this direction yields a decrease in the objective value. SPRGB method is desired to establish the global convergence of the algorithm. An implementation and tests of SPRGB algorithm are given, and some numerical results of large-scale problems are presented, which show the efficient of this approach.     

A superlinearly convergent strongly sub-feasible SSLE-type algorithm with working set for nonlinearly constrained optimization

In this paper, by means of a new efficient identification technique of active constraints and the method of strongly sub-feasible direction, we propose a new sequential system of linear equations (SSLE) algorithm for solving inequality constrained optimization problems, in which the initial point is arbitrary. At each iteration, we first yield the working set by a pivoting operation and a generalized projection; then, three or four reduced linear equations with a same coefficient are solved to obtain the search direction. After a finite number of iterations, the algorithm can produced a feasible iteration point, and it becomes the method of feasible directions. Moreover, after finitely many iterations, the working set becomes independent of the iterates and is essentially the same as the active set of the KKT point. Under some mild conditions, the proposed algorithm is proved to be globally, strongly and superlinearly convergent. Finally, some preliminary numerical experiments are reported to show that the algorithm is practicable and effective.     

Global Convergence of a Memory Gradient Method for Unconstrained Optimization

Memory gradient methods are used for unconstrained optimization, especially large scale problems. The first idea of memory gradient methods was proposed by Miele and Cantrell (1969) and Cragg and Levy (1969). In this paper, we present a new memory gradient method which generates a descent search direction for the objective function at every iteration. We show that our method converges globally to the solution if the Wolfe conditions are satisfied within the framework of the line search strategy. Our numerical results show that the proposed method is efficient for given standard test problems if we choose a good parameter included in the method.     

一类新的多步曲线搜索下的超记忆梯度法

研究一类新的求解无约束优化问题的超记忆梯度法,分析了算法的全局收敛性和线性收敛速率.算法利用一种多步曲线搜索准则产生新的迭代点,在每步迭代时同时确定下降方向和步长,并且不用计算和存储矩阵,适于求解大规模优化问题.数值试验表明算法是有效的.     

不等式约束优化一个基于滤子思想的广义梯度投影算法

讨论非线性不等式约束优化问题, 借鉴于滤子算法思想,提出了一个新型广义梯度投影算法.该方法既不使用罚函数又无真正意义下的滤子.每次迭代通过一个简单的显式广义投影法产生搜索方向,步长由目标函数值或者约束违反度函数值充分下降的Armijo型线搜索产生.算法的主要特点是: 不需要迭代序列的有界性假设;不需要传统滤子算法所必需的可行恢复阶段;使用了ε积极约束集减小计算量.在合适的假设条件下算法具有全局收敛性, 最后对算法进行了初步的数值实验.     

Adaptive nonmonotone line search method for unconstrained optimization

In this paper, an adaptive nonmonotone line search method for unconstrained minimization problems is proposed. At every iteration, the new algorithm selects only one of the two directions: a Newton-type direction and a negative curvature direction, to perform the line search. The nonmonotone technique is included in the backtracking line search when the Newton-type direction is the search direction. Furthermore, if the negative curvature direction is the search direction, we increase the steplength under certain conditions. The global convergence to a stationary point with second-order optimality conditions is established. Some numerical results which show the efficiency of the new algorithm are reported.      

Strongly sub-feasible direction method for constrained optimization problems with nonsmooth objective functions

In this paper, we propose a strongly sub-feasible direction method for the solution of inequality constrained optimization problems whose objective functions are not necessarily differentiable. The algorithm combines the subgradient aggregation technique with the ideas of generalized cutting plane method and of strongly sub-feasible direction method, and as results a new search direction finding subproblem and a new line search strategy are presented. The algorithm can not only accept infeasible starting points but also preserve the “strong sub-feasibility” of the current iteration without unduly increasing the objective value. Moreover, once a feasible iterate occurs, it becomes automatically a feasible descent algorithm. Global convergence is proved, and some preliminary numerical results show that the proposed algorithm is efficient.     

有界约束非线性优化问题的仿射共轭梯度路径法

本文提出仿射内点离散共轭梯度路径法解有界约束的非线性优化问题,通过构造预条件离散的共轭梯度路径解二次模型获得预选迭代方向,结合内点回代线搜索获得下一步的迭代,在合理的假设条件下,证明了算法的整体收敛性与局部超线性收敛速率,最后,数值结果表明了算法的有效性.