广义投影型的超线性收敛算法

该文利用矩阵分解与广义投影等技巧，给出了求解线性约束的非线性规划的一个广义投影型的超线性收敛算法，不需要δ－主动约束与每一步反复计算投影矩阵，避免了计算的数值不稳定性，利用矩阵求逆的递推公式，计算简便，由于采用了非精确搜索，算法实用可行，文中证明了算法具有收敛性及超线性的收敛速度．     

线性约束下的共轭投影梯度法及其超线性收敛性

本文考虑线性约束非线性规划问题，提出了一类共轭投影梯度法，证明了算法的全局收敛性，并对算法的二次终止性，超线性收敛特征进行了分析，算法的优点是（１）采用计算机上实现的Ａｒｍｉｊｏ线性搜索规则，（２）初始点不要求一定是可行点，可以不满足线性等式约束，（３）具有较快的收敛速度。     

一个退化线性约束下的最优化方法

对于线性约束下的非线性规划问题，过去的绝大部分文献都建立在约束为非退化的假设上．该文将去掉这一假设，就一般的线性约束问题设计了一个结构简单的新算法，并在适当的假设下证明了算法的收敛性和超线性收敛速度．     

线性互补问题的阻尼牛顿法的有限终止性

在（２）中，Ｈａｒｋｅｒ和Ｐａｎｇ提出了如下一个公开问题，对于线性互补问题的阻尼牛顿算法，当它收敛时，算法是否能在有限步内终止？本文对此问题给出一个肯定回答，而且进一步给出一个新的求解一般线性互补问题的有限终止算法，这个算法避免了阻尼牛顿算法可能不收敛的情形。     

一个结构简单的约束变尺度算法

本文我们考虑具有线性约束凹函数的最优化问题，利用我们的算法和变尺度修正公式，提出了一个结构简单的组合算法，并在「２」，「３」和「４」同样的假设条件下，证明了该算法的收敛性和超线性收敛速度，从而使该算法比原有各算法更具实用性。     

一个求解单调线性互补问题的高阶不可行内点算法

本文通过使用相同的矩阵因子，给出了一个求解单调线性互补问题的r-阶Mehrotra型宽城不可行内点算法，其中嵌入Wright的快速步与安全步算法．所给算法的迭代复杂性为O（n~((r 1)/r)L）．在考虑的问题有一个严格互补解的条件下，所给算法具有2阶Q-超线性收敛性．     

线性双层规划的改进PCP全局求解算法

本文采用K-T条件将线性双层规划模型改写为单层规划后,将参数引入上层目标函数,构造了含参线性互补问题(PLCP)并给出它的一些性质。进而通过改进Lemke算法的进基规则,在保持互补旋转算法原有优势的基础上,引入充分小正数ε,设计了改进参数互补旋转(PCP)算法求取全局最优解,最后通过两个算例说明了其有效性。     

关于不等式约束的信赖域算法

对于具有不等式约束的非线性优化问题，本文给出一个依赖域算法，由于算法中依赖区域约束采用向量的∞范数约束的形式，从而使子问题变二次规划，同时使算法变得更实用。在通常假设条件下，证明了算法的整体收敛性和超线性收敛性。     

求解线性不等式组的方法

本提出了一个新的求解线性不等式组可行解的方法－－无约束极值方法。通过在线性不等式组的非空可行域的相对内域上建立一个非线性极值问题，根据对偶关系，得到了一个对偶空间的无约束极值及原始，对偶变量之间的简单线性映射关系，这样将原来线性不等式组问题的求解转化为一个无约束极值问题。中主要讨论了求解无约束极值问题的共轭梯度算法。同时，在寻找不等式组可行解的过程中，定义了穿越方向，这样大大减少计算量。中最后数值实验结果表明此算法是有效的。     

一类超线性收敛的既约变尺度法

本文将既约梯度法与Ｈｕａｎｇ族变尺度法相结合，给出标准型线性约束规划问题的一类既约变尺度法．在较温和的假设下，算法具有全局收敛性和超线性收敛速度，最后指出本文算法包含和改进几个己有的有效算法．     

一类优化问题的快速收敛算法

给出了一个用于解决 LC1线性约束优化问题的 BFGS-SQP算法 ,这个算法是用 Armijo线性原则来求步长的 .为推广 BFGS-SGP算法 ,本文采用 Wolfe线性搜索原则来替代该 BFGS-SQP算法的 Armijo原则 ,经过分析 ,同样得到了 BFGS-SGP算法的全局收敛性及超线性收敛性     

一个新的无约束优化超记忆梯度算法

本文提出一种新的无约束优化超记忆梯度算法,算法利用当前点的负梯度和前一点的负梯度的线性组合为搜索方向,以精确线性搜索和Armijo搜索确定步长．在很弱的条件下证明了算法具有全局收敛性和线性收敛速度．因算法中避免了存贮和计算与目标函数相关的矩阵,故适于求解大型无约束优化问题．数值实验表明算法比一般的共轭梯度算法有效．     

Smoothing Newton algorithm for the second-order cone programming with a nonmonotone line search

The smoothing-type algorithms, which are in general designed based on some monotone line search, have been successfully applied to solve the second-order cone programming (denoted by SOCP). In this paper, we propose a nonmonotone smoothing Newton algorithm for solving the SOCP. Under suitable assumptions, we show that the proposed algorithm is globally and locally quadratically convergent. To compare with the existing smoothing-type algorithms for the SOCP, our algorithm has the following special properties: (i) it is based on a new smoothing function of the vector-valued natural residual function; (ii) it uses a nonmonotone line search scheme which contains the usual monotone line search as a special case. Preliminary numerical results demonstrate that the smoothing-type algorithm using the nonmonotone line search is promising for solving the SOCP.     

Convergence Properties of the DFP Algorithm for Unconstrained Optimization

In this article, the convergence properties of the DFP algorithm with inexact line searches on uniformly convex functions are investigated. An inexact line search is proposed and the global convergence and superlinear convergence of the DFP algorithm with this line search on uniformly convex functions are proved.     

A smoothing-type algorithm for solving nonlinear complementarity problems with a non-monotone line search

The smoothing-type algorithm has been successfully applied to solve various optimization problems. In general, the smoothing-type algorithm is designed based on some monotone line search. However, in order to achieve better numerical results, the non-monotone line search technique has been used in the numerical computations of some smoothing-type algorithms. In this paper, we propose a smoothing-type algorithm for solving the nonlinear complementarity problem with a non-monotone line search. We show that the proposed algorithm is globally and locally superlinearly convergent under suitable assumptions. The preliminary numerical results are also reported.     

Efficient line search algorithm for unconstrained optimization

A new line search algorithm for smooth unconstrained optimization is presented that requires only one gradient evaluation with an inaccurate line search and at most two gradient evaluations with an accurate line search. It terminates in finitely many operations and shares the same theoretical properties as the standard line search rules like the Armijo-Goldstein-Wolfe-Powell rules. This algorithm is especially appropriate for the situation when gradient evaluations are very expensive relative to function evaluations.The authors would like to thank Margaret Wright and Jorge Moré for valuable comments on earlier versions of this paper.     

Adaptive nonmonotone line search method for unconstrained optimization

In this paper, an adaptive nonmonotone line search method for unconstrained minimization problems is proposed. At every iteration, the new algorithm selects only one of the two directions: a Newton-type direction and a negative curvature direction, to perform the line search. The nonmonotone technique is included in the backtracking line search when the Newton-type direction is the search direction. Furthermore, if the negative curvature direction is the search direction, we increase the steplength under certain conditions. The global convergence to a stationary point with second-order optimality conditions is established. Some numerical results which show the efficiency of the new algorithm are reported.      

Some fundamental issues of basic line search algorithm for linear programming problems

In this article we present the fundamental idea, concepts and theorems of a basic line search algorithm for solving linear programming problems which can be regarded as an extension of the simplex method. However, unlike the iteration of the simplex method from a basic point to an improved adjacent basic point via pivot operation, the basic line search algorithm, also by pivot operation, moves from a basic line which contains two basic feasible points to an improved basic line which also contains two basic feasible points whose objective values are no worse than that of the two basic feasible points on the previous basic line. The basic line search algorithm may skip some adjacent vertices so that it converges to an optimal solution faster than the simplex method. For example, for a 2-dimensional problem, the basic line search algorithm can find an optimal solution with only one iteration.     

Convergence of the DFP Algorithm Without Exact Line Search

In this paper, we consider the DFP algorithm without exact line search. We strengthen the conditions on the line search and prove that, under the new line search conditions, the DFP algorithm is globally convergent, Q-superlinearly convergent, and n-step quadratically convergent.     

Adaptive Two-Point Stepsize Gradient Algorithm

Combined with the nonmonotone line search, the two-point stepsize gradient method has successfully been applied for large-scale unconstrained optimization. However, the numerical performances of the algorithm heavily depend on M, one of the parameters in the nonmonotone line search, even for ill-conditioned problems. This paper proposes an adaptive nonmonotone line search. The two-point stepsize gradient method is shown to be globally convergent with this adaptive nonmonotone line search. Numerical results show that the adaptive nonmonotone line search is specially suitable for the two-point stepsize gradient method.