线性约束最优化问题的一族次可行方向法

本文给出线性约束最优化问题的一族算法．方法具有如下特点：１）初始迭代点可以任意选取；２）一旦有某一个迭代点进入可行域，方法将成为一族可行方向法；３）算法避开不易处理的罚函数和罚参数．文中采用一种最优性控制函数将初始化阶段和最优化阶段有机地结合起来，正是这种技巧保证了算法的全局收敛性     

最优化两个拓广的SQP和SSLE算法模型及其超线性和二次收敛性

给出一般约束最优化的序列二次规划（SQP）和序列线性方程组（SSLE）算法两个拓广的模型,详细分析和论证两个模型的局部超线性收敛性及二次收敛性条件,其中并不需要严格互补条件,拓广的模型及其收敛速度结果具有更广泛的适用性,为SQP和SSLE算法收敛速度的研究提供了更为完善和便利的理论基础。     

两类解非线性约束问题的超记忆可行方向法

本文将无约束超记忆梯度法推广到非线性不等式约束优化问题上来,给出了两类形式很一般的超记忆可行方向法,并在非退化及连续可微等较弱的假设下证明了其全局收敛性.适当选取算法中的参量及记忆方向,不仅可得到一些已知的方法及新方法,而且还可能加快算法的收敛速度.     

不等式约束优化一个具有超线性收敛的可行序列二次规划算法

建立了一个新的SQP算法,提出了一阶可行条件这一新概念．对已有SQP型算法进行改进,减少计算工作量,证明了算法具有全局收敛及超线性收敛性．数值实验表明算法是有效的．     

非线性约束优化问题的一个新的全局收敛算法

对于非线性约束的优化问题.最近给出的各种SQP算法均采用罚函数技巧以保证算法的全局收敛性,因而都必须小心地调整惩罚参数。本文给出一个不依赖于惩罚参数、每步迭代的校正矩阵也不需正定且仍具有全局收敛性的SQP方法,而且罚函数形式简单、具有和约束函数同阶的光滑性.     

线性互补约束规划问题的一种Filter算法

本文研究了求解线性互补约束规划问题的算法问题.首先基于广义互补函数和摄动技术将问题转化为带参数的非线性优化问题,利用SlQP-Filter算法方法,求解线性互补约束规划问题的一种Filter算法.在适当条件下,证明了该算法的全局收敛性.     

求解一类约束优化问题的Newton分裂算法

本文给出了求解一类约束优化问题的一个Newton分裂算法，并证明了算法的局部平方收敛性，该算法与已有算法相比，具有计算量小的特点，因而特别适合于求解大规模问题，为进一步降低算法的计算复杂性，我们结合Broyden算法，给出了两类Broyden类分裂算法。     

一个结构简单的约束变尺度算法

本文我们考虑具有线性约束凹函数的最优化问题，利用我们的算法和变尺度修正公式，提出了一个结构简单的组合算法，并在「２」，「３」和「４」同样的假设条件下，证明了该算法的收敛性和超线性收敛速度，从而使该算法比原有各算法更具实用性。     

关于不等式约束的信赖域算法

对于具有不等式约束的非线性优化问题，本文给出一个依赖域算法，由于算法中依赖区域约束采用向量的∞范数约束的形式，从而使子问题变二次规划，同时使算法变得更实用。在通常假设条件下，证明了算法的整体收敛性和超线性收敛性。     

Spectral Gradient Methods for Linearly Constrained Optimization

Linearly constrained optimization problems with simple bounds are considered in the present work. First, a preconditioned spectral gradient method is defined for the case in which no simple bounds are present. This algorithm can be viewed as a quasi-Newton method in which the approximate Hessians satisfy a weak secant equation. The spectral choice of steplength is embedded into the Hessian approximation and the whole process is combined with a nonmonotone line search strategy. The simple bounds are then taken into account by placing them in an exponential penalty term that modifies the objective function. The exponential penalty scheme defines the outer iterations of the process. Each outer iteration involves the application of the previously defined preconditioned spectral gradient method for linear equality constrained problems. Therefore, an equality constrained convex quadratic programming problem needs to be solved at every inner iteration. The associated extended KKT matrix remains constant unless the process is reinitiated. In ordinary inner iterations, only the right-hand side of the KKT system changes. Therefore, suitable sparse factorization techniques can be applied and exploited effectively. Encouraging numerical experiments are presented.This research was supported by FAPESP Grant 2001-04597-4 and Grant 903724-6, FINEP and FAEP-UNICAMP, and the Scientific Computing Center of UCV. The authors thank two anonymous referees whose comments helped us to improve the final version of this paper.     

A Shifted-Barrier Primal-Dual Algorithm Model for Linearly Constrained Optimization Problems

In this paper we describe a Newton-type algorithm model for solving smooth constrained optimization problems with nonlinear objective function, general linear constraints and bounded variables. The algorithm model is based on the definition of a continuously differentiable exact merit function that follows an exact penalty approach for the box constraints and an exact augmented Lagrangian approach for the general linear constraints. Under very mild assumptions and without requiring the strict complementarity assumption, the algorithm model produces a sequence of pairs converging quadratically to a pair where satisfies the first order necessary conditions and is a KKT multipliers vector associated to the linear constraints. As regards the behaviour of the sequence x ^k alone, it is guaranteed that it converges at least superlinearly. At each iteration, the algorithm requires only the solution of a linear system that can be performed by means of conjugate gradient methods. Numerical experiments and comparison are reported.     

解线性约束优化问题的新锥模型信赖域法

本文提出了一个解线性等式约束优化问题的新锥模型信赖域方法.论文采用零空间技术消除了新锥模型子问题中的线性等式约束,用折线法求解转换后的子问题,并给出了解线性等式约束优化问题的信赖域方法.论文提出并证明了该方法的全局收敛性,并给出了该方法解线性等式约束优化问题的数值实验.理论和数值实验结果表明新锥模型信赖域方法是有效的,这给出了用新锥模型进一步研究非线性优化的基础.     

Solving a Class of Linearly Constrained Indefinite Quadratic Problems by D.C. Algorithms

Linearly constrained indefinite quadratic problems play an important role in global optimization. In this paper we study d.c. theory and its local approachto such problems. The new algorithm, CDA, efficiently produces local optima and sometimes produces global optima. We also propose a decomposition branch andbound method for globally solving these problems. Finally many numericalsimulations are reported.     

齐次线性约束回归模型参数的主成分压缩估计

当设计矩阵X复共线时,对齐次线性约束回归模型参数的约束最小二乘估计进行改进,提出参数的主成分压缩估计,并对新参数估计的性质进行了讨论,最后进行了数值模拟,验证了算法的参数估计优于约束最小二乘估计.     

Computational Discretization Algorithms for Functional Inequality Constrained Optimization

In this paper, a functional inequality constrained optimization problem is studied using a discretization method and an adaptive scheme. The problem is discretized by partitioning the interval of the independent parameter. Two methods are investigated as to how to treat the discretized optimization problem. The discretization problem is firstly converted into an optimization problem with a single nonsmooth equality constraint. Since the obtained equality constraint is nonsmooth and does not satisfy the usual constraint qualification condition, relaxation and smoothing techniques are used to approximate the equality constraint via a smooth inequality constraint. This leads to a sequence of approximate smooth optimization problems with one constraint. An adaptive scheme is incorporated into the method to facilitate the computation of the sum in the inequality constraint. The second method is to apply an adaptive scheme directly to the discretization problem. Thus a sequence of optimization problems with a small number of inequality constraints are obtained. Convergence analysis for both methods is established. Numerical examples show that each of the two proposed methods has its own advantages and disadvantages over the other.     

求解约束优化问题的一种算法的改进

针对用遗传算法求解约束优化问题时,初始种群产生的方法进行了研究,提出了初始种群产生的一种新方法.实验证明,该方法较直接利用随机数产生初始种群的方法,具有更快的运算速度.     

Feasible Direction Interior-Point Technique for Nonlinear Optimization

We propose a feasible direction approach for the minimization by interior-point algorithms of a smooth function under smooth equality and inequality constraints. It consists of the iterative solution in the primal and dual variables of the Karush–Kuhn–Tucker first-order optimality conditions. At each iteration, a descent direction is defined by solving a linear system. In a second stage, the linear system is perturbed so as to deflect the descent direction and obtain a feasible descent direction. A line search is then performed to get a new interior point and ensure global convergence. Based on this approach, first-order, Newton, and quasi-Newton algorithms can be obtained. To introduce the method, we consider first the inequality constrained problem and present a globally convergent basic algorithm. Particular first-order and quasi-Newton versions of this algorithm are also stated. Then, equality constraints are included. This method, which is simple to code, does not require the solution of quadratic programs and it is neither a penalty method nor a barrier method. Several practical applications and numerical results show that our method is strong and efficient.     

Linearly Constrained Global Optimization and Stochastic Differential Equations

A stochastic algorithm is proposed for the global optimization of nonconvex functions subject to linear constraints. Our method follows the trajectory of an appropriately defined Stochastic Differential Equation (SDE). The feasible set is assumed to be comprised of linear equality constraints, and possibly box constraints. Feasibility of the trajectory is achieved by projecting its dynamics onto the set defined by the linear equality constraints. A barrier term is used for the purpose of forcing the trajectory to stay within the box constraints. Using Laplace’s method we give a characterization of a probability measure (Π) that is defined on the set of global minima of the problem. We then study the transition density associated with the projected diffusion process and show that its weak limit is given by Π. Numerical experiments using standard test problems from the literature are reported. Our results suggest that the method is robust and applicable to large-scale problems.     

求解约束优化问题的两个微分方程算法

本文给出求解具有等式约束和不等式约束的非线性优化问题的一阶信息和二阶信息的两个微分方程系统,问题的局部最优解是这两个微分方程系统的渐近稳定的平衡点,给出了这两个微分方程系统的Euler离散迭代格式并证明了它们的收敛性定理,用龙格库塔法分别求解两个微分方程系统．我们构造了搜索方向由两个微分系统计算,步长采用Armijo线搜索的算法分别求解这个约束最优化问题,在局部Lipschitz条件下基于二阶信息的微分方程系统的迭代方法具有二阶的收敛速度。我们给出的数值结果表明龙格库塔的微分方程算法具有较好的稳定性和更高的精确度,求解二阶信息的微分方程系统的方法具有更快的收敛速度．