求解简单界约束优化问题的一种逐次逼近法

１引言考虑变量带简单界约束的非线性规划问题：其中二阶连续可微,ａ＝（ａ１,ａ２,…,ａｎ）,ｂ＝（ｂ１,ｂ２,…,ｂｎ）,＋ｉ＝１,２,…,ｎ．问题（１）不仅是实际应用中出现的简单界约束最优化问题,而且相当一部分最优化问题可以把变量限制在有意义的区间内（参见［１］）．因此无论在理论方面还是在实际应用方面,都有研究此类问题并给出简便而有效算法的必要．假设ｆ是凸函数,记ｇ（ｘ）＝ｆ（ｘ）,则由Ｋ－Ｔ条件,问题（１）可化为求解下面的非光滑方程组：显然,（２）等价于易证,（３）等价于求解下面的非光滑方程…     

非线性不等式约束最优化问题一个新的广义既约梯度法

本文借助一种新的求基转轴运算建立了带非线性不等式约束最优化问题的一个新的广义既约梯度法．算法不引入任何松驰变量，以致扩大问题的规模，也不需对约束函数和变量的界预先估计．另一重要特点是方法不再使用隐函数理论确定搜索方向，而是由简单的显式给出．因此方法计算量小，结构简单，便于应用．对于非Ｋ—Ｔ点ｘ，我们构造的方向为可行下降的．本文证明了算法具有全局收敛性．     

最优化中的几个问题解的等价性

考虑如下非线性规划问题：众所周知，问题（NP）的解法主要有三类：1．直接处理约束，2．将约束最优化问题化为 无约束最优化问题来处理，3．将（NP）化为简单的约束最优化问题如线性规划或二次规划等来处理，而将约束最优化问题化为无约束最优化问题的主要手段是利用如下的Lagrange函数：L（X，X，X）一八X）＋（X，g（X》十（X，h（X》（1．I）定义1．1称点卜”，V”撤足互补性条件，如果对”（X）一ojE【I：c］（亚．2）根据Lagrange函数（1．1）定义如下问题：（SPP）：求点k”，u”，v」6H””，m二。；＋c，使b“，u“，v」…     

非线性不等式约束最优化一个超线性与二次收敛的强次可行方法

本文讨论非线性不等式约束最优化问题，借助于序列线性方程组技术和强次可行方法思想，建立了问题的一个初始点任意的快速收敛新算法．在每次迭代中，算法只需解一个结构简单的线性方程组．算法的初始迭代点不仅可以是任意的，而且不使用罚函数和罚参数，在迭代过程中，迭代点列的可行性单调不减．在相对弱的假设下，算法具有较好的收敛性和收敛速度，即具有整体与强收敛性，超线性与二次收敛性．文中最后给出一些数值试验结果．     

修正的SQP型并行变量分配算法

Ferris 和Mangasarian 提出求解最优化问题的PVD(并行变量分配)算法, 此算法是把变量分为主要变量和辅助变量, 分配到p个处理机上, 每个处理机除了负责更新本处理机的主要变量外, 同时还沿着给定的方向更新辅助变量, 使算法的鲁棒性和灵活性得到了很大的提高. 该文基于文献[6]提出一种修正的SQP型PVD算法, 构造其搜索方向是下降方向和可行方向的组合, 并对此方向给予一个高阶修正, 使此算法很好地防止 Maratos 效应发生, 而且能够克服在求解子问题时出现约束不相容的情况. 在合适的条件下, 推导出此算法具有全局收敛性.     

并行求解约束优化问题的QP-free型算法

针对约束块可分的最优化问题,引入序列线性方程组方法和有效集策略,提出了一个求解约束块可分优化问题的QP-free型并行变量分配（PVD）算法.算法中用三个系数具有对称结构的线性方程组来代替PVD算法中的二次规划问题以求解线搜索方向,避免了约束不相容,减小了计算量.并且算法不要求约束是凸的.最后证明了QP-free型PVD算法的全局收敛性.     

带约束的变尺度算法

迄今为止,变尺度算法是求解无约束最优化问题最有效的一类方法。因此,近年来,对约束最优化问题建立类似方法的工作。引起了许多优化工作者的兴趣,他们提出了Wilson-Han-Powell算法及其改进等等。并且证明在一定条件下,算法具有超线性的收敛率。但这些条件不仅要求很“高”,而且很难在计算前确定能否成立。文[4]利用文[1]和[2]的结果,提出一类新的算法,求解带线性等式约束条件的非线性规划问题。并且证明了算法的超线性收敛率。本文把这个结果推广到一般的约束规划问题:     

由于波响应反演声阻抗的特征带方法

1．引言子波激发下的反演问题通常是不适定的，如何构造稳定、高效的算法是反问题研究中的重要课题．当前的波动方程反演方法主要有两类：特征线方法和最优化方法［1］．特征线方法是数值求解波动方程反问题的一种重要而有效的方法，它的基本思想是沿着波动方程上、下行波的特征传播方向逐层推进，并按照因果律求解．关于这方面的早期工作可参看［7］．在［2］中证明了脉冲激发下一维波动方程系数反问题的适定性，为这一方法提供了理论基础．随后，［4］讨论了特征线方法的差分计算的收敛性，［5，6］提供了成功的数值计算实例．近来人们逐…     

正交约束优化问题的一阶算法

带有正交约束的矩阵优化问题在材料计算、统计及数据分析等领域中有着广泛的应用.由于正交约束的可行域是Stiefel流形,一直以来流形上的优化方法是求解这一问题的主要方法.近年来,随着实际应用问题所要求的变量规模的扩大,传统的流形优化方法在计算上的劣势显现出来,而一些迭代简单、收敛快的新算法逐渐被提出.通过收缩方法、非收缩可行方法、不可行方法三个类别分别来介绍求解带有正交约束的矩阵优化问题的最新算法.通过分析这些方法的主要特性,以及应用问题的要求,对这类问题算法设计的研究进行了展望.     

初始点任意的一个非线性优化的广义梯度投影法

广义投影算法的优点是避免转轴运算。它成功地给出了线性约束问题、初始点任意的只带非线性不等式约束问题，以及利用辅助规划来处理带等式与不等式约束问题的算法．后者完满地解决了投影算法对于非线性等式约束问题的处理，但要求满足不等式约束的初始点．本文据此利用广义投影与罚函数技巧给出了一个初始点任意的等式与不等式约束问题的算法，省去了求初始解的计算，并保持了上述方法的优点，证明了算法的全局收敛性     

A Nonmonotone Trust Region Method for Nonlinear Programming with Simple Bound Constraints

In this paper we propose a nonmonotone trust region algorithm for optimization with simple bound constraints. Under mild conditions, we prove the global convergence of the algorithm. For the monotone case it is also proved that the correct active set can be identified in a finite number of iterations if the strict complementarity slackness condition holds, and so the proposed algorithm reduces finally to an unconstrained minimization method in a finite number of iterations, allowing a fast asymptotic rate of convergence. Numerical experiments show that the method is efficient. Accepted 5 September 2000. Online publication 4 December 2000.     

An improved working set selection for SMO-type decomposition method

The sequential minimization optimization (SMO) is a simple and efficient decomposition algorithm for solving support vector machines (SVMs). In this paper, an improved working set selection and a simplified minimization step are proposed for the SMO-type decomposition method that reduces the learning time for SVM and increases the efficiency of SMO. Since the working set is selected directly according to the Karush–Kuhn–Tucker (KKT) conditions, the minimization step of subproblem is simplified, accordingly the learning time for SVM is reduced and the convergence is accelerated. Following Keerthi’s method, the convergence of the proposed algorithm is analyzed. It is proven that within a finite number of iterations, solution that is based on satisfaction of the KKT conditions will be obtained by using the improved algorithm.     

On finite convergence of proximal point algorithms for variational inequalities

In this paper, we first characterize finite convergence of an arbitrary iterative algorithm for solving the variational inequality problem (VIP), where the finite convergence means that the algorithm can find an exact solution of the problem in a finite number of iterations. By using this result, we obtain that the well-known proximal point algorithm possesses finite convergence if the solution set of VIP is weakly sharp. As an extension, we show finite convergence of the inertial proximal method for solving the general variational inequality problem under the condition of weak g-sharpness.     

A very simple SQCQP method for a class of smooth convex constrained minimization problems with nice convergence results

We introduce a new and very simple algorithm for a class of smooth convex constrained minimization problems which is an iterative scheme related to sequential quadratically constrained quadratic programming methods, called sequential simple quadratic method (SSQM). The computational simplicity of SSQM, which uses first-order information, makes it suitable for large scale problems. Theoretical results under standard assumptions are given proving that the whole sequence built by the algorithm converges to a solution and becomes feasible after a finite number of iterations. When in addition the objective function is strongly convex then asymptotic linear rate of convergence is established.     

有奇异解的无约束最优化问题的一种混合法

本文研究求解含有奇异解的无约束最优化问题算法 .该类问题的一个重要特性是目标函数的Hessian阵可能处处奇异 .我们提出求解该类问题的一种梯度 -正则化牛顿型混合算法 .并在一定的条件下得到了算法的全局收敛性 .而且 ,经一定迭代步后 ,算法还原为正则化 Newton法 .因而 ,算法具有局部二次收敛性 .     

Q-learning and policy iteration algorithms for stochastic shortest path problems

We consider the stochastic shortest path problem, a classical finite-state Markovian decision problem with a termination state, and we propose new convergent Q-learning algorithms that combine elements of policy iteration and classical Q-learning/value iteration. These algorithms are related to the ones introduced by the authors for discounted problems in Bertsekas and Yu (Math. Oper. Res. 37(1):66-94, 2012). The main difference from the standard policy iteration approach is in the policy evaluation phase: instead of solving a linear system of equations, our algorithm solves an optimal stopping problem inexactly with a finite number of value iterations. The main advantage over the standard Q-learning approach is lower overhead: most iterations do not require a minimization over all controls, in the spirit of modified policy iteration. We prove the convergence of asynchronous deterministic and stochastic lookup table implementations of our method for undiscounted, total cost stochastic shortest path problems. These implementations overcome some of the traditional convergence difficulties of asynchronous modified policy iteration, and provide policy iteration-like alternative Q-learning schemes with as reliable convergence as classical Q-learning. We also discuss methods that use basis function approximations of Q-factors and we give an associated error bound.     

On Finite Convergence of Iterative Methods for Variational Inequalities in Hilbert Spaces

In a Hilbert space, we study the finite termination of iterative methods for solving a monotone variational inequality under a weak sharpness assumption. Most results to date require that the sequence generated by the method converges strongly to a solution. In this paper, we show that the proximal point algorithm for solving the variational inequality terminates at a solution in a finite number of iterations if the solution set is weakly sharp. Consequently, we derive finite convergence results for the gradient projection and extragradient methods. Our results show that the assumption of strong convergence of sequences can be removed in the Hilbert space case.     

Bias optimality for multichain continuous-time Markov decision processes

This paper deals with the bias optimality of multichain models for finite continuous-time Markov decision processes. Based on new performance difference formulas developed here, we prove the convergence of a so-called bias-optimal policy iteration algorithm, which can be used to obtain bias-optimal policies in a finite number of iterations.     

A proximal method for identifying active manifolds

The minimization of an objective function over a constraint set can often be simplified if the “active manifold” of the constraints set can be correctly identified. In this work we present a simple subproblem, which can be used inside of any (convergent) optimization algorithm, that will identify the active manifold of a “prox-regular partly smooth” constraint set in a finite number of iterations.     

Subgradient Method for Convex Feasibility on Riemannian Manifolds

In this paper, a subgradient type algorithm for solving convex feasibility problem on Riemannian manifold is proposed and analysed. The sequence generated by the algorithm converges to a solution of the problem, provided the sectional curvature of the manifold is non-negative. Moreover, assuming a Slater type qualification condition, we analyse a variant of the first algorithm, which generates a sequence with finite convergence property, i.e., a feasible point is obtained after a finite number of iterations. Some examples motivating the application of the algorithm for feasibility problems, nonconvex in the usual sense, are considered.