无约束非光滑优化问题信赖域算法的收敛条件

1 引言 考虑下列无约束非光滑优化问题 minf(x),(1) x∈R~n,其中f为R~n上的局部Lipschitz函数,本文将‖·‖_2简记为‖·‖.记下列信赖域子问题为S∪B(x,△). min m(x,s)=φ(x,s)+1/2s~TBs, 其中φ:R~(2m)→R为f的迭代函数。 对于无约束非光滑优化问题(1),[11],[13],[3]、[4]和[5]分别在特殊的条件下给出了信赖域算法用以求解(1)的收敛性结果。最近,[10]、[2]和[6]在不同的假设条件下分别给出了信赖域算法求解无约束非光滑优化问题的一般模型,并在子问题的目标函数满足局部一致有界性条件时证明了算法模型的整体收敛性。在目标函数满足某种正则性条件时,[11]和[9]给出了当信赖域子问题的目标函数中二次项不满足一致有界性条件时的收敛性结果.本文则在目标函数仅为局部Lipschitz函数时得到了和[8]、[11]、[9]相同的收敛性结果。     

高考压轴题例谈

分析：对于（2）问的解决，参考答案提供了放缩法求解，但根据不等式左边为A=x1，·x3·x5…x2n-1这一形式，因此可构造其对偶式B=x2·x4…x2n，通过A与B的积以及A与B的大小关系达到证明的目的．     

一类变分不等式问题的信赖域算法

基于J.M.Peng研究一类变分不等式问题（简记为VIP）时所提出的价值函数，本文提出了求解强单调的VIP的一个新的信赖域算法。和已有的处理VIP的信赖域方法不同的是：它在每步迭代时，不必求解带信赖域界的子问题，仅解一线性方程组而求得试验步。这样，计算的复杂性一般来说可降低。在通常的假设条件下，文中还证明了算法的整体收敛性。最后，在梯度是半光滑和约束是矩形域的假设下，该算法还是超线性收敛的。     

求解一类约束优化信赖域方法的子问题

１引言设Ｈ为一给定的ｎ×ｎ对称矩阵,ｃＲ＂,本文考虑如｝的约束优化问题这里ａ＞０为给定的参数,Ｃ＝｛ｘＲｎｘ＜ａ是Ｒ”中的一个球体,Ｋ是一个简单凸闭集．当Ｋ＝Ｒｎ时,问题（Ｐ）便是无约束优化的信赖域子问题．当Ｋ＝｛ｘＲｎμ≤ｘ≤υ５,（μ１,μ２,…,μｎ）Ｔ,υ＝（υ１,υ２…,υｎ）Ｔ,且—∞＜μｉ＜υｉ＜ｖ＜＋∞,ｉ＝１,２,…,ｎ时,问题（Ｐ）便是用信赖域方法求解带上下界约束的优化问题时遇到的子问题．对于无约束信赖域方法的子问题已经有了比较成熟的算法［８,１２－１３,１５－１６］．Ｋ＝Ｒ…     

大型稀疏线性互补问题的行作用法

且引言考虑线性互补问题＊＊P（q，M）：求X二（X；，x。，…，x。厂E”使得x＞O，训x）E＊x＋g＞o，／U（X）一O（1）其中M一（m；。）为nXn矩阵（不必对称），q一切，q。，…，q。）rER“为给定常向量．通常情况下已有求解LCP（q，M）的若干著名算法［‘－’j．本文提出求解LCP（q，M）的一种新算法一行作用法，方法具有如下特点：（i）每次迭代只需n个简单的投影运算，每次投影只涉及矩阵M的一行；（n）生成新的迭代点x‘“‘时只利用前次迭代点／；（iii）对矩阵M不实施任何整体运算．因而适合于求解大型（巨型）稀疏问题，且…     

一个解无约束优化问题的过滤信赖域方法

1 引言 本文中,我们考虑一般的无约束极小化问题: minx∈Rn f(x), (1.1) 其中f:Rn→R二次连续可微. 信赖域方法是解问题(1.1)的一类非常成功的算法.在标准信赖域算法框架([2][11][1])中,迭代点列是单调下降的,对于一些坏条件问题,会出现收敛非常缓慢的情形.针对这种问题,人们提出了非单调技术([2][3][13][14][15]),来加快算法在实际计算中的收敛速度,取得了很好的数值效果.     

一类带线搜索的非单调信赖域算法

本文对于无约束最优化问题提出了一类新的非单调信赖域算法．与通常的非单调信赖域算法不同，当试探步不成功时，并不重解信赖域子问题，而采用非单调线搜索，从而减小了计算量．在适当的条件下，证明了此算法的全局收敛性．     

对称的高逼近阶多小波的构造

本文基于已有的对称多小波,给出构造对称的高逼近阶多小波的一个显式算法．具体地,假设Φ（x）：=（φ1（x）…．,φr（x））T是一个具有逼近阶m的对称加细函数向量．对于任意非负整数n,一个具有逼近阶m＋n的新对称加细函数向量Φ^new（x）：=（φ1^new（x）…．,φr^new（x））^T可由上述算法构造出来．另外,揭示了Φ（x）与Φ^new（x）之间的关系．为了使我们的结果具体化,从具有逼近阶4的三次Hermite函数出发,构造了一个具有逼近阶6的对称加细函数向量．     

异步并行非线性对称Gauss-Seidel迭代算法

1．引言考虑非线性方程组其中A＝（a。。）EL（＊”）为＊一矩阵，B＝（衬。）EL（＊”）为非负矩阵，呐X）一（p。（X。》，4（二）＝（吵k（kk》：＊一＊一为连续的对角映射，而6＝（6k）E＊一为已知向量．这里，什小：”一”均可微，但二者的导函数并不一定连续．这类方程组具有丰富的实际背景．例如，描述冰体溶解过程的著名的Stefan问题，就可归结为问题（1·1）的数值求解（见［l］）．为在多处理机系统上有效地求解问题（1．1），文山利用这类非线性方程组的特殊结构，建立了一类并行非线性Gauss—Seidel型迭代算法．为避免该算…     

解无约束优化问题的一个新的带线搜索的信赖域算法

在传统信赖域方法的基础上, 提出了求解无约束最优化问题的一个新的带线搜索的信赖域算法. 该算法采用大步长 Armijo 线搜索技术获得迭代步长, 克服了每次迭代求解信赖域子问题时计算量较大的缺点, 因而适用于求解大型的优化问题. 在适当的条件下, 我们证明了算法的全局收敛性. 数值实验结果表明本文所提出的算法是有效的.     

A self-adaptive trust region method for the extended linear complementarity problems

By using some NCP functions, we reformulate the extended linear complementarity problem as a nonsmooth equation. Then we propose a self-adaptive trust region algorithm for solving this nonsmooth equation. The novelty of this method is that the trust region radius is controlled by the objective function value which can be adjusted automatically according to the algorithm. The global convergence is obtained under mild conditions and the local superlinear convergence rate is also established under strict complementarity conditions. This work is supported by National Natural Science Foundation of China (No. 10671126) and Shanghai Leading Academic Discipline Project (S30501).     

A New Nonmonotonic Trust Region Algorithm for A Class of Unconstrained Nonsmooth Optimization

This paper presents a new trust region algorithm for solving a class of composite nonsmooth optimizations. It is distinguished by the fact that this method does not enforce strict monotonicity of the objective function values at successive iterates and that this method extends the existing results for this type of nonlinear optimization with smooth, or piecewise smooth, or convex objective functions or their composition. It is proved that this algorithm is globally convergent under certain conditions. Finally, some numerical results for several optimization problems are reported which show that the nonmonotonic trust region method is competitive with the usual trust region method.     

A New Nonmonotonic Trust Region Algorithm for A Class of Unconstraied Nonsmooth Optimization

This paper preasents a new trust region algorithm for solving a class of composite nonsmooth optimizations.It is distinguished by the fact that this method does not enforce strict monotonicity of the objective function values at successive itereates and that this method extends the existing results for this type of nonlinear optimization with smooth ,or piecewis somooth,or convex objective functions or their composition It is pyoved that this algorithm is globally convergent under certain conditions.Finally,some numerical results for several optimization problems are reported which show that the nonmonotonic trust region method is competitive with the usual trust region method.     

A trust region algorithm for minimization of locally Lipschitzian functions

The classical trust region algorithm for smooth nonlinear programs is extended to the nonsmooth case where the objective function is only locally Lipschitzian. At each iteration, an objective function that carries both first and second order information is minimized over a trust region. The term that carries the first order information is an iteration function that may not explicitly depend on subgradients or directional derivatives. We prove that the algorithm is globally convergent. This convergence result extends the result of Powell for minimization of smooth functions, the result of Yuan for minimization of composite convex functions, and the result of Dennis, Li and Tapia for minimization of regular functions. In addition, compared with the recent model of Pang, Han and Rangaraj for minimization of locally Lipschitzian functions using a line search, this algorithm has the same convergence property without assuming positive definiteness and uniform boundedness of the second order term. Applications of the algorithm to various nonsmooth optimization problems are discussed.This author's work was supported in part by the Australian Research Council.This author's work was carried out while he was visiting the Department of Applied Mathematics at the University of New South Wales.     

An effective adaptive trust region algorithm for nonsmooth minimization

In this paper, an adaptive trust region algorithm that uses Moreau–Yosida regularization is proposed for solving nonsmooth unconstrained optimization problems. The proposed algorithm combines a modified secant equation with the BFGS update formula and an adaptive trust region radius, and the new trust region radius utilizes not only the function information but also the gradient information. The global convergence and the local superlinear convergence of the proposed algorithm are proven under suitable conditions. Finally, the preliminary results from comparing the proposed algorithm with some existing algorithms using numerical experiments reveal that the proposed algorithm is quite promising for solving nonsmooth unconstrained optimization problems.     

A trust region method for minimization of nonsmooth functions with linear constraints

We introduce a trust region algorithm for minimization of nonsmooth functions with linear constraints. At each iteration, the objective function is approximated by a model function that satisfies a set of assumptions stated recently by Qi and Sun in the context of unconstrained nonsmooth optimization. The trust region iteration begins with the resolution of an “easy problem”, as in recent works of Martínez and Santos and Friedlander, Martínez and Santos, for smooth constrained optimization. In practical implementations we use the infinity norm for defining the trust region, which fits well with the domain of the problem. We prove global convergence and report numerical experiments related to a parameter estimation problem. Supported by FAPESP (Grant 90/3724-6), FINEP and FAEP-UNICAMP. Supported by FAPESP (Grant 90/3724-6 and grant 93/1515-9).     

A TRUST REGION ALGORITHM FOR CONSTRAINED NONSMOOTH OPTIMIZATION PROBLEMS

1. Introductioncrust region methods are an hoportat class Of iterative wthods for solving nonlinearoptbozation problems, and have been developed rapidly in recent twenty years (see [1]--[9] 1 115] )[16] etc.). FOr nonsmooth optbozation problems, as early as in 1984, Y. Yuan [21 [3] prOPosed atrust region method for the composite function f(x) = h(g(x)), where h is convex and g E C';L. Qi and J. Sam [4] proposed an inexaCt trust region method for the general unconstrainednonsmooth optchatio…     

A trust region algorithm for nonsmooth optimization

A trust region algorithm is proposed for minimizing the nonsmooth composite functionF(x) = h(f(x)), wheref is smooth andh is convex. The algorithm employs a smoothing function, which is closely related to Fletcher's exact differentiable penalty functions. Global and local convergence results are given, considering convergence to a strongly unique minimizer and to a minimizer satisfying second order sufficiency conditions.     

一类复合不可微规划的信赖域算法

提出了求解带线性的束的复不可微规划的信赖域算法,并证明了它的收敛性。     

一类无约束复合非光滑优化的信赖域算法

本文提出了一个易实施的处理一类无约束复合非光滑优化的信赖域算法，并在一定条件下证明了该算法所产生的迭代序列的任何聚点都是原问题的稳定点．