一类锥模型非单调信赖域算法及收敛性分析

本文对无约束优化问题提出了一类基于锥模型的非单调信赖域算法.二次模型非单调信赖域算法是新算法的特例.在适当的条件下,证明了算法的全局收敛性及Q-二次收敛性.     

基于共轭梯度的锥模型信赖域算法

1引 言 本文考虑求解无约束优化问题 minf(x),x∈Rn, (1.1) 其中f(x)在Rn上连续二阶可导.大部分求解无约束优化问题的算法都是基于迭代的思想形成一个近似函数,然后极小化该函数.近似函数通常都采用二次函数,本文研究采用锥函数作为近似函数的锥模型算法.锥模型方法是Davidon于1980年在文献[2]中首次提出来的,随后Sorensen[16],Ariyawansa[1]等对锥模型进行了线搜索策略的研究.Di和Sun[5][18],诸梅芳[20],Xu[19]等对锥模型信赖域方法进行了研究.     

解新锥模型信赖域子问题的折线法

本文以新锥模型信赖域子问题的最优性条件为理论基础,认真讨论了新子问题的锥函数性质,分析了此函数在梯度方向及与牛顿方向连线上的单调性.在此基础上本文提出了一个求解新锥模型信赖域子问题折线法,并证明了这一子算法保证解无约束优化问题信赖域法全局收敛性要满足的下降条件.本文获得的数值实验表明该算法是有效的.     

一个锥模型的自适应信赖域算法及其收敛性

本文研究了无约束最优化问题的基于锥模型的自适应信赖域算法.利用理论分析得到一个新的自适应信赖域半径.算法在每步迭代中以变化的速率、当前迭代点的信息以及水平向量信息调节信赖域半径的大小.从理论上证明了新算法的全局收敛性和Q-二阶收敛性.用数值试验验证了新算法的有效性.推广了已有的自适应信赖域算法的可行性和有效性.     

解线性约束优化问题的新锥模型信赖域法

本文提出了一个解线性等式约束优化问题的新锥模型信赖域方法.论文采用零空间技术消除了新锥模型子问题中的线性等式约束,用折线法求解转换后的子问题,并给出了解线性等式约束优化问题的信赖域方法.论文提出并证明了该方法的全局收敛性,并给出了该方法解线性等式约束优化问题的数值实验.理论和数值实验结果表明新锥模型信赖域方法是有效的,这给出了用新锥模型进一步研究非线性优化的基础.     

无约束优化的自适应信赖域方法

本文对无约束优化问题提出一个自适应信赖域方法,每次迭代都充分利用前迭代点的信息自动产生一个恰当的信赖域半径,在此区域内,二次模型与原目标函数尽可能一致,避免盲目的尝试,提高了计算效率。文中在通常条件下证明了全局收敛性及局部超线性收敛结果,给出了新算法与传统信赖域方法的数值结果,证实了新方法的有效性。     

张量方法在信赖域算法中的应用

信赖域算法是求解无约束优化问题的一种有效的算法.对于该算法的子问题,本文将原来目标函数的二次模型扩展成四次张量模型,提出了一个带信赖域约束的四次张量模型优化问题的求解算法.该方法的最大特点是:不仅在张量模型的非稳定点可以得到下降方向及相应的迭代步长,而且在非局部极小值点的稳定点也可以得到下降方向及相应的迭代步长,从而在算法产生的迭代点列中存在一个子列收敛到信赖域子问题的局部极小值点.     

求解无约束优化问题的分式模型信赖域算法

本文提出一个求解无约束优化问题的分式模型信赖域拟Newton算法.在新算法中,分式模型信赖域子问题是用简单折线法求解的.在合理假设条件下,算法的全局收敛性获得了证明.数值实验结果表明新算法是可行、有效的.     

解线性约束优化问题的新锥模型信赖域3法

本文提出了一个解线性等式约束优化问题的新锥模型信赖域方法．论文采用零空间技术消除了新锥模型子问题中的线性等式约束，用折线法求解转换后的子问题，并给出了解线性等式约束优化问题的信赖域方法．论文提出并证明了该方法的全局收敛性，并给出了该方法解线性等式约束优化问题的数值实验．理论和数值实验结果表明新锥模型信赖域方法是有效的，这给出了用新锥模型进一步研究非线性优化的基础．     

一种基于新锥模型的自适应信赖域算法

本文提出一种自动确定信赖域半径的新锥模型信赖域算法.该算法在每步迭代中利用以前迭代点的二次信息和水平向量信息自动产生一个信赖域半径.且证明了全局收敛性及超线性收敛性,数值结果验证了新算法的有效性.     

解大型无约束优化的新的非单调简单模型BB-TR方法（英文）

The trust region(TR) method for optimization is a class of effective methods.The conic model can be regarded as a generalized quadratic model and it possesses the good convergence properties of the quadratic model near the minimizer.The Barzilai and Borwein(BB) gradient method is also an effective method,it can be used for solving large scale optimization problems to avoid the expensive computation and storage of matrices.In addition,the BB stepsize is easy to determine without large computational efforts.In this paper,based on the conic trust region framework,we employ the generalized BB stepsize,and propose a new nonmonotone adaptive trust region method based on simple conic model for large scale unconstrained optimization.Unlike traditional conic model,the Hessian approximation is an scalar matrix based on the generalized BB stepsize,which resulting a simple conic model.By adding the nonmonotone technique and adaptive technique to the simple conic model,the new method needs less storage location and converges faster.The global convergence of the algorithm is established under certain conditions.Numerical results indicate that the new method is effective and attractive for large scale unconstrained optimization problems.     

Nonmonotone adaptive trust region method based on simple conic model for unconstrained optimization

We propose a nonmonotone adaptive trust region method based on simple conic model for unconstrained optimization. Unlike traditional trust region methods, the subproblem in our method is a simple conic model, where the Hessian of the objective function is approximated by a scalar matrix. The trust region radius is adjusted with a new self-adaptive adjustment strategy which makes use of the information of the previous iteration and current iteration. The new method needs less memory and computational efforts. The global convergence and Q-superlinear convergence of the algorithm are established under the mild conditions. Numerical results on a series of standard test problems are reported to show that the new method is effective and attractive for large scale unconstrained optimization problems.     

Combining nonmonotone conic trust region and line search techniques for unconstrained optimization

In this paper, we propose a trust region method for unconstrained optimization that can be regarded as a combination of conic model, nonmonotone and line search techniques. Unlike in traditional trust region methods, the subproblem of our algorithm is the conic minimization subproblem; moreover, our algorithm performs a nonmonotone line search to find the next iteration point when a trial step is not accepted, instead of resolving the subproblem. The global and superlinear convergence results for the algorithm are established under reasonable assumptions. Numerical results show that the new method is efficient for unconstrained optimization problems.     

A trust-region method with a conic model for unconstrained optimization

In this paper, we propose and analyze a new conic trust-region algorithm for solving the unconstrained optimization problems. A new strategy is proposed to construct the conic model and the relevant conic trust-region subproblems are solved by an approximate solution method. This approximate solution method is not only easy to implement but also preserves the strong convergence properties of the exact solution methods. Under reasonable conditions, the locally linear and superlinear convergence of the proposed algorithm is established. The numerical experiments show that this algorithm is both feasible and efficient. Copyright © 2008 John Wiley & Sons, Ltd.     

A nonmonotone adaptive trust region method for unconstrained optimization based on conic model

In this paper, we present a nonmonotone adaptive trust region method for unconstrained optimization based on conic model. The new method combines nonmonotone technique and a new way to determine trust region radius at each iteration. The local and global convergence properties are proved under reasonable assumptions. Numerical experiments show that our algorithm is effective.     

A NEW DERIVATIVE FREE OPTIMIZATION METHOD BASED ON CONIC INTERPOLATION MODEL

In this paper, a new derivative free trust region method is developed basedon the conic interpolation model for the unconstrained optimization. The conic inter-polation model is built by means of the quadratic model function, the collinear scalingformula, quadratic approximation and interpolation. All the parameters in this model axedetermined by objective function interpolation condition. A new derivative free method isdeveloped based upon this model and the global convergence of this new method is provedwithout any information on gradient.     

A nonmonotone conic trust region method based on line search for solving unconstrained optimization

In this paper, we present a nonmonotone conic trust region method based on line search technique for unconstrained optimization. The new algorithm can be regarded as a combination of nonmonotone technique, line search technique and conic trust region method. When a trial step is not accepted, the method does not resolve the trust region subproblem but generates an iterative point whose steplength satisfies some line search condition. The function value can only be allowed to increase when trial steps are not accepted in close succession of iterations. The local and global convergence properties are proved under reasonable assumptions. Numerical experiments are conducted to compare this method with the existing methods.     

A nonmonotone trust-region method of conic model for unconstrained optimization

In this paper, we present a nonmonotone trust-region method of conic model for unconstrained optimization. The new method combines a new trust-region subproblem of conic model proposed in [Y. Ji, S.J. Qu, Y.J. Wang, H.M. Li, A conic trust-region method for optimization with nonlinear equality and inequality 4 constrains via active-set strategy, Appl. Math. Comput. 183 (2006) 217–231] with a nonmonotone technique for solving unconstrained optimization. The local and global convergence properties are proved under reasonable assumptions. Numerical experiments are conducted to compare this method with the method of [Y. Ji, S.J. Qu, Y.J. Wang, H.M. Li, A conic trust-region method for optimization with nonlinear equality and inequality 4 constrains via active-set strategy, Appl. Math. Comput. 183 (2006) 217–231].     

A Conic Trust-Region Method for Nonlinearly Constrained Optimization

Trust-region methods are powerful optimization methods. The conic model method is a new type of method with more information available at each iteration than standard quadratic-based methods. Can we combine their advantages to form a more powerful method for constrained optimization? In this paper we give a positive answer and present a conic trust-region algorithm for non-linearly constrained optimization problems. The trust-region subproblem of our method is to minimize a conic function subject to the linearized constraints and the trust region bound. The use of conic functions allows the model to interpolate function values and gradient values of the Lagrange function at both the current point and previous iterate point. Since conic functions are the extension of quadratic functions, they approximate general nonlinear functions better than quadratic functions. At the same time, the new algorithm possesses robust global properties. In this paper we establish the global convergence of the new algorithm under standard conditions.