非凸多分块优化的Bregman ADMM的收敛率研究

Wang等提出了求解带线性约束的多块可分非凸优化问题的带Bregman距离的交替方向乘子法(Bregman ADMM),并证明了其收敛性.该文将进一步研究求解带线性约束的多块可分非凸优化问题的Bregman ADMM的收敛率,以及算法产生的迭代点列有界的充分条件.在效益函数的Kurdyka-Lojasiewicz (KL)性质下,该文建立了值和迭代的收敛速率,证明了与目标函数相关的各种KL指数值可获得Bregman ADMM的三种不同收敛速度.更确切地说,该文证明了如下结果:如果效益函数的KL指数θ=0,那么由Bregman ADMM生成的序列经过有限次迭代后收敛;如果θ∈(0,1/2],那么Bregman ADMM是线性收敛的;如果θ∈(1/2,1),那么Bregman ADMM是次线性收敛的.     

可数族弱Bregman相对非扩展映像的收敛性分析

在自反Banach空间中,引入可数族弱Bregman相对非扩张映像概念,构造了两种迭代算法求解可数族弱Bregman相对非扩张映像的公共不动点.在适当条件下,证明了两种迭代算法产生的序列的强收敛性.     

非凸不可分优化线性近似Bregman型Peaceman-Rachford分裂算法

基于Peaceman-Rachford分裂算法,结合线性近似技术和Bregman距离,本文提出一种线性近似Bregman型Peaceman-Rachford分裂算法,用于求解目标函数带不可分结构的线性约束非凸优化问题.在常规假设下,得到算法的全局收敛性.在效益函数满足Kurdyka-Lojasiewicz性质前提下,论证算法的强收敛性.当KurdykaLojasiewicz性质关联函数为特殊结构时,分析并获得算法的收敛率结果.最后,初步数值试验说明算法有数值有效性.     

一种SENSE模型下信号重建的类-Dykstra近点有效算法

本文研究了SENSE模型下从部分傅里叶数据中信号的重建问题.利用类Dykstra近点方法和Bregman迭代方法,我们获得了一种SENSE模型下信号重建的加速类-Dykstra近点有效算法,并证明了该算法的收敛性.实验仿真显示,该方法比经典的分裂Bregman方法有效.     

一种SENSE模型下信号重建的类-Dykstra近点有效算法（英文）

本文研究了SENSE模型下从部分傅里叶数据中信号的重建问题.利用类Dykstra近点方法和Bregman迭代方法,我们获得了一种SENSE模型下信号重建的加速类-Dykstra近点有效算法,并证明了该算法的收敛性.实验仿真显示,该方法比经典的分裂Bregman方法有效.     

一种新的Bregman迭代方法在信号恢复中的应用

本文结合残量Bregman迭代方法以及不动点迭代方法提出一种新迭代方法,将其应用于信号恢复问题.数值试验表明,新方法避免了Bregman迭代方法产生的停滞现象且较线性Bregman迭代方法更稳定、快速、有效.     

一种基于新锥模型的自适应信赖域算法

本文提出一种自动确定信赖域半径的新锥模型信赖域算法.该算法在每步迭代中利用以前迭代点的二次信息和水平向量信息自动产生一个信赖域半径.且证明了全局收敛性及超线性收敛性,数值结果验证了新算法的有效性.     

垂直线性互补问题的一步全局线性和局部二次收敛光滑Newton法

基于凝聚函数,提出一个求解垂直线性互补问题的光滑Newton法.该算法具有以下优点:(i)每次迭代仅需解一个线性系统和实施一次线性搜索;(ⅱ)算法对垂直分块P0矩阵的线性互补问题有定义且迭代序列的每个聚点都是它的解.而且,对垂直分块P₀+R₀矩阵的线性互补问题,算法产生的迭代序列有界且其任一聚点都是它的解;(ⅲ)在无严格互补条件下证得算法即具有全局线性收敛性又具有局部二次收敛性.许多已存在的求解此问题的光滑Newton法都不具有性质(ⅲ).     

求解l1极小化问题的Bregman迭代算法

在Tikhonov正则化方法的基础上将其转化为一类l1极小化问题进行求解,并基于Bregman迭代正则化构建了Bregman迭代算法,实现了l1极小化问题的快速求解.数值实验结果表明,Bregman迭代算法在快速求解算子方程的同时,有着比最小二乘法和Tikhonov正则化方法更高的求解精度.     

垂直线性互补问题的一种光滑算法

文中给出了垂直线性互补问题的一个新的光滑价值函数,不同于光滑化方法中的价值函数,它不包含任何必须趋向零的参数,因此算法中不涉及参数调整步骤,而且具有良好的强制性.基此价值函数,提出了求解垂直线性互补问题的一种阻尼Newton类算法,并证明了该算法对竖块P0+R0矩阵的垂直线性互补问题具有全局收敛性;当解满足相当于BD-正则条件时,算法具有局部二次收敛性;在不增加额外校正步骤(算法的每个迭代步只求解一个Newton方程)的情形下,算法对竖块P-矩阵垂直线性互补问题(无须假设严格互补),具有有限步收敛性.数值实验结果令人满意.     

An extension of the proximal point algorithm with Bregman distances on Hadamard manifolds

In this paper we present an extension of the proximal point algorithm with Bregman distances to solve constrained minimization problems with quasiconvex and convex objective function on Hadamard manifolds. The proposed algorithm is a modified and extended version of the one presented in Papa Quiroz and Oliveira (J Convex Anal 16(1): 49–69, 2009). An advantage of the proposed algorithm, for the nonconvex case, is that in each iteration the algorithm only needs to find a stationary point of the proximal function and not a global minimum. For that reason, from the computational point of view, the proposed algorithm is more practical than the earlier proximal method. Another advantage, for the convex case, is that using minimal condition on the problem data as well as on the proximal parameters we get the same convergence results of the Euclidean proximal algorithm using Bregman distances.     

Derivative free two-point methods with and without memory for solving nonlinear equations

Two families of derivative free two-point iterative methods for solving nonlinear equations are constructed. These methods use a suitable parametric function and an arbitrary real parameter. It is proved that the first family has the convergence order four requiring only three function evaluations per iteration. In this way it is demonstrated that the proposed family without memory supports the Kung-Traub hypothesis (1974) on the upper bound 2ⁿ of the order of multipoint methods based on n + 1 function evaluations. Further acceleration of the convergence rate is attained by varying a free parameter from step to step using information available from the previous step. This approach leads to a family of two-step self-accelerating methods with memory whose order of convergence is at least and even in special cases. The increase of convergence order is attained without any additional calculations so that the family of methods with memory possesses a very high computational efficiency. Numerical examples are included to demonstrate exceptional convergence speed of the proposed methods using only few function evaluations.     

Split Bregman method for the modified lot model in image denoising

In this paper a split Bregman iteration is proposed for the modified LOT model in image denoising. We first use the split Bregman method to solve the ROF model which can be seen as an approximate form of the first step of the original LOT model. Then we use a modified split Bregman method to fit the second step of the LOT model and give the convergence of the proposed split Bregman method. Several numerical examples are arranged to show the effectiveness of the proposed method.     

非线性规划的QP-free方法

该文提出一种QP-free可行域方法用来解满足光滑不等式约束的最优化问题.此方法把QP-free方法和3-1线性互补函数相结合一个等价于原约束问题的一阶KKT条件的方程组,并在此基础上给出解这个方程组的迭代算法. 这个方法的每一步迭代都可以看作是对求KKT条件解的牛顿或拟牛顿迭代的扰动,且在该方法中每一步的迭代均具有可行性. 该方法是可实行的且具有全局性, 且不需要严格互补条件、聚点的孤立性和积极约束函数梯度的线性独立等假设. 在与文献[2]中相同的适当条件下,此方法还具有超线性收敛性. 数值检验结果表示,该文提出的QP-free可行域方法是切实有效的方法.     

On Bregman Best Proximity Points in Banach Spaces

In this article, using Bregman functions and Bregman distances, we first introduce the notion of Bregman best proximity points, extending the notion of best proximity points introduced and studied in [1 K. Fan (1969). Extensions of two mixed point theorems of F. E. Browder. Math. Z. 122:234–240.[Crossref], [Web of Science ®] , [Google Scholar]]. We then prove existence and convergence results of Bregman best proximity points for Bregman cyclic contraction mappings in the setting of Banach spaces. It is well known that the Bregman distance does not satisfy either the symmetry property or the triangle inequality which are required for standard distances. Numerical examples are included at the end of the paper. So, our results improve and generalize many known results in the current literature.     

A projection method based on the splitting Bregman iteration for the image denoising

By analyzing the connection between the projection operator and the shrink operator, we propose a projection method based on the splitting Bregman iteration for image denoising problem in this paper. Compared with the splitting Bregman method, the proposed method has a more compact form so that it is more fast and efficient. Following from the operator theory, the convergence of the proposed method is proved. Some numerical comparisons between the proposed method and the splitting Bregman method are arranged for solving two basic image denoising models.     

QSDPNAL: a two-phase augmented Lagrangian method for convex quadratic semidefinite programming

In this paper, we present a two-phase augmented Lagrangian method, called QSDPNAL, for solving convex quadratic semidefinite programming (QSDP) problems with constraints consisting of a large number of linear equality and inequality constraints, a simple convex polyhedral set constraint, and a positive semidefinite cone constraint. A first order algorithm which relies on the inexact Schur complement based decomposition technique is developed in QSDPNAL-Phase I with the aim of solving a QSDP problem to moderate accuracy or using it to generate a reasonably good initial point for the second phase. In QSDPNAL-Phase II, we design an augmented Lagrangian method (ALM) wherein the inner subproblem in each iteration is solved via inexact semismooth Newton based algorithms. Simple and implementable stopping criteria are designed for the ALM. Moreover, under mild conditions, we are able to establish the rate of convergence of the proposed algorithm and prove the R-(super)linear convergence of the KKT residual. In the implementation of QSDPNAL, we also develop efficient techniques for solving large scale linear systems of equations under certain subspace constraints. More specifically, simpler and yet better conditioned linear systems are carefully designed to replace the original linear systems and novel shadow sequences are constructed to alleviate the numerical difficulties brought about by the crucial subspace constraints. Extensive numerical results for various large scale QSDPs show that our two-phase algorithm is highly efficient and robust in obtaining accurate solutions. The software reviewed as part of this submission was given the DOI (Digital Object Identifier)  https://doi.org/10.5281/zenodo.1206980.     

Picard iteration convergence analysis in a Galerkin finite element approximation of the one-dimensional shallow water equations

A Fourier method for analyzing iteration convergence is applied to four different formulations of the “simple” or Picard iteration procedure of a shallow water model. The model uses the Galerkin linear FE scheme in space and the implicit θ finite differencing in time. Although the numerical scheme is implicit and linearly stable for forward centering in time (θ > 0.5), it is shown that if the Picard iteration procedure is used, there may be additional operating restrictions which need to be observed to achieve iteration convergence. These restrictions effectively limit the time step (Δt) and take the form of upper bounds on θ times the Courant number (θ?). In the 1D shallow water model, iteration convergence requires θ?$ \le 1/ \sqrt 3 $ for two of the four iteration formulations, but there are no effective restrictions for the other two formulations. These results were confirmed by numerical experiments. There is a tradeoff between computer storage and run times. The model version with the shortest run time (due to unrestricted Δt) also requires most computer storage. © 1993 John Wiley & Sons, Inc.     

Stability, Convergence, and Conditioning of Stationary Iterative Methods of the Form x(I+1)=Px(I)+q for the Solution of Linear Systems

A statistical approach to the study of the stability of a stationaryiterative method for solving a linear system x=Px+q is studied.An asymptotic stability factor is introduced. The relationsbetween this stability measure, the spectral radius of the iterationmatrix, and the condition number of the system are studied.The special case when the iteration matrix is normal is treatedseparately from the general one. For iteration matrices thatare normal, the following logical implications are found: large condition number large asymptotic stability factor poorconvergence. In the general case, a large asymptotic stability factor doesnot imply poor convergence, i.e.: large condition number large asymptotic stability factor poorconvergence.