凸可行问题的一种强收敛算法

无限维Hilbert空间中,解凸可行问题的平行投影算法通常是弱收敛的.本文对一般的平行投影算法进行改进,设计了一种解凸可行问题的具有强收敛性的新算法.该算法主要是在原有算法基础上引入了一个参数序列,在参数序列满足一定的控制条件下保证了算法的强收敛性.为了简单证明算法的强收敛性,我们构建了一个新的积空间,然后把原空间的这种改进平行投影算法转换为积空间中的交替投影算法.这样,改进的平行投影算法的强收敛性就可以通过交替投影算法的收敛性证明得到.     

一种求解非线性鞍点问题的交替投影方法

本文针对一类连续非线性Max-Min优化所对应的鞍点问题,提出了一种交替投影算法,证明了算法的收敛性.初步的数值实验表明本文所提出的算法比已有的同类算法具有更高的计算效率.     

闭凸集约束下线性矩阵方程求解的松弛交替投影算法

研究线性矩阵方程AXB=C在闭凸集合R约束下的数值迭代解法.所考虑的闭凸集合R为(1)有界矩阵集合,(2)Q-正定矩阵集合和(3)矩阵不等式解集合.构造松弛交替投影算法求解上述问题,并用算子理论证明了由该算法生成的序列具有弱收敛性.给出了矩阵方程AXB=C求对称非负解和对称半正定解的数值算例,大量数值实验验证了该算法的可行性和高效性,并说明该算法与交替投影算法和谱投影梯度算法比较在迭代效率上的明显优势.     

求解拟单调变分不等式问题的交替惯性向前向后算法

该文结合线搜索方法,提出了改进的交替惯性向前向后算法求解拟单调变分不等式问题.该算法在每次迭代时只需计算一次到可行集上的投影,在一定的假设下证明了解集的弱收敛性定理.最后通过数值实验验证了算法的有效性.     

利用交替投影算法求解矩阵方程AXB=C的广义中心对称解

利用交替投影算法求解矩阵方程AXB=C的广义中心对称解,当矩阵方程AXB=C不相容时,利用Dykstra's交替投影算法来求其广义中心对称解的最佳逼近,数值结果表明该方法是行之有效的.     

张量分裂可行域问题的有效投影迭代法

投影法是解决多集分裂可行域问题的广泛且有效的研究方法.本文从分裂迭代视角出发,研究了求解张量可行域问题的高效投影分裂迭代方法.首先,利用投影算子将张量分裂可行域问题转化为多线性方程组.然后,借助加速超松弛法和对称(交替)加速超松弛法的高维化处理方式,推广到适合多线性方程组的求解框架.最后,通过对新的张量分裂迭代格式的谱半径的理论分析,证明了算法的收敛性.充分的数值测试验证了算法的有效性.     

基于迭代投影的梯度硬阈值追踪算法

梯度硬阈值追踪算法是求解稀疏优化问题的有效算法之一.考虑到算法中投影对最优解的影响,提出一种比贪婪策略更好的投影算法是很有必要的.针对一般的稀疏约束优化问题,利用整数规划提出一种迭代投影策略,将梯度投影算法中的投影作为一个子问题求解.通过迭代求解该子问题得到投影的指标集,并以此继续求解原问题,以提高梯度硬阈值追踪算法的计算效果.证明了算法的收敛性,并通过数值实例验证了算法的有效性.     

解一类结构变分不等式问题的非精确并行交替方向法

带线性约束的具有两分块结构的单调变分不等式问题, 出现在许多现代应用中, 如交通和经济问题等. 基于该问题良好的可分结构, 分裂型算法被广泛研究用于其求解. 提出新的带回代的非精确并行交替方向法解该类问题, 在每一步迭代中,首先以并行模式通过投影得到预测点, 然后对其校正得到下一步的迭代点. 在压缩型算法的理论框架下, 在适当条件下证明了所提算法的全局收敛性. 数值结果表明了算法的有效性. 此外, 该算法可推广到求解具有多分块结构的问题.     

基于字典学习和TV的能谱CT重建算法

能谱CT可以将较宽的能谱数据划分为几个单独的窄谱数据,从而同时获得多个能量通道下的投影.但由于窄谱通道内接收到的光子数较少,投影通常包含较大的噪声.针对这一问题,基于压缩感知理论提出了一种基于字典学习和全变分TV(total-variation)的迭代重建算法用于能谱CT重建,应用交替最小化方法优化相关目标函数,并采用Split-Bregman算法求解.同时,采用有序子集方法加速迭代收敛过程,提高运算速率.为了验证和评估所提出的方法,使用简单模型和实际临床小鼠模型进行了仿真实验,实验结果表明,所提出的算法有较好的去噪及细节保存能力.     

核范数和谱范数下广义Sylvester方程最小二乘问题的一类改进算法

在文献[10]中,作者从数值角度讨论核范数和谱范数下的广义Sylvester方程约束最小二乘问题min X∈ S|NΣI=1A_iXB_i-C|的算法,其中s为闭凸集合.采用的数值算法是非精确交替方向法,并结合阈值算法、 MoreauYosida正则化算法、谱投影算法、LSQR, SPG等算法求解相应子问题.本文在文献[10]的基础上,通过引入新变量,应用交替方向法简化子问题的求解,其中每个子问题都可以精确求解,更重要的是每个变量都具有显式的表达式.在理论方面我们证明了算法的收敛性,数值试验表明改进后的算法不管是在时间上还是在迭代步上,运行的结果得到很大的改善.     

Alternating convex projection methods for discrete-time covariance control design

The problem of designing a controller for a linear, discretetime system is formulated as a problem of designing an appropriate plant-state covariance matrix. Closed-loop stability and multiple-output performance constraints are expressed geometrically as requirements that the covariance matrix lies in the intersection of some specified closed, convex sets in the space of symmetric matrices. We solve a covariance feasibility problem to determine the existence and compute a covariance matrix to satisty assignability and output-norm performance constraints. In addition, we can treat a covariance optimization problem to construct an assignable covariance matrix which satisfies output performance constraints and is as close as possible to a given desired covariance. We can also treat inconsistent constraints, where we look for an assignable covariance which best approximates desired but unachievable output performance objectives; we call this the infeasible covariance optimization problem. All these problems are of a convex nature, and alternating convex projection methods are proposed to solve them, exploiting the geometric formulation of the problem. To this end, analytical expressions for the projections onto the covariance assignability and the output covariance inequality constraint sets are derived. Finally, the problem of designing low-order dynamic controllers using alternating projections is discussed, and a numerical technique using alternating projections is suggested for a solution, although convergence of the algorithm is not guaranteed in this case. A control design example for a fighter aircraft model illustrates the method.This research was completed while the first author was with the Space Systems Control Laboratory at Purdue University. Support from the Army Research Office Grant ARO-29029-EG is gratefully acknowledged.     

Restricted Normal Cones and Sparsity Optimization with Affine Constraints

The problem of finding a vector with the fewest nonzero elements that satisfies an underdetermined system of linear equations is an NP-complete problem that is typically solved numerically via convex heuristics or nicely behaved nonconvex relaxations. In this paper we consider the elementary method of alternating projections (MAP) for solving the sparsity optimization problem without employing convex heuristics. In a parallel paper we recently introduced the restricted normal cone which generalizes the classical Mordukhovich normal cone and reconciles some fundamental gaps in the theory of sufficient conditions for local linear convergence of the MAP algorithm. We use the restricted normal cone together with the notion of superregularity, which is inherently satisfied for the affine sparse optimization problem, to obtain local linear convergence results with estimates for the radius of convergence of the MAP algorithm applied to sparsity optimization with an affine constraint.     

A von Neumann alternating method for finding common solutions to variational inequalities

By modifying von Neumann’s alternating projections algorithm, we obtain an alternating method for solving the recently introduced Common Solutions to Variational Inequalities Problem (CSVIP). For simplicity, we mainly confine our attention to the two-set CSVIP, which entails finding common solutions to two unrelated variational inequalities in Hilbert space.     

Local linear convergence of approximate projections onto regularized sets

The numerical properties of algorithms for finding the intersection of sets depend to some extent on the regularity of the sets, but even more importantly on the regularity of the intersection. The alternating projection algorithm of von Neumann has been shown to converge locally at a linear rate dependent on the regularity modulus of the intersection. In many applications, however, the sets in question come from inexact measurements that are matched to idealized models. It is unlikely that any such problems in applications will enjoy metrically regular intersection, let alone set intersection. We explore a regularization strategy that generates an intersection with the desired regularity properties. The regularization, however, can lead to a significant increase in computational complexity. In a further refinement, we investigate and prove linear convergence of an approximate alternating projection algorithm. The analysis provides a regularization strategy that fits naturally with many ill-posed inverse problems, and a mathematically sound stopping criterion for extrapolated, approximate algorithms. The theory is demonstrated on the phase retrieval problem with experimental data. The conventional early termination applied in practice to unregularized, consistent problems in diffraction imaging can be justified fully in the framework of this analysis providing, for the first time, proof of convergence of alternating approximate projections for finite dimensional, consistent phase retrieval problems.     

Modified Alternating Direction Methods for the Modified Multiple-Sets Split Feasibility Problems

In this paper, we propose two new multiple-sets split feasibility problem models and new solution methods. The first model is more separable than the original one, which enables us to apply a modified alternating direction method with parallel steps to solve it. Then, to overcome the difficulty of computing projections onto the constraint sets, a special version of this modified method with the strategy of projection onto half-space is given. The second model consists in finding a least Euclidean norm solution of the multiple-sets split feasibility problem, for which we provide another modified alternating direction method. Numerical results presented at the last show the efficiency of our methods.     

An alternating projections method for certain linear problems in a Hilbert space

Recent extensions of von Neumann's alternating projection methodpermit the computation of proximity projections onto certainconvex sets. This paper exploits this fact in constructing aglobally convergent method for minimizing linear functions overa convex set in a Hilbert space. In particular, we solve theeducational testing problem and an inverse eigenvalue problem,two difficult problems involving positive semidefiniteness constraints.     

Symmetric tensor decomposition by alternating gradient descent

The symmetric tensor decomposition problem is a fundamental problem in many fields, which appealing for investigation. In general, greedy algorithm is used for tensor decomposition. That is, we first find the largest singular value and singular vector and subtract the corresponding component from tensor, then repeat the process. In this article, we focus on designing one effective algorithm and giving its convergence analysis. We introduce an exceedingly simple and fast algorithm for rank-one approximation of symmetric tensor decomposition. Throughout variable splitting, we solve symmetric tensor decomposition problem by minimizing a multiconvex optimization problem. We use alternating gradient descent algorithm to solve. Although we focus on symmetric tensors in this article, the method can be extended to nonsymmetric tensors in some cases. Additionally, we also give some theoretical analysis about our alternating gradient descent algorithm. We prove that alternating gradient descent algorithm converges linearly to global minimizer. We also provide numerical results to show the effectiveness of the algorithm.     

Proximity Function Minimization Using Multiple Bregman Projections, with Applications to Split Feasibility and Kullback–Leibler Distance Minimization

Problems in signal detection and image recovery can sometimes be formulated as a convex feasibility problem (CFP) of finding a vector in the intersection of a finite family of closed convex sets. Algorithms for this purpose typically employ orthogonal or generalized projections onto the individual convex sets. The simultaneous multiprojection algorithm of Censor and Elfving for solving the CFP, in which different generalized projections may be used at the same time, has been shown to converge for the case of nonempty intersection; still open is the question of its convergence when the intersection of the closed convex sets is empty.Motivated by the geometric alternating minimization approach of Csiszár and Tusnády and the product space formulation of Pierra, we derive a new simultaneous multiprojection algorithm that employs generalized projections of Bregman to solve the convex feasibility problem or, in the inconsistent case, to minimize a proximity function that measures the average distance from a point to all convex sets. We assume that the Bregman distances involved are jointly convex, so that the proximity function itself is convex. When the intersection of the convex sets is empty, but the closure of the proximity function has a unique global minimizer, the sequence of iterates converges to this unique minimizer. Special cases of this algorithm include the Expectation Maximization Maximum Likelihood (EMML) method in emission tomography and a new convergence result for an algorithm that solves the split feasibility problem.     

Accelerating the convergence of the method of alternating projections

The powerful von Neumann-Halperin method of alternating projections (MAP) is an algorithm for determining the best approximation to any given point in a Hilbert space from the intersection of a finite number of subspaces. It achieves this by reducing the problem to an iterative scheme which involves only computing best approximations from the individual subspaces which make up the intersection. The main practical drawback of this algorithm, at least for some applications, is that the method is slowly convergent. In this paper, we consider a general class of iterative methods which includes the MAP as a special case. For such methods, we study an ``accelerated' version of this algorithm that was considered earlier by Gubin, Polyak, and Raik (1967) and by Gearhart and Koshy (1989). We show that the accelerated algorithm converges faster than the MAP in the case of two subspaces, but is, in general, not faster than the MAP for more than two subspaces! However, for a ``symmetric' version of the MAP, the accelerated algorithm always converges faster for any number of subspaces. Our proof seems to require the use of the Spectral Theorem for selfadjoint mappings.

     

Simultaneous Subgradient Algorithms for the Generalized Split Variational Inclusion Problem in Hilbert Spaces

In this article, we study the generalized split variational inclusion problem. For this purpose, motivated by the projected Landweber algorithm for the split equality problem, we first present a simultaneous subgradient extragradient algorithm and give related convergence theorems for the proposed algorithm. Next, motivated by the alternating CQ-algorithm for the split equality problem, we propose another simultaneous subgradient extragradient algorithm to study the general split variational inclusion problem. As applications, we consider the split equality problem, split feasibility problem, split variational inclusion problem, and variational inclusion problem in Hilbert spaces.