EXTENDED OBLIQUE PROJECTION METHOD FOR GENERALIZED LEAST SQUARES PROBLEM

We extend the oblique projection method given by Y.Saad to solve the generalized least squares problem. The corresponding oblique projection operator is presented and the convergence theorems are proved. Some necessary and sufficient conditions for computing the solution or the minimum N-norm solution of the min || A x- b ||M2 have been proposed as well.     

广义鞍点问题的改进的类SOR算法

针对广义鞍点问题,本文提出了一个改进的类逐次超松弛迭代算法,在较弱的条件下,分析了算法的收敛性及线性收敛率.新算法的每步计算量与已有的算法类似,都是需要（近似）求解线性方程组,但新算法有更好的灵活度通过合适地选取参数矩阵,每一步子问题可以容易地求解,甚至可以有闭式解（closed-form solution）.数值实验结果显示了新算法的有效性.     

一类拟互补问题的迭代法

本文研究一类非线性算子的拟互补问题,获得了在新的条件下的解的存在唯一性定理,并给出了两个Schwarz算法,所产生的近似解序列单调收敛于真解。     

ON THE SEPARABLE NONLINEAR LEAST SQUARES PROBLEMS

Separable nonlinear least squares problems are a special class of nonlinear least squares problems, where the objective functions are linear and nonlinear on different parts of variables. Such problems have broad applications in practice. Most existing algorithms for this kind of problems are derived from the variable projection method proposed by Golub and Pereyra, which utilizes the separability under a separate framework. However, the methods based on variable projection strategy would be invalid if there exist some constraints to the variables, as the real problems always do, even if the constraint is simply the ball constraint. We present a new algorithm which is based on a special approximation to the Hessian by noticing the fact that certain terms of the Hessian can be derived from the gradient. Our method maintains all the advantages of variable projection based methods, and moreover it can be combined with trust region methods easily and can be applied to general constrained separable nonlinear problems. Convergence analysis of our method is presented and numerical results are also reported.     

一类求解鞍点问题的广义不精确Uzawa方法

本文提出了一类求解大型稀疏鞍点问题的新的广义不精确Uzawa算法.该方法不仅可以包含 前人的方法, 而且可以拓展出很多新方法. 理论分析给出该方法收敛的条件, 并详细的分析了其收敛性质和参数矩阵的选取方法. 通过对有限元离散的Stokes问题的数值实验表明, 新方法是行之有效的, 其收敛速度明显优于原来的算法.     

A NUMERICALLY STABLE BLOCK MODIFIED GRAM-SCHMIDT ALGORITHM FOR SOLVING STIFF WEIGHTED LEAST SQUARES PROBLEMS

Recently, Wei in proved that perturbed stiff weighted pseudoinverses and stiff weighted least squares problems are stable, if and only if the original and perturbed coefficient matrices A and A^- satisfy several row rank preservation conditions. According to these conditions, in this paper we show that in general, ordinary modified Gram-Schmidt with column pivoting is not numerically stable for solving the stiff weighted least squares problem. We then propose a row block modified Gram-Schmidt algorithm with column pivoting, and show that with appropriately chosen tolerance, this algorithm can correctly determine the numerical ranks of these row partitioned sub-matrices, and the computed QR factor R^- contains small roundoff error which is row stable. Several numerical experiments are also provided to compare the results of the ordinary Modified Gram-Schmidt algorithm with column pivoting and the row block Modified Gram-Schmidt algorithm with column pivoting.     

非线性最小二乘问题的信赖域方法

本文提出一个新的非线性最小二乘的信赖域方法,在该方法中每个信赖域子问题只需要一次求解,而且每次迭代的一维搜索步长因子是给定的,避开一维搜索的环节,大大地提高了算法效率.文中证明了在一定的条件下算法的全局收敛性.     

关于鞍点问题的广义预处理HSS-SOR交替分裂迭代方法

本文研究了鞍点问题的迭代法. 在白中治,Golub和潘建瑜提出的预处理对称/反对称分裂（PHSS）迭代法的基础上,通过结合GSOR迭代格式,利用两个参数加速,提出了一种广义预处理HSS-SOR交替分裂迭代法,并研究了该方法的收敛性.数值结果表明本文所给方法是有效的.     

二阶锥线性互补问题的广义模系矩阵分裂迭代算法

通过将二阶锥线性互补问题转化为等价的不动点方程,介绍了一种广义模系矩阵分裂迭代算法,并研究了该算法的收敛性.进一步,数值结果表明广义模系矩阵分裂迭代算法能够有效地求解二阶锥线性互补问题.     

COMPONENTWISE CONDITION NUMBERS FOR GENERALIZED MATRIX INVERSION AND LINEAR LEAST SQUARES

We present componentwise condition numbers for the problems of Moore-Penrose generalized matrix inversion and linear least squares. Also, the condition numbers for these condition numbers are given.     

A NONMONOTONE TRUST REGION METHOD FOR NONLINEAR LEAST SQUARES PROBLEMS

In this paper we present a nonmonotone trust region method for nonlinear least squares problems with zero-residual and prove its convergence properties. The extensive numerical results are reported which show that the nonmonotone trust region method is generally superior to the usual trust region method.     

一种求解鞍点问题的广义对称超松弛迭代法

本文研究了鞍点问题的迭代算法.利用新的待定参数加速迭代格式并结合SSOR分裂的方法,获得了有两个参数的广义对称超松弛迭代法及其收敛性条件.数值例子表明选择适当的参数值可以提高算法的收敛效率,推广和改进了SOR-like迭代法.     

解线性互补问题的区间GAOR方法

1引言设M∈Rn×n,q∈Rn,则线性互补问题LCP(M,q)指的是寻找一个向量x∈Rn,使其满足下面的条件: x≥0 Mx+q≥0 xt(Mx+q)=0由于线性互补问题在工程物理、管理学、经济学、约束最优化等领域的应用非常广泛,所以该问题的研究一直倍受大家的关注,至今已有很多有效的算法.早在20世纪80年代     

鞍点问题的广义位移分裂预条件子

对于大型稀疏非Hermitian正定线性方程组,Bai等人提出了一种位移分裂预条件子(J.Comput.Math.,24(2006)539-552).本文将这种思想用到鞍点问题上并提出了一种广义位移分裂(Generalized Shift Splitting,GSS)预条件子,同时证明了该预条件子所对应分裂迭代法的无条件收敛性.最后用数值算例验证了新预条件子的有效性.     

求解单调变分不等式问题的一类迭代方法

１．引言 变分不等式问题在数学规划中起着重要作用,它最初作为研究偏微分方程的工具,首先由 Ｆｉｓｈｅｒａ和 Ｓｔａｍｐａｃｃｈｉａ等于六十年代初提出,可参看［１］及其参考文献,之后也被广泛用于研究经济学和运筹学等领域中的均衡模型,互补问题和凸规划问题都是变分不等式问题的特殊情形,文献［２］对有限维变分不等式问题和非线性互补问题的理论、算法及应用作了十分全面的综述．设 Ｃ是实有限维空间 Ｒｎ,的非空闲凸子集, Ｆ是 Ｒｎ → Ｒｎ的映射,本文讨论的变分不等式问题ＶＩ（Ｃ,Ｆ）是： 求向量ｒ＊∈Ｃ．使得：Ｆ（…     

广义鞍点问题的块三角预条件子

本文对Golub和Yuan(2002)中给出的ST分解推广到广义鞍点问题上,给出了三种块预条件子,并重点分析了其中两种预条件子应用到广义鞍点问题上所得到的对称正定阵,得出了其一般的性质并重点研究了预处理矩阵条件数的上界,最后给出了数值算例.     

求解单调变分不等式问题的一个连续型迭代方法

本文给出一个求解单调变分不等式问题的连续型迭代方法,对任意单调趋于零的正数序列和任意初始点,方法产生的迭代点列均收敛到所求变分不等式问题的一个解,且在适当条件下方法具有Q-超线性收敛率.数值试验结果进一步表明了所给方法的稳定性和有效性.     

Preconditioned sor methods for generalized least-squares problems

1.IntroductionThegeneralizedleastsquaresproblem,definedasmin(Ax--b)"W--'(Ax--b),(1.1)xacwhereAERm",m>n,bERm,andWERm'misasymmetricandpositivedefinitematrix,isfrequentlyfoundwhensolvingproblemsinstatistics,engineeringandeconomics.Forexample,wegetgeneralizedleastsquaresproblemswhensolvingnonlinearregressionanalysisbyquasi-likelihoodestimation,imagereconstructionproblemsandeconomicmodelsobtainedbythemaximumlikelihoodmethod(of.[1,21).Paige[3,4]investigatestheproblemexplicitly.Hechangestheorig…     

无约束极大极小问题的广义梯度投影算法

本文讨论Rⁿ空间上的无约束极大极小问题. 通过Rⁿ⁺¹空间上的广义梯度投影技术产生Rⁿ上的下降搜索方向,进而结合Armijo非精确线搜索建立了原问题Rⁿ上的一个广义梯度投影型算法.算法在仿射线性无关条件下,具有全局收敛性和强收敛性. 文中对算法进行了初步的数值试验.     

广义鞍点问题基于PSS的约束预条件子

对于(1,1)块为非Hermitian阵的广义鞍点问题,本文给出了一种基于正定和反对称分裂(Positive definite andskew-Hermitian splitting, PSS)的约束预条件子.该预条件子的(1,1)块由求解非Hermitian正定线性方程组时的PSS迭代法所构造得到.文中分析了PSS约束预条件子的一些性质并证明了预处理迭代法的收敛性.最后用数值算例验证了该预条件子的有效性.