TLS和LS问题的比较

There are a number of articles discussing the total least squares(TLS) and the least squares(LS) problems.M.Wei(M.Wei, Mathematica Numerica Sinica 20(3)(1998),267-278) proposed a new orthogonal projection method to improve existing perturbation bounds of the TLS and LS problems.In this paper,wecontinue to improve existing bounds of differences between the squared residuals,the weighted squared residuals and the minimum norm correction matrices of the TLS and LS problems.     

关于TLS和LS解的扰动分析

1．引言本文采用卜］的记号．最小二乘（LS）和总体最小二乘（TLS）是科学计算中的两种重要方法．尤是TLS，近来已有多篇论文讨论［1－6，8－16］．奇异值分解（SVD）和CS分解是研究TLS和LS的重要工具．令ACm，BCm,C=(A,B)，A和C的SVD分别为（1．1）（1．2）其中P51为某个正整数，U，U，V，V均为西矩阵，UI，UI，VI，VI为上述矩阵的前P列，z1一山。g（。1，…，内），】2＝di。g（内十l，…，。小】1＝dl。g（61；…，站，】2二diag（4＋1；…，dk），。l三··2。120和dl三…三d。20分别为C和A的奇异值，Z＝mhfm．n十以…     

加权总体最小二乘问题的解集和性质

本文讨论了加权总体最小二乘问题的等价解集，分析了加权总体最小二乘解与加权最小二乘问题的解之间的关系。推广了Ｇｏｌｕｂ和Ｖａｎ Ｌｏａｎ，Ｖａｎ Ｈｕｆｆｅｌ和Ｖａｎｄｅｗａｌｌｅ，及Ｗｅｉ的相应结果。     

加权总体最小二乘问题的分析

总体最小二乘问题由Golub和Van Loan首先进行数学的分析,随后人们对于总体最小二乘问题的算法、解的各种形式、总体最小二乘解和最小二乘解的关系、总体最小二乘解的扰动理论以及数值试验作了大量的研究工作。近来,[10]中给出了总体最小二乘问题(TLS)较一般地讨论。另一方面,Golub和Van Loan研究了总体最小二乘问题的特殊均加权形式。本文试图在[10,11]的基础上讨论最一般的总体最小二     

加权广义逆、加权最小二乘和约束最小二乘问题

本文采用如下记号:记C~m×n是具有复数域的m×n长方矩阵的集合,C~m=C~m×1是m维向量的集合.对A∈C~m×n称A~H∈C~m×n是A的共轭转置矩阵,rank(A)表示A的秩,R(A)和N(A)分别为A的值域和零空间,||·||=||·||2和||·||F分别为2-范数和Frobenius范数;I表示恒等矩阵.人们在研究数学规划、数值分析、数据处理,散射理论和电磁学等领域中都将问题归纳为如下的最小二乘问题:     

关于TLS问题

1.引 言考虑观测线性系统AX=B,（1.1a）其中A∈Cm×n,B∈Cm×d（本文通篇假设m≥n d）,分别是精确但不可观测的A0∈Cm×n,B0∈Cm×d的近似,即精确线性系统是A0X=B0.（1.1b）Golub和Van Loan于1980年提出的总体最小二乘问题（以下简称TLS问题）就是求解线性系统AX=B（1.2）     

关于TLS的可解性及扰动分析

尽管有关总体最小二乘问题的研究工作是大量的，然而ＴＬＳ可解的充分必要条件一直没有得到。本文首先给出完整的可解性分析，然后建立了ＴＬＳ的扰动上界。     

加权均值T-统计量推广

本文将[1]提出的一维异方差正态总体均值的加权T-统计量估计推广到多维异方差正态总体均值的估计,并应用于其假设检验。     

精化的二次残量迭代法

According to the refined projection principle advocated by Jia[8], we improve the residual iteration method of quadratic eigenvalue problems and propose a refined residual iteration method. We study the restarting issue of the method and develop a practical algorithm. Preliminary numerical examples illustrate the efficiency of the method.     

ON STABLE PERTURBATIONS OF THE STIFFLY WEIGHTED PSEUDOINVERSE AND WEIGHTED LEAST SQUARES PROBLEM

In this paper we study perturbations of the stiffly weighted pseudoinverse （W^1/2 A）^＋W^1/2 and the related stiffly weighted least squares problem, where both the matrices A and W are given with W positive diagonal and severely stiff. We show that the perturbations to the stiffly weighted pseudoinverse and the related stiffly weighted least squares problem are stable, if and only if the perturbed matrices A = A ＋ δA satisfy several row rank preserving conditions.     

ON THE ACCURACY OF THE LEAST SQUARES AND THE TOTAL LEAST SQUARES METHODS

Consider solving an overdetermined system of linear algebraic equations by both the least squares method (LS) and the total least squares method (TLS). Extensive published computational evidence shows that when the original system is consistent. one often obtains more accurate solutions by using the TLS method rather than the LS method. These numerical observations contrast with existing analytic perturbation theories for the LS and TLS methods which show that the upper bounds for the LS solution are always smaller than the corresponding upper bounds for the TLS solutions. In this paper we derive a new upper bound for the TLS solution and indicate when the TLS method can be more accurate than the LS method.Many applied problems in signal processing lead to overdetermined systems of linear equations where the matrix and right hand side are determined by the experimental observations (usually in the form of a lime series). It often happens that as the number of columns of the matrix becomes larger, the ra     

THE SOLUBILITY OF THE MULTIDIMENSIONAL TLS PROBLEM

A necessary and sufficient condition of the solubility far the multidimensional TLS problem is presented.     

等式约束加权线性最小二乘问题的解法

1 引言 在实际应用中常会提出解等式约束加权线性最小二乘问题 min||b-Ax||_M,(1.1) x∈C~n s.t.Bx=d, 其中B∈C~(p×n),A∈C~(q×n),d∈C~p,b∈C~q,M∈C~(q×q)为Hermite正定阵. 对于问题(1.1),目前已有多种解法,见文[1—3).本文将利用广义逆矩阵的知识,给出(1.1)的通解及迭代解法.本文中关于矩阵广义逆与投影算子(矩阵)的记号基本上与文[4]的相同.例如,A~+表示A的MP逆,P_L表示到子空间L上的正交投影算子,λ_(max)(MAY)表示矩阵M~(1/2)AY的最大特征值.我们还要用到广义BD逆的概念: 设A∈C~(n×n),L为C~n的子空间,则称A_(L)~(+)=P_L(AP_L+P_L⊥)~+为A关于L的广义BD逆.     

A NUMERICALLY STABLE BLOCK MODIFIED GRAM-SCHMIDT ALGORITHM FOR SOLVING STIFF WEIGHTED LEAST SQUARES PROBLEMS

Recently, Wei in proved that perturbed stiff weighted pseudoinverses and stiff weighted least squares problems are stable, if and only if the original and perturbed coefficient matrices A and A^- satisfy several row rank preservation conditions. According to these conditions, in this paper we show that in general, ordinary modified Gram-Schmidt with column pivoting is not numerically stable for solving the stiff weighted least squares problem. We then propose a row block modified Gram-Schmidt algorithm with column pivoting, and show that with appropriately chosen tolerance, this algorithm can correctly determine the numerical ranks of these row partitioned sub-matrices, and the computed QR factor R^- contains small roundoff error which is row stable. Several numerical experiments are also provided to compare the results of the ordinary Modified Gram-Schmidt algorithm with column pivoting and the row block Modified Gram-Schmidt algorithm with column pivoting.     

COMPARISON OF TWO MODELS AND TWO ESTIMATION METHODS FOR CATCH AND EFFORT DATA

We consider the problem of estimating the optimal steady effort level from a time series of catch and effort data, taking account of errors in the observation of the “effective effort” as well as randomness in the stock-production function. The “total least squares” method ignores the time series nature of the data, while the “approximate likelihood” method takes it into account. We compare estimation schemes based upon these two methods by applying them to artificial data for which the “correct” parameters are known. We use a similar procedure to compare the effectiveness of a “power model” for stock and production with the “Ricker model.” We apply these estimation methods to some sets of real data, and obtain an interval estimate of the optimal effort.     

加权有理三次插值的逼近性质及其应用

利用带导数和不带导数的分母为线性的有理三次插值样条构造了一类加权有理三次插值函数,利用这种插值方法,将样条曲线严格约束于给定的折线之上、之下或之间的问题都可以得到解决同时还研究了这种加权有理三次插值的逼近性质。