线性混合模型协方差阵的谱分解的一种新方法及其应用

对平衡线性混合模型, 随机效应的设计阵具有一定结构.定义了一种新的矩阵序, 借助于这种新序, 提出了协方差阵谱分解的一种新方法.与现有的两种方法相比较, 新方法的突出的特点是能够给出协方差阵不同特征值的精确个数, 以及谱分解中不同特征值对应的投影阵与随机效应的设计阵之间的关系. 基于新的谱分解结果,(1) 证明了平衡随机模型的方差分析估计为最小方差无偏估计; (2) 证明了在一定条件下, 一般平衡线性混合模型的方差分析估计也具有最小方差无偏性; (3) 给出了一般混合模型的极大似然方程显示解存在的一个较易验证的判定定理, 并给出了显示解存在时解的一般形式; (4) 清晰地显示了谱分解估计的构造原理, 并找到了谱分解估计与方差分析估计相等的充要条件.     

一般线性混合模型中的最佳线性无偏估计和谱分解估计

该文在一般线性混合模型中, 研究了固定和随机效应线性组合的估计问题.对观测向量的协方差阵可以为奇异矩阵情形下,导出了该组合的最佳线性无偏估计,并证明了它的唯一性.在一般线性混合模型的特例, 三个小域模型下, 得到了小域均值u_i 和方差分量的谱分解估计. 进而, 获得了基于谱分解估计的两步估计均方误差的二阶逼近.     

混合效应模型下ANOVA估计和SD估计相等的充分条件

混合效应模型是统计模型中非常重要的一类模型,广泛地应用到许多领域.本文比较了该模型下方差分量的两种估计:方差分析(ANOVA)估计和谱分解(SD)估计,借助吴密霞和王松桂[A new method of spectral decomposition of covariance matrix in mixed effects models and its applications,Sci.China,Ser.A,2005,48:1451-1464]协方差矩阵的谱分解结果,给出了ANOVA估计和SD估计相等的两个充分条件及其相应的统计性质,并将以上的结果应用于圆形部件数据模型和混合方差分析模型.     

含有两个方差分量的多元混合效应模型方差分量矩阵的估计

考虑含有两个方差分量矩阵的多元混合模型,将一元混合模型下的谱分解估计推广到多元模型下.给出的方差分量矩阵的谱分解估计在均方误差意义下一致的优于ANOVA估计,最后还讨论了谱分解估计与ANOVA估计等价的条件.     

随机变量二次型的协方差在混合效应模型中的应用

本文提出方差分量ANOVA估计的一种改进方法, 证明了对于一般的方差分量模型, 只要方差分量的ANOVA估计存在就可以通过此方法给出其改进形式, 并且在均方误差意义下优于ANOVA估计. 特别地, 对于单向分类随机效应模型, Kelly和Mathew^[1]对ANOVA估计的改进就是我们提出的改进方法的特殊形式, 这也给出了此类改进估计在均方误差意义下优于ANOVA估计的另一种合理的解释. 同时, 本文又将此思想应用到对谱分解估计的改进上. 本文应用协方差的简单性质证明了对带有一个随机效应的方差分量模型, 当随机效应的协方差阵只有一个非零特征值时, 随机效应方差分量谱分解估计在均方误差意义下总是优于ANOVA估计. 本文最后将第三节的结论推广到广义谱分解估计下, 同时给出广义谱分解估计待定系数的一个合理的取值.     

方差分量的广义谱分解估计

对于随机效应部分为一般平衡多向分类的线性混合模型,将王松桂(2002)提出的一种称之为谱分解估计的参数估计新方法推广到随机效应设计阵为任意矩阵的含两个方差分量的线性混合模型,给出了方差分量的广义谱分解估计方法,并证明了所得估计的一些统计性质。另外,还就广义谱分解估计类中某些特殊估计和对应的方差分析估计进行了比较,得到了它们相等的充分必要条件。     

多元线性混合模型方差分量矩阵的非负估计

本文研究了带有两个方差分量矩阵的多元线性混合模型方差分量矩阵的估计问题.对于平衡模型,给出了基于谱分解估计的一个方差分量矩阵的非负估计类.对于非平衡模型,给出了方差分量矩阵的广义谱分解估计类,讨论了与ANOVA估计等价的充要条件.同时,在广义谱分解估计的基础上给出了一种非负估计类,并讨论了其优良性.当具有较小二次风险的非负估计不存在时,从估计为非负的概率的角度考虑,将Kelly和Mathew(1993)提出的构造具有更小取负值概率的估计类的方法推广到本文的多元模型下,给出了较谱分解估计相比有更小取负值概率和更小风险的估计类.最后,模拟研究和实例分析表明文中理论结果有很好的表现.     

一类线性混合模型的谱分解估计

谱分解估计(SDE)是新近提出的关于线性混合模型参数的一种新的估计方法,此方法的一个突出特点是同时给出固定效应参数和方差分量的显式解估计．本文就含两个方差分量的线性混合模型,对谱分解估计的性质做了进一步的研究,获得了方差分量的SDE和方差分析估计相等的充分必要条件,证明了在一定的条件下方差分量的SDE为一致最小方差无偏估计．     

方差分量谱分解估计的几个性质

对于线性混合模型中方差分量的估计，虽有多种方法，但一般情况下只有方差分析估计和谱分解估计有显式解，本文就线性混合模型中含两个方差分量的情形，对方差分析估计和谱分解估计进行了比较，证明了在一些条件下两个估计的方差相等，由此推出谱分解估计也具有方差分析估计的某些优良性．文末用实例进一步说明了文中的结果．     

����������������������ŷ���ģ�͵��Ʋ�ǰ���ӯ��ֲ�

本文综述混合效应模型参数估计方面的若干新进展. 平衡混合效应方差分析模型的协方差阵具有一定结构. 对这类模型, 文献[1]提出了参数估计的一种新方法, 称为谱分解法. 新方法的突出特点是, 能同时给出固定效应和方差分量的估计, 前者是线性的, 后者是二次的,且相互独立. 而后, 文献[2--9]证明了谱分解估计的进一步的统计性质, 同时给出了协方差阵对应的估计, 它不仅是正定阵, 而且可获得它的风险函数, 这些文献还研究了谱分解估计与方差分析估计, 极大似然估计, 限制极大似然估计以及最小范数二次无偏估计的关系. 本文综述这一方向的部分研究成果, 并提出一些待进一步研究的问题.     

Trimmed minimax estimator of a covariance matrix

Summary In the problem of estimating the covariance matrix of a multivariate normal population, James and Stein (Proc. Fourth Berkeley Symp. Math. Statist. Prob.,1, 361–380, Univ. of California Press) obtained a minimax estimator under a scale invariant loss. In this paper we propose an orthogonally invariant trimmed estimator by solving certain differential inequality involving the eigenvalues of the sample covariance matrix. The estimator obtained, truncates the extreme eigenvalues first and then shrinks the larger and expands the smaller sample eigenvalues. Adaptive version of the trimmed estimator is also discussed. Finally some numerical studies are performed using Monte Carlo simulation method and it is observed that the trimmed estimate shows a substantial improvement over the minimax estimator. The second author's research was supported by NSF Grant Number MCS 82-12968.     

Estimation of a Multivariate Normal Covariance Matrix with Staircase Pattern Data

In this paper, we study the problem of estimating a multivariate normal covariance matrix with staircase pattern data. Two kinds of parameterizations in terms of the covariance matrix are used. One is Cholesky decomposition and another is Bartlett decomposition. Based on Cholesky decomposition of the covariance matrix, the closed form of the maximum likelihood estimator (MLE) of the covariance matrix is given. Using Bayesian method, we prove that the best equivariant estimator of the covariance matrix with respect to the special group related to Cholesky decomposition uniquely exists under the Stein loss. Consequently, the MLE of the covariance matrix is inadmissible under the Stein loss. Our method can also be applied to other invariant loss functions like the entropy loss and the symmetric loss. In addition, based on Bartlett decomposition of the covariance matrix, the Jeffreys prior and the reference prior of the covariance matrix with staircase pattern data are also obtained. Our reference prior is different from Berger and Yang’s reference prior. Interestingly, the Jeffreys prior with staircase pattern data is the same as that with complete data. The posterior properties are also investigated. Some simulation results are given for illustration.     

A Generalization of Rao's Covariance Structure with Applications to Several Linear Models

This paper presents a generalization of Rao's covariance structure. In a general linear regression model, we classify the error covariance structure into several categories and investigate the efficiency of the ordinary least squares estimator (OLSE) relative to the Gauss–Markov estimator (GME). The classification criterion considered here is the rank of the covariance matrix of the difference between the OLSE and the GME. Hence our classification includes Rao's covariance structure. The results are applied to models with special structures: a general multivariate analysis of variance model, a seemingly unrelated regression model, and a serial correlation model.     

Estimation of the entropy of a multivariate normal distribution

Motivated by problems in molecular biosciences wherein the evaluation of entropy of a molecular system is important for understanding its thermodynamic properties, we consider the efficient estimation of entropy of a multivariate normal distribution having unknown mean vector and covariance matrix. Based on a random sample, we discuss the problem of estimating the entropy under the quadratic loss function. The best affine equivariant estimator is obtained and, interestingly, it also turns out to be an unbiased estimator and a generalized Bayes estimator. It is established that the best affine equivariant estimator is admissible in the class of estimators that depend on the determinant of the sample covariance matrix alone. The risk improvements of the best affine equivariant estimator over the maximum likelihood estimator (an estimator commonly used in molecular sciences) are obtained numerically and are found to be substantial in higher dimensions, which is commonly the case for atomic coordinates in macromolecules such as proteins. We further establish that even the best affine equivariant estimator is inadmissible and obtain Stein-type and Brewster–Zidek-type estimators dominating it. The Brewster–Zidek-type estimator is shown to be generalized Bayes.     

The Kullback-Leibler risk of the Stein estimator and the conditional MLE

The decomposition of the Kullback-Leibler risk of the maximum likelihood estimator (MLE) is discussed in relation to the Stein estimator and the conditional MLE. A notable correspondence between the decomposition in terms of the Stein estimator and that in terms of the conditional MLE is observed. This decomposition reflects that of the expected log-likelihood ratio. Accordingly, it is concluded that these modified estimators reduce the risk by reducing the expected log-likelihood ratio. The empirical Bayes method is discussed from this point of view.     

The superiorities of bayes linear unbiased estimator in multivariate linear models

In this article,the Bayes linear unbiased estimator (BALUE) of parameters is derived for the multivariate linear models.The superiorities of the BALUE over the least square estimator (LSE) is studied in terms of the mean square error matrix (MSEM) criterion and Bayesian Pitman closeness (PC) criterion.     

A well-conditioned estimator for large-dimensional covariance matrices

Many applied problems require a covariance matrix estimator that is not only invertible, but also well-conditioned (that is, inverting it does not amplify estimation error). For large-dimensional covariance matrices, the usual estimator—the sample covariance matrix—is typically not well-conditioned and may not even be invertible. This paper introduces an estimator that is both well-conditioned and more accurate than the sample covariance matrix asymptotically. This estimator is distribution-free and has a simple explicit formula that is easy to compute and interpret. It is the asymptotically optimal convex linear combination of the sample covariance matrix with the identity matrix. Optimality is meant with respect to a quadratic loss function, asymptotically as the number of observations and the number of variables go to infinity together. Extensive Monte Carlo confirm that the asymptotic results tend to hold well in finite sample.     

增长曲线模型中UMRE估计的存在性

对于设计矩阵不满秩，协方差阵任意或具有均匀结构或序列结构的正态增长曲线模型，本文讨论参数矩阵的一致最小风险同变（UMng）估计的存在性．在仿射变换群GI和转移交换群、二次损失和矩阵损失下本文分别获得存在回归系数矩阵的线性可估函数矩阵的UMRE估计的充要条件，推广了由[21]给出的在设计矩阵满秩下估计回归系数矩阵的结果．本文还首次证明了在群G1和二次损失下不存在协方差阵V和trV的UMRE估计．     

Asymptotic distribution of the weighted least squares estimator

This paper derives the asymptotic distribution of the weighted least squares estimator (WLSE) in a heteroscedastic linear regression model. A consistent estimator of the asymptotic covariance matrix of the WLSE is also obtained. The results are obtained under weak conditions on the design matrix and some moment conditions on the error distributions. It is shown that most of the error distributions encountered in practice satisfy these moment conditions. Some examples of the asymptotic covariance matrices are also given.