Estimation of the precision matrix of a singular Wishart distribution and its application in high-dimensional data

In this article, the Stein-Haff identity is established for a singular Wishart distribution with a positive definite mean matrix but with the dimension larger than the degrees of freedom. This identity is then used to obtain estimators of the precision matrix improving on the estimator based on the Moore-Penrose inverse of the Wishart matrix under the Efron-Morris loss function and its variants. Ridge-type empirical Bayes estimators of the precision matrix are also given and their dominance properties over the usual one are shown using this identity. Finally, these precision estimators are used in a quadratic discriminant rule, and it is shown through simulation that discriminant methods based on the ridge-type empirical Bayes estimators provide higher correct classification rates.     

具有特殊协方差结构的 SURE 模型中参数估计的若干结果

本文讨论具有特殊协方差结构似乎不相关回归方程（SURE）模型中参数的估计问题．除非另有说明,损失函数将取为二次损失和矩阵损失．本文证明了回归系数的线性可估函数的最小二乘估计是极小极大的且在矩阵损失函数下是可容许的;还分别在仿射交换群和平移群下导出了存在回归系数的线性可估函数的一致最小风险同变（UMRE）估计的充要条件,并证明了在仿射交换和二次损失下不存在协方差阵和方差的UMRE估计．     

A subclass of bayes linear estimators that are minimax

In the linear regression model with ellipsoidal parameter constraints, the problem of estimating the unknown parameter vector is studied. A well-described subclass of Bayes linear estimators is proposed in the paper. It is shown that for each member of this subclass, a generalized quadratic risk function exists so that the estimator is minimax. Moreover, some of the proposed Bayes linear estimators are admissible with respect to all possible generalized quadratic risks. Also, a necessary and sufficient condition is given to ensure that the considered Bayes linear estimator improves the least squares estimator over the whole ellipsoid whatever generalized risk function is chosen.     

Methods for improvement in estimation of a normal mean matrix

This paper is concerned with the problem of estimating a matrix of means in multivariate normal distributions with an unknown covariance matrix under invariant quadratic loss. It is first shown that the modified Efron-Morris estimator is characterized as a certain empirical Bayes estimator. This estimator modifies the crude Efron-Morris estimator by adding a scalar shrinkage term. It is next shown that the idea of this modification provides a general method for improvement of estimators, which results in the further improvement on several minimax estimators. As a new method for improvement, an adaptive combination of the modified Stein and the James-Stein estimators is also proposed and is shown to be minimax. Through Monte Carlo studies of the risk behaviors, it is numerically shown that the proposed, combined estimator inherits the nice risk properties of both individual estimators and thus it has a very favorable risk behavior in a small sample case. Finally, the application to a two-way layout MANOVA model with interactions is discussed.     

Shrinkage priors for Bayesian estimation of the mean matrix in an elliptically contoured distribution

This paper deals with the problem of estimating the mean matrix in an elliptically contoured distribution with unknown scale matrix. The Laplace and inverse Laplace transforms of the density allow us not only to evaluate the risk function with respect to a quadratic loss but also to simplify expressions of Bayes estimators. Consequently, it is shown that generalized Bayes estimators against shrinkage priors dominate the unbiased estimator.     

矩阵损失函数下回归系数矩阵的非齐次线性估计的可容许性

在二次矩阵损失函数下研究了协方差矩阵未知的多元线性模型中回归系数矩阵的可估线性函数的矩阵非齐次线性估计的可容许性,给出了矩阵非齐次线性估计在线性估计类中可容许的一个充要条件.     

Statistical inference in a panel data semiparametric regression model with serially correlated errors

We consider a panel data semiparametric partially linear regression model with an unknown vector β of regression coefficients, an unknown nonparametric function g(·) for nonlinear component, and unobservable serially correlated errors. The correlated errors are modeled by a vector autoregressive process which involves a constant intraclass correlation. Applying the pilot estimators of β and g(·), we construct estimators of the autoregressive coefficients, the intraclass correlation and the error variance, and investigate their asymptotic properties. Fitting the error structure results in a new semiparametric two-step estimator of β, which is shown to be asymptotically more efficient than the usual semiparametric least squares estimator in terms of asymptotic covariance matrix. Asymptotic normality of this new estimator is established, and a consistent estimator of its asymptotic covariance matrix is presented. Furthermore, a corresponding estimator of g(·) is also provided. These results can be used to make asymptotically efficient statistical inference. Some simulation studies are conducted to illustrate the finite sample performances of these proposed estimators.     

Estimation of the entropy of a multivariate normal distribution

Motivated by problems in molecular biosciences wherein the evaluation of entropy of a molecular system is important for understanding its thermodynamic properties, we consider the efficient estimation of entropy of a multivariate normal distribution having unknown mean vector and covariance matrix. Based on a random sample, we discuss the problem of estimating the entropy under the quadratic loss function. The best affine equivariant estimator is obtained and, interestingly, it also turns out to be an unbiased estimator and a generalized Bayes estimator. It is established that the best affine equivariant estimator is admissible in the class of estimators that depend on the determinant of the sample covariance matrix alone. The risk improvements of the best affine equivariant estimator over the maximum likelihood estimator (an estimator commonly used in molecular sciences) are obtained numerically and are found to be substantial in higher dimensions, which is commonly the case for atomic coordinates in macromolecules such as proteins. We further establish that even the best affine equivariant estimator is inadmissible and obtain Stein-type and Brewster–Zidek-type estimators dominating it. The Brewster–Zidek-type estimator is shown to be generalized Bayes.     

Improved estimation of a covariance matrix in an elliptically contoured matrix distribution

In this paper, the problem of estimating the covariance matrix of the elliptically contoured distribution (ECD) is considered. A new class of estimators which shrink the eigenvalues towards their arithmetic mean is proposed. It is shown that this new estimator dominates the unbiased estimator under the squared error loss function. Two special classes of ECD, namely, the multivariate-elliptical t distribution and the ε-contaminated normal distribution are considered. A simulation study is carried out and indicates that this new shrinkage estimator provides a substantial improvement in risk under most situations.     

Risk and Pitman closeness properties of feasible generalized double k-class estimators in linear regression models with non-spherical disturbances under balanced loss function

In this article, a family of feasible generalized double k-class estimator in a linear regression model with non-spherical disturbances is considered. The performance of this estimator is judged with feasible generalized least-squares and feasible generalized Stein-rule estimators under balanced loss function using the criteria of quadratic risk and general Pitman closeness. A Monte-Carlo study investigates the finite sample properties of several estimators arising from the family of feasible double k-class estimators.     

Estimating the covariance matrix: a new approach

In this paper, we consider the problem of estimating the covariance matrix and the generalized variance when the observations follow a nonsingular multivariate normal distribution with unknown mean. A new method is presented to obtain a truncated estimator that utilizes the information available in the sample mean matrix and dominates the James-Stein minimax estimator. Several scale equivariant minimax estimators are also given. This method is then applied to obtain new truncated and improved estimators of the generalized variance; it also provides a new proof to the results of Shorrock and Zidek (Ann. Statist. 4 (1976) 629) and Sinha (J. Multivariate Anal. 6 (1976) 617).     

Estimation of multivariate normal covariance and precision matrices in a star-shape model with missing data

In this paper, we study the problem of estimating the covariance matrix Σ and the precision matrix Ω (the inverse of the covariance matrix) in a star-shape model with missing data. By considering a type of Cholesky decomposition of the precision matrix Ω=Ψ^′Ψ, where Ψ is a lower triangular matrix with positive diagonal elements, we get the MLEs of the covariance matrix and precision matrix and prove that both of them are biased. Based on the MLEs, unbiased estimators of the covariance matrix and precision matrix are obtained. A special group G, which is a subgroup of the group consisting all lower triangular matrices, is introduced. By choosing the left invariant Haar measure on G as a prior, we obtain the closed forms of the best equivariant estimates of Ω under any of the Stein loss, the entropy loss, and the symmetric loss. Consequently, the MLE of the precision matrix (covariance matrix) is inadmissible under any of the above three loss functions. Some simulation results are given for illustration.     

IMPROVED ESTIMATES OF THE COVARIANCE MATRIX IN GENERAL LINEAR MIXED MODELS

In this article, the problem of estimating the covariance matrix in general linear mixed models is considered. Two new classes of estimators obtained by shrinking the eigenvalues towards the origin and the arithmetic mean, respectively, are proposed. It is shown that these new estimators dominate the unbiased estimator under the squared error loss function. Finally, some simulation results to compare the performance of the proposed estimators with that of the unbiased estimator are reported. The simulation results indicate that these new shrinkage estimators provide a substantial improvement in risk under most situations.     

平衡损失下一般Gauss-Markov模型中回归系数的最优估计（英文）

在平衡损失下,我们研究了一般Gauss-Markov模型中回归系数的最优估计,首先我们得到了线性估计为最佳线性无偏估计的充分必要条件;其次证明了平衡损失下的最佳线性无偏估计在几乎处处意义下是唯一的,并且是普通最小二乘估计和二次损失下最优估计的平衡;最后,我们讨论了最优估计关于损失函数和模型设定的稳健性,并得到了该最优估计在模型误定下具有稳健性的充分必要条件.     

James-Stein estimators for time series regression models

The least squares (LS) estimator seems the natural estimator of the coefficients of a Gaussian linear regression model. However, if the dimension of the vector of coefficients is greater than 2 and the residuals are independent and identically distributed, this conventional estimator is not admissible. James and Stein [Estimation with quadratic loss, Proceedings of the Fourth Berkely Symposium vol. 1, 1961, pp. 361-379] proposed a shrinkage estimator (James-Stein estimator) which improves the least squares estimator with respect to the mean squares error loss function. In this paper, we investigate the mean squares error of the James-Stein (JS) estimator for the regression coefficients when the residuals are generated from a Gaussian stationary process. Then, sufficient conditions for the JS to improve the LS are given. It is important to know the influence of the dependence on the JS. Also numerical studies illuminate some interesting features of the improvement. The results have potential applications to economics, engineering, and natural sciences.     

The Minimax Estimator of Stochastic Regression Coefficients and Parameters in the Class of All Estimators

In this paper, the authors address the problem of the minimax estimator of linear combinations of stochastic regression coefficients and parameters in the general normal linear model with random effects. Under a quadratic loss function, the minimax property of linear estimators is investigated. In the class of all estimators, the minimax estimator of estimable functions, which is unique with probability 1, is obtained under a multivariate normal distribution.     

正态线性模型中随机回归系数和参数的Minimax估计

该文在一般正态随机效应线性模型中研究了随机回归系数和参数的估计问题. 在二次损失下，得到了线性可估函数在一切估计类中的唯一Minimax估计.     

A note on improving quadratic inference functions using a linear shrinkage approach

In some commonly used longitudinal clinical trials designs, the quadratic inference functions (QIF) method fails to work due to non-invertible estimation of the optimal weighting matrix. We propose a modified QIF method, in which the optimal weighting matrix is estimated by a linear shrinkage estimator, replacing the sample covariance matrix. We prove that the linear shrinkage estimator is consistent and asymptotically optimal under the expected quadratic loss, and will have more stable numerical performance than the sample covariance matrix. Simulations show that numerical improvements are acquired in light of a higher percentage of convergence, and smaller standard errors and mean square errors of parameter estimates.     

Confidence ellipsoids based on a general family of shrinkage estimators for a linear model with non-spherical disturbances

This paper considers a general family of Stein rule estimators for the coefficient vector of a linear regression model with nonspherical disturbances, and derives estimators for the Mean Squared Error (MSE) matrix, and risk under quadratic loss for this family of estimators. The confidence ellipsoids for the coefficient vector based on this family of estimators are proposed, and the performance of the confidence ellipsoids under the criterion of coverage probability and expected volumes is investigated. The results of a numerical simulation are presented to illustrate the theoretical findings, which could be applicable in the area of economic growth modeling.     

Admissibility of linear estimators with respect to inequality constraints under matrix loss function

In this paper we investigate the admissibility of linear estimators in the multivariate linear model with respect to inequality constraints under matrix loss function. The necessary and sufficient conditions for a linear estimator to be admissible in the class of homogeneous linear estimators and the class of inhomogeneous linear estimators are obtained, respectively.