A robustness study in sampling on successive occasions

Summary In this paper, we have undertaken an investigation covering three occasions in sampling on successive occasions with a view to examining efficiency robustness of the best linear unbiased estimator (BLUE) visa-vis certain other potentially conceivable estimators when the usual correlation model breaks down. We have inferred that the BLUE, is by and large, an efficiency robust estimate in the face of unforeseen deviations from the usual correlation model.     

错误先验假定下Bayes线性无偏估计的稳健性

本文基于错误的先验假定获得了一般线性模型下可估函数的Bayes线性无偏估计(BLUE), 证明了在均方误差矩阵(MSEM)准则和后验Pitman Closeness (PPC)准则下BLUE相对于最小二乘估计(LSE)的优良性, 并导出了它们的相对效率的界, 从而获得BLUE的稳健性.     

一般半相依回归系统的协方差改进估计

本文讨论了由两个等阶的回归方程组成的半相依系统,运用协方差改进法获得了参数的一个迭代估计序列,并证明了它的协方差阵已知时,处处收敛到最佳线性无偏估计,同时其协方差阵在矩阵偏序意义下单调性,并且给出了当迭代次数亦趋于无穷时,保证其具有相合性的一个条件。     

平衡损失下一般Gauss-Markov模型中回归系数的最优估计（英文）

在平衡损失下,我们研究了一般Gauss-Markov模型中回归系数的最优估计,首先我们得到了线性估计为最佳线性无偏估计的充分必要条件;其次证明了平衡损失下的最佳线性无偏估计在几乎处处意义下是唯一的,并且是普通最小二乘估计和二次损失下最优估计的平衡;最后,我们讨论了最优估计关于损失函数和模型设定的稳健性,并得到了该最优估计在模型误定下具有稳健性的充分必要条件.     

A decomposition of a linear model

In this paper we consider a general linear model in a continuous time. We propose a decomposition of the process which helps us to understand the structure of the model. Moreover, the sufficiency of the BLUE estimator of the expectation of the process can be characterized in terms of the Gaussian character of a component of the decomposition.     

Time series regression models with locally stationary disturbance

Time series linear regression models with stationary residuals are a well studied topic, and have been widely applied in a number of fields. However, the stationarity assumption on the residuals seems to be restrictive. The analysis of relatively long stretches of time series data that may contain changes in the spectrum is of interest in many areas. Locally stationary processes have time-varying spectral densities, the structure of which smoothly changes in time. Therefore, we extend the model to the case of locally stationary residuals. The best linear unbiased estimator (BLUE) of vector of regression coefficients involves the residual covariance matrix which is usually unknown. Hence, we often use the least squares estimator (LSE), which is always feasible, but in general is not efficient. We evaluate the asymptotic covariance matrices of the BLUE and the LSE. We also study the efficiency of the LSE relative to the BLUE. Numerical examples illustrate the situation under locally stationary disturbances.     

Estimation of an unobservable parameters in the type II constraints in singular linear regression model

In regular linear regression model with the type II constraints the unobservable parameters in the constraints can be estimated by the BLUE of the observable parameters. The BLUE respects the constraints. If the estimator of the observable parameters which is the BLUE in the model without constraints is used, then the estimator of the unobservable parameters is the same.     

Nonparametric regression estimation with general parametric error covariance

The asymptotic distribution for the local linear estimator in nonparametric regression models is established under a general parametric error covariance with dependent and heterogeneously distributed regressors. A two-step estimation procedure that incorporates the parametric information in the error covariance matrix is proposed. Sufficient conditions for its asymptotic normality are given and its efficiency relative to the local linear estimator is established. We give examples of how our results are useful in some recently studied regression models. A Monte Carlo study confirms the asymptotic theory predictions and compares our estimator with some recently proposed alternative estimation procedures.     

一般线性混合模型中的最佳线性无偏估计和谱分解估计

该文在一般线性混合模型中, 研究了固定和随机效应线性组合的估计问题.对观测向量的协方差阵可以为奇异矩阵情形下,导出了该组合的最佳线性无偏估计,并证明了它的唯一性.在一般线性混合模型的特例, 三个小域模型下, 得到了小域均值u_i 和方差分量的谱分解估计. 进而, 获得了基于谱分解估计的两步估计均方误差的二阶逼近.     

Some properties of projectors associated with the WLSE under a general linear model

Projectors associated with a particular estimator in a general linear model play an important role in characterizing statistical properties of the estimator. A variety of new properties were derived on projectors associated with the weighted least-squares estimator (WLSE). These properties include maximal and minimal possible ranks, rank invariance, uniqueness, idempotency, and other equalities involving the projectors. Applications of these properties were also suggested. Proofs of the main theorems demonstrate how to use the matrix rank method for deriving various equalities involving the projectors under the general linear model.     

Best affine unbiased representations of the fully restricted general Gauss-Markov model

This article completes and simplifies earlier results on the derivation of best linear, or affine, unbiased estimates in the general Gauss-Markov model with a singular dispersion matrix and additional restrictions under very general conditions. We provide the class of all linear representations of the best affine unbiased estimator with precise statements concerning its indeterminacy.     

Shrinkage estimation in the frequency domain of multivariate time series

In this paper on developing shrinkage for spectral analysis of multivariate time series of high dimensionality, we propose a new nonparametric estimator of the spectral matrix with two appealing properties. First, compared to the traditional smoothed periodogram our shrinkage estimator has a smaller L₂ risk. Second, the proposed shrinkage estimator is numerically more stable due to a smaller condition number. We use the concept of “Kolmogorov” asymptotics where simultaneously the sample size and the dimensionality tend to infinity, to show that the smoothed periodogram is not consistent and to derive the asymptotic properties of our regularized estimator. This estimator is shown to have asymptotically minimal risk among all linear combinations of the identity and the averaged periodogram matrix. Compared to existing work on shrinkage in the time domain, our results show that in the frequency domain it is necessary to take the size of the smoothing span as “effective sample size” into account. Furthermore, we perform extensive Monte Carlo studies showing the overwhelming gain in terms of lower L₂ risk of our shrinkage estimator, even in situations of oversmoothing the periodogram by using a large smoothing span.     

On a Multiparameter Version of Tukey's Linear Sensitivity Measure and its Properties

A multiparameter version of Tukey's (1965, Proc. Nat. Acad. Sci. U.S.A., 53, 127–134) linear sensitivity measure, as a measure of informativeness in the joint distribution of a given set of random variables, is proposed. The proposed sensitivity measure, under some conditions, is a matrix which is non-negative definite, weakly additive, monotone and convex. Its relation to Fisher information matrix and the best linear unbiased estimator (BLUE) are investigated. The results are applied to the location-scale model and it is observed that the dispersion matrix of the BLUE of the vector location-scale parameter is the inverse of the sensitivity measure. A similar property was established by Nagaraja (1994, Ann. Inst. Statist. Math., 46, 757–768) for the single parameter case when applied to the location and scale models. Two illustrative examples are included.     

任意秩有限总体中无偏预测和估计的构造关系

研究了有限总体均值向量的无偏估计和线性可预测变量的无偏预测之间的关系,利用分块矩阵广义逆直接对加权风险函数进行分解,提出了一种由均值向量的无偏估计来构造无偏预测的新方法,并找到了它们之间的构造关系.特别地,线性可预测变量的最优线性无偏预测(BLUP)可由均值向量的最佳线性无偏估计(BLUE)惟一地表示(有关惟一性在几乎处处意义下理解).     

Statistical inference in a panel data semiparametric regression model with serially correlated errors

We consider a panel data semiparametric partially linear regression model with an unknown vector β of regression coefficients, an unknown nonparametric function g(·) for nonlinear component, and unobservable serially correlated errors. The correlated errors are modeled by a vector autoregressive process which involves a constant intraclass correlation. Applying the pilot estimators of β and g(·), we construct estimators of the autoregressive coefficients, the intraclass correlation and the error variance, and investigate their asymptotic properties. Fitting the error structure results in a new semiparametric two-step estimator of β, which is shown to be asymptotically more efficient than the usual semiparametric least squares estimator in terms of asymptotic covariance matrix. Asymptotic normality of this new estimator is established, and a consistent estimator of its asymptotic covariance matrix is presented. Furthermore, a corresponding estimator of g(·) is also provided. These results can be used to make asymptotically efficient statistical inference. Some simulation studies are conducted to illustrate the finite sample performances of these proposed estimators.     

Admissibility of linear estimators with respect to inequality constraints under matrix loss function

In this paper we investigate the admissibility of linear estimators in the multivariate linear model with respect to inequality constraints under matrix loss function. The necessary and sufficient conditions for a linear estimator to be admissible in the class of homogeneous linear estimators and the class of inhomogeneous linear estimators are obtained, respectively.     

Linear minimax estimation with ellipsoidal constraints

We consider the simultaneous linear minimax estimation problem in linear models with ellipsoidal constraints imposed on an unknown parameter. Using convex analysis, we derive necessary and sufficient optimality conditions for a matrix to define the linear minimax estimator. For certain regions of the set of characteristics of linear models and constraints, we exploit these optimality conditions and get explicit formulae for linear minimax estimators.     

On improved estimation of normal precision matrix and discriminant coefficients

The problem of estimating the precision matrix of a multivariate normal distribution model is considered with respect to a quadratic loss function. A number of covariance estimators originally intended for a variety of loss functions are adapted so as to obtain alternative estimators of the precision matrix. It is shown that the alternative estimators have analytically smaller risks than the unbiased estimator of the precision matrix. Through numerical studies of risk values, it is shown that the new estimators have substantial reduction in risk. In addition, we consider the problem of the estimation of discriminant coefficients, which arises in linear discriminant analysis when Fisher's linear discriminant function is viewed as the posterior log-odds under the assumption that two classes differ in mean but have a common covariance matrix. The above method is also adapted for this problem in order to obtain improved estimators of the discriminant coefficients under the quadratic loss function. Furthermore, a numerical study is undertaken to compare the properties of a collection of alternatives to the “unbiased” estimator of the discriminant coefficients.     

James-Stein estimators for time series regression models

The least squares (LS) estimator seems the natural estimator of the coefficients of a Gaussian linear regression model. However, if the dimension of the vector of coefficients is greater than 2 and the residuals are independent and identically distributed, this conventional estimator is not admissible. James and Stein [Estimation with quadratic loss, Proceedings of the Fourth Berkely Symposium vol. 1, 1961, pp. 361-379] proposed a shrinkage estimator (James-Stein estimator) which improves the least squares estimator with respect to the mean squares error loss function. In this paper, we investigate the mean squares error of the James-Stein (JS) estimator for the regression coefficients when the residuals are generated from a Gaussian stationary process. Then, sufficient conditions for the JS to improve the LS are given. It is important to know the influence of the dependence on the JS. Also numerical studies illuminate some interesting features of the improvement. The results have potential applications to economics, engineering, and natural sciences.     

Linear sufficiency in a general growth curve model

The notion of linear sufficiency for the whole set of estimable functions in the general Gauss-Markov model is extended to the estimation of any special set of estimable functions in a general growth curve model. Some general results with respect to the concept of linear sufficiency are obtained, from which a necessary and sufficient condition is established for a linear transformation, {F₁,F₂}, of the observation matrix Y to have the property that there exists a linear function of which is the BLUE of the estimable functions .