纵向数据边际模型非参数光滑方法的比较

对于纵向数据边际模型的均值函数, 有很多非参数估计方法, 其中回归样条, 光滑样条, 似乎不相关(SUR)核估计等方法在工作协方差阵正确指定时具有最小的渐近方差. 回归样条的渐近偏差与工作协方差阵无关, 而SUR核估计和光滑样条估计的渐近偏差却依赖于工作协方差阵. 本文主要研究了回归样条, 光滑样条和SUR核估计的效率问题. 通过模拟比较发现回归样条估计的表现比较稳定, 在大多数情况下比光滑样条估计和SUR核估计的效率高.     

Statistical inference in a panel data semiparametric regression model with serially correlated errors

We consider a panel data semiparametric partially linear regression model with an unknown vector β of regression coefficients, an unknown nonparametric function g(·) for nonlinear component, and unobservable serially correlated errors. The correlated errors are modeled by a vector autoregressive process which involves a constant intraclass correlation. Applying the pilot estimators of β and g(·), we construct estimators of the autoregressive coefficients, the intraclass correlation and the error variance, and investigate their asymptotic properties. Fitting the error structure results in a new semiparametric two-step estimator of β, which is shown to be asymptotically more efficient than the usual semiparametric least squares estimator in terms of asymptotic covariance matrix. Asymptotic normality of this new estimator is established, and a consistent estimator of its asymptotic covariance matrix is presented. Furthermore, a corresponding estimator of g(·) is also provided. These results can be used to make asymptotically efficient statistical inference. Some simulation studies are conducted to illustrate the finite sample performances of these proposed estimators.     

Second-order nonlinear least squares estimation

The ordinary least squares estimation is based on minimization of the squared distance of the response variable to its conditional mean given the predictor variable. We extend this method by including in the criterion function the distance of the squared response variable to its second conditional moment. It is shown that this “second-order” least squares estimator is asymptotically more efficient than the ordinary least squares estimator if the third moment of the random error is nonzero, and both estimators have the same asymptotic covariance matrix if the error distribution is symmetric. Simulation studies show that the variance reduction of the new estimator can be as high as 50% for sample sizes lower than 100. As a by-product, the joint asymptotic covariance matrix of the ordinary least squares estimators for the regression parameter and for the random error variance is also derived, which is only available in the literature for very special cases, e.g. that random error has a normal distribution. The results apply to both linear and nonlinear regression models, where the random error distributions are not necessarily known.     

Estimation in partial linear EV models with replicated observations

The aim of this work is to construct the parameter estimators in the partial linear errors-in-variables (EV) models and explore their asymptotic properties. Unlike other related references, the assumption of known error covariance matrix is removed when the sample can be repeatedly drawn at each designed point from the model. The estimators of interested regression parameters, and the model error variance, as well as the non-parametric function, are constructed. Under some regular conditions, all of the estimators prove strongly consistent. Meanwhile, the asymptotic normality for the estimator of regression parameter is also presented. A simulation study is reported to illustrate our asymptotic results.     

Double k-Class Estimators in Regression Models with Non-spherical Disturbances

In this paper, we consider a family of feasible generalised double k-class estimators in a linear regression model with non-spherical disturbances. We derive the large sample asymptotic distribution of the proposed family of estimators and compare its performance with the feasible generalized least squares and Stein-rule estimators using the mean squared error matrix and risk under quadratic loss criteria. A Monte-Carlo experiment investigates the finite sample behaviour of the proposed family of estimators.     

Sample Covariance Matrix for Random Vectors with Heavy Tails

We compute the asymptotic distribution of the sample covariance matrix for independent and identically distributed random vectors with regularly varying tails. If the tails of the random vectors are sufficiently heavy so that the fourth moments do not exist, then the sample covariance matrix is asymptotically operator stable as a random element of the vector space of symmetric matrices.     

Robustifying principal component analysis with spatial sign vectors

In this paper, we apply orthogonally equivariant spatial sign covariance matrices as well as their affine equivariant counterparts in principal component analysis. The influence functions and asymptotic covariance matrices of eigenvectors based on robust covariance estimators are derived in order to compare the robustness and efficiency properties. We show in particular that the estimators that use pairwise differences of the observed data have very good efficiency properties, providing practical robust alternatives to classical sample covariance matrix based methods.     

Error rates in classification of multivariate Gaussian random field observation

We consider the problem of supervised classifying the multivariate Gaussian random field (GRF) single observation into one of two populations in case of given training sample. The populations are specified by different regression mean models and by common factorized covariance function. For completely specified populations, we derive a formula for Bayes error rate. In the case of unknown regression parameters and feature covariance matrix, the plug-in Bayes discriminant function based on ML estimators of parameters is used for classification. We derive the actual error rate and the asymptotic expansion of the expected error rate associated with plug-in Bayes discriminant function. These results are multivariate generalizations of previous ones. Numerical analysis of the derived formulas is implemented for the bivariate GRF observations at locations belonging to the two-dimensional lattice with unit spacing.     

误差服从多元t分布的一类线性模型下参数估计的若干注记

研究一类线性模型下参数估计的若干问题．这类模型包含了多个因变量线性模型、增长曲线模型、扩充的增长曲线模型、似乎不相关回归方程组、方差分量模型等常用模型．在这类线性模型下,证明了当误差服从多元t分布时与误差服从多元正态分布时,具有相同的完全统计量和无偏估计,且在后一种情况下的充分统计量必为前一种情况下的充分统计量．对于带有多种协方差结构的前述几种模型,把在误差服从多元正态分布下,相应的协方差阵及有关参数的一致最小风险无偏(UMRU)估计存在性的结论推广到了相应的误差服从多元t分布情形．此外,对于误差服从多元t分布的这类统一的线性模型,给出了回归系数的线性可估函数的无偏估计的协方差阵的C-R下界．     

Estimation of the entropy of a multivariate normal distribution

Motivated by problems in molecular biosciences wherein the evaluation of entropy of a molecular system is important for understanding its thermodynamic properties, we consider the efficient estimation of entropy of a multivariate normal distribution having unknown mean vector and covariance matrix. Based on a random sample, we discuss the problem of estimating the entropy under the quadratic loss function. The best affine equivariant estimator is obtained and, interestingly, it also turns out to be an unbiased estimator and a generalized Bayes estimator. It is established that the best affine equivariant estimator is admissible in the class of estimators that depend on the determinant of the sample covariance matrix alone. The risk improvements of the best affine equivariant estimator over the maximum likelihood estimator (an estimator commonly used in molecular sciences) are obtained numerically and are found to be substantial in higher dimensions, which is commonly the case for atomic coordinates in macromolecules such as proteins. We further establish that even the best affine equivariant estimator is inadmissible and obtain Stein-type and Brewster–Zidek-type estimators dominating it. The Brewster–Zidek-type estimator is shown to be generalized Bayes.     

Quantile estimations via modified Cholesky decomposition for longitudinal single-index models

Quantile regression is a powerful complement to the usual mean regression and becomes increasingly popular due to its desirable properties. In longitudinal studies, it is necessary to consider the intra-subject correlation among repeated measures over time to improve the estimation efficiency. In this paper, we focus on longitudinal single-index models. Firstly, we apply the modified Cholesky decomposition to parameterize the intra-subject covariance matrix and develop a regression approach to estimate the parameters of the covariance matrix. Secondly, we propose efficient quantile estimating equations for the index coefficients and the link function based on the estimated covariance matrix. Since the proposed estimating equations include a discrete indicator function, we propose smoothed estimating equations for fast and accurate computation of the index coefficients, as well as their asymptotic covariances. Thirdly, we establish the asymptotic properties of the proposed estimators. Finally, simulation studies and a real data analysis have illustrated the efficiency of the proposed approach.

     

封闭型保单组未来损失现值向量的联合分布及渐近分布

本文针对封闭型保单组,利用历年死亡人数随机向量D,将保单组的未来给付现值随机变量和未来损失现值随机变量表达为某个满秩矩阵和D的乘积,根据D服从多项分布的性质,得到未来损失现值随机向量渐近服从多元正态分布的结果,为分析责任准备金提供了一个新的框架.     

Efficient parameter estimation via modified Cholesky decomposition for quantile regression with longitudinal data

It is well known that specifying a covariance matrix is difficult in the quantile regression with longitudinal data. This paper develops a two step estimation procedure to improve estimation efficiency based on the modified Cholesky decomposition. Specifically, in the first step, we obtain the initial estimators of regression coefficients by ignoring the possible correlations between repeated measures. Then, we apply the modified Cholesky decomposition to construct the covariance models and obtain the estimator of within-subject covariance matrix. In the second step, we construct unbiased estimating functions to obtain more efficient estimators of regression coefficients. However, the proposed estimating functions are discrete and non-convex. We utilize the induced smoothing method to achieve the fast and accurate estimates of parameters and their asymptotic covariance. Under some regularity conditions, we establish the asymptotically normal distributions for the resulting estimators. Simulation studies and the longitudinal progesterone data analysis show that the proposed approach yields highly efficient estimators.     

Distribution of eigenvalues and eigenvectors of Wishart matrix when the population eigenvalues are infinitely dispersed and its application to minimax estimation of covariance matrix

We consider the asymptotic joint distribution of the eigenvalues and eigenvectors of Wishart matrix when the population eigenvalues become infinitely dispersed. We show that the normalized sample eigenvalues and the relevant elements of the sample eigenvectors are asymptotically all mutually independently distributed. The limiting distributions of the normalized sample eigenvalues are chi-squared distributions with varying degrees of freedom and the distribution of the relevant elements of the eigenvectors is the standard normal distribution. As an application of this result, we investigate tail minimaxity in the estimation of the population covariance matrix of Wishart distribution with respect to Stein's loss function and the quadratic loss function. Under mild regularity conditions, we show that the behavior of a broad class of tail minimax estimators is identical when the sample eigenvalues become infinitely dispersed.     

空间半参数变系数部分线性回归中的分位数估计

本文研究了空间数据变系数部分线性回归中的分位数估计. 模型中的参数估计量通过未知系数函数的分段多项式逼近得到, 而未知系数函数的估计量通过将参数估计量代入模型中并通过局部线性逼近得到. 文中推导了未知参数向量估计量的渐近分布, 并建立了未知系数函数估计量在内点及边界点的渐近分布. 通过Monte Carlo 模拟研究了估计量的有限样本性质.     

Statistical inference for a certain class of bivariate distributions

The paper deals with statistical inference for a certain class of bivariate distributions. The class of marginal distributions is given and is shown to include distributions with only location and scale parameters. A normalizing transformation is applied to the marginal distributions and the parameters are estimated by maximum likelihood. For this class there is a great deal of simplification in the calculations for the asymptotic covariance matrix of the vector of parameter estimators. Statistics for tests of zero correlation are discussed. Also, the analysis is carried out for exponential marginal distributions.     

Estimation of time-varying ARMA models with Markovian changes in regime

In this paper, we consider the estimation of time-varying ARMA models subject to Markovian changes in regime. We give explicit conditions ensuring consistency and asymptotic normality, as well as the limiting covariance matrix, of least squares and quasi-generalized least-squares estimators.     

Estimation in multivariate errors-in-variables models

This paper reviews and extends some of the known results in the estimation in “errors-in-variables” models, treating the structural and the functional cases on a unified basis. The generalized least-squares method proposed by some previous authors is extended to the case where the error covariance matrix contains an unknown vector parameter. This alleviates the difficulty of multiple roots arising from defining estimators as roots to a set of unbiased estimating equations. An alternative method is also considered for cases with both known and unknown error covariance matrix. The relationship between this method and the usual maximum-likelihood and generalized least-squares approaches is also investigated, and it is shown that in a special case they do not necessarily give identical results in finite samples. Finally, asymptotic results are presented.     

Tapered Covariance: Bayesian Estimation and Asymptotics

The method of maximum tapered likelihood has been proposed as a way to quickly estimate covariance parameters for stationary Gaussian random fields. We show that under a useful asymptotic regime, maximum tapered likelihood estimators are consistent and asymptotically normal for covariance models in common use. We then formalize the notion of tapered quasi-Bayesian estimators and show that they too are consistent and asymptotically normal. We also present asymptotic confidence intervals for both types of estimators and show via simulation that they accurately reflect sampling variability, even at modest sample sizes. Proofs, an example, and detailed derivations are provided in the supplementary materials, available online.