Admissibility of linear estimators of regression coefficients under quadratic loss

For the general fixed effects linear model:Y=X+, N(0,V),V0, we obtain the necessary and sufficient conditions forLY+a to be admissible for a linear estimable functionS in the class of all estimators under the loss function (d -S)D(d -S), whereD0 is known. For the general random effects linear model: =XV ₁₁ X+XV ₁₂+V ₂₁ X+V ₂₂0, we also get the necessary and sufficient conditions forLY+a to be admissible for a linear estimable functionS+Q in the class of all estimators under the loss function (d -S -Q)D(d -S -Q), whereD0 is known.     

Admissibility for linear estimator of parameter on growth curve model with respect to linear constraint

By using the vector-method of matrix, we study Growth Curve Model with respect to linear constraint. Under matrix loss function and vector loss function, we obtain necessary and sufficient conditions for admissibility of linear estimators of parameters in the inhomogeneous linear class.     

Admissibility of linear estimators with respect to inequality constraints under matrix loss function

In this paper we investigate the admissibility of linear estimators in the multivariate linear model with respect to inequality constraints under matrix loss function. The necessary and sufficient conditions for a linear estimator to be admissible in the class of homogeneous linear estimators and the class of inhomogeneous linear estimators are obtained, respectively.     

Admissibility results under some balanced loss functions for a functional regression model

We consider the problem of the nonparametric estimation in a functional regression model $Y=r(X)+\epsilon$, with Y a real random variable response and X representing a functional variable taking values in a semi-metric space. The aim of this note is to find conditions of admissibility of Stein-type estimators of such a model under a class of balanced loss functions. Our method is to compare the risk with that obtained in the case of a quadratic loss.     

Admissible prediction in superpopulation models with random regression coefficients under matrix loss function

Admissible prediction problems in finite populations with arbitrary rank under matrix loss function are investigated. For the general random effects linear model, we obtained the necessary and sufficient conditions for a linear predictor of the linearly predictable variable to be admissible in the two classes of homogeneous linear predictors and all linear predictors and the class that contains all predictors, respectively. Moreover, we prove that the best linear unbiased predictors (BLUPs) of the population total and the finite population regression coefficient are admissible under different assumptions of superpopulation models respectively.     

Weighted least-squares estimators of parametric functions of the regression coefficients under a general linear model

The weighted least-squares estimator of parametric functions K β under a general linear regression model { y, X b, s²S }{\{ {\bf y},\,{\bf X \beta}, \sigma^2{\bf \Sigma} \}} is defined to be K[^(b)]{{\bf K}{\hat{\bf {\beta}}}}, where [^(b)]{\hat{{\bf \beta}}} is a vector that minimizes (y − X β)′V(y − X β) for a given nonnegative definite weight matrix V. In this paper, we study some algebraic and statistical properties of K[^(b)]{{\bf K}\hat{{\bf \beta}}} and the projection matrix associated with the estimator, such as, their ranks, unbiasedness, uniqueness, as well as equalities satisfied by the projection matrices.     

Admissibility of linear estimators with respect to inequality constraints under some loss functions

In this paper, we study the issue of admissibility of linear estimated functions of parameters in the multivariate linear model with respect to inequality constraints under a matrix loss and a matrix balanced loss. Under the matrix loss, when the model is not constrained, the results in the class of non-homogeneous linear estimators [Xie, 1989, Chinese Sci. Bull., 1148–1149; Xie, 1993, J. Multivariate Anal., 1071–1074] showed that the admissibility under the matrix loss and the trace loss is equivalent. However, when the model is constrained by the inequality constraints, we find this equivalency is not tenable, our result shows that the admissibility of linear estimator does not depend on the constraints again under this matrix loss, but it is contrary under the trace loss [Wu, 2008, Linear Algebra Appl., 2040–2048], and it is also relative to the constraints under another matrix loss [He, 2009, Linear Algebra Appl., 241–250]. Under the matrix balanced loss, the necessary and sufficient conditions that the linear estimators are admissible in the class of homogeneous and non-homogeneous linear estimators are obtained, respectively. These results will support the theory of admissibility on the linear model with inequality constraints.     

Multiple outlier detection in growth curve model with unstructured covariance matrix

Under a normal assumption, Liski (1991,Biometrics,47, 659–668) gave some measurements for assessing influential observations in a Growth Curve Model (GCM) with a known covariance. For the GCM with an arbitrary (p.d.) covariance structure, known as unstructured covariance matrix (UCM), the problems of detecting multiple outliers are discussed in this paper. When a multivariate normal error is assumed, the MLEs of the parameters in the Multiple-Individual-Deletion model (MIDM) and the Mean-Shift-Regression model (MSRM) are derived, respectively. In order to detect multiple outliers in the GCM with UCM, the likelihood ratio testing statistic in MSRM is established and its null distribution is derived. For illustration, two numerical examples are discussed, which shows that the criteria presented in this paper are useful in practice.Supported partially by the WAI TAK Investment and Loan Company Ltd. Research Scholarship of Hong Kong for 1992–93.Supported partially by the Hong Kong UPGC Grant.     

Functional linear regression with Huber loss

In this paper, we consider the robust regression problem associated with Huber loss in the framework of functional linear model and reproducing kernel Hilbert spaces. We propose an Ivanov regularized empirical risk minimization estimation procedure to approximate the slope function of the linear model in the presence of outliers or heavy-tailed noises. By appropriately tuning the scale parameter of the Huber loss, we establish explicit rates of convergence for our estimates in terms of excess prediction risk under mild assumptions. Our study in the paper justifies the efficiency of Huber regression for functional data from a theoretical viewpoint.     

Central limit theorem of linear regression model under right censorship

In this paper,the estimation of joint dlstribution F(y,z)of(Y,Z)and the estimation in thelinear regression model Y=b'Z+εfor complete data are extended to that of the right censored data.Theregression parameter estimates of b and the variance of ε are weighted least square estimates with randomweights. The central limit theorems of the estimators are obtained under very weak conditions and the derivedasymptotic variance has a very simple form.     

Minimax estimates of a linear parameter function in a regression model under restrictions on the parameters and variance-covariance matrix

Minimax nonhomogeneous linear estimators of scalar linear parameter functions are studied in the paper under restrictions on the parameters and variance-covariance matrix. The variance-covariance matrix of the linear model under consideration is assumed to be unknown but from a specific set R of nonnegativedefinite matrices. It is shown under this assumption that, without any restriction on the parameters, minimax estimators correspond to the least-squares estimators of the parameter functions for the “worst” variance-covariance matrix. Then the minimax mean-square error of the estimator is derived using the Bayes approach, and finally the exact formulas are derived for the calculation of minimax estimators under elliptical restrictions on the parameter space and for two special classes of possible variance-covariance matrices R. For example, it is shown that a special choice of a constant q ₀ and a matrixW ₀ defining one of the above classes R leads to the well known Kuks—Olman admissible estimator (see [16]) with a known variance-covariance matrixW ₀. Bibliography:32 titles. Translated fromObchyslyuval'na ta Prykladna Matematyka, No. 81, 1997, pp. 79–92.     

Explicit formulas for the estimation of linear regression coefficients

Lithuanian Mathematical Journal -     

All admissible linear estimators of a regression coefficient under a balanced loss function

Admissibility of linear estimators of a regression coefficient in linear models with and without the assumption that the underlying distribution is normal is discussed under a balanced loss function. In the non-normal case, a necessary and sufficient condition is given for linear estimators to be admissible in the space of homogeneous linear estimators. In the normal case, a sufficient condition is provided for restricted linear estimators to be admissible in the space of all estimators having finite risks under the balanced loss function. Furthermore, the sufficient condition is proved to be necessary in the normal case if additional conditions are assumed.     

Mean quadratic error of an estimate of splines of first order in a model of linear regression

We study the mean quadratic error of an estimate of splines of the first order, which is obtained by the method of least squares under the assumption that the data represents a superposition of proper values of a spline and a white noise. A quantitative formula for the quadratic mean error is found and its asymptotics is investigated.Translated from Ukrainskii Matematicheskii Zhurnal, Vol. 49, No. 3, pp. 429–432, March, 1991.     

Mean quadratic error of an estimate of splines of first order in a model of linear regression

We study the mean quadratic error of an estimate of splines of the first order, which is obtained by the method of least squares under the assumption that the data represents a superposition of proper values of a spline and a white noise. A quantitative formula for the quadratic mean error is found and its asymptotics is investigated.Translated from Ukrainskii Matematicheskii Zhurnal, Vol. 49, No. 3, pp. 429–432, March, 1991.     

分组数据下线性回归模型的参数估计

讨论了分组数据下线性回归模型参数的MLE的存在、唯一性.通过EM算法获得MLE的近似解.通过SEM算法获得MLE的渐近协方差阵.     

Testing some covariance structures under a growth curve model

This paper considers three types of problems: (i) the problem of independence of two sets, (ii) the problem of sphericity of the covariance matrix Σ, and (iii) the problem of intraclass model for the covariance matrix Σ, when the column vectors of X are independently distributed as multivariate normal with covariance matrix Σ and E(X) = BξA,A and B being given matrices and ξ and Σ being unknown. These problems are solved by the likelihood ratio test procedures under some restrictions on the models, and the null distributions of the test statistics are established.     

Functional-coefficient partially linear regression model

In this paper, the functional-coefficient partially linear regression (FCPLR) model is proposed by combining nonparametric and functional-coefficient regression (FCR) model. It includes the FCR model and the nonparametric regression (NPR) model as its special cases. It is also a generalization of the partially linear regression (PLR) model obtained by replacing the parameters in the PLR model with some functions of the covariates. The local linear technique and the integrated method are employed to give initial estimators of all functions in the FCPLR model. These initial estimators are asymptotically normal. The initial estimator of the constant part function shares the same bias as the local linear estimator of this function in the univariate nonparametric model, but the variance of the former is bigger than that of the latter. Similarly, initial estimators of every coefficient function share the same bias as the local linear estimates in the univariate FCR model, but the variance of the former is bigger than that of the latter. To decrease the variance of the initial estimates, a one-step back-fitting technique is used to obtain the improved estimators of all functions. The improved estimator of the constant part function has the same asymptotic normality property as the local linear nonparametric regression for univariate data. The improved estimators of the coefficient functions have the same asymptotic normality properties as the local linear estimates in FCR model. The bandwidths and the smoothing variables are selected by a data-driven method. Both simulated and real data examples related to nonlinear time series modeling are used to illustrate the applications of the FCPLR model.