Empirical Bayes estimation in a multiple linear regression model

Summary Estimation of the vector β of the regression coefficients in a multiple linear regressionY=Xβ+ε is considered when β has a completely unknown and unspecified distribution and the error-vector ε has a multivariate standard normal distribution. The optimal estimator for β, which minimizes the overall mean squared error, cannot be constructed for use in practice. UsingX, Y and the information contained in the observation-vectors obtained fromn independent past experiences of the problem, (empirical Bayes) estimators for β are exhibited. These estimators are compared with the optimal estimator and are shown to be asymptotically optimal. Estimators asymptotically optimal with rates nearO(n ⁻¹) are constructed. Supported in part by a Natural Sciences and Engineering Research Council of Canada grant.     

多参数离散指数族参数渐近最优的经验Bayes估计的收敛速度

本文构造了多参数离散指数族参数的渐近最优的经验Bayes（EB）估计,若记B_n（δ_n,G）为δn的全面Bayes风险,R_G最小Bayes风险,则在某些条件下c_1n~(-1）2成立,其中c_1,c_2为正的常数,     

Superiority of empirical Bayes estimation of error variance in linear model

In this paper, the Bayes estimator of the error variance is derived in a linear regression model, and the parametric empirical Bayes estimator (PEBE) is constructed. The superiority of the PEBE over the least squares estimator (LSE) is investigated under the mean square error (MSE) criterion. Finally, some simulation results for the PEBE are obtained.     

Minimax multivariate empirical Bayes estimators under multicollinearity

In this paper we consider the problem of estimating the matrix of regression coefficients in a multivariate linear regression model in which the design matrix is near singular. Under the assumption of normality, we propose empirical Bayes ridge regression estimators with three types of shrinkage functions, that is, scalar, componentwise and matricial shrinkage. These proposed estimators are proved to be uniformly better than the least squares estimator, that is, minimax in terms of risk under the Strawderman's loss function. Through simulation and empirical studies, they are also shown to be useful in the multicollinearity cases.     

On Bayes linear unbiased estimation of estimable functions for the singular linear model

The unique Bayes linear unbiased estimator (Bayes LUE) of estimable functions is derived for the singular linear model. The superiority of Bayes LUE over ordinary best linear unbiased estimator is investigated under mean square error matrix (MSEM) criterion.     

刻度指数族参数的经验Bayes检验函数收敛速度的改进

在加权线性损失下导出了刻度指数族中参数单调的Bayes检验函数,利用同分布负相协(NA)样本情形概率密度函数及其导数的核估计构造了经验Bayes(EB)检验函数,获得了EB检验函数的收敛速度.在适当的条件下,这一收敛速度可任意接近O(n~(-1)),改进了文献中已有的结果.对同分布正相协(PA)样本和独立同分布(iid)样本情形,亦可获得类似结论.最后给出了一个满足文中主要结果的例子.     

Improved estimation of regression parameters in measurement error models

The problem of simultaneous estimation of the regression parameters in a multiple regression model with measurement errors is considered when it is suspected that the regression parameter vector may be the null-vector with some degree of uncertainty. In this regard, we propose two sets of four estimators, namely, (i) the unrestricted estimator, (ii) the preliminary test estimator, (iii) the Stein-type estimator and (iv) the postive-rule Stein-type estimator. In an asymptotic setup, properties of these estimators are studied based on asymptotic distributional bias, MSE matrices, and risks under a quadratic loss function. In addition to the asymptotic dominance of the Stein-type estimators, the paper contains discussion of dominating confidence sets based on the Stein-type estimation. Asymptotic analysis is considered based on a sequence of local alternatives to obtain the desired results.     

A study over the general formula of regression sum of squares in multiple linear regression

In this study, in addition to the formula of regression sum of squares (SSR) in linear regression, a general formula of SSR in multiple linear regression is given. The derivations of the formula presented are given step by step. This new formula is proposed for estimation of the SSR in multiple linear regression. By using this formula, the researcher can find easily SSR and so the researcher can compose easily the table of variance analysis to interpret the regression made.     

The superiority of empirical bayes estimation of parameters in partitioned normal linear model

In this article,the empirical Bayes（EB）estimators are constructed for the estimable functions of the parameters in partitioned normal linear model.The superiorities of the EB estimators over ordinary least-squares（LS）estimator are investigated under mean square error matrix（MSEM）criterion.     

THE ASYMPTOTICALLY OPTIMAL EMPIRICAL BAYES ESTIMATION IN MULTIPLE LINEAR REGRESSION MODEL

ＴＨＥＡＳＹＭＰＴＯＴＩＣＡＬＬＹＯＰＴＩＭＡＬＥＭＰＩＲＩＣＡＬＢＡＹＥＳＥＳＴＩＭＡＴＩＯＮＩＮＭＵＬＴＩＰＬＥＬＩＮＥＡＲＲＥＧＲＥＳＳＩＯＮＭＯＤＥＬ￥ＺＨＡＮＧＳＨＵＮＰＵ；ＷＥＩＬＡＩＳＨＥＮＧ（ＤｅｐａｒｔｍｅｎｔｏｆＭａｔｈｅｍａｔｉ...     

Efficient estimation of a varying-coefficient partially linear binary regression model

This article considers a semiparametric varying-coefficient partially linear binary regression model. The semiparametric varying-coefficient partially linear regression binary model which is a generalization of binary regression model and varying-coefficient regression model that allows one to explore the possibly nonlinear effect of a certain covariate on the response variable. A Sieve maximum likelihood estimation method is proposed and the asymptotic properties of the proposed estimators are discussed. One of our main objects is to estimate nonparametric component and the unknowen parameters simultaneously. It is easier to compute, and the required computation burden is much less than that of the existing two-stage estimation method. Under some mild conditions, the estimators are shown to be strongly consistent. The convergence rate of the estimator for the unknown smooth function is obtained, and the estimator for the unknown parameter is shown to be asymptotically efficient and normally distributed. Simulation studies are carried out to investigate the performance of the proposed method.     

Bayes empirical Bayes estimation of a poisson mean

In the empirical Bayes (EB) decision problem consisting of squared error estimation of a Poisson mean, a prior distribution λ is placed on the gamma family of prior distributions to produce Bayes EB estimators which are admissible. A subclass of such estimators is shown to be asymptotically optimal (a.o.). The results of a Monte Carlo study are presented to demonstrate the favorable a.o. property of the Bayes EB estimators in comparison with other competitors.     

一维双边截断型分布族中参数函数的经验Bayes估计及其收敛速度

对一维双边截断型分布族构造了参数函数的经验 Ｂａｙｅｓ 估计,在适当的条件下给出了相应的收敛速度,并说明此收敛速度可充分接近 １２ ．     

On the empirical Bayes approach to multiple decision problems with sequential components

The empirical Bayes approach to multiple decision problems with a sequential decision problem as the component is studied. An empirical Bayesm-truncated sequential decision procedure is exhibited for general multiple decision problems. With a sequential component, an empirical Bayes sequential decision procedure selects both a stopping rule function and a terminal decision rule function for use in the component. Asymptotic results are presented for the convergence of the Bayes risk of the empirical Bayes sequential decision procedure.     

完全随机缺失机制下伽玛分布中形状参数的经验贝叶斯推断

在完全随机缺失机制下构造了伽玛分布参数的经验贝叶斯检验函数,并获得了它的渐进最优性.在适当的条件下证明了所提出的经验贝叶斯检验函数收敛速度可任意接近O(n(~(-1/2)).     

Empirical Bayes approach to multiparameter estimation: with special reference to multinomial distribution

Empirical Bayes approach to estimation of many parameters is considered. Special features of the techniques discussed are: (i) the handling of unequal sample sizes at various stages of an Empirical Bayes sampling scheme and (ii) a general iterative procedure for estimating the parameters of a parametric prior distribution based on the likelihood approach. Linear empirical Bayes estimation is also considered. Application of the general techniques is demonstrated with special reference to a multinomial data distribution.     

指数分布中寿命参数的经验贝叶斯检验

本文中,我们利用经验贝叶斯方法研究了指数分布中寿命参数的检验问题.对于假设H0∶θ≤θ0 H1∶θ>θ0,在线性误差损失下,利用两种不同的核估计方法,我们获得了贝叶斯检验风险的同样上界.本文获得的收敛速度优于文献中的早期结果.     

NA样本下截断型分布族参数的经验Bayes估计

运用NA样本密度函数核估计构造了一类截断型分布族参数的经验Bayes估计，建立了它的收敛速度，证明了在适当条件下该收敛速度可以任意接近于1，文中还给出了适合定理条件的例子。     

On asymptotically efficient estimation for a semiparametric regression model

1.IntroductionConsiderthemodelY=X"0 g(T) E,(1'1)whereX"~(xl,',xo)areexplanatoryvariablesthatenterlinearly,Pisakx1vectorofunknownparameters,Tisanotherexplanatoryvariablesthatentersinanonlinearfashion,g')isanunknownsmoothfunctionofTinR',(X,T)andeareindependent,andeistheerrorwithmean0andvariancea2.Trangesoveranondegeneratecompact1-dimensionalilltervalC*;withoutlossofgenerality,C*=[0,1].Chenl2]discussedasymptoticnormalityofestimatorsP.of0byusingpiecewisepolynthacaltoapproximateg.Speckmanls…     

指数分布族参数的渐近最优与可容许的经验Bayes估计

在平方损失下 ,构造了指数族 { f(x|λ) =λe-λx,λ >0 ,x >0 }的参数λ的渐近最优与可容许的经验Bayes估计 ,即δn=(n +u + 1n1φ(n) + 1) β1+ βX,其中X1,X2 ,…Xn(历史样本 )和X(当前样本 )独立同分布于 f(x) ,Sn= ni=11n(1+ βXi) ,φ(n) =1n(Sn+ 1n(1+ βX) +v- 1) ,u >0 ,v >0 ,β >0 (已知 )为任意的实数 ,并证明了该估计的收敛速度为O(n- 1)。