Stein's positive part estimator and bayes estimator

Summary Stein's positive part estimator forp normal means is known to dominate the M.L.E. ifp≧3. In this article by introducing some proirs we show that Stein's positive part estimator is posterior mode. We also consider the Bayes estimators (posterior mean) with respect to the same priors and show that some of them dominate M.L.E. and are admissible.     

Component risk in multiparameter estimation

Summary For estimating the mean of ap-variate normal distribution under a quadratic loss, a class of estimators, known as Stein's estimators, is known to dominate the maximum likelihood estimator (MLE) forp≧3. But, whereas the risk of the MLE has the same value, equal to a constant, for each component, the maximum component risk of Stein's estimator is large for large values ofp. Certain modification of Stein's rule has been proposed in the literature for reducing the maximum component risk. In this paper, a new rule is given for reducing the maximum component risk. The new rule yields larger reduction in the maximum component risk, compared to its competitor.     

Improved Estimation of Parameter Matrices in a One-Sample and Two-Sample Problems

In this paper, the problems of estimating the covariance matrix in a Wishart distribution (refer as one-sample problem) and the scale matrix in a multi-variate F distribution (which arise naturally from a two-sample setting) are considered. A new class of estimators which shrink the eigenvalues towards their harmonic mean is proposed. It is shown that the new estimator dominates the best linear estimator under two scale invariant loss functions.     

������̬��٤���������̬�ֲ��еķ��������Stein��ʧ�µı�Ҷ˹���������

or the variance parameter of the normal distribution with a normal-inverse-gamma prior, we analytically calculate the Bayes posterior estimator with respect to a conjugate normal-inverse-gamma prior distribution under Stein's loss function. This estimator minimizes the Posterior Expected Stein's Loss (PESL). We also analytically calculate the Bayes posterior estimator and the PESL under the squared error loss function. The numerical simulations exemplify our theoretical studies that the PESLs do not depend on the sample, and that the Bayes posterior estimator and the PESL under the squared error loss function are unanimously larger than those under Stein's loss function. Finally, we calculate the Bayes posterior estimators and the PESLs of the monthly simple returns of the SSE Composite Index.     

A Comparison of Restricted and Unrestricted Estimators in Estimating Linear Functions of Ordered Scale Parameters of Two Gamma Distributions

The problem of estimating linear functions of ordered scale parameters of two Gamma distributions is considered. A necessary and sufficient condition on the ratio of two coefficients is given for the maximum likelihood estimator (MLE) to dominate the crude unbiased estimator (UE) in terms of mean square error. A modified MLE which satisfies the restriction is also suggested, and a necessary and sufficient condition is also given for it to dominate the admissible estimator based solely on one sample. The estimation of linear functions of variances in two sample problem and also of variance components in a one-way random effect model is mentioned.     

Comparisons among some estimators in misspecified linear models with multicollinearity

In this paper we deal with comparisons among several estimators available in situations of multicollinearity (e.g., the r-k class estimator proposed by Baye and Parker, the ordinary ridge regression (ORR) estimator, the principal components regression (PCR) estimator and also the ordinary least squares (OLS) estimator) for a misspecified linear model where misspecification is due to omission of some relevant explanatory variables. These comparisons are made in terms of the mean square error (mse) of the estimators of regression coefficients as well as of the predictor of the conditional mean of the dependent variable. It is found that under the same conditions as in the true model, the superiority of the r-k class estimator over the ORR, PCR and OLS estimators and those of the ORR and PCR estimators over the OLS estimator remain unchanged in the misspecified model. Only in the case of comparison between the ORR and PCR estimators, no definite conclusion regarding the mse dominance of one over the other in the misspecified model can be drawn.     

Estimation of the entropy of a multivariate normal distribution

Motivated by problems in molecular biosciences wherein the evaluation of entropy of a molecular system is important for understanding its thermodynamic properties, we consider the efficient estimation of entropy of a multivariate normal distribution having unknown mean vector and covariance matrix. Based on a random sample, we discuss the problem of estimating the entropy under the quadratic loss function. The best affine equivariant estimator is obtained and, interestingly, it also turns out to be an unbiased estimator and a generalized Bayes estimator. It is established that the best affine equivariant estimator is admissible in the class of estimators that depend on the determinant of the sample covariance matrix alone. The risk improvements of the best affine equivariant estimator over the maximum likelihood estimator (an estimator commonly used in molecular sciences) are obtained numerically and are found to be substantial in higher dimensions, which is commonly the case for atomic coordinates in macromolecules such as proteins. We further establish that even the best affine equivariant estimator is inadmissible and obtain Stein-type and Brewster–Zidek-type estimators dominating it. The Brewster–Zidek-type estimator is shown to be generalized Bayes.     

Improving Penalized Least Squares through Adaptive Selection of Penalty and Shrinkage

Estimation of the mean function in nonparametric regression is usefully separated into estimating the means at the observed factor levels—a one-way layout problem—and interpolation between the estimated means at adjacent factor levels. Candidate penalized least squares (PLS) estimators for the mean vector of a one-way layout are expressed as shrinkage estimators relative to an orthogonal regression basis determined by the penalty matrix. The shrinkage representation of PLS suggests a larger class of candidate monotone shrinkage (MS) estimators. Adaptive PLS and MS estimators choose the shrinkage vector and penalty matrix to minimize estimated risk. The actual risks of shrinkage-adaptive estimators depend strongly upon the economy of the penalty basis in representing the unknown mean vector. Local annihilators of polynomials, among them difference operators, generate penalty bases that are economical in a range of examples. Diagnostic techniques for adaptive PLS or MS estimators include basis-economy plots and estimates of loss or risk.     

r-k Class estimation in regression model with concomitant variables

We treat with the r-k class estimation in a regression model, which includes the ordinary least squares estimator, the ordinary ridge regression estimator and the principal component regression estimator as special cases of the r-k class estimator. Many papers compared total mean square error of these estimators. Sarkar (1989, Ann. Inst. Statist. Math., 41, 717–724) asserts that the results of this comparison are still valid in a misspecified linear model. We point out some confusions of Sarkar and show additional conditions under which his assertion holds.     

随机变量二次型的协方差在混合效应模型中的应用

本文提出方差分量ANOVA估计的一种改进方法, 证明了对于一般的方差分量模型, 只要方差分量的ANOVA估计存在就可以通过此方法给出其改进形式, 并且在均方误差意义下优于ANOVA估计. 特别地, 对于单向分类随机效应模型, Kelly和Mathew^[1]对ANOVA估计的改进就是我们提出的改进方法的特殊形式, 这也给出了此类改进估计在均方误差意义下优于ANOVA估计的另一种合理的解释. 同时, 本文又将此思想应用到对谱分解估计的改进上. 本文应用协方差的简单性质证明了对带有一个随机效应的方差分量模型, 当随机效应的协方差阵只有一个非零特征值时, 随机效应方差分量谱分解估计在均方误差意义下总是优于ANOVA估计. 本文最后将第三节的结论推广到广义谱分解估计下, 同时给出广义谱分解估计待定系数的一个合理的取值.     

Third order efficiency implies fourth order efficiency: A resolution of the conjecture of J. K. Ghosh

Under suitable regularity conditions, it is shown that a third order asymptotically efficient estimator is fourth order asymptotically efficient in some class of estimators in the sense that the estimator has the most concentration probability in any symmetric interval around the true parameter up to the fourth order in the class. This is a resolution of the conjecture by Ghosh (1994, Higher Order Asymptotics, Institute of Mathematical Statistics, Hayward, California). It is also shown that the bias-adjusted maximum likelihood estimator is fourth order asymptotically efficient in the class.     

Estimation of the Scale Matrix and its Eigenvalues in the Wishart and the Multivariate F Distributions

In this paper, the problem of estimating the scale matrix and their eigenvalues in a Wishart distribution and in a multivariate F distribution (which arise naturally from a two-sample setting) are considered. A new class of estimators which shrink the eigenvalues towards their arithmetic mean are proposed. It is shown that the new estimator which dominates the usual unbiased estimator under the squared error loss function. A simulation study was carried out to study the performance of these estimators.     

Asymptotic equivalence of the jackknife and infinitesimal jackknife variance estimators for some smooth statistics

The jackknife variance estimator and the infinitesimal jackknife variance estimator are shown to be asymptotically equivalent if the functional of interest is a smooth function of the mean or a trimmed L-statistic with Hölder continuous weight function.     

Closer estimators of a common mean in the sense of Pitman

Consider the problem of estimating the common mean of two normal populations with different unknown variances. Suppose a random sample of sizem is drawn from the first population and a random sample of sizen is drawn from the second population. The paper gives a family of estimators closer than the sample mean of the first population in the sense of Pitman (1937,Proc. Cambridge Phil. Soc.,33, 212–222). In particular, the Graybill-Deal estimator (1959,Biometrics,15, 543–550) is shown to be closer than each of the sample means ifm5 andn5.     

A sequence of improvements over the James-Stein estimator

In this article, we consider the problem of estimating a p-variate (p ≥ 3) normal mean vector in a decision-theoretic setup. Using a simple property of the noncentral chi-square distribution, we have produced a sequence of smooth estimators dominating the James-Stein estimator and each improved estimator is better than the previous one. It is also shown by using a technique of [5]. J. Multivariate Anal.36 121–126) that our smooth estimators can be dominated by non-smooth estimators.     

Admissibility of estimators of the probability of unobserved outcomes

The problem of estimating the probability of unobserved outcomes or, as it is sometimes called, the conditional probability of a new species, is studied. Good's estimator, which is essentially the same as Robbins' estimator, namely the number of singleton species observed divided by the sample size, is studied from a decision theory point of view. The results obtained are as follows: (1) When the total number of different species is assumed bounded by some known number, Good's and Robbins' estimators are inadmissible for squared error loss. (2) If the number of different species can be infinite, Good's and Robbins' estimators are admissible for squared error loss. (3) Whereas Robbins' estimator is a UMVUE for theunconditional probability of a new species obtained in one extra sample point, Robbins' estimator is not a uniformly minimum mean squared error unbiased estimator of the conditional probability of a new species. This answers a question raised by Robbins. (4) It is shown that for Robbins' model and squared error loss, there are admissible Bayes estimators which do not depend only on a minimal sufficient statistic. A discussion of interpretations and significance of the results is offered. Research supported by NSF Grant DMS-88-22622.     

Nonlinear wavelet density estimation with censored dependent data

In this paper, we provide an asymptotic expansion for the mean integrated squared error (MISE) of nonlinear wavelet estimator of survival density for a censorship model when the data exhibit some kind of dependence. It is assumed that the observations form a stationary and α‐mixing sequence. This asymptotic MISE expansion, when the density is only piecewise smooth, is same. However, for the kernel estimators, the MISE expansion fails if the additional smoothness assumption is absent. Also, we establish the asymptotic normality of the nonlinear wavelet estimator. Copyright © 2011 John Wiley & Sons, Ltd.     

Estimation of two normal means which may be common

Consider the problem of estimating the mean of a normal population when independent samples from this as well as a second normal population are available. Pre-test estimators which combine the two sample means if a test of the hypothesis of equal population means accepts but otherwise use only the first sample mean, are compared to limited translation estimators which are derived in the spirit of Bickel (1984, Ann. Statist., 12, 864–879) (we also cover the cases of unknown variances). Our conclusion is that if the accuracy with which the second population mean can be estimated is of the same or better order of magnitude as teh accuracy with which the first can be estimated, then the limited translation estimators largely dominate the pre-test estimators in terms of mean square error loss.This research was supported by grants from the FRD of the CSIR of South Africa.     

Integrated squared error of kernel-type estimator of distribution function

Let X ₁ ,...,X _n be a random sample drawn from distribution function F(x) with density function f(x) and suppose we want to estimate X(x). It is already shown that kernel estimator of F(x) is better than usual empirical distribution function in the sense of mean integrated squared error. In this paper we derive integrated squared error of kernel estimator and compare the error with that of the empirical distribution function. It is shown that the superiority of kernel estimators is not necessarily true in the sense of integrated squared error.     

Multiparameter estimation for some multivariate discrete distributions with possibly dependent components

Summary In multiparameter estimation for multivariate discrete distributions with infinite support, inadmissibility problems in situations where the multivariate probability distribution function isnot a product of the one-dimensional marginal probability distribution functions have previously been unexplored. This paper examines the inadmissibility problem in some of these situations. Special attention is given to estimating the mean of a negative multinomial distribution. In estimating the mean vector, certain Clevenson-Zidek type estimators are shown to be uniformly better than the usual estimator under a large class of generally scaled squared loss functions. Some of the results are generalized to other multivariate discrete distributions and to situations where several independent negative multinomial distributions are considered.