Estimation of a non-negative location parameter with unknown scale

For a vast array of general spherically symmetric location-scale models with a residual vector, we consider estimating the (univariate) location parameter when it is lower bounded. We provide conditions for estimators to dominate the benchmark minimax MRE estimator, and thus be minimax under scale invariant loss. These minimax estimators include the generalized Bayes estimator with respect to the truncation of the common non-informative prior onto the restricted parameter space for normal models under general convex symmetric loss, as well as non-normal models under scale invariant \(L^p\) loss with \(p>0\) . We cover many other situations when the loss is asymmetric, and where other generalized Bayes estimators, obtained with different powers of the scale parameter in the prior measure, are proven to be minimax. We rely on various novel representations, sharp sign change analyses, as well as capitalize on Kubokawa’s integral expression for risk difference technique. Several properties such as robustness of the generalized Bayes estimators under various loss functions are obtained.     

Estimation of the parameters of an exponential distribution under constrained location

In this paper, the problem of estimating parameters of an exponential population is studied under quadratic loss functions. The location parameter of the distribution is assumed to be bounded above by a known constant. Various classes of estimators are derived using integral expression of risk difference (IERD) method of Kubokawa (1994). Some complete class results are also established.     

截尾样本下,具有共同尺度参数的多总体指数分布的参数估计

讨论了在截尾样本下,具有共同尺度参数的多总体指数分布的参数估计问题,证明了尺度参数及位置参数的最佳仿射同变估计是不容许的,且给出了相应的改进估计.     

Estimation of the eigenvalues of noncentrality parameter matrix in noncentral Wishart distribution

We consider the problem of estimating the eigenvalues of noncentrality parameter matrix in noncentral Wishart distribution when the scale parameter is known. A decision theoretic approach is taken with squared error as the loss function. We propose two new estimators and show their superior performance to an usual estimator theoretically and numerically.     

Some modifications of improved estimators of a normal variance

Consider the problem of estimating a normal variance based on a random sample when the mean is unknown. Scale equivariant estimators which improve upon the best scale and translation equivariant one have been proposed by several authors for various loss functions including quadratic loss. However, at least for quadratic loss function, improvement is not much. Herein, some methods are proposed to construct improving estimators which are not scale equivariant and are expected to be considerably better when the true variance value is close to the specified one. The idea behind the methods is to modify improving equivariant shrinkage estimators, so that the resulting ones shrink little when the usual estimate is less than the specified value and shrink much more otherwise. Sufficient conditions are given for the estimators to dominate the best scale and translation equivariant rule under the quadratic loss and the entropy loss. Further, some results of a Monte Carlo experiment are reported which show the significant improvements by the proposed estimators.     

Loss Estimation for Spherically Symmetrical Distributions

In this paper we consider the problem of estimating the quadratic loss of point estimators of a location parameter for a family of spherically symmetric distributions. We compare the unbiased loss estimator of the minimax estimator with a new shrinkage type loss estimator. Conditions on the distributions for the domination of competing estimators are given. It is shown that, in addition to the class of scale mixtures of normal distributions, there exists a more general family for which the domination results hold.     

Estimation of the ratio of the scale parameters of two exponential distributions with unknown location parameters

We consider the estimation of the ratio of the scale parameters of two independent two-parameter exponential distributions with unknown location parameters. It is shown that the best affine equivariant estimator (BAEE) is inadmissible under any loss function from a large class of bowl-shaped loss functions. Two new classes of improved estimators are obtained. Some values of the risk functions of the BAEE and two improved estimators are evaluated for two particular loss functions. Our results are parallel to those of Zidek (1973, Ann. Statist., 1, 264–278), who derived a class of estimators that dominate the BAEE of the scale parameter of a two-parameter exponential distribution.     

On the non existence of unbiased estimators of risk for spherically symmetric distributions

We study existence of unbiased estimators of risk for estimators of the location parameter of a spherically symmetric distribution, when a residual vector is available to estimate scale, under invariant quadratic loss. We show such existence often characterizes normality.     

A Paradox Concerning Shrinkage Estimators: Should a Known Scale Parameter Be Replaced by an Estimated Value in the Shrinkage Factor?

When estimating, under quadratic loss, the location parameterθof a spherically symmetric distribution with known scale parameter, we show that it may be that the common practice of utilizing the residual vector as an estimate of the variance is preferable to using the known value of the variance. In the context of Stein-like shrinkage estimators, we exhibit sufficient conditions on the spherical distributions for which this paradox occurs. In particular, we show that it occurs fort-distributions when the dimension of the residual vector is sufficiently large. The main tools in the development are upper and lower bounds on the risks of the James–Stein estimators which are exact atθ=0.     

Estimation of error variance in ANOVA model and order restricted scale parameters

We consider the estimation of error variance in the analysis of experiments using two level orthogonal arrays. We address the estimator which is the minimum of all the estimators which we obtain by pooling some sums of squares for factorial effects. Under squared error loss, we discuss whether or not this estimator uniformly improves upon the best positive multiple of error sum of squares. We show that when we have two factorial effects, we obtain uniform improvement. However, we show that when we have more than two factorial effects, we cannot necessarily obtain uniform improvement. Further, the above results are applied to the problem of estimating the smallest scale parameter of chi-square distributions.     

Positive shrinkage, improved pretest and absolute penalty estimators in partially linear models

Shrinkage estimators of a partially linear regression parameter vector are constructed by shrinking estimators in the direction of the estimate which is appropriate when the regression parameters are restricted to a linear subspace. We investigate the asymptotic properties of positive Stein-type and improved pretest semiparametric estimators under quadratic loss. Under an asymptotic distributional quadratic risk criterion, their relative dominance picture is explored analytically. It is shown that positive Stein-type semiparametric estimators perform better than the usual Stein-type and least square semiparametric estimators and that an improved pretest semiparametric estimator is superior to the usual pretest semiparametric estimator. We also consider an absolute penalty type estimator for partially linear models and give a Monte Carlo simulation comparisons of positive shrinkage, improved pretest and the absolute penalty type estimators. The comparison shows that the shrinkage method performs better than the absolute penalty type estimation method when the dimension of the parameter space is much larger than that of the linear subspace.     

Improved estimation under Pitman's measure of closeness

Stein-type and Brown-type estimators are constructed for general families of distributions which improve in the sense of Pitman closeness on the closest (in a class) estimator of a parameter. The results concern mainly scale parameters but a brief discussion on improved estimation of location parameters is also included. The loss is a general continuous and strictly bowl shaped function, and the improved estimators presented do not depend on it, i.e., uniform domination is established with respect to the loss. The normal and inverse Gaussian distributions are used as illustrative examples. This work unifies and extends previous relevant results available in the literature.     

Robust Estimation of the Generalized Pareto Distribution

One approach used for analyzing extremes is to fit the excesses over a high threshold by a generalized Pareto distribution. For the estimation of the shape and scale parameters in the generalized Pareto distribution, under some restrictions on the value of the scale parameter, maximum likelihood, method of moments and probability weighted moments' estimators are available. However, these are not robust estimators. In this paper we implement a robust estimation procedure known as the method of medians (He and Fung, 1999) to estimate the parameters in the generalized Pareto distribution. The asymptotic distribution of our estimator is normal for any value of the shape parameter except –1.     

Double shrinkage estimation of ratio of scale parameters

The problems of estimating ratio of scale parameters of two distributions with unknown location parameters are treated from a decision-theoretic point of view. The paper provides the procedures improving on the usual ratio estimator under strictly convex loss functions and the general distributions having monotone likelihood ratio properties. In particular,double shrinkage improved estimators which utilize both of estimators of two location parameters are presented. Under order restrictions on the scale parameters, various improvements for estimation of the ratio and the scale parameters are also considered. These results are applied to normal, lognormal, exponential and pareto distributions. Finally, a multivariate extension is given for ratio of covariance matrices.     

Improvement of estimators in a linear regression problem with random errors in coefficients

Under consideration is the problem of estimating the linear regression parameter in the case when the variances of observations depend on the unknown parameter of the model, while the coefficients (independent variables) are measured with random errors. We propose a new two-step procedure for constructing estimators which guarantees their consistency, find general necessary and sufficient conditions for the asymptotic normality of these estimators, and discuss the case in which these estimators have the minimal asymptotic variance.     

On improved estimation of normal precision matrix and discriminant coefficients

The problem of estimating the precision matrix of a multivariate normal distribution model is considered with respect to a quadratic loss function. A number of covariance estimators originally intended for a variety of loss functions are adapted so as to obtain alternative estimators of the precision matrix. It is shown that the alternative estimators have analytically smaller risks than the unbiased estimator of the precision matrix. Through numerical studies of risk values, it is shown that the new estimators have substantial reduction in risk. In addition, we consider the problem of the estimation of discriminant coefficients, which arises in linear discriminant analysis when Fisher's linear discriminant function is viewed as the posterior log-odds under the assumption that two classes differ in mean but have a common covariance matrix. The above method is also adapted for this problem in order to obtain improved estimators of the discriminant coefficients under the quadratic loss function. Furthermore, a numerical study is undertaken to compare the properties of a collection of alternatives to the “unbiased” estimator of the discriminant coefficients.     

An admissible minimax estimator of a bounded scale-parameter in a subclass of the exponential family under scale-invariant squared-error loss

A subclass of the scale-parameter exponential family is considered and for the rth power of the scale parameter, which is lower bounded, an admissible minimax estimator under scale-invariant squared-error loss is presented. Also, an admissible minimax estimator of a lower-bounded parameter in the family of transformed chi-square distributions is given. These estimators are the pointwise limits of a sequence of Bayes estimators. Some examples are given.     

EMPIRICAL LIKELIHOOD APPROACH FOR LONGITUDINAL DATA WITH MISSING VALUES AND TIME-DEPENDENT COVARIATES

Missing data and time-dependent covariates often arise simultaneously in longitudinal studies, and directly applying classical approaches may result in a loss of efficiency and biased estimates. To deal with this problem, we propose weighted corrected estimating equations under the missing at random mechanism, followed by developing a shrinkage empirical likelihood estimation approach for the parameters of interest when time-dependent covariates are present. Such procedure improves efficiency over generalized estimation equations approach with working independent assumption, via combining the independent estimating equations and the extracted additional information from the estimating equations that are excluded by the independence assumption. The contribution from the remaining estimating equations is weighted according to the likelihood of each equation being a consistent estimating equation and the information it carries. We show that the estimators are asymptotically normally distributed and the empirical likelihood ratio statistic and its profile counterpart follow central chi-square distributions asymptotically when evaluated at the true parameter. The practical performance of our approach is demonstrated through numerical simulations and data analysis.     

Estimating the ratio of two scale parameters: a simple approach

We describe a simple approach for estimating the ratio ρ = σ ₂/σ ₁ of the scale parameters of two populations from a decision theoretic point of view. We show that if the loss function satisfies a certain condition, then the estimation of ρ reduces to separately estimating σ ₂ and 1/σ ₁. This implies that the standard estimator of ρ can be improved by just employing an improved estimator of σ ₂ or 1/σ ₁. Moreover, in the case where the loss function is convex in some function of its argument, we prove that such improved estimators of ρ are further dominated by corresponding ones that use all the available data. Using this result, we construct new classes of double-adjustment improved estimators for several well-known convex as well as non-convex loss functions. In particular, Strawderman-type estimators of ρ in general models are given whereas Shinozaki-type estimators of the ratio of two normal variances are briefly treated.     

Generalized Partially Linear Measurement Error Models

This article considers generalized partially linear models when the linear covariate is measured with additive error. We propose estimators of parameter and nonparametric function by using local linear regression, the SIMEX technique, and generalized estimating equation. The asymptotic normality of the estimators of the parameter, and bias and variance of the estimators of the nonparametric component are derived under appropriate assumptions. In addition, the generalization to clustered measurements is discussed. The approaches are used to the analysis of data from the Framingham Heart Study. A simulation experiment is conducted for an illustration.