A general ratio estimator and its application in model based inference

A general ratio estimator of a population total is proposed as an approximation to the estimator introduced by Srivastava (1985,Bull. Internat. Statist. Inst.,51(10.3), 1–16). This estimator incorporates additional information gathered during the survey in a new way. Statistical properties of the general ratio estimator are given and its relationship to the estimator proposed by Srivastava is explored. A special kind of general ratio estimator is suggested and it turns out to be very efficient in a simulation study when compared to several other commonly used estimators.The work of this author was supported by AFOSR grant #830080.     

A Berry-Esseen theorem for the kernel quantile estimator with application to studying the deficiency of quantile estimators

A Berry-Esseen bound is established for the kernel quantile estimator under various conditions. The results improve an earlier result of Falk (1985,Ann. Statist.,13, 428–433) and rely on the local smoothness of the quantile function. This new Berry-Esseen bound is applied to studying the deficiency of the sample quantile estimator with respect to the kernel quantile estimator. A new result is obtained which is an extension of that in Falk (1985).     

r-k Class estimation in regression model with concomitant variables

We treat with the r-k class estimation in a regression model, which includes the ordinary least squares estimator, the ordinary ridge regression estimator and the principal component regression estimator as special cases of the r-k class estimator. Many papers compared total mean square error of these estimators. Sarkar (1989, Ann. Inst. Statist. Math., 41, 717–724) asserts that the results of this comparison are still valid in a misspecified linear model. We point out some confusions of Sarkar and show additional conditions under which his assertion holds.     

Testing for serial correlation of unknown form in cointegrated time series models

Portmanteau test statistics are useful for checking the adequacy of many time series models. Here we generalized the omnibus procedure proposed by Duchesne and Roy (2004,Journal of Multivariate Analysis,89, 148–180) for multivariate stationary autoregressive models with exogenous variables (VARX) to the case of cointegrated (or partially nonstationary) VARX models. We show that for cointegrated VARX time series, the test statistic obtained by comparing the spectral density of the errors under the null hypothesis of non-correlation with a kernel-based spectral density estimator, is asymptotically standard normal. The parameters of the model can be estimated by conditional maximum likelihood or by asymptotically equivalent estimation procedures. The procedure relies on a truncation point or a smoothing parameter. We state conditions under which the asymptotic distribution of the test statistic is unaffected by a data-dependent method. The finite sample properties of the test statistics are studied via a small simulation study.     

Trimmed minimax estimator of a covariance matrix

Summary In the problem of estimating the covariance matrix of a multivariate normal population, James and Stein (Proc. Fourth Berkeley Symp. Math. Statist. Prob.,1, 361–380, Univ. of California Press) obtained a minimax estimator under a scale invariant loss. In this paper we propose an orthogonally invariant trimmed estimator by solving certain differential inequality involving the eigenvalues of the sample covariance matrix. The estimator obtained, truncates the extreme eigenvalues first and then shrinks the larger and expands the smaller sample eigenvalues. Adaptive version of the trimmed estimator is also discussed. Finally some numerical studies are performed using Monte Carlo simulation method and it is observed that the trimmed estimate shows a substantial improvement over the minimax estimator. The second author's research was supported by NSF Grant Number MCS 82-12968.     

Iterative Estimation of the Extreme Value Index

Let {X_n, n ≥ 1} be a sequence of independent random variables with common continuous distribution function F having finite and unknown upper endpoint. A new iterative estimation procedure for the extreme value index γ is proposed and one implemented iterative estimator is investigated in detail, which is asymptotically as good as the uniform minimum varianced unbiased estimator in an ideal model. Moreover, the superiority of the iterative estimator over its non iterated counterpart in the non asymptotic case is shown in a simulation study.AMS 2000 Subject Classification: 62G32Supported by Swiss National Science foundation.     

Asymptotic theorems for estimating the distribution function under random truncation

Representation theorem and local asymptotic minimax theorem are derived for nonparametric estimators of the distribution function on the basis of randomly truncated data. The convolution-type representation theorem asserts that the limiting process of any regular estimator of the distribution function is at least as dispersed as the limiting process of the product-limit estimator. The theorems are similar to those results for the complete data case due to Beran (1977, Ann. Statist., 5, 400–404) and for the censored data case due to Wellner (1982, Ann. Statist., 10, 595–602). Both likelihood and functional approaches are considered and the proofs rely on the method of Begun et al. (1983, Ann. Statist., 11, 432–452) with slight modifications.Division of Biostatistics, School of Public Health, Columbia Univ.     

Loss of information of a statistic for a family of non-regular distributions

In the non-regular case, the asymptotic loss of amount of information (extended to as Rényi measure) associated with a statistic is discussed. It is shown that the second order asymptotic loss of information in reducing to a statistic consisting of extreme values and an asymptotically ancillary statistic vanishes. This result corresponds to the fact that the statistic is second order asymptotically sufficient in the sense of Akahira (1991, Metron, 49, 133–143). Some examples on truncated distributions are also given.     

Weighted least-squares estimators of parametric functions of the regression coefficients under a general linear model

The weighted least-squares estimator of parametric functions K β under a general linear regression model { y, X b, s²S }{\{ {\bf y},\,{\bf X \beta}, \sigma^2{\bf \Sigma} \}} is defined to be K[^(b)]{{\bf K}{\hat{\bf {\beta}}}}, where [^(b)]{\hat{{\bf \beta}}} is a vector that minimizes (y − X β)′V(y − X β) for a given nonnegative definite weight matrix V. In this paper, we study some algebraic and statistical properties of K[^(b)]{{\bf K}\hat{{\bf \beta}}} and the projection matrix associated with the estimator, such as, their ranks, unbiasedness, uniqueness, as well as equalities satisfied by the projection matrices.     

Test for parameter change based on the estimator minimizing density-based divergence measures

In this paper we consider the problem of testing for a parameter change based on the cusum test proposed by Leeet al. (2003,Scandinavian Journal of Statistics,30, 781–796). The cusum test statistic is constructed via employing the estimator minimizing density-based divergence measures. It is shown that under regularity conditions, the test statistic has the limiting distribution of the sup of standard Brownian bridge. Simulation results demonstrate that the cusum test is robust when outliers exist.     

Closer estimators of a common mean in the sense of Pitman

Consider the problem of estimating the common mean of two normal populations with different unknown variances. Suppose a random sample of sizem is drawn from the first population and a random sample of sizen is drawn from the second population. The paper gives a family of estimators closer than the sample mean of the first population in the sense of Pitman (1937,Proc. Cambridge Phil. Soc.,33, 212–222). In particular, the Graybill-Deal estimator (1959,Biometrics,15, 543–550) is shown to be closer than each of the sample means ifm5 andn5.     

Estimating Functions for Nonlinear Time Series Models

This paper discusses the problem of estimation for two classes of nonlinear models, namely random coefficient autoregressive (RCA) and autoregressive conditional heteroskedasticity (ARCH) models. For the RCA model, first assuming that the nuisance parameters are known we construct an estimator for parameters of interest based on Godambe's asymptotically optimal estimating function. Then, using the conditional least squares (CLS) estimator given by Tjøstheim (1986, Stochastic Process. Appl., 21, 251–273) and classical moment estimators for the nuisance parameters, we propose an estimated version of this estimator. These results are extended to the case of vector parameter. Next, we turn to discuss the problem of estimating the ARCH model with unknown parameter vector. We construct an estimator for parameters of interest based on Godambe's optimal estimator allowing that a part of the estimator depends on unknown parameters. Then, substituting the CLS estimators for the unknown parameters, the estimated version is proposed. Comparisons between the CLS and estimated optimal estimator of the RCA model and between the CLS and estimated version of the ARCH model are given via simulation studies.     

Sequential estimation of a parameter of an exponential distribution

We consider the problem of minimum risk point estimation for the parameter =a+b of the exponential distribution with unknown location parameter and scale parameter when the loss function is squared error plus linear cost. In this paper, we propose a sequential estimator of and show that the associated risk is asymptotically one cost less than that given by Ghosh and Mukhopadhyay (1989,South African Statist. J.,23, 251–268).     

On Adaptive Combination of Regression Estimators

Consider the problem of choosing between two estimators of the regression function, where one estimator is based on stronger assumptions than the other and thus the rates of convergence are different. We propose a linear combination of the estimators where the weights are estimated by Mallows' C _L . The adaptive estimator retains the optimal rates of convergence and is an extension of Stein-type estimators considered by Li and Hwang (1984, Ann. Statist., 12, 887-897) and related to an estimator in Burman and Chaudhuri (1999, Ann. Inst. Statist. Math. (to appear)).     

Minimax estimation of means of multivariate normal mixtures

Assume X = (X₁, …, X_p)′ is a normal mixture distribution with density w.r.t. Lebesgue measure, , where Σ is a known positive definite matrix and F is any known c.d.f. on (0, ∞). Estimation of the mean vector under an arbitrary known quadratic loss function _Q(θ, a) = (a − θ)′ Q(a − θ), Q a positive definite matrix, is considered. An unbiased estimator of risk is obatined for an arbitrary estimator, and a sufficient condition for estimators to be minimax is then achieved. The result is applied to modifying all the Stein estimators for the means of independent normal random variables to be minimax estimators for the problem considered here. In particular the results apply to the Stein class of limited translation estimators.     

Admissibility of estimators of the probability of unobserved outcomes

The problem of estimating the probability of unobserved outcomes or, as it is sometimes called, the conditional probability of a new species, is studied. Good's estimator, which is essentially the same as Robbins' estimator, namely the number of singleton species observed divided by the sample size, is studied from a decision theory point of view. The results obtained are as follows: (1) When the total number of different species is assumed bounded by some known number, Good's and Robbins' estimators are inadmissible for squared error loss. (2) If the number of different species can be infinite, Good's and Robbins' estimators are admissible for squared error loss. (3) Whereas Robbins' estimator is a UMVUE for theunconditional probability of a new species obtained in one extra sample point, Robbins' estimator is not a uniformly minimum mean squared error unbiased estimator of the conditional probability of a new species. This answers a question raised by Robbins. (4) It is shown that for Robbins' model and squared error loss, there are admissible Bayes estimators which do not depend only on a minimal sufficient statistic. A discussion of interpretations and significance of the results is offered. Research supported by NSF Grant DMS-88-22622.     

Delete-group Jackknife Estimate in Partially Linear Regression Models with Heteroscedasticity

Abstract Consider a partially linear regression model with an unknown vector parameter β,an unknownfunction g(.),and unknown heteroscedastic error variances.Chen,You proposed a semiparametric generalizedleast squares estimator(SGLSE)for β,which takes the heteroscedasticity into account to increase efficiency.Forinference based on this SGLSE,it is necessary to construct a consistent estimator for its asymptotic covariancematrix.However,when there exists within-group correlation, the traditional delta method and the delete-1jackknife estimation fail to offer such a consistent estimator.In this paper, by deleting grouped partial residualsa delete-group jackknife method is examined.It is shown that the delete-group jackknife method indeed canprovide a consistent estimator for the asymptotic covariance matrix in the presence of within-group correlations.This result is an extension of that in[21].     

Asymptotics of Huber-Dutter Estimators for Partial Linear Model with Nonstochastic Designs

For partial linear model Y=X~τβ_0 _(g0)(T) εwith unknown β_0∈R~d and an unknown smooth function go, this paper considers the Huber-Dutter estimators of β_0, scale σfor the errors and the function go respectively, in which the smoothing B-spline function is used. Under some regular conditions, it is shown that the Huber-Dutter estimators of β_0 and σare asymptotically normal with convergence rate n~((-1)/2) and the B-spline Huber-Dutter estimator of go achieves the optimal convergence rate in nonparametric regression. A simulation study demonstrates that the Huber-Dutter estimator of β_0 is competitive with its M-estimator without scale parameter and the ordinary least square estimator. An example is presented after the simulation study.     

Kullback-Leibler Information Consistent Estimation for Censored Data

This paper is intended as an investigation of parametric estimation for the randomly right censored data. In parametric estimation, the Kullback-Leibler information is used as a measure of the divergence of a true distribution generating a data relative to a distribution in an assumed parametric model M. When the data is uncensored, maximum likelihood estimator (MLE) is a consistent estimator of minimizing the Kullback-Leibler information, even if the assumed model M does not contain the true distribution. We call this property minimum Kullback-Leibler information consistency (MKLI-consistency). However, the MLE obtained by maximizing the likelihood function based on the censored data is not MKLI-consistent. As an alternative to the MLE, Oakes (1986, Biometrics, 42, 177–182) proposed an estimator termed approximate maximum likelihood estimator (AMLE) due to its computational advantage and potential for robustness. We show MKLI-consistency and asymptotic normality of the AMLE under the misspecification of the parametric model. In a simulation study, we investigate mean square errors of these two estimators and an estimator which is obtained by treating a jackknife corrected Kaplan-Meier integral as the log-likelihood. On the basis of the simulation results and the asymptotic results, we discuss comparison among these estimators. We also derive information criteria for the MLE and the AMLE under censorship, and which can be used not only for selecting models but also for selecting estimation procedures.     

Equilibrated error estimators for discontinuous Galerkin methods

We consider some diffusion problems in domains of ?^d, d = 2 or 3 approximated by a discontinuous Galerkin method with polynomials of any degree. We propose a new a posteriori error estimator based on H(div)‐conforming elements. It is shown that this estimator gives rise to an upper bound where the constant is one up to higher order terms. The lower bound is also established with a constant depending on the aspect ratio of the mesh, the dependence with respect to the coefficients being also traced. The reliability and efficiency of the proposed estimator is confirmed by some numerical tests. © 2007 Wiley Periodicals, Inc. Numer Methods Partial Differential Eq, 2008