Nonlinear wavelet density estimation with censored dependent data

In this paper, we provide an asymptotic expansion for the mean integrated squared error (MISE) of nonlinear wavelet estimator of survival density for a censorship model when the data exhibit some kind of dependence. It is assumed that the observations form a stationary and α‐mixing sequence. This asymptotic MISE expansion, when the density is only piecewise smooth, is same. However, for the kernel estimators, the MISE expansion fails if the additional smoothness assumption is absent. Also, we establish the asymptotic normality of the nonlinear wavelet estimator. Copyright © 2011 John Wiley & Sons, Ltd.     

Distribution asymptotique de l'affinité L2 de densités gaussiennes

After recalling the L² affinity measure between two multidimensionnal Gaussian density functions, we prove its asymptotic normality when parameters of one density are replaced by their maximum likelihood estimators. We extend this result to the vectorial case and we use it to allocate an estimated density to a class of densities as does the discriminant analysis method. As an application, a dating method for archeological data is proposed.     

Semiparametric analysis based on weighted estimating equations for transformation models with missing covariates

Missing covariate data are very common in regression analysis. In this paper, the weighted estimating equation method (Qi et al., 2005) [25] is used to extend the so-called unified estimation procedure (Chen et al., 2002) [4] for linear transformation models to the case of missing covariates. The non-missingness probability is estimated nonparametrically by the kernel smoothing technique. Under missing at random, the proposed estimators are shown to be consistent and asymptotically normal, with the asymptotic variance estimated consistently by the usual plug-in method. Moreover, the proposed estimators are more efficient than the weighted estimators with the inverse of true non-missingness probability as weight. Finite sample performance of the estimators is examined via simulation and a real dataset is analyzed to illustrate the proposed methods.     

On estimating distribution functions using Bernstein polynomials

It is a known fact that some estimators of smooth distribution functions can outperform the empirical distribution function in terms of asymptotic (integrated) mean-squared error. In this paper, we show that this is also true of Bernstein polynomial estimators of distribution functions associated with densities that are supported on a closed interval. Specifically, we introduce a higher order expansion for the asymptotic (integrated) mean-squared error of Bernstein estimators of distribution functions and examine the relative deficiency of the empirical distribution function with respect to these estimators. Finally, we also establish the (pointwise) asymptotic normality of these estimators and show that they have highly advantageous boundary properties, including the absence of boundary bias.     

Positive shrinkage, improved pretest and absolute penalty estimators in partially linear models

Shrinkage estimators of a partially linear regression parameter vector are constructed by shrinking estimators in the direction of the estimate which is appropriate when the regression parameters are restricted to a linear subspace. We investigate the asymptotic properties of positive Stein-type and improved pretest semiparametric estimators under quadratic loss. Under an asymptotic distributional quadratic risk criterion, their relative dominance picture is explored analytically. It is shown that positive Stein-type semiparametric estimators perform better than the usual Stein-type and least square semiparametric estimators and that an improved pretest semiparametric estimator is superior to the usual pretest semiparametric estimator. We also consider an absolute penalty type estimator for partially linear models and give a Monte Carlo simulation comparisons of positive shrinkage, improved pretest and the absolute penalty type estimators. The comparison shows that the shrinkage method performs better than the absolute penalty type estimation method when the dimension of the parameter space is much larger than that of the linear subspace.     

Reducing component estimation for varying coefficient models with longitudinal data

Varying-coefficient models with longitudinal observations are very useful in epidemiology and some other practical fields.In this paper,a reducing component procedure is proposed for es- timating the unknown functions and their derivatives in very general models,in which the unknown coefficient functions admit different or the same degrees of smoothness and the covariates can be time- dependent.The asymptotic properties of the estimators,such as consistency,rate of convergence and asymptotic distribution,are derived.The asymptotic results show that the asymptotic variance of the reducing component estimators is smaller than that of the existing estimators when the coefficient functions admit different degrees of smoothness.Finite sample properties of our procedures are studied through Monte Carlo simulations.     

On nonlinear TAR processes and threshold estimation

We consider the problem of threshold estimation for autoregressive time series with a ??space switching?? in the situation when the regression is nonlinear and the innovations have a smooth, possibly non-Gaussian, probability density. Assuming that the unknown threshold parameter is sampled from a continuous positive prior density, we find the asymptotic distribution of the Bayes estimator. As is usual in the singular estimation problems, the sequence of Bayes estimators is asymptotically efficient, attaining the minimax risk lower bound.     

Inference for ordered parameters in multinomial distributions

This paper discusses inference for ordered parameters of multinomial distributions. We first show that the asymptotic distributions of their maximum likelihood estimators (MLEs) are not always normal and the bootstrap distribution estimators of the MLEs can be inconsistent. Then a class of weighted sum estimators (WSEs) of the ordered parameters is proposed. Properties of the WSEs are studied, including their asymptotic normality. Based on those results, large sample inferences for smooth functions of the ordered parameters can be made. Especially, the confidence intervals of the maximum cell probabilities are constructed. Simulation results indicate that this interval estimation performs much better than the bootstrap approaches in the literature. Finally, the above results for ordered parameters of multinomial distributions are extended to more general distribution models. This work was supported by National Natural Science Foundation of China (Grant No. 10371126)     

强相关数据回归函数的小波估计

讨论了在强相关数据情形下对回归函数的小波估计,并且给出了估计量的均方误差的一个渐近展开表示式． 对研究估计量的优劣,所推导的近似表示式显得非常重要．对一般的回归函数核估计,如果回归函数不是充分光滑,这个均方误差表示式并不成立A·D2但对小波估计,即使回归函数间断连续,这个均方误差表示式仍然成立．因此,小波估计的收敛速度要比核估计来得快,从而小波估计在某种程度上改进了现有的核估计．     

Probability density estimation with surrogate data and validation sample

The probability density estimation problem with surrogate data and validation sample is considered. A regression calibration kernel density estimator is defined to incorporate the information contained in both surrogate variates and validation sample. Also, we define two weighted estimators which have less asymptotic variances but have bigger biases than the regression calibration kernel density estimator. All the proposed estimators are proved to be asymptotically normal. And the asymptotic representations for the mean squared error and mean integrated square error of the proposed estimators are established, respectively. A simulation study is conducted to compare the finite sample behaviors of the proposed estimators.     

Asymptotic variance of grey-scale surface area estimators

Grey-scale local algorithms have been suggested as a fast way of estimating surface area from grey-scale digital images. Their asymptotic mean has already been described. In this paper, the asymptotic behavior of the variance is studied in isotropic and sufficiently smooth settings, resulting in a general asymptotic bound. For compact convex sets with nowhere vanishing Gaussian curvature, the asymptotics can be described more explicitly. As in the case of volume estimators, the variance is decomposed into a lattice sum and an oscillating term of at most the same magnitude.     

Asymptotic representations for importance-sampling estimators of value-at-risk and conditional value-at-risk

Value-at-risk (VaR) and conditional value-at-risk (CVaR) are important risk measures. They are often estimated by using importance-sampling (IS) techniques. In this paper, we derive the asymptotic representations for IS estimators of VaR and CVaR. Based on these representations, we are able to prove the consistency and asymptotic normality of the estimators and to provide simple conditions under which the IS estimators have smaller asymptotic variances than the ordinary Monte Carlo estimators.     

Estimating cumulative incidence functions when the life distributions are constrained

In competing risks studies, the Kaplan-Meier estimators of the distribution functions (DFs) of lifetimes and the corresponding estimators of cumulative incidence functions (CIFs) are used widely when no prior information is available for these distributions. In some cases better estimators of the DFs of lifetimes are available when they obey some inequality constraints, e.g., if two lifetimes are stochastically or uniformly stochastically ordered, or some functional of a DF obeys an inequality in an empirical likelihood estimation procedure. If the restricted estimator of a lifetime differs from the unrestricted one, then the usual estimators of the CIFs will not add up to the lifetime estimator. In this paper we show how to estimate the CIFs in this case. These estimators are shown to be strongly uniformly consistent. In all cases we consider, when the inequality constraints are strict the asymptotic properties of the restricted and the unrestricted estimators are the same, thus providing the asymptotic properties of the restricted estimators essentially “free of charge”. We give an example to illustrate our procedure.     

Partially smooth tail-index estimation for small samples

Small samples are a challenge in extreme value theory. Asymptotic results do not apply and many estimation techniques, e.g. maximum likelihood, are unstable. In such situations, imposing qualitative constraints on the empirical distribution function is known to greatly reduce variability. Distribution functions typically appearing in the extreme-value theory, e.g. the generalized extreme-value distribution or the generalized Pareto distribution, have monotone upper tails. Applying monotone density estimation to parts of initial kernel density estimators leads to partially smooth estimated distribution functions. Particularly in small samples, replacing the order statistics in tail-index estimators by their corresponding quantiles from partially smooth estimated distribution functions leads to improved tail-index estimators. Monte Carlo simulations demonstrate that the partially smoothed version of the estimators are well superior to their non-smoothed counterparts, in terms of mean-squared error.     

Importance sampling correction versus standard averages of reversible MCMCs in terms of the asymptotic variance

We establish an ordering criterion for the asymptotic variances of two consistent Markov chain Monte Carlo (MCMC) estimators: an importance sampling (IS) estimator, based on an approximate reversible chain and subsequent IS weighting, and a standard MCMC estimator, based on an exact reversible chain. Essentially, we relax the criterion of the Peskun type covariance ordering by considering two different invariant probabilities, and obtain, in place of a strict ordering of asymptotic variances, a bound of the asymptotic variance of IS by that of the direct MCMC. Simple examples show that IS can have arbitrarily better or worse asymptotic variance than Metropolis–Hastings and delayed-acceptance (DA) MCMC. Our ordering implies that IS is guaranteed to be competitive up to a factor depending on the supremum of the (marginal) IS weight. We elaborate upon the criterion in case of unbiased estimators as part of an auxiliary variable framework. We show how the criterion implies asymptotic variance guarantees for IS in terms of pseudo-marginal (PM) and DA corrections, essentially if the ratio of exact and approximate likelihoods is bounded. We also show that convergence of the IS chain can be less affected by unbounded high-variance unbiased estimators than PM and DA chains.     

Asymptotic properties of computationally efficient alternative estimators for a class of multivariate normal models

Parameters of Gaussian multivariate models are often estimated using the maximum likelihood approach. In spite of its merits, this methodology is not practical when the sample size is very large, as, for example, in the case of massive georeferenced data sets. In this paper, we study the asymptotic properties of the estimators that minimize three alternatives to the likelihood function, designed to increase the computational efficiency. This is achieved by applying the information sandwich technique to expansions of the pseudo-likelihood functions as quadratic forms of independent normal random variables. Theoretical calculations are given for a first-order autoregressive time series and then extended to a two-dimensional autoregressive process on a lattice. We compare the efficiency of the three estimators to that of the maximum likelihood estimator as well as among themselves, using numerical calculations of the theoretical results and simulations.     

Multivariate density estimation using dimension reducing information and tail flattening transformations for truncated or censored data

This paper introduces a multivariate density estimator for truncated and censored data with special emphasis on extreme values based on survival analysis. A local constant density estimator is considered. We extend this estimator by means of tail flattening transformation, dimension reducing prior knowledge and a combination of both. The asymptotic theory is derived for the proposed estimators. It shows that the extensions might improve the performance of the density estimator when the transformation and the prior knowledge is not too far away from the true distribution. A simulation study shows that the density estimator based on tail flattening transformation and prior knowledge substantially outperforms the one without prior knowledge, and therefore confirms the asymptotic results. The proposed estimators are illustrated and compared in a data study of fire insurance claims.     

Asymptotic approximation of kernel-type estimators with its application

Sufficient conditions are given under which a generalized class of kernel-type estimators allows asymptotic approximation on the modulus of continuity. This generalized class includes sample distribution function, kernel-type estimator of density function, and an estimator that may apply to the censored case. In addition, an application is given to asymptotic normality of recursive density estimators of density function at an unknown point.     

Reduced‐bias kernel estimators of a positive extreme value index

In this paper, we deal with the semi‐parametric estimation of the extreme value index, an important parameter in extreme value analysis. It is well known that many classic estimators, such as the Hill estimator, reveal a strong bias. This problem motivated the study of two classes of kernel estimators. Those classes generalize the classical Hill estimator and have a tuning parameter that enables us to modify the asymptotic mean squared error and eventually to improve their efficiency. Since the improvement in efficiency is not very expressive, we also study new reduced bias estimators based on the two classes of kernel statistics. Under suitable conditions, we prove their asymptotic normality. Moreover, an asymptotic comparison, at optimal levels, shows that the new classes of reduced bias estimators are more efficient than other reduced bias estimator from the literature. An illustration of the finite sample behaviour of the kernel reduced‐bias estimators is also provided through the analysis of a data set in the field of insurance.