Wavelet estimation of conditional density with truncated, censored and dependent data

In this paper we define a new nonlinear wavelet-based estimator of conditional density function for a random left truncation and right censoring model. We provide an asymptotic expression for the mean integrated squared error (MISE) of the estimator. It is assumed that the lifetime observations form a stationary α-mixing sequence. Unlike for kernel estimators, the MISE expression of the wavelet-based estimators is not affected by the presence of discontinuities in the curves. Also, asymptotic normality of the estimator is established.     

On estimation of survival function under random censoring model

We study an estimator of the survival function under the random censoring model. Bahadur-type representation of the estimator is obtained and asymptotic expression for its mean squared errors is given, which leads to the consistency and asymptotic normality of the estimator. A data-driven local bandwidth selection rule for the estimator is proposed. It is worth noting that the estimator is consistent at left boundary points, which contrasts with the cases of density and hazard rate estimation. A Monte Carlo comparison of different estimators is made and it appears that the proposed data-driven estimators have certain advantages over the common Kaplan-Meier estmator.     

Density Estimation with Replicate Heteroscedastic Measurements

We present a deconvolution estimator for the density function of a random variable from a set of independent replicate measurements. We assume that measurements are made with normally distributed errors having unknown and possibly heterogeneous variances. The estimator generalizes well-known deconvoluting kernel density estimators, with error variances estimated from the replicate observations. We derive expressions for the integrated mean squared error and examine its rate of convergence as n → ∞ and the number of replicates is fixed. We investigate the finite-sample performance of the estimator through a simulation study and an application to real data.     

Locally adaptive hazard smoothing

Summary We consider nonparametric estimation of hazard functions and their derivatives under random censorship, based on kernel smoothing of the Nelson (1972) estimator. One critically important ingredient for smoothing methods is the choice of an appropriate bandwidth. Since local variance of these estimates depends on the point where the hazard function is estimated and the bandwidth determines the trade-off between local variance and local bias, data-based local bandwidth choice is proposed. A general principle for obtaining asymptotically efficient data-based local bandwiths, is obtained by means of weak convergence of a local bandwidth process to a Gaussian limit process. Several specific asymptotically efficient bandwidth estimators are discussed. We propose in particular an, asymptotically efficient method derived from direct pilot estimators of the hazard function and of the local mean squared error. This bandwidth choice method has practical advantages and is also of interest in the uncensored case as well as for density estimation.Research supported by UC Davis Faculty Research Grant and by Air Force grant AFOSR-89-0386Research supported by Air Force grant AFOSR-89-0386     

Second-order nonlinear least squares estimation

The ordinary least squares estimation is based on minimization of the squared distance of the response variable to its conditional mean given the predictor variable. We extend this method by including in the criterion function the distance of the squared response variable to its second conditional moment. It is shown that this “second-order” least squares estimator is asymptotically more efficient than the ordinary least squares estimator if the third moment of the random error is nonzero, and both estimators have the same asymptotic covariance matrix if the error distribution is symmetric. Simulation studies show that the variance reduction of the new estimator can be as high as 50% for sample sizes lower than 100. As a by-product, the joint asymptotic covariance matrix of the ordinary least squares estimators for the regression parameter and for the random error variance is also derived, which is only available in the literature for very special cases, e.g. that random error has a normal distribution. The results apply to both linear and nonlinear regression models, where the random error distributions are not necessarily known.     

Pre-averaged kernel estimators for the drift function of a diffusion process in the presence of microstructure noise

We consider estimation of the drift function of a stationary diffusion process when we observe high-frequency data with microstructure noise over a long time interval. We propose to estimate the drift function at a point by a Nadaraya–Watson estimator that uses observations that have been pre-averaged to reduce the noise. We give conditions under which our estimator is consistent and asympotically normal. Its rate and asymptotic bias and variance are the same as those without microstructure noise. To use our method in data analysis, we propose a data-based cross-validation method to determine the bandwidth in the Nadaraya–Watson estimator. Via simulation, we study several methods of bandwidth choices, and compare our estimator to several existing estimators. In terms of mean squared error, our new estimator outperforms existing estimators.     

Properties of nonparametric estimators of autocovariance for stationary random fields

Summary We introduce nonparametric estimators of the autocovariance of a stationary random field. One of our estimators has the property that it is itself an autocovatiance. This feature enables the estimator to be used as the basis of simulation studies such as those which are necessary when constructing bootstrap confidence intervals for unknown parameters. Unlike estimators proposed recently by other authors, our own do not require assumptions such as isotropy or monotonicity. Indeed, like nonparametric function estimators considered more widely in the context of curve estimation, our approach demands only smoothness and tail conditions on the underlying curve or surface (here, the autocovariance), and moment and mixing conditions on the random field. We show that by imposing the condition that the estimator be a covariance function we actually reduce the numerical value of integrated squared error.     

Integrated squared error of kernel-type estimator of distribution function

Let X ₁ ,...,X _n be a random sample drawn from distribution function F(x) with density function f(x) and suppose we want to estimate X(x). It is already shown that kernel estimator of F(x) is better than usual empirical distribution function in the sense of mean integrated squared error. In this paper we derive integrated squared error of kernel estimator and compare the error with that of the empirical distribution function. It is shown that the superiority of kernel estimators is not necessarily true in the sense of integrated squared error.     

Operational Variants of the Minimum Mean Squared Error Estimator in Linear Regression Models with Non-Spherical Disturbances

There is a good deal of literature that investigates the properties of various operational variants of Theil's (1971, Principles of Econometrics, Wiley, New York) minimum mean squared error estimator. It is interesting that virtually all of the existing analysis to date is based on the premise that the model's disturbances are i.i.d., an assumption which is not satisfied in many practical situations. In this paper, we consider a model with non-spherical errors and derive the asymptotic distribution, bias and mean squared error of a general class of feasible minimum mean squared error estimators. A Monte-Carlo experiment is conducted to examine the performance of this class of estimators in finite samples.     

Comparative Analysis of Cubic Spline and Kernel Estimation of a Probit Function

The least-squares cubic spline and the kernel estimators produce comparable mean squared errors, although the kernel produces smaller mean squared errors when the variable increases away from 0. Mean squared error increases with an increase in the number of knots (for the cubic spline) or reduced band width (for the kernel estimator). The cubic spline produces smaller mean squared errors when all observations are made at knots than when they are spaced out between knots. Irrespective of the exact form of the probit function g(x), the cubic spline estimator is asymptotically unbiased, while the kernel estimator only converges to g(x) under certain conditions. Moreover, the cubic spline is a smooth function, which is twice differentiable on the interval [0,1].     

Maximum integrated likelihood estimator of the interest parameter when the nuisance parameter is location or scale

The problem of estimation of an interest parameter in the presence of a nuisance parameter, which is either location or scale, is studied. Two estimators are considered: the usual maximum likelihood estimator and the estimator based on maximization of the integrated likelihood function. The estimators are compared, asymptotically, with respect to the bias and with respect to the mean squared error. The examples are given.     

������̬��٤���������̬�ֲ��еķ��������Stein��ʧ�µı�Ҷ˹���������

or the variance parameter of the normal distribution with a normal-inverse-gamma prior, we analytically calculate the Bayes posterior estimator with respect to a conjugate normal-inverse-gamma prior distribution under Stein's loss function. This estimator minimizes the Posterior Expected Stein's Loss (PESL). We also analytically calculate the Bayes posterior estimator and the PESL under the squared error loss function. The numerical simulations exemplify our theoretical studies that the PESLs do not depend on the sample, and that the Bayes posterior estimator and the PESL under the squared error loss function are unanimously larger than those under Stein's loss function. Finally, we calculate the Bayes posterior estimators and the PESLs of the monthly simple returns of the SSE Composite Index.     

Multivariate Hazard Rates under Random Censorship

The data consists of multivariate failure times under right random censorship. By the kernel smoothing technique, convolutions of cumulative multivariate hazard functions suggest estimators of the so-called multivariate hazard functions. We establish strong i.i.d. representations and uniform bounds of the remainder terms on some compact sets of the underlying space. Thus asymptotic normality and uniform consistency on such sets are obtained. The asymptotic mean squared error gives an optimal bandwidth by the plug-in method. Simulations assess the performance of our estimators.     

A family of estimators for multivariate kurtosis in a nonnormal linear regression model

In this paper, we propose a new estimator for a kurtosis in a multivariate nonnormal linear regression model. Usually, an estimator is constructed from an arithmetic mean of the second power of the squared sample Mahalanobis distances between observations and their estimated values. The estimator gives an underestimation and has a large bias, even if the sample size is not small. We replace this squared distance with a transformed squared norm of the Studentized residual using a monotonic increasing function. Our proposed estimator is defined by an arithmetic mean of the second power of these squared transformed squared norms with a correction term and a tuning parameter. The correction term adjusts our estimator to an unbiased estimator under normality, and the tuning parameter controls the sizes of the squared norms of the residuals. The family of our estimators includes estimators based on ordinary least squares and predicted residuals. We verify that the bias of our new estimator is smaller than usual by constructing numerical experiments.     

Probability density estimation with surrogate data and validation sample

The probability density estimation problem with surrogate data and validation sample is considered. A regression calibration kernel density estimator is defined to incorporate the information contained in both surrogate variates and validation sample. Also, we define two weighted estimators which have less asymptotic variances but have bigger biases than the regression calibration kernel density estimator. All the proposed estimators are proved to be asymptotically normal. And the asymptotic representations for the mean squared error and mean integrated square error of the proposed estimators are established, respectively. A simulation study is conducted to compare the finite sample behaviors of the proposed estimators.     

On the Accuracy of Binned Kernel Density Estimators

The accuracy of the binned kernel density estimator is studied for general binning rules. We derive mean squared error results for the closeness of this estimator to both the true density and the unbinned kernel estimator. The binning rule and smoothness of the kernel function are shown to influence the accuracy of the binned kernel estimators. Our results are used to compare commonly used binning rules, and to determine the minimum grid size required to obtain a given level of accuracy.     

Bidimensional random effect estimation in mixed stochastic differential model

In this work, a mixed stochastic differential model is studied with two random effects in the drift. We assume that N trajectories are continuously observed throughout a large time interval [0, T]. Two directions are investigated. First we estimate the random effects from one trajectory and give a bound of the \(L^2\)-risk of the estimators. Secondly, we build a nonparametric estimator of the common bivariate density of the random effects. The mean integrated squared error is studied. The performances of the density estimator are illustrated on simulations.     

IMPROVED ESTIMATES OF THE COVARIANCE MATRIX IN GENERAL LINEAR MIXED MODELS

In this article, the problem of estimating the covariance matrix in general linear mixed models is considered. Two new classes of estimators obtained by shrinking the eigenvalues towards the origin and the arithmetic mean, respectively, are proposed. It is shown that these new estimators dominate the unbiased estimator under the squared error loss function. Finally, some simulation results to compare the performance of the proposed estimators with that of the unbiased estimator are reported. The simulation results indicate that these new shrinkage estimators provide a substantial improvement in risk under most situations.     

Reduced‐bias kernel estimators of a positive extreme value index

In this paper, we deal with the semi‐parametric estimation of the extreme value index, an important parameter in extreme value analysis. It is well known that many classic estimators, such as the Hill estimator, reveal a strong bias. This problem motivated the study of two classes of kernel estimators. Those classes generalize the classical Hill estimator and have a tuning parameter that enables us to modify the asymptotic mean squared error and eventually to improve their efficiency. Since the improvement in efficiency is not very expressive, we also study new reduced bias estimators based on the two classes of kernel statistics. Under suitable conditions, we prove their asymptotic normality. Moreover, an asymptotic comparison, at optimal levels, shows that the new classes of reduced bias estimators are more efficient than other reduced bias estimator from the literature. An illustration of the finite sample behaviour of the kernel reduced‐bias estimators is also provided through the analysis of a data set in the field of insurance.     

Robust Wavelet-Domain Estimation of the Fractional Difference Parameter in Heavy-Tailed Time Series: An Empirical Study

We investigate the performance of several wavelet-based estimators of the fractional difference parameter. We consider situations where, in addition to long-range dependence, the time series exhibit heavy tails and are perturbed by polynomial and change-point trends. We make detailed study of a wavelet-domain pseudo Maximum Likelihood Estimator (MLE), for which we provide an asymptotic and finite-sample justification. Using numerical experiments, we show that unlike the traditional time-domain estimators, estimators based on the wavelet transform are robust to additive trends and change points in mean, and produce accurate estimates even under significant departures from normality. The Wavelet-domain MLE appears to dominate a regression-based wavelet estimator in terms of smaller root mean squared error. These findings are derived from a simulation study and application to computer traffic traces.