Root-<Emphasis Type="Italic">n</Emphasis> consistency in weighted <Emphasis Type="Italic">L</Emphasis><Subscript>1</Subscript>-spaces for density estimators of invertible linear processes

The stationary density of an invertible linear processes can be estimated at the parametric rate by a convolution of residual-based kernel estimators. We have shown elsewhere that the convergence is uniform and that a functional central limit theorem holds in the space of continuous functions vanishing at infinity. Here we show that analogous results hold in weighted L ₁-spaces. We do not require smoothness of the innovation density.      

Some statistical properties of the kernel-diffeomorphism estimator

The kernel density estimation method is not so attractive when the density has its support confined to a bounded space U of R^d. In a recent paper, we suggested a new nonparametric probability density function (p.d.f.) estimator called the ‘kernel-diffeomorphism estimator’, which suppressed border convergence difficulties by using an appropriate regular change of variable. The present paper gives more asymptotic theory (uniform consistency, normality). An invariance criterion for p.d.f. estimators is discussed. The invariance of the kernel diffeomorphism estimator under special affine motion (a translation followed by any member of the special linear group SL(d, R) is proved. © 1997 by John Wiley & Sons, Ltd.     

A characterization of limiting distributions of estimators in an autoregressive process

Summary Let the random variablesX ₁,X ₂, ...,X _n be generated by the first-order autoregressive modelX _i =θX _i−1 +e _i wheree _i ,i=1, 2, ...,n, are i.i.d. random variables with mean zero, variance σ², and with unspecified density functiong(·). In the present paper we obtain a characterization of limiting distributions of nonparametric and parametric estimators of θ as well as a local asymptotic minimax bound of the risks of estimators.     

Probability Density Function Estimation Using Gamma Kernels

We consider estimating density functions which have support on [0, ) using some gamma probability densities as kernels to replace the fixed and symmetric kernel used in the standard kernel density estimator. The gamma kernels are non-negative and have naturally varying shape. The gamma kernel estimators are free of boundary bias, non-negative and achieve the optimal rate of convergence for the mean integrated squared error. The variance of the gamma kernel estimators at a distance x away from the origin is O(n ^–4/5 x ^–1/2) indicating a smaller variance as x increases. Finite sample comparisons with other boundary bias free kernel estimators are made via simulation to evaluate the performance of the gamma kernel estimators.     

The normal approximation rate for the drift estimator of multidimensional diffusions

We consider the problem of the density and drift estimation by the observation of a trajectory of an \mathbbR^d{\mathbb{R}^{d}}-dimensional homogeneous diffusion process with a unique invariant density. We construct estimators of the kernel type based on discretely sampled observations and study their asymptotic distribution. An estimate of the rate of normal approximation is given.     

A Note on Asymptotic Normality of Kernel Estimation for Linear Random Fields on <Emphasis Type="Italic">Z</Emphasis><Superscript>2</Superscript>

This note considers the kernel estimation of a linear random field on Z ². Instead of imposing certain mixing conditions on the random fields, it is assumed that the weights of the innovations satisfy a summability property. By building a martingale decomposition based on a suitable filtration, asymptotic normality is proven for the kernel estimator of the marginal density of the random field. T.-L. Cheng’s research is supported in part by NSC 94-2118-M-018-001, Taiwan. Also, he is indebted to Department of Mathematics and Statistics, University of Calgary, for their hospitality during his visit. X. Lu’s research is supported in part by NSERC Discovery Grant of Canada.     

Nonparametric Density Estimation for a Long-Range Dependent Linear Process

We estimate the marginal density function of a long-range dependent linear process by the kernel estimator. We assume the innovations are i.i.d. Then it is known that the term of the sample mean is dominant in the MISE of the kernel density estimator when the dependence is beyond some level which depends on the bandwidth and that the MISE has asymptotically the same form as for i.i.d. observations when the dependence is below the level. We call the latter the case where the dependence is not very strong and focus on it in this paper. We show that the asymptotic distribution of the kernel density estimator is the same as for i.i.d. observations and the effect of long-range dependence does not appear. In addition we describe some results for weakly dependent linear processes.     

Consistency of kernel density estimators for causal processes

Using the blocking techniques and m-dependent methods,the asymptotic behavior of kernel density estimators for a class of stationary processes,which includes some nonlinear time series models,is investigated.First,the pointwise and uniformly weak convergence rates of the deviation of kernel density estimator with respect to its mean(and the true density function)are derived.Secondly,the corresponding strong convergence rates are investigated.It is showed,under mild conditions on the kernel functions and bandwidths,that the optimal rates for the i.i.d.density models are also optimal for these processes.     

Asymptotic expansions and higher order properties of semi-parametric estimators in a system of simultaneous equations

Asymptotic expansions are made for the distributions of the Maximum Empirical Likelihood (MEL) estimator and the Estimating Equation (EE) estimator (or the Generalized Method of Moments (GMM) in econometrics) for the coefficients of a single structural equation in a system of linear simultaneous equations, which corresponds to a reduced rank regression model. The expansions in terms of the sample size, when the non-centrality parameters increase proportionally, are carried out to O(n⁻¹). Comparisons of the distributions of the MEL and GMM estimators are made. Also, we relate the asymptotic expansions of the distributions of the MEL and GMM estimators to the corresponding expansions for the Limited Information Maximum Likelihood (LIML) and the Two-Stage Least Squares (TSLS) estimators. We give useful information on the higher order properties of alternative estimators including the semi-parametric inefficiency factor under the homoscedasticity assumption.     

A two-stage rank test using density estimation

For the one-sample problem, a two-stage rank test is derived which realizes a required power against a given local alternative, for all sufficiently smooth underlying distributions. This is achieved using asymptotic expansions resulting in a precision of orderm ^–1, wherem is the size of the first sample. The size of the second sample is derived through a number of estimators of e. g. integrated squared densities and density derivatives, all based on the first sample. The resulting procedure can be viewed as a nonparametric analogue of the classical Stein's two-stage procedure, which uses at-test and assumes normality for the underlying distribution. The present approach also generalizes earlier work which extended the classical method to parametric families of distributions.     

A Monte Carlo Estimation of the Entropy for Markov Chains

We introduce an estimate of the entropy of the marginal density p ^t of a (eventually inhomogeneous) Markov chain at time t≥1. This estimate is based on a double Monte Carlo integration over simulated i.i.d. copies of the Markov chain, whose transition density kernel is supposed to be known. The technique is extended to compute the external entropy , where the p ₁ ^t s are the successive marginal densities of another Markov process at time t. We prove, under mild conditions, weak consistency and asymptotic normality of both estimators. The strong consistency is also obtained under stronger assumptions. These estimators can be used to study by simulation the convergence of p ^t to its stationary distribution. Potential applications for this work are presented: (1) a diagnostic by simulation of the stability property of a Markovian dynamical system with respect to various initial conditions; (2) a study of the rate in the Central Limit Theorem for i.i.d. random variables. Simulated examples are provided as illustration.      

On Distribution of Error of Linear Wavelet Estimator of Probability Density

We establish the asymptotic normality of the squared L ²-norm of the approximation error of a linear wavelet estimator of the density of a distribution. The calculations are based on the smallness of correlations between the coefficients of the high-frequency part of the multiresolution expansion of the estimator.Supported by the FCT Foundation (Portugal) in the framework of the project Probability and Statistics (2000–2002), Centro de Matematica, Universidade da Beira Interior.__________Translated from Lietuvos Matematikos Rinkinys, Vol. 45, No. 2, pp. 184–207, April–June, 2005.     

THE ASYMPTOTICALLY OPTIMAL EMPIRICAL BAYES ESTIMATION IN MULTIPLE LINEAR REGRESSION MODEL

ＴＨＥＡＳＹＭＰＴＯＴＩＣＡＬＬＹＯＰＴＩＭＡＬＥＭＰＩＲＩＣＡＬＢＡＹＥＳＥＳＴＩＭＡＴＩＯＮＩＮＭＵＬＴＩＰＬＥＬＩＮＥＡＲＲＥＧＲＥＳＳＩＯＮＭＯＤＥＬ￥ＺＨＡＮＧＳＨＵＮＰＵ；ＷＥＩＬＡＩＳＨＥＮＧ（ＤｅｐａｒｔｍｅｎｔｏｆＭａｔｈｅｍａｔｉ...     

Minimum distance estimation in linear regression with unknown error distributions

This paper discusses minimum distance (m.d.) estimators of the paramter vector in the multiple linear regression model when the distributions of errors are unknown. These estimators are defined in terms of L₂-distances involving certain weighted empirical processes. Their finite sample properties and asymptotic behavior under heteroscedastic, symmetric and asymmetric errors are discussed. Some robustness properties of these estimators are also studied.     

Likelihood-Based Local Polynomial Fitting for Single-Index Models

The parametric generalized linear model assumes that the conditional distribution of a response Y given a d-dimensional covariate X belongs to an exponential family and that a known transformation of the regression function is linear in X. In this paper we relax the latter assumption by considering a nonparametric function of the linear combination β^TX, say η₀(β^TX). To estimate the coefficient vector β and the nonparametric component η₀ we consider local polynomial fits based on kernel weighted conditional likelihoods. We then obtain an estimator of the regression function by simply replacing β and η₀ in η₀(β^TX) by these estimators. We derive the asymptotic distributions of these estimators and give the results of some numerical experiments.     

Risk bounds for kernel density estimators

We use results from probability on Banach spaces and Poissonization techniques to develop sharp finite sample and asymptotic moment bounds for the L _p risk for kernel density estimators. Our results are shown to augment the previous work in this area. Bibliography: 19 titles.     

Asymptotic expansions in the singular value decomposition for cross covariance and correlation under nonnormality

Asymptotic cumulants of the distributions of the sample singular vectors and values of cross covariance and correlation matrices are obtained under nonnormality. The asymptotic cumulants are used to have the approximations of the distributions of the estimators by the Edgeworth expansions up to order O(1/n) and Hall’s method with variable transformation. The cases of Studentized estimators are also considered. As an application of the method, the distributions of the parameter estimators in the model of inter-battery factor analysis are expanded. Interpreting the singular vectors and values in the context of the factor model with distributional conditions, the asymptotic robustness of some lower-order normal-theory cumulants of the distributions of the sample singular vectors and values under nonnormality is shown.     

Estimation of a quantile in some nonstandard cases

A necessary condition for the asymptotic normality of the sample quantile estimator isf(Q(p))=F(Q(p))>0, whereQ(p) is thep-th quantile of the distribution functionF(x). In this paper, we estimate a quantile by a kernel quantile estimator when this condition is violated. We have shown that the kernel quantile estimator is asymptotically normal in some nonstandard cases. The optimal convergence rate of the mean squared error for the kernel estimator is obtained with respect to the asymptotically optimal bandwidth. A law of the iterated logarithm is also established.This research was partially supported by the new faculty award from the University of Oregon.     

Estimation of density functionals

Given a sequence of independent random variables with densityf we estimate quantities of the form = (f(x))dx, a known function, by inserting histograms and kernel density estimators for the unknownf. We obtain conditions for consistency and asymptotic normality and discuss the choice of cell size and bandwidth.     

Almost sure central limit theorems for random functions

Let {Xn,-∞< n <∞} be a sequence of independent identically distributed random variables with EX1 = 0, EX12 = 1 and let Sn =∑k=1∞Xk, and Tn = Tn(X1,…,Xn) be a random function such that Tn = ASn Rn, where supn E|Rn| <∞and Rn = o(n~(1/2)) a.s., or Rn = O(n1/2-2γ) a.s., 0 <γ< 1/8. In this paper, we prove the almost sure central limit theorem (ASCLT) and the function-typed almost sure central limit theorem (FASCLT) for the random function Tn. As a consequence, it can be shown that ASCLT and FASCLT also hold for U-statistics, Von-Mises statistics, linear processes, moving average processes, error variance estimates in linear models, power sums, product-limit estimators of a continuous distribution, product-limit estimators of a quantile function, etc.