Wavelet estimation of conditional density with truncated, censored and dependent data

In this paper we define a new nonlinear wavelet-based estimator of conditional density function for a random left truncation and right censoring model. We provide an asymptotic expression for the mean integrated squared error (MISE) of the estimator. It is assumed that the lifetime observations form a stationary α-mixing sequence. Unlike for kernel estimators, the MISE expression of the wavelet-based estimators is not affected by the presence of discontinuities in the curves. Also, asymptotic normality of the estimator is established.     

强相关数据回归函数的小波估计

讨论了在强相关数据情形下对回归函数的小波估计,并且给出了估计量的均方误差的一个渐近展开表示式． 对研究估计量的优劣,所推导的近似表示式显得非常重要．对一般的回归函数核估计,如果回归函数不是充分光滑,这个均方误差表示式并不成立A·D2但对小波估计,即使回归函数间断连续,这个均方误差表示式仍然成立．因此,小波估计的收敛速度要比核估计来得快,从而小波估计在某种程度上改进了现有的核估计．     

Asymptotically optimal choice of the smoothing parameter in a nonparametric kernel estimator for a probability density

This paper presents a method of estimation of an “optimal” smoothing parameter (window width) in kernel estimators for a probability density. The obtained estimator is calculated directly from observations. By “optimal” smoothing parameters we mean those parameters which minimize the mean integral square error (MISE) or the integral square error (ISE) of approximation of an unknown density by the kernel estimator. It is shown that the asymptotic “optimality” properties of the proposed estimator correspond (with respect to the order) to those of the well-known cross-validation procedure [1, 2]. Translated fromStatisticheskie Metody Otsenivaniya i Proverki Gipotez, pp. 67–80, Perm, 1990.     

Mean Integrated Squared Error of Nonlinear Wavelet-based Estimators with Long Memory Data

We consider the nonparametric regression model with long memory data that are not necessarily Gaussian and provide an asymptotic expansion for the mean integrated squared error (MISE) of nonlinear wavelet-based mean regression function estimators. We show this MISE expansion, when the underlying mean regression function is only piecewise smooth, is the same as analogous expansion for the kernel estimators. However, for the kernel estimators, this MISE expansion generally fails if an additional smoothness assumption is absent. Research supported in part by the NSF grant DMS-0103939.     

Nonparametric Density Estimation for a Long-Range Dependent Linear Process

We estimate the marginal density function of a long-range dependent linear process by the kernel estimator. We assume the innovations are i.i.d. Then it is known that the term of the sample mean is dominant in the MISE of the kernel density estimator when the dependence is beyond some level which depends on the bandwidth and that the MISE has asymptotically the same form as for i.i.d. observations when the dependence is below the level. We call the latter the case where the dependence is not very strong and focus on it in this paper. We show that the asymptotic distribution of the kernel density estimator is the same as for i.i.d. observations and the effect of long-range dependence does not appear. In addition we describe some results for weakly dependent linear processes.     

Asymptotic normality of wavelet density estimator under censored dependent observations

In this paper, we discuss the asymptotic normality of the wavelet estimator of the density function based on censored data, when the survival and the censoring times form a stationary ??-mixing sequence. To simulate the distribution of estimator such that it is easy to perform statistical inference for the density function, a random weighted estimator of the density function is also constructed and investigated. Finite sample behavior of the estimator is investigated via simulations too.     

PA误差下回归函数小波估计的渐近性质

本文研究了回归函数小波估计的渐进性质的问题.利用概率不等式方法,获得了函数g(·)的小波估计量的r-阶矩相合,依概率收敛和强收敛以及渐进正态性的结果,所获的结果推广了其他混合相依下的相应结果.     

Wavelet estimation in diffusions with periodicity

We consider a time-inhomogeneous diffusion process, whose drift term contains a deterministic T-periodic signal with known periodicity. This signal is supposed to be contained in a Besov space, we try to estimate it using a non-parametric wavelet estimator. Our estimator is inspired by the thresholded wavelet density estimator constructed by Donoho, Johnstone, Kerkyacharian and Picard in 1996. Under certain ergodicity assumptions to the process, we can give the same asymptotic rate of convergence as for the density estimator.     

Lower bounds for bandwidth selection in density estimation

Summary This paper establishes asymptotic lower bounds which specify, in a variety of contexts, how well (in terms of relative rate of convergence) one may select the bandwidth of a kernel density estimator. These results provide important new insights concerning how the bandwidth selection problem should be considered. In particular it is shown that if the error criterion is Integrated Squared Error (ISE) then, even under very strong assumptions on the underlying density, relative error of the selected bandwidth cannot be reduced below ordern ^–1/10 (as the sample size grows). This very large error indicates that any technique which aims specifically to minimize ISE will be subject to serious practical difficulties arising from sampling fluctuations. Cross-validation exhibits this very slow convergence rate, and does suffer from unacceptably large sampling variation. On the other hand, if the error criterion is Mean Integrated Squared Error (MISE) then relative error of bandwidth selection can be reduced to ordern ^–1/2, when enough smoothness is assumed. Therefore bandwidth selection techniques which aim to minimize MISE can be much more stable, and less sensitive to small sampling fluctuations, than those which try to minimize ISE. We feel this indicates that performance in minimizing MISE, rather than ISE, should become the benchmark for measuring performance of bandwidth selection methods.Research partially supported by National Science Foundation Grants DMS-8701201 and DMS-8902973Research of the first author was done while on leave from the Australian National University     

On Distribution of Error of Linear Wavelet Estimator of Probability Density

We establish the asymptotic normality of the squared L ²-norm of the approximation error of a linear wavelet estimator of the density of a distribution. The calculations are based on the smallness of correlations between the coefficients of the high-frequency part of the multiresolution expansion of the estimator.Supported by the FCT Foundation (Portugal) in the framework of the project Probability and Statistics (2000–2002), Centro de Matematica, Universidade da Beira Interior.__________Translated from Lietuvos Matematikos Rinkinys, Vol. 45, No. 2, pp. 184–207, April–June, 2005.     

Estimation of nonlinear autoregressive models using design-adapted wavelets

We estimate nonlinear autoregressive models using a design-adapted wavelet estimator. We show two properties of the wavelet transform adapted to an autoregressive design. First, in an asymptotic setup, we derive the order of the threshold that removes all the noise with a probability tending to one asymptotically. Second, with this threshold, we estimate the detail coefficients by soft-thresholding the empirical detail coefficients. We show an upper bound on thel ₂-risk of these soft-thresholded detail coefficients. Finally, we illustrate the behavior of this design-adapted wavelet estimator on simulated and real data sets. Financial support from the contract ‘Projet d'Actions de Recherche Concertées’ nr. 98/03-217 from the Belgian government, and from the IAP research network nr. P5/24 of the Belgian State (Federal Office for Scientific, Technical and Cultural Affairs) is gratefully acknowledged.     

Nonlinear wavelet estimation of regression function with random desigm

The nonlinear wavelet estimator of regression function with random design is constructed. The optimal uniform convergence rate of the estimator in a ball of Besov spaceB ³ _p,q is proved under quite general assumpations. The adaptive nonlinear wavelet estimator with near-optimal convergence rate in a wide range of smoothness function classes is also constructed. The properties of the nonlinear wavelet estimator given for random design regression and only with bounded third order moment of the error can be compared with those of nonlinear wavelet estimator given in literature for equal-spaced fixed design regression with i.i.d. Gauss error. Project supported by Doctoral Programme Foundation, the National Natural Science Foundation of China (Grant No. 19871003) and Natural Science Fundation of Heilongjiang Province, China.     

Convergence rates in density estimation for data from infinite-order moving average processes

Summary The effect of long-range dependence in nonparametric probability density estimation is investigated under the assumption that the observed data are a sample from a stationary, infinite-order moving average process. It is shown that to first order, the mean integrated squared error (MISE) of a kernel estimator for moving average data may be expanded as the sum of MISE of the kernel estimator for a same-sizerandom sample, plus a term proportional to the variance of the moving average sample mean. The latter term does not depend on bandwidth, and so imposes a ceiling on the convergence rate of a kernel estimator regardless of how bandwidth is chosen. This ceiling can be quite significant in the case of long-range dependence. We show thatall density estimators have the convergence rate ceiling possessed by kernel estimators.The research of Dr. Hart was done while he was visiting the Australian National University, and was supported in part by ONR Contract N00014-85-K-0723     

相关数据密度函数的非线性小波估计

本文考虑了严平稳随机序列密度函数的非线性小波估计,证明了在Besov空间中,非线性小波估计可达到最优收敛速度.进一步讨论了自适应非线性小波估计,证明了自适非线性小波估计可达到次最优速度即和最优速度相差in n.     

Local Whittle likelihood estimators and tests for non-Gaussian stationary processes

In this paper, we propose a local Whittle likelihood estimator for spectral densities of non-Gaussian processes and a local Whittle likelihood ratio test statistic for the problem of testing whether the spectral density of a non-Gaussian stationary process belongs to a parametric family or not. Introducing a local Whittle likelihood of a spectral density f _θ (λ) around λ, we propose a local estimator [^(q)] = [^(q)] (l){\hat{\theta } = \hat{\theta } (\lambda ) } of θ which maximizes the local Whittle likelihood around λ, and use f_{[^(q)] (l)} (l){f_{\hat{\theta } (\lambda )} (\lambda )} as an estimator of the true spectral density. For the testing problem, we use a local Whittle likelihood ratio test statistic based on the local Whittle likelihood estimator. The asymptotics of these statistics are elucidated. It is shown that their asymptotic distributions do not depend on non-Gaussianity of the processes. Because our models include nonlinear stationary time series models, we can apply the results to stationary GARCH processes. Advantage of the proposed estimator is demonstrated by a few simulated numerical examples.     

Étude asymptotique locale de l'estimateur par ondelettesA law of the iterated logarithm for wavelet density estimator

We state a pointwise central limit theorem for the linear wavelet density estimator in a more general setting than the result of Wu [12]. Furthermore, we also give a pointwise law of the iterated logarithm for this density estimator. Our proof of the law of the iterated logarithm uses the results of Mason [9] on the asymptotic behavior of the tail empirical process. To cite this article: A. Massiani, C. R. Acad. Sci. Paris, Ser. I 335 (2002) 553–556.     

对于部分线性模型的乘积调整半参估计

本文使用一种带有乘积调整的半参方法估计部分线性模型的非参数部分并给出所得估计的渐近性质。与传统的非参估计方法相比,我们所使用的半参数方法能够有效的降低所得估计的偏差,而方差不受影响。因此在积分均方误差(MISE)的意义下,该半参数方法要优于传统的估计方法。数值模拟也表明了这一点.     

Convergence Rates of Multivariate Regression Estimators with Errors-In-Variables

This paper studies the regression estimation with errors-in-variables. We first extend Meister’s theorems (Meister, 2009. Deconvolution Problems in Nonparametric Statistics. Springer, Berlin) from one to multi-dimensional setting, when a noise density has no zeros in the Fourier domain. Then motivated by the work of Delaigle and Meister (Delaigle, Meister, 2011. Nonparametric function estimation under Fourier-oscillating noise. Statistica Sinica 21, 1065–1092), we show a desired convergence rate of a kernel estimator for Fourier-oscillating noises. Finally, two technical conditions are removed, when a wavelet estimator is used.     

Asymptotic normality in conditional wavelet density with left‐truncated α‐mixing observations

In this paper we define a new nonlinear wavelet‐based estimator of conditional density function for a left truncation model. Asymptotic normality of the estimator is established. It is assumed that the lifetime observations form a stationary α‐mixing sequence. Copyright © 2010 John Wiley & Sons, Ltd.     

Edgeworth expansion for the pre-averaging estimator

In this paper, we study the Edgeworth expansion for a pre-averaging estimator of quadratic variation in the framework of continuous diffusion models observed with noise. More specifically, we obtain a second order expansion for the joint density of the estimators of quadratic variation and its asymptotic variance. Our approach is based on martingale embedding, Malliavin calculus and stable central limit theorems for continuous diffusions. Moreover, we derive the density expansion for the studentized statistic, which might be applied to construct asymptotic confidence regions.