Transformation Kernel Density Estimation With Applications

One of the main objectives of this article is to derive efficient nonparametric estimators for an unknown density fX. It is well known that the ordinary kernel density estimator has, despite several good properties, some serious drawbacks. For example, it suffers from boundary bias and it also exhibits spurious bumps in the tails. We propose a semiparametric transformation kernel density estimator to overcome these defects. It is based on a new semiparametric transformation function that transforms data to normality. A generalized bandwidth adaptation procedure is also developed. It is found that the newly proposed semiparametric transformation kernel density estimator performs well for unimodal, low, and high kurtosis densities. Moreover, it detects and estimates densities with excessive curvature (e.g., modes and valleys) more effectively than existing procedures. In conclusion, practical examples based on real-life data are presented.     

Moderate deviations for deconvolution kernel density estimators with ordinary smooth measurement errors

In this paper, we establish the pointwise and uniform moderate deviations limit results for the deconvolution kernel density estimator in the errors-in-variables model, when the measurement error possesses an ordinary smooth distribution. The results are similar to the moderate deviations theorems for the classical kernel density estimators, but a factor related to the ordinary smooth order is needed to account for the measurement errors.     

未知方向密度估计的收敛率

设Ｘ为ｐ维随机向量,对于未知的投影方向θｏ（‖θｏ‖＝１）,本文利用θｏ的估计与核密度估计相结合的方法给出了θ＾Ｔ０Ｘ的密度（方向密度）的核型密度估计,获得了此估计的逐点渐近正态性,逐点精确强收敛率,一致精确强收敛率以及均方误差收敛率,所得结果与最优性与已知方向上的核密度估计完全一致。作为例子,对θｏ为Ｘ协方差阵的最大特征值所对应的特征方向,我们给出了θｏ的满足条件的估计极其方向密度估计。     

Strong uniform consistency and asymptotic normality of a kernel based error density estimator in functional autoregressive models

Estimating the innovation probability density is an important issue in any regression analysis. This paper focuses on functional autoregressive models. A residual-based kernel estimator is proposed for the innovation density. Asymptotic properties of this estimator depend on the average prediction error of the functional autoregressive function. Sufficient conditions are studied to provide strong uniform consistency and asymptotic normality of the kernel density estimator.     

Bayesian bandwidth estimation for a semi-functional partial linear regression model with unknown error density

In the context of semi-functional partial linear regression model, we study the problem of error density estimation. The unknown error density is approximated by a mixture of Gaussian densities with means being the individual residuals, and variance a constant parameter. This mixture error density has a form of a kernel density estimator of residuals, where the regression function, consisting of parametric and nonparametric components, is estimated by the ordinary least squares and functional Nadaraya–Watson estimators. The estimation accuracy of the ordinary least squares and functional Nadaraya–Watson estimators jointly depends on the same bandwidth parameter. A Bayesian approach is proposed to simultaneously estimate the bandwidths in the kernel-form error density and in the regression function. Under the kernel-form error density, we derive a kernel likelihood and posterior for the bandwidth parameters. For estimating the regression function and error density, a series of simulation studies show that the Bayesian approach yields better accuracy than the benchmark functional cross validation. Illustrated by a spectroscopy data set, we found that the Bayesian approach gives better point forecast accuracy of the regression function than the functional cross validation, and it is capable of producing prediction intervals nonparametrically.     

具可微卷积核的第二类Volterra积分方程的行列式级数解法

§1.引言 对具可微卷积核的第二类Volterra积分方程 y(x)=f(x)+λ integral from n=a to x(K(x-t)y(t)dt),(1)通常的解法有迭代法与Laplace变换法以及化为微分方程求解等.毫无疑义,这些方法对于方程(1)的求解是重要的.但这些方法也有其本质的缺点,即在求解过程中,往往涉     

The Accuracy and the Computational Complexity of a Multivariate Binned Kernel Density Estimator

The computational cost of multivariate kernel density estimation can be reduced by prebinning the data. The data are discretized to a grid and a weighted kernel estimator is computed. We report results on the accuracy of such a binned kernel estimator and discuss the computational complexity of the estimator as measured by its average number of nonzero terms.     

Boundary kernels for adaptive density estimators on regions with irregular boundaries

In some applications of kernel density estimation the data may have a highly non-uniform distribution and be confined to a compact region. Standard fixed bandwidth density estimates can struggle to cope with the spatially variable smoothing requirements, and will be subject to excessive bias at the boundary of the region. While adaptive kernel estimators can address the first of these issues, the study of boundary kernel methods has been restricted to the fixed bandwidth context. We propose a new linear boundary kernel which reduces the asymptotic order of the bias of an adaptive density estimator at the boundary, and is simple to implement even on an irregular boundary. The properties of this adaptive boundary kernel are examined theoretically. In particular, we demonstrate that the asymptotic performance of the density estimator is maintained when the adaptive bandwidth is defined in terms of a pilot estimate rather than the true underlying density. We examine the performance for finite sample sizes numerically through analysis of simulated and real data sets.     

Estimating and Visualizing Conditional Densities

Abstract

We consider the kernel estimator of conditional density and derive its asymptotic bias, variance, and mean-square error. Optimal bandwidths (with respect to integrated mean-square error) are found and it is shown that the convergence rate of the density estimator is order n ^–2/3. We also note that the conditional mean function obtained from the estimator is equivalent to a kernel smoother. Given the undesirable bias properties of kernel smoothers, we seek a modified conditional density estimator that has mean equivalent to some other nonparametric regression smoother with better bias properties. It is also shown that our modified estimator has smaller mean square error than the standard estimator in some commonly occurring situations. Finally, three graphical methods for visualizing conditional density estimators are discussed and applied to a data set consisting of maximum daily temperatures in Melbourne, Australia.     

Slepian半小波基函数及其在无线通讯信号概率密度估计中的应用

文[20]引进了Slepian半小波基函数并讨论了这组基在概率度估计核方法中的应用[21]，Slepian半小波基函数具有极好的性质．包括多重尺度结构和局部非负性．更值得指出的是．与Gauss核不同，Slepian函数是与无线信号类似的具有平滑谱的有限带宽函数．在所有相同带宽的函数中．Slepian函数在特定的时同区域上具有最大能量．在逼近具有平滑谱的无线信号中．这些特性使得Slepian半小波核与Gauss核以及其他小波基相比具有潜在的优越性．美中不足的是．和其他核密度估计一样．Slepian核密度估计的算法设计具有一定的挑战性．幸运的是．我们注意到Slepian核可以被表示成卷积形式．这一观察具有重要的计算意义．本文主要讨论Slephn核密度估计的应用及其计算．我们首先设计了基于离散卷积的算法并讨论了这一算法的有效性．在文章的结尾，以Slepian核密度估计作为具有平滑谱的远程信号的衰减包络的模型为例．我们考查了Slepian核及其算法的性质．为了尝试数学理论与应用的紧密联系，本文的数值试验不仅采用了模拟数据而且包括了从无线通讯用户的硬件直接采集的实际数据．     

Asymptotic Properties of a Nonparametric Regression Function Estimator with Randomly Truncated Data

In this paper, we define a new kernel estimator of the regression function under a left truncation model. We establish the pointwise and uniform strong consistency over a compact set and give a rate of convergence of the estimate. The pointwise asymptotic normality of the estimate is also given. Some simulations are given to show the asymptotic behavior of the estimate in different cases. The distribution function and the covariable’s density are also estimated.     

球面数据核近邻估计的强相合性

该文绘出了球面数据密度函数的核近邻估计,通过对核估计与近邻估计相互关系的讨论,建立了核近邻估计的逐点强相合性及一致强相合性．     

On a nonparametric estimator for the finite time survival probability with zero initial surplus

In this paper, we consider the estimation of the finite time survival probability in the classical risk model when the initial surplus is zero. We construct a nonparametric estimator by Fourier inversion and kernel density estimation method. Under some mild assumptions imposed on the kernel, bandwidth and claim size density, we derive the order of the bias and variance, and show that the estimator has asymptotic normality property. Some simulation studies show that the estimator performs quite well in the finite sample setting.     

Nonparametric Density Estimation for a Long-Range Dependent Linear Process

We estimate the marginal density function of a long-range dependent linear process by the kernel estimator. We assume the innovations are i.i.d. Then it is known that the term of the sample mean is dominant in the MISE of the kernel density estimator when the dependence is beyond some level which depends on the bandwidth and that the MISE has asymptotically the same form as for i.i.d. observations when the dependence is below the level. We call the latter the case where the dependence is not very strong and focus on it in this paper. We show that the asymptotic distribution of the kernel density estimator is the same as for i.i.d. observations and the effect of long-range dependence does not appear. In addition we describe some results for weakly dependent linear processes.     

Asymptotic Normality of a Combined Regression Estimator

In this paper, we propose a combined regression estimator by using a parametric estimator and a nonparametric estimator of the regression function. The asymptotic distribution of this estimator is obtained for cases where the parametric regression model is correct, incorrect, and approximately correct. These distributional results imply that the combined estimator is superior to the kernel estimator in the sense that it can never do worse than the kernel estimator in terms of convergence rate and it has the same convergence rate as the parametric estimator in the case where the parametric model is correct. Unlike the parametric estimator, the combined estimator is robust to model misspecification. In addition, we also establish the asymptotic distribution of the estimator of the weight given to the parametric estimator in constructing the combined estimator. This can be used to construct consistent tests for the parametric regression model used to form the combined estimator.     

A semiparametric density estimator based on elliptical distributions

In the paper we study a semiparametric density estimation method based on the model of an elliptical distribution. The method considered here shows a way to overcome problems arising from the curse of dimensionality. The optimal rate of the uniform strong convergence of the estimator under consideration coincides with the optimal rate for the usual one-dimensional kernel density estimator except in a neighbourhood of the mean. Therefore the optimal rate does not depend on the dimension. Moreover, asymptotic normality of the estimator is proved.     

On the Accuracy of Binned Kernel Density Estimators

The accuracy of the binned kernel density estimator is studied for general binning rules. We derive mean squared error results for the closeness of this estimator to both the true density and the unbinned kernel estimator. The binning rule and smoothness of the kernel function are shown to influence the accuracy of the binned kernel estimators. Our results are used to compare commonly used binning rules, and to determine the minimum grid size required to obtain a given level of accuracy.     

Estimating a density under pointwise constraints on the derivatives

Suppose we want to estimate a density at a point where we know the values of its first or higher order derivatives. In this case a given kernel estimator of the density can be modified by adding appropriately weighted kernel estimators of these derivatives. We give conditions under which the modified estimators are asymptotically normal. We also determine the optimal weights. When the highest derivative is known to vanish at a point, then the bias is asymptotically negligible at that point and the asymptotic variance of the kernel estimator can be made arbitrarily small by choosing a large bandwidth.     

删失数据回归误差项的非参数密度估计的一致相合性(英文)

回归误差项是不可观测的. 由于回归误差项的密度函数在实际中有许多应用, 故使用非参数方法对其进行估计就成为回归分析中的一个基本问题. 针对完全观测数据回归模型, 曾有作者对此问题进行了研究. 然而在实际应用中, 经常会有数据被删失的情况发生, 在此情况下, 可以利用删失回归残差, 并使用核估计的方法对回归误差项的密度函数进行估计. 本文研究了该估计的大样本性质, 并证明了估计量的一致相合性.     

i.i.d情况下非参数回归模型的误差密度估计的收敛性质

本文研究了i．i．d情况下非参数回归的误差密度估计的一致收敛和均方收敛，给出了一定条件下误差密度的估计量f^n(x)的一致收敛速度和均方收敛速度。