不等式约束条件下部分线性回归模型的参数估计

本文研究了不等式约束条件下部分线性回归模型的参数估计问题，利用最优化方法和贝叶斯方法，给出了不等式约束条件下部分线性回归模型的最小二乘核估计和最佳贝叶斯估计，并且证明了在一定条件下，带约束条件的最小二乘核估计在均方误差意义下要优于无约束条件的最小二乘核估计。     

Error density estimation in high-dimensional sparse linear model

This paper is concerned with the error density estimation in high-dimensional sparse linear model, where the number of variables may be larger than the sample size. An improved two-stage refitted cross-validation procedure by random splitting technique is used to obtain the residuals of the model, and then traditional kernel density method is applied to estimate the error density. Under suitable sparse conditions, the large sample properties of the estimator including the consistency and asymptotic normality, as well as the law of the iterated logarithm are obtained. Especially, we gave the relationship between the sparsity and the convergence rate of the kernel density estimator. The simulation results show that our error density estimator has a good performance. A real data example is presented to illustrate our methods.

     

未知方向密度估计的收敛率

设Ｘ为ｐ维随机向量,对于未知的投影方向θｏ（‖θｏ‖＝１）,本文利用θｏ的估计与核密度估计相结合的方法给出了θ＾Ｔ０Ｘ的密度（方向密度）的核型密度估计,获得了此估计的逐点渐近正态性,逐点精确强收敛率,一致精确强收敛率以及均方误差收敛率,所得结果与最优性与已知方向上的核密度估计完全一致。作为例子,对θｏ为Ｘ协方差阵的最大特征值所对应的特征方向,我们给出了θｏ的满足条件的估计极其方向密度估计。     

Nonparametric estimation of multivariate density with direct and auxiliary data and application

We consider the problem of multivariate density estimation, using samples from the distribution of interest as well as auxiliary samples from a related distribution. We assume that the data from the target distribution and the related distribution may occur individually as well as in pairs. Using nonparametric maximum likelihood estimator of the joint distribution, we derive a kernel density estimator of the marginal density. We show theoretically, in a simple special case, that the implied estimator of the marginal density has smaller integrated mean squared error than that of a similar estimator obtained by ignoring dependence of the paired observations. We establish consistency of the marginal density estimator under suitable conditions. We demonstrate small sample superiority of the proposed estimator over the estimator that ignores dependence of the samples, through a simulation study with dependent and non-normal populations. The application of the density estimator in nonparametric classification is also discussed. It is shown that the misclassification probability of the resulting classifier is asymptotically equivalent to that of the Bayes classifier. We also include a data analytic illustration.     

A Berry-Esseen type bound in kernel density estimation for strong mixing censored samples

In this paper, we discuss the estimation of a density function based on censored data by the kernel smoothing method when the survival and the censoring times form a stationary α-mixing sequence. A Berry-Esseen type bound is derived for the kernel density estimator at a fixed point x. For practical purposes, a randomly weighted estimator of the density function is also constructed and investigated.     

Asymptotically efficient estimation of the sparsity function at a point

The sparsity function is important in nonparametric inference based on order statistics. In this paper, we consider kernel estimation of the sparsity function. We establish an invariance principle for the kernel estimator and then construct a simple adaptive estimator which we show is asymptotically efficient in the mean squared error sense.     

A note on the performance of the gamma kernel estimators at the boundary

The gamma kernel estimator is proposed in Chen [Chen, S.X., 2000. Probability density function estimation using gamma kernels. Annals of the Institute of Statistical Mathematics 52, 471–480] to estimate densities with support $[0,\infty )$. It is shown in his paper that the gamma kernel estimator is non-negative, free of boundary bias, and achieves the optimal rate of convergence for the mean integrated squared error. Numerical results reported in Chen’s paper show that, in the boundary region, the gamma kernel estimator even outperforms some widely used boundary corrected density estimators such as the boundary kernel estimator. However, our study finds that the gamma kernel estimator at $x=0$ is actually the reflection estimator when the double exponential kernel is used and is only boundary problem free when the estimated density has a shoulder at $x=0$ (i.e., the first derivative of the density at $x=0$ is zero). For densities not satisfying the shoulder condition, we show that the gamma kernel estimator has a severe boundary problem and its performance is inferior to that of the boundary kernel estimator.     

The Accuracy and the Computational Complexity of a Multivariate Binned Kernel Density Estimator

The computational cost of multivariate kernel density estimation can be reduced by prebinning the data. The data are discretized to a grid and a weighted kernel estimator is computed. We report results on the accuracy of such a binned kernel estimator and discuss the computational complexity of the estimator as measured by its average number of nonzero terms.     

Boundary kernels for adaptive density estimators on regions with irregular boundaries

In some applications of kernel density estimation the data may have a highly non-uniform distribution and be confined to a compact region. Standard fixed bandwidth density estimates can struggle to cope with the spatially variable smoothing requirements, and will be subject to excessive bias at the boundary of the region. While adaptive kernel estimators can address the first of these issues, the study of boundary kernel methods has been restricted to the fixed bandwidth context. We propose a new linear boundary kernel which reduces the asymptotic order of the bias of an adaptive density estimator at the boundary, and is simple to implement even on an irregular boundary. The properties of this adaptive boundary kernel are examined theoretically. In particular, we demonstrate that the asymptotic performance of the density estimator is maintained when the adaptive bandwidth is defined in terms of a pilot estimate rather than the true underlying density. We examine the performance for finite sample sizes numerically through analysis of simulated and real data sets.     

删失数据回归误差项的非参数密度估计的一致相合性(英文)

回归误差项是不可观测的. 由于回归误差项的密度函数在实际中有许多应用, 故使用非参数方法对其进行估计就成为回归分析中的一个基本问题. 针对完全观测数据回归模型, 曾有作者对此问题进行了研究. 然而在实际应用中, 经常会有数据被删失的情况发生, 在此情况下, 可以利用删失回归残差, 并使用核估计的方法对回归误差项的密度函数进行估计. 本文研究了该估计的大样本性质, 并证明了估计量的一致相合性.     

Probability density estimation with surrogate data and validation sample

The probability density estimation problem with surrogate data and validation sample is considered. A regression calibration kernel density estimator is defined to incorporate the information contained in both surrogate variates and validation sample. Also, we define two weighted estimators which have less asymptotic variances but have bigger biases than the regression calibration kernel density estimator. All the proposed estimators are proved to be asymptotically normal. And the asymptotic representations for the mean squared error and mean integrated square error of the proposed estimators are established, respectively. A simulation study is conducted to compare the finite sample behaviors of the proposed estimators.     

Stahel-Donoho kernel estimation for fixed design nonparametric regression models

This paper reports a robust kernel estimation for fixed design nonparametric regression models. A Stahel-Donoho kernel estimation is introduced, in which the weight functions depend on both the depths of data and the distances between the design points and the estimation points. Based on a local approximation, a computational technique is given to approximate to the incomputable depths of the errors. As a result the new estimator is computationally efficient. The proposed estimator attains a high breakdown point and has perfect asymptotic behaviors such as the asymptotic normality and convergence in the mean squared error. Unlike the depth-weighted estimator for parametric regression models, this depth-weighted nonparametric estimator has a simple variance structure and then we can compare its efficiency with the original one. Some simulations show that the new method can smooth the regression estimation and achieve some desirable balances between robustness and efficiency.     

Strong convergence in nonparametric regression with truncated dependent data

In this paper we derive rates of uniform strong convergence for the kernel estimator of the regression function in a left-truncation model. It is assumed that the lifetime observations with multivariate covariates form a stationary α-mixing sequence. The estimation of the covariate’s density is considered as well. Under the assumption that the lifetime observations are bounded, we show that, by an appropriate choice of the bandwidth, both estimators of the covariate’s density and regression function attain the optimal strong convergence rate known from independent complete samples.     

Convergence rates in density estimation for data from infinite-order moving average processes

Summary The effect of long-range dependence in nonparametric probability density estimation is investigated under the assumption that the observed data are a sample from a stationary, infinite-order moving average process. It is shown that to first order, the mean integrated squared error (MISE) of a kernel estimator for moving average data may be expanded as the sum of MISE of the kernel estimator for a same-sizerandom sample, plus a term proportional to the variance of the moving average sample mean. The latter term does not depend on bandwidth, and so imposes a ceiling on the convergence rate of a kernel estimator regardless of how bandwidth is chosen. This ceiling can be quite significant in the case of long-range dependence. We show thatall density estimators have the convergence rate ceiling possessed by kernel estimators.The research of Dr. Hart was done while he was visiting the Australian National University, and was supported in part by ONR Contract N00014-85-K-0723     

Bayesian bandwidth estimation for a semi-functional partial linear regression model with unknown error density

In the context of semi-functional partial linear regression model, we study the problem of error density estimation. The unknown error density is approximated by a mixture of Gaussian densities with means being the individual residuals, and variance a constant parameter. This mixture error density has a form of a kernel density estimator of residuals, where the regression function, consisting of parametric and nonparametric components, is estimated by the ordinary least squares and functional Nadaraya–Watson estimators. The estimation accuracy of the ordinary least squares and functional Nadaraya–Watson estimators jointly depends on the same bandwidth parameter. A Bayesian approach is proposed to simultaneously estimate the bandwidths in the kernel-form error density and in the regression function. Under the kernel-form error density, we derive a kernel likelihood and posterior for the bandwidth parameters. For estimating the regression function and error density, a series of simulation studies show that the Bayesian approach yields better accuracy than the benchmark functional cross validation. Illustrated by a spectroscopy data set, we found that the Bayesian approach gives better point forecast accuracy of the regression function than the functional cross validation, and it is capable of producing prediction intervals nonparametrically.     

Convergence Rates of Multivariate Regression Estimators with Errors-In-Variables

This paper studies the regression estimation with errors-in-variables. We first extend Meister’s theorems (Meister, 2009. Deconvolution Problems in Nonparametric Statistics. Springer, Berlin) from one to multi-dimensional setting, when a noise density has no zeros in the Fourier domain. Then motivated by the work of Delaigle and Meister (Delaigle, Meister, 2011. Nonparametric function estimation under Fourier-oscillating noise. Statistica Sinica 21, 1065–1092), we show a desired convergence rate of a kernel estimator for Fourier-oscillating noises. Finally, two technical conditions are removed, when a wavelet estimator is used.     

A semiparametric density estimator based on elliptical distributions

In the paper we study a semiparametric density estimation method based on the model of an elliptical distribution. The method considered here shows a way to overcome problems arising from the curse of dimensionality. The optimal rate of the uniform strong convergence of the estimator under consideration coincides with the optimal rate for the usual one-dimensional kernel density estimator except in a neighbourhood of the mean. Therefore the optimal rate does not depend on the dimension. Moreover, asymptotic normality of the estimator is proved.     

Modal Regression Based on Nonparametric Quantile Estimator

Modal regression based on nonparametric quantile estimator is given. Unlike the traditional mean and median regression, modal regression uses mode but not mean or median to represent the center of a conditional distribution, which helps the model to be more robust for outliers, asymmetric or heavy-taileddistribution. Most of solutions for modal regression are based on kernel estimation of density. This paper studies a new solution for modal regression by means of nonparametric quantile estimator. This method builds on the fact that the distribution function is the inverse of the quantile function, then the flexibility of nonparametric quantile estimator is utilized to improve the estimation of modal function. The simulations and application show that the new model outperforms the modal regression model via linear quantile function estimation.     

������е�VaR�ֲ��˹��Ƽ���Ӧ��

In the situation of \rho-mixing dependent sequences, this paper studied the mean square error and the optimal bandwidth of distribution kernel estimator nu_{p,h} of VaR. And the optimal bandwidth minimized the mean square error. The density function of Laplace distribution is used in the calculation of bandwidth and we adopt the method of interpolation to compute specific value of bandwidth in this paper. According to the numerical simulations, the distribution kernel estimator is more accurate by comparing the performance of VaR distribution kernel estimation with a common order statistic. Finally, Shangzheng A-share index and Shenzheng B-share index are chosen for an empirical research, which concludes that the risk of the latter is significantly higher than that of the former.     

球面数据核近邻估计的强相合性

该文绘出了球面数据密度函数的核近邻估计,通过对核估计与近邻估计相互关系的讨论,建立了核近邻估计的逐点强相合性及一致强相合性．