On the estimation of a monotone conditional variance in nonparametric regression

A monotone estimate of the conditional variance function in a heteroscedastic, nonparametric regression model is proposed. The method is based on the application of a kernel density estimate to an unconstrained estimate of the variance function and yields an estimate of the inverse variance function. The final monotone estimate of the variance function is obtained by an inversion of this function. The method is applicable to a broad class of nonparametric estimates of the conditional variance and particularly attractive to users of conventional kernel methods, because it does not require constrained optimization techniques. The approach is also illustrated by means of a simulation study.     

分布自由的回归函数近邻核估计的相合性

本文获得了基于混合，α－混合样本的回归函数核估计，随机窗宽核估计，近邻核估计的强相合性，积分绝对误差的强相合性与平均相合性，所得结果对所有ｘ的分布μ均成立，其中核函数的支撑可以无界，甚至可以是不可积的。     

Global gradient estimate on graph and its applications

Continuing our previous work(ar Xiv:1509.07981v1),we derive another global gradient estimate for positive functions,particularly for positive solutions to the heat equation on finite or locally finite graphs.In general,the gradient estimate in the present paper is independent of our previous one.As applications,it can be used to get an upper bound and a lower bound of the heat kernel on locally finite graphs.These global gradient estimates can be compared with the Li–Yau inequality on graphs contributed by Bauer et al.[J.Differential Geom.,99,359–409(2015)].In many topics,such as eigenvalue estimate and heat kernel estimate(not including the Liouville type theorems),replacing the Li–Yau inequality by the global gradient estimate,we can get similar results.     

Robust regression function estimation

A robust estimator of the regression function is proposed combining kernel methods as introduced for density estimation and robust location estimation techniques. Weak and strong consistency and asymptotic normality are shown under mild conditions on the kernel sequence. The asymptotic variance is a product from a factor depending only on the kernel and a factor similar to the asymptotic variance in robust estimation of location. The estimation is minimax robust in the sense of Huber (1964). Robust estimation of a location parameter. Ann. Math. Statist.33 73–101.     

Fully robust one-sided cross-validation for regression functions

Fully robust OSCV is a modification of the OSCV method that produces consistent bandwidths in the cases of smooth and nonsmooth regression functions. We propose the practical implementation of the method based on the robust cross-validation kernel \(H_I\) in the case when the Gaussian kernel \(\phi \) is used in computing the resulting regression estimate. The kernel \(H_I\) produces practically unbiased bandwidths in the smooth and nonsmooth cases and performs adequately in the data examples. Negative tails of \(H_I\) occasionally result in unacceptably wiggly OSCV curves in the neighborhood of zero. This problem can be resolved by selecting the bandwidth from the largest local minimum of the curve. Further search for the robust kernels with desired properties brought us to consider the quartic kernel for the cross-validation purposes. The quartic kernel is almost robust in the sense that in the nonsmooth case it substantially reduces the asymptotic relative bandwidth bias compared to \(\phi \). However, the quartic kernel is found to produce more variable bandwidths compared to \(\phi \). Nevertheless, the quartic kernel has an advantage of producing smoother OSCV curves compared to \(H_I\). A simplified scale-free version of the OSCV method based on a rescaled one-sided kernel is proposed.     

Bayesian bandwidth estimation for a semi-functional partial linear regression model with unknown error density

In the context of semi-functional partial linear regression model, we study the problem of error density estimation. The unknown error density is approximated by a mixture of Gaussian densities with means being the individual residuals, and variance a constant parameter. This mixture error density has a form of a kernel density estimator of residuals, where the regression function, consisting of parametric and nonparametric components, is estimated by the ordinary least squares and functional Nadaraya–Watson estimators. The estimation accuracy of the ordinary least squares and functional Nadaraya–Watson estimators jointly depends on the same bandwidth parameter. A Bayesian approach is proposed to simultaneously estimate the bandwidths in the kernel-form error density and in the regression function. Under the kernel-form error density, we derive a kernel likelihood and posterior for the bandwidth parameters. For estimating the regression function and error density, a series of simulation studies show that the Bayesian approach yields better accuracy than the benchmark functional cross validation. Illustrated by a spectroscopy data set, we found that the Bayesian approach gives better point forecast accuracy of the regression function than the functional cross validation, and it is capable of producing prediction intervals nonparametrically.     

Closed form of the Fourier–Borel Kernel in the Framework of Clifford Analysis

In this paper we derive for the even dimensional case a closed form of the Fourier–Borel kernel in the Clifford analysis setting. This kernel is obtained as the monogenic component in the Fischer decomposition of the exponential function ${e^{\langle \underline{x}, \underline{u} \rangle}}$ where ${\langle . , . \rangle}$ denotes the standard inner product on the m-dimensional Euclidean space. A first approach based on Clifford analysis techniques leads to a conceptual formula containing the Gamma operator and the so-called Clifford–Bessel function, two fundamental objects in the theory of Clifford analysis. To obtain an explicit expression for the Fourier–Borel kernel in terms of a finite sum of Bessel functions, this formula remains however hard to work with. To that end we have also elaborated a more direct approach based on special functions leading to recurrence formulas for a closed form of the Fourier–Borel kernel.     

A review on consistency and robustness properties of support vector machines for heavy-tailed distributions

Support vector machines (SVMs) belong to the class of modern statistical machine learning techniques and can be described as M-estimators with a Hilbert norm regularization term for functions. SVMs are consistent and robust for classification and regression purposes if based on a Lipschitz continuous loss and a bounded continuous kernel with a dense reproducing kernel Hilbert space. For regression, one of the conditions used is that the output variable Y has a finite first absolute moment. This assumption, however, excludes heavy-tailed distributions. Recently, the applicability of SVMs was enlarged to these distributions by considering shifted loss functions. In this review paper, we briefly describe the approach of SVMs based on shifted loss functions and list some properties of such SVMs. Then, we prove that SVMs based on a bounded continuous kernel and on a convex and Lipschitz continuous, but not necessarily differentiable, shifted loss function have a bounded Bouligand influence function for all distributions, even for heavy-tailed distributions including extreme value distributions and Cauchy distributions. SVMs are thus robust in this sense. Our result covers the important loss functions ${\epsilon}$ -insensitive for regression and pinball for quantile regression, which were not covered by earlier results on the influence function. We demonstrate the usefulness of SVMs even for heavy-tailed distributions by applying SVMs to a simulated data set with Cauchy errors and to a data set of large fire insurance claims of Copenhagen Re.     

混合序列矩不等式和非参数估计

对p-混合、(?)-混合序列给出两个矩不等式,它们在加权和序列研究中比邵启满在[6]、[7]中给出的矩不等式更实用.作为应用,这里讨论非参数递归密度核估计的强收敛速度和非参数回归函数加权核估计的强相合性,获得较好结论.     

负相协平均剩余寿命函数和有效函数的一类非参数估计

本文在 NA 样本下,讨论了平均剩余寿命函数和有效函数的非参数递归型估计的相合性和渐近正态性．     

Asymptotic Properties of a Nonparametric Regression Function Estimator with Randomly Truncated Data

In this paper, we define a new kernel estimator of the regression function under a left truncation model. We establish the pointwise and uniform strong consistency over a compact set and give a rate of convergence of the estimate. The pointwise asymptotic normality of the estimate is also given. Some simulations are given to show the asymptotic behavior of the estimate in different cases. The distribution function and the covariable’s density are also estimated.     

Strong consistency of automatic kernel regression estimates

Regression function estimation from independent and identically distributed bounded data is considered. TheL ₂ error with integration with respect to the design measure is used as an error criterion. It is shown that the kernel regression estimate with an arbitrary random bandwidth is weakly and strongly consistent forall distributions whenever the random bandwidth is chosen from some deterministic interval whose upper and lower bounds satisfy the usual conditions used to prove consistency of the kernel estimate for deterministic bandwidths. Choosing discrete bandwidths by cross-validation allows to weaken the conditions on the bandwidths. Research supported by DAAD, NSERC and Alexander von Humboldt Foundation. The research of the second author was completed during his stay at the Technical University of Szczecin, Poland.     

Nonparametric recursive estimation of the derivative of the regression function with application to sea shores water quality

This paper is devoted to the nonparametric estimation of the derivative of the regression function in a nonparametric regression model. We implement a very efficient and easy to handle statistical procedure based on the derivative of the recursive Nadaraya–Watson estimator. We establish the almost sure convergence as well as the asymptotic normality for our estimates. We also illustrate our nonparametric estimation procedure on simulated data and real life data associated with sea shores water quality and valvometry.

     

方向数据回归函数核估计平均偏差的指数界

本文讨论方向数据回归函数核估计的平均偏差，在关于应变量、核函数及窗宽的温和假定下得到了 这类估计的平均偏差的指数界．     

Distributions modulo subgroups of GF(q)

The main purpose of this paper is to determine the number of symbols in each equivalence class modulo subgroups of $\text{GF(q)}{}^1$ for a certain class of linear recursive sequences with irreducible generating polynomial. The method used is to map sequences onto maximal linear recursive sequences.     

A semiparametric method for estimating nonlinear autoregressive model with dependent errors

The first-order nonlinear autoregressive model is considered and a semiparametric method is proposed to estimate regression function. In the presented model, dependent errors are defined as first-order autoregressive AR(1). The conditional least squares method is used for parametric estimation and the nonparametric kernel approach is applied to estimate regression adjustment. In this case, some asymptotic behaviors and simulated results for the semiparametric method are presented. Furthermore, the method is applied for the financial data in Iran’s Tejarat-Bank.     

Randomly censored partially linear single-index models

This paper proposes a method for estimation of a class of partially linear single-index models with randomly censored samples. The method provides a flexible way for modelling the association between a response and a set of predictor variables when the response variable is randomly censored. It presents a technique for “dimension reduction” in semiparametric censored regression models and generalizes the existing accelerated failure-time models for survival analysis. The estimation procedure involves three stages: first, transform the censored data into synthetic data or pseudo-responses unbiasedly; second, obtain quasi-likelihood estimates of the regression coefficients in both linear and single-index components by an iteratively algorithm; finally, estimate the unknown nonparametric regression function using techniques for univariate censored nonparametric regression. The estimators for the regression coefficients are shown to be jointly root-n consistent and asymptotically normal. In addition, the estimator for the unknown regression function is a local linear kernel regression estimator and can be estimated with the same efficiency as all the parameters are known. Monte Carlo simulations are conducted to illustrate the proposed methodology.     

Asymptotics of R-, MD- and LAD-estimators in linear regression models with long range dependent errors

Summary This paper establishes the uniform closeness of a weighted residual empirical process to its natural estimate in the linear regression setting when the errors are Gaussian, or a function of Gaussian random variables, that are strictly stationary and long range dependent. This result is used to yield the asymptotic uniform linearity of a class of rank statistics in linear regression models with long range dependent errors. The latter result, in turn, yields the asymptotic distribution of the Jaeckel (1972) rank estimators. The paper also studies the least absolute deviation and a class of certain minimum distance estimators of regression parameters and the kernel type density estimators of the marginal error density when the errors are long range dependent.Research of this author was partly supported by the NSF grant: DMS-9102041     

On variable discounting in dynamic programming: applications to resource extraction and other economic models

This paper generalizes the classical discounted utility model introduced in Samuelson (Rev. Econ. Stud. 4:155–161, 1937) by replacing a constant discount rate with a function. The existence of recursive utilities and their constructions are based on Matkowski’s extension of the Banach Contraction Principle. The derived utilities go beyond the class of recursive utilities studied in the literature and enable a discussion on subtle issues concerning time preferences in the theory of finance, economics or psychology. Moreover, our main results are applied to the theory of optimal economic growth related with resource extraction models with unbounded utility function of consumption.