Nonparametric estimation of mixed partial derivatives of a multivariate density

On the basis of a random sample of size n on an m-dimensional random vector X, this note proposes a class of estimators f_n^(p) of f^(p), where f is a density of X w.r.t. a σ-finite measure dominated by the Lebesgue measure on R^m, p = (p₁,…,p_m), p_j ≥ 0, fixed integers, and for x = (x₁,…,x_m) in R^m, f^(p)(x) = ?^p₁+…+p_m f(x)/(?^p₁x₁ … ?^p_mx_m). Asymptotic unbiasedness as well as both almost sure and mean square consistencies of f_n^(p) are examined. Further, a necessary and sufficient condition for uniform asymptotic unbisedness or for uniform mean square consistency of f_n^(p) is given. Finally, applications of estimators of this note to certain statistical problems are pointed out.     

Nonparametric density estimation for linear processes with infinite variance

We consider nonparametric estimation of marginal density functions of linear processes by using kernel density estimators. We assume that the innovation processes are i.i.d. and have infinite-variance. We present the asymptotic distributions of the kernel density estimators with the order of bandwidths fixed as h =  cn ^−1/5, where n is the sample size. The asymptotic distributions depend on both the coefficients of linear processes and the tail behavior of the innovations. In some cases, the kernel estimators have the same asymptotic distributions as for i.i.d. observations. In other cases, the normalized kernel density estimators converge in distribution to stable distributions. A simulation study is also carried out to examine small sample properties.     

Study of Dependence for Some Stochastic Processes

Abstract

This article is concerned with studying the following problem: Consider a multivariate stochastic process whose law is characterized in terms of some infinitesimal characteristics, such as the infinitesimal generator in case of finite Markov chains. Under what conditions imposed on these infinitesimal characteristics of this multivariate process, the univariate components of the process agree in law with given univariate stochastic processes. Thus, in a sense, we study a stochastic processe' counterpart of the stochastic dependence problem, which in case of real valued random variables is solved in terms of Sklar's theorem.     

A penalty method for nonparametric estimation of the logarithmic derivative of a density function

Summary Given a random sample of sizen from a densityf ₀ on the real line satisfying certain regularity conditions, we propose a nonparametric estimator forψ ₀=−f ₀ ^′ /f⁰. The estimate is the minimizer of a quadratic functional of the formλJ(ψ)+∫[ψ ²−2ψ′]dF_n where λ>0 is a smoothing parameter,J(·) is a roughness penalty, andF _n is the empirical c.d.f. of the sample. A characterization of the estimate (useful for computational purposes) is given which is related to spline functions. A more complete study of the caseJ(ψ)=∫[d ²ψ/dx²]² is given, since it has the desirable property of giving the maximum likelihood normal estimate in the infinite smoothness limit (λ→∞). Asymptotics under somewhat restrictive assumptions (periodicity) indicate that the estimator is asymptotically consistent and achieves the optimal rate of convergence. This type of estimator looks promising because the minimization problem is simple in comparison with the analogous penalized likelihood estimators. This research was supported by the Office of Naval Research under Grant Number N00014-82-C-0062.     

A quantile-copula approach to conditional density estimation

A new kernel-type estimator of the conditional density is proposed. It is based on an efficient quantile transformation of the data. The proposed estimator, which is based on the copula representation, turns out to have a remarkable product form. Its large-sample properties are considered and comparisons in terms of bias and variance are made with competitors based on nonparametric regression. A comparative simulation study is also provided.     

线性过程误差下概率密度函数核估计的均方相合性

设{Xt,t≥1}为一单边线性平稳过程序列,具有共同的未知密度函数f(x),本文定义通常的f(x)的核估计,在适当条件下,证明了其均方相合性.     

Penalized maximum likelihood estimation for a function of the intensity of a Poisson point process

Let be an unknown 2 times differentiable function and consider M to be an α- homogeneous Poisson process on Graf(f). The goal is to estimate f having a sample of the inhomogeneous Poisson process N constructed by dislocating each point of M perpendicularly to Graf(f) by a normal random variable with zero mean and constant variance σ². The exact formulas for the mean measure and the intensity function of N are obtained. Then, the function f is estimated directly using a hybrid spline approach to penalized maximum likelihood. Simulation results indicate the procedure to be consistent as and .      

Nonparametric estimation of the stationary density and the transition density of a Markov chain

In this paper, we study first the problem of nonparametric estimation of the stationary density f$f$ of a discrete-time Markov chain (_Xi)$\left(X_i\right)$. We consider a collection of projection estimators on finite dimensional linear spaces. We select an estimator among the collection by minimizing a penalized contrast. The same technique enables us to estimate the density g$g$ of (_Xi,_Xi+1)$(X_i,X_{i+1})$ and so to provide an adaptive estimator of the transition density π=g/f$\pi =g/f$. We give bounds in L²$L^2$ norm for these estimators and we show that they are adaptive in the minimax sense over a large class of Besov spaces. Some examples and simulations are also provided.     

Nonparametric iterative estimation of multivariate binary density

In this paper, an iterative estimate of the multivariate density is proposed when the variables are binary in nature. Some properties of this estimate are also discussed. Finally, applications of this estimate are discussed in the areas of pattern recognition and reliability.     

无穷维自回归过程的中偏差原理

本文考虑无穷维自回归过程经验协方差函数的中偏差原理,仅对自回归过程的随机扰动项做了高斯可积性的假设,这个条件比[4]中的对数Sobolev不等式要弱很多.主要利用了m-相依随机变量的中偏差结果和Ellis-Grtner定理,推广了[6]的结果.     

Nonparametric criteria for supervised classification of fuzzy data

The supervised classification of fuzzy data obtained from a random experiment is discussed. The data generation process is modelled through random fuzzy sets which, from a formal point of view, can be identified with certain function-valued random elements. First, one of the most versatile discriminant approaches in the context of functional data analysis is adapted to the specific case of interest. In this way, discriminant analysis based on nonparametric kernel density estimation is discussed. In general, this criterion is shown not to be optimal and to require large sample sizes. To avoid such inconveniences, a simpler approach which eludes the density estimation by considering conditional probabilities on certain balls is introduced. The approaches are applied to two experiments; one concerning fuzzy perceptions and linguistic labels and another one concerning flood analysis. The methods are tested against linear discriminant analysis and random K-fold cross validation.     

An EM-Like Algorithm for Semi- and Nonparametric Estimation in Multivariate Mixtures

We propose an algorithm for nonparametric estimation for finite mixtures of multivariate random vectors that strongly resembles a true EM algorithm. The vectors are assumed to have independent coordinates conditional upon knowing from which mixture component they come, but otherwise their density functions are completely unspecified. Sometimes, the density functions may be partially specified by Euclidean parameters, a case we call semiparametric. Our algorithm is much more flexible and easily applicable than existing algorithms in the literature; it can be extended to any number of mixture components and any number of vector coordinates of the multivariate observations. Thus it may be applied even in situations where the model is not identifiable, so care is called for when using it in situations for which identifiability is difficult to establish conclusively. Our algorithm yields much smaller mean integrated squared errors than an alternative algorithm in a simulation study. In another example using a real dataset, it provides new insights that extend previous analyses. Finally, we present two different variations of our algorithm, one stochastic and one deterministic, and find anecdotal evidence that there is not a great deal of difference between the performance of these two variants. The computer code and data used in this article are available online.     

Nonparametric identification and estimation of score auctions in multi-attribute procurement

Score auctions are used in procurement to incorporate other attributes beyond price. We establish nonparametric econometric identification of bidders' pseudotypes (a measure of bidder's private cost), when bids are evaluated using a preannounced quasi-linear score, calculated on the basis of the submitted levels of the attributes. Hence, we extend the standard nonparametric method for independent private costs sealed-bid, first price auctions, to multi-attribute quasi-linear score auctions. We illustrate the result with an application to scoring bid data.     

Fast Algorithms for Nonparametric Curve Estimation

Abstract

Naive implementations of local polynomial fits and kernel estimators require almost O(n ²) operations. In this article two fast O(n) algorithms for nonparametric local polynomial fitting are presented. They are based on updating normal equations. Numerical stability is guaranteed by controlling ill-conditioned situations for small bandwidths and data-tuned restarting of the updating procedure. Restarting at every output point results in a moderately fast but highly stable O(n ^7/5) algorithm. Applicability of algorithms is evaluated for estimation of regression curves and their derivatives. The idea is also applied to kernel estimators of regression curves and densities.     

Nonparametric estimation of distributions with categorical and continuous data

In this paper we consider the problem of estimating an unknown joint distribution which is defined over mixed discrete and continuous variables. A nonparametric kernel approach is proposed with smoothing parameters obtained from the cross-validated minimization of the estimator's integrated squared error. We derive the rate of convergence of the cross-validated smoothing parameters to their ‘benchmark’ optimal values, and we also establish the asymptotic normality of the resulting nonparametric kernel density estimator. Monte Carlo simulations illustrate that the proposed estimator performs substantially better than the conventional nonparametric frequency estimator in a range of settings. The simulations also demonstrate that the proposed approach does not suffer from known limitations of the likelihood cross-validation method which breaks down with commonly used kernels when the continuous variables are drawn from fat-tailed distributions. An empirical application demonstrates that the proposed method can yield superior predictions relative to commonly used parametric models.     

Prediction for discrete time series

Let {X_n} be a stationary and ergodic time series taking values from a finite or countably infinite set Assume that the distribution of the process is otherwise unknown. We propose a sequence of stopping times _n along which we will be able to estimate the conditional probability P(=x|X₀,...,) from data segment (X₀,...,) in a pointwise consistent way for a restricted class of stationary and ergodic finite or countably infinite alphabet time series which includes among others all stationary and ergodic finitarily Markovian processes. If the stationary and ergodic process turns out to be finitarily Markovian (among others, all stationary and ergodic Markov chains are included in this class) then almost surely. If the stationary and ergodic process turns out to possess finite entropy rate then _n is upperbounded by a polynomial, eventually almost surely.Mathematics Subject Classification (2000): 62G05, 60G25, 60G10     

Nonparametric estimation and testing time-homogeneity for processes with independent increments

We consider a nonparametric estimation problem for the Lévy measure of time-inhomogeneous process with independent increments. We derive the functional asymptotic normality and efficiency, in an ℓ^∞-space, of generalized Nelson–Aalen estimators. Also we propose some asymptotically distribution free tests for time-homogeneity of the Lévy measure. Our result is a fruit of the empirical process theory and the martingale theory.