M-estimation in nonparametric regression under strong dependence and infinite variance

A robust local linear regression smoothing estimator for a nonparametric regression model with heavy-tailed dependent errors is considered in this paper. Under certain regularity conditions, the weak consistency and asymptotic distribution of the proposed estimators are obtained. If the errors are short-range dependent, then the limiting distribution of the estimator is normal. If the data are long-range dependent, then the limiting distribution of the estimator is a stable distribution.     

Nonparametric Density Estimation for a Long-Range Dependent Linear Process

We estimate the marginal density function of a long-range dependent linear process by the kernel estimator. We assume the innovations are i.i.d. Then it is known that the term of the sample mean is dominant in the MISE of the kernel density estimator when the dependence is beyond some level which depends on the bandwidth and that the MISE has asymptotically the same form as for i.i.d. observations when the dependence is below the level. We call the latter the case where the dependence is not very strong and focus on it in this paper. We show that the asymptotic distribution of the kernel density estimator is the same as for i.i.d. observations and the effect of long-range dependence does not appear. In addition we describe some results for weakly dependent linear processes.     

Local Polynomial Fitting with Long-Memory, Short-Memory and Antipersistent Errors

Local polynomial smoothing for the trend function and its derivatives in nonparametric regression with long-memory, short-memory and antipersistent errors is considered. We show that in the case of antipersistence, the convergence rate of a nonparametric regression estimator is faster than for uncorrelated or short-range dependent errors. Moreover, it is shown that unified asymptotic formulas for the optimal bandwidth and the MSE hold for all of the three dependence structures. Also, results on estimation at the boundary are included. A bandwidth selector for nonparametric regression with different types of dependent errors is proposed. Its asymptotic property is investigated. The practical performance of the proposal is illustrated by simulated and real data examples.     

On the departure process of a leaky bucket system with long-range dependent input traffic

Due to the strong experimental evidence that the traffic to be offered to future broadband networks will display long-range dependence, it is important to study the possible implications that such traffic may have for the design and performance of these networks. In particular, an important question is whether the offered traffic preserves its long-range dependent nature after passing through a policing mechanism at the interface of the network. One of the proposed solutions for flow control in the context of the emerging ATM standard is the so-called leaky bucket scheme. In this paper we consider a leaky bucket system with long-range dependent input traffic. We adopt the following popular model for long-range dependent traffic: Time is discrete. At each unit time a random number of sessions is initiated, having the distribution of a Poisson random variable with mean λ. Each of these sessions has a random duration τ, where the integer random variable τ has finite mean, infinite variance, and a regularly varying tail, i.e., P(τ >К) ~ К^-Lα L(К), where 1 < α < 2 L(·) is a slowly varying function. Once a session is initiated, it generates one cell at each unit of time until its termination. We examine the departure process of the leaky bucket policing mechanism driven by such an arrival process, and show that it too is long-range dependent for any token buffer size and any - finite or infinite - cell buffer size. Moreover, upper and lower bounds for the covariance sequence of the output process are established. The above results demonstrate that long-range dependence cannot be removed by the kinds of flow control schemes that are currently being envisioned for broadband networks. This revised version was published online in June 2006 with corrections to the Cover Date.     

A Minmax Regret Linear Regression Model Under Uncertainty in the Dependent Variable

This paper analyzes the simple linear regression model corresponding to a sample affected by errors from a non-probabilistic viewpoint. We consider the simplest case where the errors just affect the dependent variable and there only exists one explanatory variable. Moreover, we assume the errors affecting each observation can be bounded. In this context the minmax regret criterion is used in order to obtain a regression line with nearly optimal goodness of fit for any true values of the dependent variable. Theoretical results as well as numerical methods are stated in order to solve the optimization problem under different residual cost functions.     

On Estimating the Cumulant Generating Function of Linear Processes

We compare two estimates of the cumulant generating function of a stationary linear process. The first estimate is based on the empirical moment generating function. The second estimate uses the linear representation of the process and the empirical moment generating function of the innovations. Asymptotic expressions for the mean square errors are derived under short- and long-range dependence. For long-memory processes, the estimate based on the linear representation turns out to have a better rate of convergence. Thus, exploiting the linear structure of the process leads to an infinite gain in asymptotic efficiency.     

非参数回归模型下长程依赖线性过程

考虑数据相互依赖时的非参数回归模型,在作出一定假设的条件下,给出超级光滑情形时长程依赖线性过程中的重要结论,并给予相应的证明.     

Optimal nonparametric estimation of the density of regression errors with finite support

Knowledge of the probability distribution of error in a regression problem plays an important role in verification of an assumed regression model, making inference about predictions, finding optimal regression estimates, suggesting confidence bands and goodness of fit tests as well as in many other issues of the regression analysis. This article is devoted to an optimal estimation of the error probability density in a general heteroscedastic regression model with possibly dependent predictors and regression errors. Neither the design density nor regression function nor scale function is assumed to be known, but they are suppose to be differentiable and an estimated error density is suppose to have a finite support and to be at least twice differentiable. Under this assumption the article proves, for the first time in the literature, that it is possible to estimate the regression error density with the accuracy of an oracle that knows “true” underlying regression errors. Real and simulated examples illustrate importance of the error density estimation as well as the suggested oracle methodology and the method of estimation.     

On spline regression under Gaussian subordination with long memory

Motivated by an example from neurobiology, we consider estimation in a spline regression model with long-range dependent errors that are generated by Gaussian subordination. Consistency and the asymptotic distribution are derived for general Hermite ranks. Simulations illustrate the asymptotic results and finite sample properties. The method is applied to optical measurements of calcium concentration in the antennal lobe of honey bees used in the study of olfactory patterns.     

Asymptotics of R-, MD- and LAD-estimators in linear regression models with long range dependent errors

Summary This paper establishes the uniform closeness of a weighted residual empirical process to its natural estimate in the linear regression setting when the errors are Gaussian, or a function of Gaussian random variables, that are strictly stationary and long range dependent. This result is used to yield the asymptotic uniform linearity of a class of rank statistics in linear regression models with long range dependent errors. The latter result, in turn, yields the asymptotic distribution of the Jaeckel (1972) rank estimators. The paper also studies the least absolute deviation and a class of certain minimum distance estimators of regression parameters and the kernel type density estimators of the marginal error density when the errors are long range dependent.Research of this author was partly supported by the NSF grant: DMS-9102041     

Heavy traffic limits associated with >M/G/∞ input processes

We study the heavy traffic regime of a discrete-time queue driven by correlated inputs, namely the M/G/ input processes of Cox. We distinguish between M/G/ processes with short- and long-range dependence, identifying in each case the appropriate heavy traffic scaling that results in a nondegenerate limit. As expected, the limits we obtain for short-range dependent inputs involve the standard Brownian motion. Of particular interest are the conclusions for the long-range dependent case: the normalized queue length can be expressed as a function not of a fractional Brownian motion, but of an -stable, 1/ self-similar independent increment Lévy process. The resulting buffer content distribution in heavy traffic is expressed through a Mittag–Leffler special function and displays a hyperbolic decay of power 1-. Thus, M/G/ processes already demonstrate that under long-range dependence, fractional Brownian motion does not necessarily assume the ubiquitous role that standard Brownian motion plays in the short-range dependence setup.     

相依误差广义线性模型的M估计的Bahadur表示

考虑如下广义线性模型y_i=h(x~T_i,β)+e_i=1,2,…,n,其中e_i=G(…,ε_(i-1),ε_i),h是一个连续可导函数,ε_i是独立同分布的随机变量,并且它的期望为0,方差σ~2有限.本文给出了参数β的M估计,并且得到了该估计的Bahadur表示,该结论推广了线性模型的相关结论.应用M估计的Bahadur表示,得到了相依误差的线性回归模型,poisson模型,logistic模型和独立误差的广义线性模型等模型的渐近性质.     

Detecting abrupt changes of the long-range dependence or the self-similarity of a Gaussian process

In this Note, an estimator of m instants (m is known) of abrupt changes of the parameter of long-range dependence or self-similarity is proved to satisfy a limit theorem with an explicit convergence rate for a sample of a Gaussian process. In each estimated zone where the parameter is supposed not to change, a central limit theorem is established for the parameter's (of long-range dependence, self-similarity) estimator and a goodness-of-fit test is also built. To cite this article: J.-M. Bardet, I. Kammoun, C. R. Acad. Sci. Paris, Ser. I 346 (2008).     

Regression Quantiles and Related Processes Under Long Range Dependent Errors

This paper obtains asymptotic representations of the regression quantiles and the regression rank-scores processes in linear regression setting when the errors are a function of Gaussian random variables that ale stationary and long range dependent. These representations are then used to obtain the limiting behavior of L- and linear regression rank-scores statistics based on the above processes. The paper also obtains the asymptotic uniform linearity of the linear regression rank-scores processes and statistics based on residuals under the long range dependent setup. It thus generalizes some of the results of Jure ková [In Proceedings of the Meeting on Nonparametric Statistics and Related topics (A. K. Md. E. Saleh, Ed.) pp. 217-228. Elsevier, Amsterdam/New York] and Gutenbrunner and Jure ková [Ann. Statist. 20 305-329] for the case of independent errors to one of the highly useful dependent errors setup.     

Vectors of two-parameter Poisson-Dirichlet processes

The definition of vectors of dependent random probability measures is a topic of interest in applications to Bayesian statistics. They represent dependent nonparametric prior distributions that are useful for modelling observables for which specific covariate values are known. In this paper we propose a vector of two-parameter Poisson-Dirichlet processes. It is well-known that each component can be obtained by resorting to a change of measure of a σ-stable process. Thus dependence is achieved by applying a Lévy copula to the marginal intensities. In a two-sample problem, we determine the corresponding partition probability function which turns out to be partially exchangeable. Moreover, we evaluate predictive and posterior distributions.     

Composite Quantile Regression for Functional Linear Models with Dependent Errors

n this paper, we propose composite quantile regression for functional linear model with dependent data, in which the errors are from a short-range dependent and strictly stationary linear process. The functional principal component analysis is employed to approximate the slope function and the functional predictive variable respectively to construct an estimator of the slope function, and the convergence rate of the estimator is obtained under some regularity conditions. Simulation studies and a real data analysis are presented for illustration of the performance of the proposed estimator.     

�����������ĺ���������ģ�͵ĸ��Ϸ�λ������

??n this paper, we propose composite quantile regression for functional linear model with dependent data, in which the errors are from a short-range dependent and strictly stationary linear process. The functional principal component analysis is employed to approximate the slope function and the functional predictive variable respectively to construct an estimator of the slope function, and the convergence rate of the estimator is obtained under some regularity conditions. Simulation studies and a real data analysis are presented for illustration of the performance of the proposed estimator.     

On ecological aspects of dynamics for zero slope regression for water pollution in Chile

Zero slope regression is an important problem in chemometrics, ranging from challenges of intercept-bias and slope ‘corrections’ in spectrometry, up to analysis of administrative data on chemical pollution in water in the region of Arica and Parinacota. Such issue is really complex and it integrates problems of optimal design, symmetry of errors, stabilization of the variability of estimators, dynamical system for errors up to an administrative data challenges. In this article we introduce a realistic approach to zero slope regression problem from dynamical point of view. Linear regression is a widely used approach for data fitting under assumption of normally distributed residuals. Many times non-normal residuals are observed and also theoretically justified. Our solution to such problem uses the recently introduced inference function called score function of distribution. As a minimization criterion, the minimum information of residuals criterion is used. The score regression appears to be a direct generalization of the least-squares regression for an arbitrary known (believed) distribution of residuals. The score estimation is also distribution sensitive version of M-estimation. The capability of the method is demonstrated by water pollution data examples.     

Availability optimization of a redundant system through dependency modeling

This paper presents a constructive approach to optimize the availability of a system through modeling the dependency of the components. Our goal is to minimize the system cost under the constraint that system availability must not be less than a given level. In particular, the components are dependent of each other. A function noted as the dependence function is introduced to model the dependency. It is demonstrated that, for a general form of the system cost, the dependence function guarantees a finite set of feasible solutions. An approach is then developed with the help of the dependence function to obtain the optimal solution. The resolution is illustrated by an interesting example, in which the system cost depends on the strength of the dependency. Our study reveals that the dependency is an essential and effective option to improve system reliability. Moreover, the modeling of dependency, i.e. the introduction of the dependence function is valuable for resolving the optimization problem.     

Modified nonparametric kernel estimates of a regression function and their consistencies with rates

Summary Two sets of modified kernel estimates of a regression function are proposed: one when a bound on the regression function is known and the other when nothing of this sort is at hand. Explicit bounds on the mean square errors of the estimators are obtained. Pointwise as well as uniform consistency in mean square and consistency in probability of the estimators are proved. Speed of convergence in each case is investigated. Major work of this research was completed during the first author's two visits (November–December, 1983 and August–September 1984) to the second author at the Universite du Quebec a Montreal. Part of the work of the second author was supported by the Air Force Office of Scientific Research under contract F49620-85-C-0008 while he was at the University of Pittsburgh during Spring in 1985.