Statistical inference in a panel data semiparametric regression model with serially correlated errors

We consider a panel data semiparametric partially linear regression model with an unknown vector β of regression coefficients, an unknown nonparametric function g(·) for nonlinear component, and unobservable serially correlated errors. The correlated errors are modeled by a vector autoregressive process which involves a constant intraclass correlation. Applying the pilot estimators of β and g(·), we construct estimators of the autoregressive coefficients, the intraclass correlation and the error variance, and investigate their asymptotic properties. Fitting the error structure results in a new semiparametric two-step estimator of β, which is shown to be asymptotically more efficient than the usual semiparametric least squares estimator in terms of asymptotic covariance matrix. Asymptotic normality of this new estimator is established, and a consistent estimator of its asymptotic covariance matrix is presented. Furthermore, a corresponding estimator of g(·) is also provided. These results can be used to make asymptotically efficient statistical inference. Some simulation studies are conducted to illustrate the finite sample performances of these proposed estimators.     

Weighted local polynomial estimations of a non-parametric function with censoring indicators missing at random and their applications

In this paper, we consider the weighted local polynomial calibration estimation and imputation estimation of a non-parametric function when the data are right censored and the censoring indicators are missing at random, and establish the asymptotic normality of these estimators. As their applications, we derive the weighted local linear calibration estimators and imputation estimations of the conditional distribution function, the conditional density function and the conditional quantile function, and investigate the asymptotic normality of these estimators. Finally, the simulation studies are conducted to illustrate the finite sample performance of the estimators.     

Parameter estimation for the Langevin equation with stationary-increment Gaussian noise

We study the Langevin equation with stationary-increment Gaussian noise. We show the strong consistency and the asymptotic normality with Berry–Esseen bound of the so-called second moment estimator of the mean reversion parameter. The conditions and results are stated in terms of the variance function of the noise. We consider both the case of continuous and discrete observations. As examples we consider fractional and bifractional Ornstein–Uhlenbeck processes. Finally, we discuss the maximum likelihood and the least squares estimators.     

Statistical inference for misspecified ergodic Lévy driven stochastic differential equation models

We consider the estimation problem of misspecified ergodic Lévy driven stochastic differential equation models based on high-frequency samples. We utilize a widely applicable and tractable Gaussian quasi-likelihood approach which focuses on mean and variance structure. It is shown that the Gaussian quasi-likelihood estimators of the drift and scale parameters still satisfy polynomial type probability estimates and asymptotic normality at the same rate as the correctly specified case. In their derivation process, the theory of extended Poisson equation for time-homogeneous Feller Markov processes plays an important role. Our result confirms the reliability of the Gaussian quasi-likelihood approach for SDE models.     

Wavelet estimation of conditional density with truncated, censored and dependent data

In this paper we define a new nonlinear wavelet-based estimator of conditional density function for a random left truncation and right censoring model. We provide an asymptotic expression for the mean integrated squared error (MISE) of the estimator. It is assumed that the lifetime observations form a stationary α-mixing sequence. Unlike for kernel estimators, the MISE expression of the wavelet-based estimators is not affected by the presence of discontinuities in the curves. Also, asymptotic normality of the estimator is established.     

左截断相依数据下非参数回归的局部M 估计

本文对左截断模型, 利用局部多项式的方法构造了非参数回归函数的局部M 估计. 在观察样本为平稳α-混合序列下, 建立了该估计量的强弱相合性以及渐近正态性. 模拟研究显示回归函数的局部M 估计比Nadaraya-Watson 型估计和局部多项式估计更稳健.     

Local asymptotic normality in a stationary model for spatial extremes

De Haan and Pereira (2006) [6] provided models for spatial extremes in the case of stationarity, which depend on just one parameter β>0 measuring tail dependence, and they proposed different estimators for this parameter. We supplement this framework by establishing local asymptotic normality (LAN) of a corresponding point process of exceedances above a high multivariate threshold. Standard arguments from LAN theory then provide the asymptotic minimum variance within the class of regular estimators of β. It turns out that the relative frequency of exceedances is a regular estimator sequence with asymptotic minimum variance, if the underlying observations follow a multivariate extreme value distribution or a multivariate generalized Pareto distribution.     

Multivariate Locally Weighted Polynomial Fitting and Partial Derivative Estimation

Nonparametric regression estimator based on locally weighted least squares fitting has been studied by Fan and Ruppert and Wand. The latter paper also studies, in the univariate case, nonparametric derivative estimators given by a locally weighted polynomial fitting. Compared with traditional kernel estimators, these estimators are often of simpler form and possess some better properties. In this paper, we develop current work on locally weighted regression and generalize locally weighted polynomial fitting to the estimation of partial derivatives in a multivariate regression context. Specifically, for both the regression and partial derivative estimators we prove joint asymptotic normality and derive explicit asymptotic expansions for their conditional bias and conditional convariance matrix (given observations of predictor variables) in each of the two important cases of local linear fit and local quadratic fit.     

Robust Wavelet-Domain Estimation of the Fractional Difference Parameter in Heavy-Tailed Time Series: An Empirical Study

We investigate the performance of several wavelet-based estimators of the fractional difference parameter. We consider situations where, in addition to long-range dependence, the time series exhibit heavy tails and are perturbed by polynomial and change-point trends. We make detailed study of a wavelet-domain pseudo Maximum Likelihood Estimator (MLE), for which we provide an asymptotic and finite-sample justification. Using numerical experiments, we show that unlike the traditional time-domain estimators, estimators based on the wavelet transform are robust to additive trends and change points in mean, and produce accurate estimates even under significant departures from normality. The Wavelet-domain MLE appears to dominate a regression-based wavelet estimator in terms of smaller root mean squared error. These findings are derived from a simulation study and application to computer traffic traces.     

Some statistical properties of the kernel-diffeomorphism estimator

The kernel density estimation method is not so attractive when the density has its support confined to a bounded space U of R^d. In a recent paper, we suggested a new nonparametric probability density function (p.d.f.) estimator called the ‘kernel-diffeomorphism estimator’, which suppressed border convergence difficulties by using an appropriate regular change of variable. The present paper gives more asymptotic theory (uniform consistency, normality). An invariance criterion for p.d.f. estimators is discussed. The invariance of the kernel diffeomorphism estimator under special affine motion (a translation followed by any member of the special linear group SL(d, R) is proved. © 1997 by John Wiley & Sons, Ltd.     

Asymptotic efficiency of ridge estimator in linear and semiparametric linear models

The linear model with a growing number of predictors arises in many contemporary scientific endeavor. In this article, we consider the commonly used ridge estimator in linear models. We propose analyzing the ridge estimator for a finite sample size n and a growing dimension p. The existence and asymptotic normality of the ridge estimator are established under some regularity conditions when p→∞. It also occurs that a strictly linear model is inadequate when some of the relations are believed to be of certain linear form while others are not easily parameterized, and thus a semiparametric partial linear model is considered. For these semiparametric partial linear models with p>n, we develop a procedure to estimate the linear coefficients as if the nonparametric part is not present. The asymptotic efficiency of the proposed estimator for the linear component is studied for p→∞. It is shown that the proposed estimator of the linear component asymptotically performs very well.     

Local Polynomial Regression: Optimal Kernels and Asymptotic Minimax Efficiency

We consider local polynomial fitting for estimating a regression function and its derivatives nonparametrically. This method possesses many nice features, among which automatic adaptation to the boundary and adaptation to various designs. A first contribution of this paper is the derivation of an optimal kernel for local polynomial regression, revealing that there is a universal optimal weighting scheme. Fan (1993, Ann. Statist., 21, 196-216) showed that the univariate local linear regression estimator is the best linear smoother, meaning that it attains the asymptotic linear minimax risk. Moreover, this smoother has high minimax risk. We show that this property also holds for the multivariate local linear regression estimator. In the univariate case we investigate minimax efficiency of local polynomial regression estimators, and find that the asymptotic minimax efficiency for commonly-used orders of fit is 100% among the class of all linear smoothers. Further, we quantify the loss in efficiency when going beyond this class.     

Distribution asymptotique de l'affinité L2 de densités gaussiennes

After recalling the L² affinity measure between two multidimensionnal Gaussian density functions, we prove its asymptotic normality when parameters of one density are replaced by their maximum likelihood estimators. We extend this result to the vectorial case and we use it to allocate an estimated density to a class of densities as does the discriminant analysis method. As an application, a dating method for archeological data is proposed.     

Difference based ridge and Liu type estimators in semiparametric regression models

We consider a difference based ridge regression estimator and a Liu type estimator of the regression parameters in the partial linear semiparametric regression model, y=Xβ+f+ε. Both estimators are analyzed and compared in the sense of mean-squared error. We consider the case of independent errors with equal variance and give conditions under which the proposed estimators are superior to the unbiased difference based estimation technique. We extend the results to account for heteroscedasticity and autocovariance in the error terms. Finally, we illustrate the performance of these estimators with an application to the determinants of electricity consumption in Germany.     

Third order asymptotic properties of maximum likelihood estimators for Gaussian ARMA processes

In this paper we investigate various third-order asymptotic properties of maximum likelihood estimators for Gaussian ARMA processes by the third-order Edgeworth expansions of the sampling distributions. We define a third-order asymptotic efficiency by the highest probability concentration around the true value with respect to the third-order Edgeworth expansion. Then we show that the maximum likelihood estimator is not always third-order asymptotically efficient in the class A₃ of third-order asymptotically median unbiased estimators. But, if we confine our discussions to an appropriate class D (⊂ A₃) of estimators, we can show that appropriately modified maximum likelihood estimator is always third-order asymptotically efficient in D.     

Maximum likelihood estimation for all-pass time series models

An autoregressive-moving average model in which all roots of the autoregressive polynomial are reciprocals of roots of the moving average polynomial and vice versa is called an all-pass time series model. All-pass models generate uncorrelated (white noise) time series, but these series are not independent in the non-Gaussian case. An approximate likelihood for a causal all-pass model is given and used to establish asymptotic normality for maximum likelihood estimators under general conditions. Behavior of the estimators for finite samples is studied via simulation. A two-step procedure using all-pass models to identify and estimate noninvertible autoregressive-moving average models is developed and used in the deconvolution of a simulated water gun seismogram.     

A new time domain estimation of k-factors GARMA processes

We address the problem of parameter estimation of long memory time series. We consider k-factors Gegenbauer Autoregressive Moving Average (k-GARMA) processes and we estimate their parameters by the minimum Hellinger distance estimator. We establish the consistency of the estimator and the asymptotic normality for some bandwidth choice.     

Quasi-likelihood analysis for the stochastic differential equation with jumps

In this paper, we consider a multidimensional diffusion process X with jumps whose jump term is driven by a compound Poisson process, and discuss its parametric estimation. We present asymptotic normality and convergence of moments of any order for a quasi-maximum likelihood estimator and a Bayes type estimator by assuming an exponential mixing property of X. To show these properties, we use the polynomial type large deviation theory.     

STRONG CONVERGENCE RATES OF SEVERAL ESTIMATORS IN SEMIPARAMETRIC VARYING-COEFFICIENT PARTIALLY LINEAR MODELS

This article is concerned with the estimating problem of semiparametric varyingcoefficient partially linear regression models. By combining the local polynomial and least squares procedures Fan and Huang （2005） proposed a profile least squares estimator for the parametric component and established its asymptotic normality. We further show that the profile least squares estimator can achieve the law of iterated logarithm. Moreover, we study the estimators of the functions characterizing the non-linear part as well as the error variance. The strong convergence rate and the law of iterated logarithm are derived for them, respectively.     

On likelihood estimation for a discretely observed jump process

We consider the parameter estimation problem for a Markov jump process sampled at periodic epochs with a constant step. Unlike the diffusion case where a closed form of the likelihood function is usually unavailable, we provide here an explicit expression of the likelihood function of the sampled chain. Moreover under suitable ergodicity condition on the jump process, we establish the consistency and the asymptotic normality of the likelihood estimator as the observation period tends to infinity. To cite this article: D. Dehay, J.-f. Yao, C. R. Acad. Sci. Paris, Ser. I 342 (2006).