Spline estimation of functional coefficient regression models for time series with correlated errors

In this work we focus on functional coefficient regression (FCR) models. Here we study the estimation of FCR models by splines, with autoregressive errors and show the rates of convergence of the proposed estimator. The importance of taking into account the correlation is assessed via simulation studies and multi-step ahead forecasts for a real data set.     

Jackknifing in partially linear regression models with serially correlated errors

In this paper jackknifing technique is examined for functions of the parametric component in a partially linear regression model with serially correlated errors. By deleting partial residuals a jackknife-type estimator is proposed. It is shown that the jackknife-type estimator and the usual semiparametric least-squares estimator (SLSE) are asymptotically equivalent. However, simulation shows that the former has smaller biases than the latter when the sample size is small or moderate. Moreover, since the errors are correlated, both the Tukey type and the delta type jackknife asymptotic variance estimators are not consistent. By introducing cross-product terms, a consistent estimator of the jackknife asymptotic variance is constructed and shown to be robust against heterogeneity of the error variances. In addition, simulation results show that confidence interval estimation based on the proposed jackknife estimator has better coverage probability than that based on the SLSE, even though the latter uses the information of the error structure, while the former does not.     

Asymptotic properties of local polynomial regression with missing data and correlated errors

The main objective of this work is the nonparametric estimation of the regression function with correlated errors when observations are missing in the response variable. Two nonparametric estimators of the regression function are proposed. The asymptotic properties of these estimators are studied; expresions for the bias and the variance are obtained and the joint asymptotic normality is established. A simulation study is also included.     

On exact D-optimal designs for regression models with correlated observations

Let ^* be an exact D-optimal design for a given regression model Y = X + Z . In this paper sufficient conditions are given for sesigning how the covariance matrix of Z may be changed so that not only ^* remains D-optimal but also that the best linear unbiased estimator (BLUE) of stays fixed for the design ^*, although the covariance matrix of Z * is changed. Hence under these conditions a best, according to D-optimality, BLUE of is known for the model with the changed covariance matrix. The results may also be considered as determination of exact D-optimal designs for regression models with special correlated observations where the covariance matrices are not fully known. Various examples are given, especially for regression with intercept term, polynomial regression, and straight-line regression. A real example in electrocardiography is treated shortly.     

Asymptotically optimal estimation in a linear-fractional regression problem with random errors in coefficients

Considering the linear-fractional regression problem with errors in independent variables, we construct and study asymptotically optimal estimators for unknown parameters in the case of violation of the classical regression assumptions (the variances of the observations are different and depend on the unknown parameters).     

Shrinkage estimation and variable selection in multiple regression models with random coefficient autoregressive errors

In this paper, we consider improved estimation strategies for the parameter vector in multiple regression models with first-order random coefficient autoregressive errors (RCAR(1)). We propose a shrinkage estimation strategy and implement variable selection methods such as lasso and adaptive lasso strategies. The simulation results reveal that the shrinkage estimators perform better than both lasso and adaptive lasso when and only when there are many nuisance variables in the model.     

B-spline estimation for varying coefficient regression with spatial data

This paper considers a nonparametric varying coefficient regression with spatial data. A global smoothing procedure is developed by using B-spline function approximations for estimating the coefficient functions. Under mild regularity assumptions,the global convergence rates of the B-spline estimators of the unknown coefficient functions are established. Asymptotic results show that our B-spline estimators achieve the optimal convergence rate. The asymptotic distributions of the B-spline estimators of the u...     

Approximate maximum likelihood estimation in linear regression

The application of the ML method in linear regression requires a parametric form for the error density. When this is not available, the density may be parameterized by its cumulants ( _i ) and the ML then applied. Results are obtained when the standardized cumulants ( _i ) satisfy _i = _i+2/ ₂ ^(i+2)/2 =O(v ⁱ ) asv 0 fori>0.Research financed in part by the Research Center of the Athens University of Economics and Business.     

One-step estimation for varying coefficient models

A one-step method is proposed to estimate the unknown functions in the varying coefficient models, in which the unknown functions admit different degrees of smoothness. In this method polynomials of different orders are used to approximate unknown functions with different degrees of smoothness. As only one minimization operation is employed, the required computation burden is much less than that required by the existing two-step estimation method. It is shown that the one-step estimators also achieve the optimal convergence rate. Moreover this property is obtained under conditions milder than that imposed in the two-step estimation method. More importantly, as only one minimization operation is employed, the full asymptotic properties, not only the asymptotic bias and variance, but also the asymptotic distributions of the estimators can be derived. The asymptotic distribution results will play a key role for making statistical inference.     

Optimal estimation in random coefficient regression models

In linear regression models with random coefficients, the score function usually involves unknown nuisance parameters in the form of weights. Conditioning with respect to the sufficient statistics for the nuisance parameter, when the parameter of interest is held fixed, eliminates the nuisance parameters and is expected to give reasonably good estimating functions. The present paper adopts this approach to the problem of estimation of average slope in random coefficient regression models. Four sampling situations are discussed. Some asymptotic results are also obtained for a model where neither the regressors nor the random regression coefficients replicate. Simulation studies for normal as well as non-normal models show that the performance of the suggested estimating functions is quite satisfactory.     

Robust designs for models with possible bias and correlated errors

This paper studies the model-robust design problem for general models with an unknown bias or contamination and the correlated errors. The true response function is assumed to be from a reproducing kernel Hilbert space and the errors are fitted by the qth order moving average process MA（q）, especially the MA（1） errors and the MA（2） errors. In both situations, design criteria are derived in terms of the average expected quadratic loss for the least squares estimation by using a minimax method. A case is studied and the orthogonality of the criteria is proved for this special response. The robustness of the design criteria is discussed through several numerical examples.     

空间半参数变系数部分线性回归中的分位数估计

本文研究了空间数据变系数部分线性回归中的分位数估计. 模型中的参数估计量通过未知系数函数的分段多项式逼近得到, 而未知系数函数的估计量通过将参数估计量代入模型中并通过局部线性逼近得到. 文中推导了未知参数向量估计量的渐近分布, 并建立了未知系数函数估计量在内点及边界点的渐近分布. 通过Monte Carlo 模拟研究了估计量的有限样本性质.     

Optimal designs for parameter estimation of the Ornstein–Uhlenbeck process

This paper deals with optimal designs for Gaussian random fields with constant trend and exponential correlation structure, widely known as the Ornstein–Uhlenbeck process. Assuming the maximum likelihood approach, we study the optimal design problem for the estimation of the trend µ and the correlation parameter θ using a criterion based on the Fisher information matrix. For the problem of trend estimation, we give a new proof of the optimality of the equispaced design for any sample size (see Statist. Probab. Lett. 2008; 78 :1388–1396). We also show that for the estimation of the correlation parameter, an optimal design does not exist. Furthermore, we show that the optimal strategy for µ conflicts with the one for θ, since the equispaced design is the worst solution for estimating the correlation. Hence, when the inferential purpose concerns both the unknown parameters we propose the geometric progression design, namely a flexible class of procedures that allow the experimenter to choose a suitable compromise regarding the estimation's precision of the two unknown parameters guaranteeing, at the same time, high efficiency for both. Copyright © 2008 John Wiley & Sons, Ltd.     

Asymptotically normal estimation in the linear-fractional regression problem with random errors in coefficients

We consider the problem of estimating the unknown parameter of the one-dimensional analog of the Michaelis-Menten equation when the independent variables are measured with random errors. We study the behavior of the explicit estimates that we have found earlier in the case of known independent variables and establish almost necessary conditions under which the presence of the random errors does not affect the asymptotic normality of these explicit estimates.     

Reducing component estimation for varying coefficient models with longitudinal data

Varying-coefficient models with longitudinal observations are very useful in epidemiology and some other practical fields.In this paper,a reducing component procedure is proposed for es- timating the unknown functions and their derivatives in very general models,in which the unknown coefficient functions admit different or the same degrees of smoothness and the covariates can be time- dependent.The asymptotic properties of the estimators,such as consistency,rate of convergence and asymptotic distribution,are derived.The asymptotic results show that the asymptotic variance of the reducing component estimators is smaller than that of the existing estimators when the coefficient functions admit different degrees of smoothness.Finite sample properties of our procedures are studied through Monte Carlo simulations.     

BLUP estimation of linear mixed-effects models with measurement errors and its applications to the estimation of small areas

The linear mixed-effects model （LMM） is a very useful tool for analyzing cluster data. In practice, however, the exact values of the variables are often difficult to observe. In this paper, we consider the LMM with measurement errors in the covariates. The empirical BLUP estimator of the linear combination of the fixed and random effects and its approximate conditional MSE are derived. The application to the estimation of small area is provided. Simulation study shows good performance of the proposed estimators.     

On regression model selection for the data with correlated errors

A class of regression model selection criteria for the data with correlated errors is proposed. The proposed class of selection criteria is an estimator of weighted prediction risk. In addition, the proposed selection criteria are the generalizations of several commonly used criteria in statistical analysis. The theoretical and asymptotic properties for the class of criteria are established. Further, in the medium-sample case, the results based on a simulation study are quite consistent with the theoretical ones. The proposed criteria perform well in the simulations. Several applications are also given for a variety of statistical models.     

Efficient estimation of varying coefficient seemly unrelated regression model

In this paper, we propose a class of varying coefficient seemingly unrelated regression models, in which the errors are correlated across the equations. By applying the series approximation and taking the contemporaneous correlations into account, we propose an efficient generalized least squares series estimation for the unknown coefficient functions. The consistency and asymptotic normality of the resulting estimators are established. In comparison with the ordinary/east squares ones, the proposed estimators are more efficient with smaller asymptotical variances. Some simulgtlon＇studies and a real application are presented to demonstrate the finite sample performance of the proposed methods. In addition, based on a B-spline approximation, we deduce the asymptotic bias and variance of the proposed estimators.     

Constrained optimal discrimination designs for Fourier regression models

In this article, the problem of constructing efficient discrimination designs in a Fourier regression model is considered. We propose designs which maximize the power of the F-test, which discriminates between the two highest order models, subject to the constraints that the tests that discriminate between lower order models have at least some given relative power. A complete solution is presented in terms of the canonical moments of the optimal designs, and for the special case of equal constraints even more specific formulae are available.     

Empirical process of residuals for regression models with long memory errors

We consider the residual empirical process in random design regression with long memory. We establish its limiting behaviour, showing that its rates of convergence are different from the rates of convergence for the empirical process based on (unobserved) errors.