Jackknifing in partially linear regression models with serially correlated errors

In this paper jackknifing technique is examined for functions of the parametric component in a partially linear regression model with serially correlated errors. By deleting partial residuals a jackknife-type estimator is proposed. It is shown that the jackknife-type estimator and the usual semiparametric least-squares estimator (SLSE) are asymptotically equivalent. However, simulation shows that the former has smaller biases than the latter when the sample size is small or moderate. Moreover, since the errors are correlated, both the Tukey type and the delta type jackknife asymptotic variance estimators are not consistent. By introducing cross-product terms, a consistent estimator of the jackknife asymptotic variance is constructed and shown to be robust against heterogeneity of the error variances. In addition, simulation results show that confidence interval estimation based on the proposed jackknife estimator has better coverage probability than that based on the SLSE, even though the latter uses the information of the error structure, while the former does not.     

Prediction and calibration in generalized linear models

This paper concerns prediction and calibration in generalized linear models. A new predictive procedure, giving improved prediction intervals, is briefly reviewed and further theoretical results, useful for calculations, are presented. Indeed, the calibration problem is faced within the classical approach and a suitable solution is obtained by inverting the associated improved prediction procedure. This calibration technique gives accurate confidence regions and it constitutes a substantial improvement over both the estimative solution and the naive solution, which involves, even for non-linear and non-normal models, the results available for the linear Gaussian case. Finally, some useful explicit formulae for the construction of prediction and calibration intervals are presented, with regard to generalized linear models with alternative error terms and link functions. This research was partially supported by a grant from Ministero dell’Instruzione, dell’Università e della Ricerca, Italy.     

Strong consistency of maximum quasi-likelihood estimates in generalized linear models

In a generalized linear model with q×1 responses, bounded and fixed p×q regressors zi and general link function, under the most general assumption on the minimum eigenvalue of ∑in=1 ZiZi', the moment condition on responses as weak as possible and other mild regular conditions, we prove that with probability one, the quasi-likelihood equation has a solution βn for all large sample size n, which converges to the true regression parameter β0. This result is an essential improvement over the relevant results in literature.     

A generalized inverse method for asymptotic linear programming

Consider a linear program in which the entries of the coefficient matrix vary linearly with time. To study the behavior of optimal solutions as time goes to infinity, it is convenient to express the inverse of the basis matrix as a series expansion of powers of the time parameter. We show that an algorithm of Wilkinson (1982) for solving singular differential equations can be used to obtain such an expansion efficiently. The resolvent expansions of dynamic programming are a special case of this method.     

Asymptotic robustness of the normal theory likelihood ratio statistic for two-level covariance structure models

Data in social and behavioral sciences are often hierarchically organized. Special statistical procedures have been developed to analyze such data while taking into account the resulting dependence of observations. Most of these developments require a multivariate normality distribution assumption. It is important to know whether normal theory-based inference can still be valid when applied to nonnormal hierarchical data sets. Using an analytical approach for balanced data and numerical illustrations for unbalanced data, this paper shows that the likelihood ratio statistic based on the normality assumption is asymptotically robust for many nonnormal distributions. The result extends the scope of asymptotic robustness theory that has been established in different contexts.     

Quasi-maximum likelihood estimators in generalized linear models with autoregressive processes

The paper studies a generalized linear model(GLM)y_t = h(x_t~T β) + ε_t,t = l,2,...,n,where ε_1 = η_1,ε_1 =ρε_t +η_t,t = 2,3,...;n,h is a continuous differentiable function,η_t's are independent and identically distributed random errors with zero mean and finite variance σ~2.Firstly,the quasi-maximum likelihood(QML) estimators of β,p and σ~2 are given.Secondly,under mild conditions,the asymptotic properties(including the existence,weak consistency and asymptotic distribution) of the QML estimators are investigated.Lastly,the validity of method is illuminated by a simulation example.     

Rate of strong consistency of quasi maximum likelihood estimate in generalized linear models

Under the assumption that in the generalized linear model (GLM) the expectation of the response variable has a correct specification and some other smooth conditions, it is shown that with probability one the quasi-likelihood equation for the GLM has a solution when the sample size n is sufficiently large. The rate of this solution tending to the true value is determined. In an important special case, this rate is the same as specified in the LIL for iid partial sums and thus cannot be improved anymore.     

Asymptotic normality and strong consistency of maximum quasi-likelihood estimates in generalized linear models

In a generalized linear model with q x 1 responses, the bounded and fixed (or adaptive) p × q regressors Zi and the general link function, under the most general assumption on the minimum eigenvalue of ZiZ'i,the moment condition on responses as weak as possible and the other mild regular conditions, we prove that the maximum quasi-likelihood estimates for the regression parameter vector are asymptotically normal and strongly consistent.     

The strong consistency of M-estimators in linear models

The strong consistency of M-estimators in linear models is considered. Under some conditions on the ratios of maximum and minimum eigenvalues of the information matrices the desired result is established.     

On some problems of weak consistency of quasi-maximum likelihood estimates in generalized linear models

In this paper,we explore some weakly consistent properties of quasi-maximum likelihood estimates(QMLE) concerning the quasi-likelihood equation in=1 Xi(yi-μ(Xiβ)) = 0 for univariate generalized linear model E(y |X) = μ(X'β).Given uncorrelated residuals {ei = Yi-μ(Xiβ0),1 i n} and other conditions,we prove that βn-β0 = Op(λn-1/2) holds,where βn is a root of the above equation,β0 is the true value of parameter β and λn denotes the smallest eigenvalue of the matrix Sn = ni=1 XiXi.We also show that the convergence rate above is sharp,provided independent non-asymptotically degenerate residual sequence and other conditions.Moreover,paralleling to the elegant result of Drygas(1976) for classical linear regression models,we point out that the necessary condition guaranteeing the weak consistency of QMLE is Sn-1→ 0,as the sample size n →∞.     

Estimation of time-varying ARMA models with Markovian changes in regime

In this paper, we consider the estimation of time-varying ARMA models subject to Markovian changes in regime. We give explicit conditions ensuring consistency and asymptotic normality, as well as the limiting covariance matrix, of least squares and quasi-generalized least-squares estimators.     

On the quadratic estimation of covariance matrices in multivariate linear models

This paper investigates the estimation of covariance matrices in multivariate mixed models. Some sufficient conditions are derived for a multivariate quadratic form and a linear combination of multivariate quadratic forms to be the BQUE (quadratic unbiased and severally minimum varianced) estimators of its expectations.     

Strong consistency of M-estimates in linear models

The strong consistency of M-estimates of the regression coefficients in a linear model under some mild conditions is established, which is an essential improvement over the relevant results in the literature on the moment condition. Especially, in some important circumstances, onlyE|ψ(e_k)|^q for some q > 1 is needed, where ψ{e_k} is some score function of random error.     

Robustness of F-tests in singular linear models

F-test is the most popular test in the general linear model. However, there is few discussions on the robustness of F-test under the singular linear model. In this paper, the necessary and sufficient conditions of robust F-test statistic are given under the general linear models or their partition models, which allows that the design matrix has deficient rank and the covariance matrix of error is a nonnegative definite matrix with parameters. The main results obtained in this paper include the existing findings of the general linear model under the definite covariance matrix. The usage of the theorems is illustrated by an example.     

Adaptive quasi-likelihood estimate in generalized linear models

This paper gives a thorough theoretical treatment on the adaptive quasi-likelihood estimate of the parameters in the generalized linear models. The unknown covariance matrix of the response variable is estimated by the sample. It is shown that the adaptive estimator defined in this paper is asymptotically most efficient in the sense that it is asymptotic normal, and the covariance matrix of the limit distribution coincides with the one for the quasi-likelihood estimator for the case that the covariance matrix of the response variable is completely known.     

Fuzzy clusterwise quasi-likelihood generalized linear models

The quasi-likelihood method has emerged as a useful approach to the parameter estimation of generalized linear models (GLM) in circumstances where there is insufficient distributional information to construct a likelihood function. Despite its flexibility, the quasi-likelihood approach to GLM is currently designed for an aggregate-sample analysis based on the assumption that the entire sample of observations is taken from a single homogenous population. Thus, this approach may not be suitable when heterogeneous subgroups exist in the population, which involve qualitatively distinct effects of covariates on the response variable. In this paper, the quasi-likelihood GLM approach is generalized to a fuzzy clustering framework which explicitly accounts for such cluster-level heterogeneity. A simple iterative estimation algorithm is presented to optimize the regularized fuzzy clustering criterion of the proposed method. The performance of the proposed method in recovering parameters is investigated based on a Monte Carlo analysis involving synthetic data. Finally, the empirical usefulness of the proposed method is illustrated through an application to actual data on the coupon usage behaviour of a sample of consumers.     

Shift permutation invariance in linear random factor models

The objective of this paper is to consider shift invariance, a specific type of exchangeability, of random factors in linearmodels. The randomfactors are described via their covariance matrices and it is shown that shift invariance implies circular Toeplitz covariancematrices and marginally shift invariance implies block circular Toeplitz covariance matrices. In order to get interpretable linear models reparametrization is performed. It is shown that by putting restrictions on the spectrum of the shift invariant covariance matrices natural reparametrization conditions for the corresponding factors are obtained which then, among others, can be used to obtain unique parametrizations under shift invariance.      

Asymptotic property of linear Volterra difference systems

By using the resolvent matrix and the comparison principle, we investigate the asymptotic behavior of linear Volterra difference systems.     

The generalized variance of a stationary autoregressive process

For a stationary autoregressive process of order p and disturbance variance σ² it is shown that the determinant of the covariance of T (≥p) consecutive random variables of the process is (σ²)^T Π_i,j=1^p (1 − w_iw_j)⁻¹, where w₁, …, w_p are the roots of the associated polynomial equation.     

变系数联立模型的局部线性广义矩变窗宽估计

在随机设计条件下,提出了一类变系数联立模型,运用局部线性广义矩变窗宽估计,对模型的变系数进行了估计,研究了估计量的大样本性质.利用概率论中大数定律和中心极限定理,证明了估计量的大样本性质,局部线性广义矩变窗宽估计具有相合性和渐进正态性.