Strong consistency of maximum quasi-likelihood estimates in generalized linear models

In a generalized linear model with q×1 responses, bounded and fixed p×q regressors zi and general link function, under the most general assumption on the minimum eigenvalue of ∑in=1 ZiZi', the moment condition on responses as weak as possible and other mild regular conditions, we prove that with probability one, the quasi-likelihood equation has a solution βn for all large sample size n, which converges to the true regression parameter β0. This result is an essential improvement over the relevant results in literature.     

Rate of strong consistency of quasi maximum likelihood estimate in generalized linear models

Under the assumption that in the generalized linear model (GLM) the expectation of the response variable has a correct specification and some other smooth conditions, it is shown that with probability one the quasi-likelihood equation for the GLM has a solution when the sample size n is sufficiently large. The rate of this solution tending to the true value is determined. In an important special case, this rate is the same as specified in the LIL for iid partial sums and thus cannot be improved anymore.     

Rate of strong consistency of the maximum quasi-likelihood estimator in quasi-likelihood nonlinear models

Quasi-likelihood nonlinear models （QLNM） include generalized linear models as a special case. Under some regularity conditions, the rate of the strong consistency of the maximum quasi-likelihood estimation （MQLE） is obtained in QLNM. In an important case, this rate is O（n-^1/2（loglogn）^1/2）, which is just the rate of LIL of partial sums for i.i.d variables, and thus cannot be improved anymore.     

Consistency and asymptotic normality of the maximum quasi-likelihood estimator in quasi-likelihood nonlinear models with random regressors

This paper proposes some regularity conditions, which result in the existence, strong consistency and asymptotic normality of maximum quasi-likelihood estimator （MQLE） in quasi-likelihood nonlinear models （QLNM） with random regressors. The asymptotic results of generalized linear models （GLM） with random regressors are generalized to QLNM with random regressors.     

自适应设计广义线性模型极大拟似然估计的渐近性

在对Fisher信息矩阵的最小特征根最一般的假定,响应变量的矩条件尽可能弱和其它正则条件下,证明了自适应设计广义线性模型中极大拟似然估计的强相合性与渐近正态性,同时给出了强收敛速度.     

On some problems of weak consistency of quasi-maximum likelihood estimates in generalized linear models

In this paper,we explore some weakly consistent properties of quasi-maximum likelihood estimates(QMLE) concerning the quasi-likelihood equation in=1 Xi(yi-μ(Xiβ)) = 0 for univariate generalized linear model E(y |X) = μ(X'β).Given uncorrelated residuals {ei = Yi-μ(Xiβ0),1 i n} and other conditions,we prove that βn-β0 = Op(λn-1/2) holds,where βn is a root of the above equation,β0 is the true value of parameter β and λn denotes the smallest eigenvalue of the matrix Sn = ni=1 XiXi.We also show that the convergence rate above is sharp,provided independent non-asymptotically degenerate residual sequence and other conditions.Moreover,paralleling to the elegant result of Drygas(1976) for classical linear regression models,we point out that the necessary condition guaranteeing the weak consistency of QMLE is Sn-1→ 0,as the sample size n →∞.     

Adaptive quasi-likelihood estimate in generalized linear models

This paper gives a thorough theoretical treatment on the adaptive quasi-likelihood estimate of the parameters in the generalized linear models. The unknown covariance matrix of the response variable is estimated by the sample. It is shown that the adaptive estimator defined in this paper is asymptotically most efficient in the sense that it is asymptotic normal, and the covariance matrix of the limit distribution coincides with the one for the quasi-likelihood estimator for the case that the covariance matrix of the response variable is completely known.     

Asymptotic properties of general autoregressive models and strong consistency of least-squares estimates of their parameters

This paper establishes several almost sure asymptotic properties of general autoregressive processes. By making use of these properties, we obtain a proof of the strong consistency of the least-squares estimates of the parameters of the process without any assumption on the roots of the characteristic polynomial.     

Asymptotic properties of maximum likelihood estimator for two-step logit models

Two-step logit models are extensions of the ordinary logistic regression model, which are designed for complex ordinal outcomes commonly seen in practice. In this paper, we establish some asymptotic properties of the maximum likelihood estimator (MLE) of the regression parameter vector under some mild conditions, which include existence of the MLE, convergence rate and asymptotic normality of the MLE. We relax the boundedness condition of the regressors required in most existing theoretical results, and all conditions are easy to verify.     

Estimation of partial linear error-in-response models with validation data

In this paper, an estimation theory in partial linear model is developed when there is measurement error in the response and when validation data are available. A semiparametric method with the primary data is used to define two estimators for both the regression parameter and the nonparametric part using the least squares criterion with the help of validation data. The proposed estimators of the parameter are proved to be strongly consistent and asymptotically normaal, and the estimators of the nonparametric part are also proved to be strongly consistent and weakly consistent with an optimal convergent rate. Then, the two estimators of the parameter are compared based on their empirical performances. Supported by NNSF of China (No. 10231030, No. 10241001) and a grant to the author for his excellent Ph.D. dissertation work in China.     

Asymptotic normality of spectral estimates

The asymptotic normality of some spectral estimates, including a functional central limit theorem for an estimate of the spectral distribution function, is proved for fourth-order stationary processes. In contrast to known results it is not assumed that all moments exist or that the process is linear. The data are allowed to be tapered. Using some recent results on the central limit theorem for stationary processes, corollaries are obtained for strong and φ-mixing sequences and linear transformations of martingale differences.     

Strong consistency of M-estimates in linear models

The strong consistency of M-estimates of the regression coefficients in a linear model under some mild conditions is established, which is an essential improvement over the relevant results in the literature on the moment condition. Especially, in some important circumstances, onlyE|ψ(e_k)|^q for some q > 1 is needed, where ψ{e_k} is some score function of random error.     

Asymptotic normality of cumulant spectral estimates

The paper considers higher-order cumulant spectral estimates obtained by directly Fourier transforming weighted cumulant estimates. Such estimates computationally are different from those based on the finite Fourier transform. These estimates can be looked at continuously as well as directly on submanifolds. The estimates of cumulants are based on unbiased moment estimates. Asymptotic normality is obtained for these estimates and is based on a strong mixing condition and only a finite number of cumulant summability conditions.     

Asymptotic normality of double-indexed linear permutation statistics

The paper provides sufficient conditions for the asymptotic normality of statistics of the form a _ijb_RiRj, wherea _ijandb _ijare real numbers andR _iis a random permutation.     

Strong consistency of automatic kernel regression estimates

Regression function estimation from independent and identically distributed bounded data is considered. TheL ₂ error with integration with respect to the design measure is used as an error criterion. It is shown that the kernel regression estimate with an arbitrary random bandwidth is weakly and strongly consistent forall distributions whenever the random bandwidth is chosen from some deterministic interval whose upper and lower bounds satisfy the usual conditions used to prove consistency of the kernel estimate for deterministic bandwidths. Choosing discrete bandwidths by cross-validation allows to weaken the conditions on the bandwidths. Research supported by DAAD, NSERC and Alexander von Humboldt Foundation. The research of the second author was completed during his stay at the Technical University of Szczecin, Poland.     

The strong consistency of M-estimators in linear models

The strong consistency of M-estimators in linear models is considered. Under some conditions on the ratios of maximum and minimum eigenvalues of the information matrices the desired result is established.     

Convergence systems and strong consistency of least squares estimates in regression models

A recent theorem of T. L. Hai, H. Robbins, and C. Z. Wei (J. Multivariate Anal.9 (1979), 343–362) is extended to a more general form which unifies previous results in the literature on the strong consistency of least squares estimates in multiple regression models with nonrandom regressors. In particular the issue of strong consistency of the least squares estimate in the Gauss-Markov model, in the i.i.d. model with infinite second moment, and in general time series models is examined. In this connection, some basic properties of convergence systems are also obtained and are applied to the strong consistency problem.     

混合双重广义线性模型的参数估计

在实际应用中,不同类别的数据统计特性存在差异,所以对异质总体的研究非常有必要.基于总体一,二阶矩存在,利用双重广义线性模型对异质总体的不同子类数据的均值和散度同时建模,研究提出了混合双重广义线性模型.然后,利用EM算法构造了模型参数的最大扩展拟似然估计和最大伪似然估计.最后,通过随机模拟和实例研究,结果表明模型和方法的有效性和有用性.     

随机适应误差下线性模型参数M估计的渐近性质

在一些较弱的充分条件下,本文研究了误差为随机适应序列下,线性模型回归参数M估计的强相合性.与文献中已有结果比较,扩大了应用范围,且对矩条件也有较大改进.同时我们给出了随机适应误差下线性模型参数M估计的渐近正态性.     

变系数联立模型的局部线性广义矩变窗宽估计

在随机设计条件下,提出了一类变系数联立模型,运用局部线性广义矩变窗宽估计,对模型的变系数进行了估计,研究了估计量的大样本性质.利用概率论中大数定律和中心极限定理,证明了估计量的大样本性质,局部线性广义矩变窗宽估计具有相合性和渐进正态性.