Restricted normal mixture QMLE for non-stationary TGARCH(1, 1) models

The threshold GARCH(TGARCH)models have been very useful for analyzing asymmetric volatilities arising from financial time series.Most research on TGARCH has been directed to the stationary case.This paper studies the estimation of non-stationary first order TGARCH models.Restricted normal mixture quasi-maximum likelihood estimation(NM-QMLE)for non-stationary TGARCH models is proposed in the sense that we estimate the other parameters with any fixed location parameter.We show that the proposed estimators(except location parameter)are consistent and asymptotically normal under mild regular conditions.The impact of relative leptokursis and skewness of the innovations’distribution and quasi-likelihood distributions on the asymptotic efficiency has been discussed.Numerical results lend further support to our theoretical results.Finally,an illustrated real example is presented.     

Rate of strong consistency of quasi maximum likelihood estimate in generalized linear models

Under the assumption that in the generalized linear model (GLM) the expectation of the response variable has a correct specification and some other smooth conditions, it is shown that with probability one the quasi-likelihood equation for the GLM has a solution when the sample size n is sufficiently large. The rate of this solution tending to the true value is determined. In an important special case, this rate is the same as specified in the LIL for iid partial sums and thus cannot be improved anymore.     

Ergodicity of observation-driven time series models and consistency of the maximum likelihood estimator

This paper deals with a general class of observation-driven time series models with a special focus on time series of counts. We provide conditions under which there exist strict-sense stationary and ergodic versions of such processes. The consistency of the maximum likelihood estimators is then derived for well-specified and misspecified models.     

Maximum likelihood estimation for multivariate skew normal mixture models

This paper provides a flexible mixture modeling framework using the multivariate skew normal distribution. A feasible EM algorithm is developed for finding the maximum likelihood estimates of parameters in this context. A general information-based method for obtaining the asymptotic covariance matrix of the maximum likelihood estimators is also presented. The proposed methodology is illustrated with a real example and results are also compared with those obtained from fitting normal mixtures.     

Non-Gaussian non-stationary models for natural hazard modeling

This paper addresses the construction of probabilistic models for time or space dependent natural hazards. The proposed method uses Karhunen-Loève expansion in order to construct an empirical model matching the non-stationarity and the randomness of natural phenomena such as earthquakes or other complex environmental processes. The terms of the Karhunen-Loève expansion are identified directly from measured data. The approach is illustrated and its performance assessed through two academic examples. It is then applied to seismic ground motion modeling using recorded data.     

Sieve maximum likelihood estimation for doubly semiparametric zero-inflated Poisson models

For nonnegative measurements such as income or sick days, zero counts often have special status. Furthermore, the incidence of zero counts is often greater than expected for the Poisson model. This article considers a doubly semiparametric zero-inflated Poisson model to fit data of this type, which assumes two partially linear link functions in both the mean of the Poisson component and the probability of zero. We study a sieve maximum likelihood estimator for both the regression parameters and the nonparametric functions. We show, under routine conditions, that the estimators are strongly consistent. Moreover, the parameter estimators are asymptotically normal and first order efficient, while the nonparametric components achieve the optimal convergence rates. Simulation studies suggest that the extra flexibility inherent from the doubly semiparametric model is gained with little loss in statistical efficiency. We also illustrate our approach with a dataset from a public health study.     

Asymptotic properties of maximum likelihood estimator for two-step logit models

Two-step logit models are extensions of the ordinary logistic regression model, which are designed for complex ordinal outcomes commonly seen in practice. In this paper, we establish some asymptotic properties of the maximum likelihood estimator (MLE) of the regression parameter vector under some mild conditions, which include existence of the MLE, convergence rate and asymptotic normality of the MLE. We relax the boundedness condition of the regressors required in most existing theoretical results, and all conditions are easy to verify.     

混合双重广义线性模型的参数估计

在实际应用中,不同类别的数据统计特性存在差异,所以对异质总体的研究非常有必要.基于总体一,二阶矩存在,利用双重广义线性模型对异质总体的不同子类数据的均值和散度同时建模,研究提出了混合双重广义线性模型.然后,利用EM算法构造了模型参数的最大扩展拟似然估计和最大伪似然估计.最后,通过随机模拟和实例研究,结果表明模型和方法的有效性和有用性.     

Local polynomial maximum likelihood estimation for Pareto-type distributions

We discuss the estimation of the tail index of a heavy-tailed distribution when covariate information is available. The approach followed here is based on the technique of local polynomial maximum likelihood estimation. The generalized Pareto distribution is fitted locally to exceedances over a high specified threshold. The method provides nonparametric estimates of the parameter functions and their derivatives up to the degree of the chosen polynomial. Consistency and asymptotic normality of the proposed estimators will be proven under suitable regularity conditions. This approach is motivated by the fact that in some applications the threshold should be allowed to change with the covariates due to significant effects on scale and location of the conditional distributions. Using the asymptotic results we are able to derive an expression for the asymptotic mean squared error, which can be used to guide the selection of the bandwidth and the threshold. The applicability of the method will be demonstrated with a few practical examples.     

Maximum likelihood estimation in exponential orthogeodesic models

An orthogeodesic statistical model is defined in terms of five conditions of differential geometric nature. These conditions are reviewed together with a characterization theorem for exponential orthogeodesic models. Orthogonal projections, relevant for maximum likelihood estimation in exponential orthogeodesic models, are described in a simple way in terms of some of the quantities in the characterization theorem. A unified procedure for performing maximum likelihood estimation in exponential orthogenodesic models is given and the use of this procedure is illustrated for some of the most important models of this kind such as -parallel models, -parallel models and certain transformation models.     

Maximum likelihood estimation for all-pass time series models

An autoregressive-moving average model in which all roots of the autoregressive polynomial are reciprocals of roots of the moving average polynomial and vice versa is called an all-pass time series model. All-pass models generate uncorrelated (white noise) time series, but these series are not independent in the non-Gaussian case. An approximate likelihood for a causal all-pass model is given and used to establish asymptotic normality for maximum likelihood estimators under general conditions. Behavior of the estimators for finite samples is studied via simulation. A two-step procedure using all-pass models to identify and estimate noninvertible autoregressive-moving average models is developed and used in the deconvolution of a simulated water gun seismogram.     

Semiparametric empirical likelihood estimation for two-stage outcome-dependent sampling under the frame of generalized linear models

Epidemiologic studies use outcome-dependent sampling （ODS） schemes where, in addition to a simple random sample, there are also a number of supplement samples that are collected based on outcome variable. ODS scheme is a cost-effective way to improve study efficiency. We develop a maximum semiparametric empirical likelihood estimation （MSELE） for data from a two-stage ODS scheme under the assumption that given covariate, the outcome follows a general linear model. The information of both validation samples and nonvalidation samples are used. What is more, we prove the asymptotic properties of the proposed MSELE.     

On normal approximation for maximum likelihood estimation from single server queues

This paper is concerned with the rate of convergence of the distribution of the maximum likelihood estimators of the arrival and the service rates in a GI/G/1 queueing system. This revised version was published online in June 2006 with corrections to the Cover Date.     

偏t正态数据下混合线性联合位置与尺度模型的参数估计

偏t正态分布是分析尖峰,厚尾数据的重要统计工具之一.研究提出了偏t正态数据下混合线性联合位置与尺度模型,通过EM算法和Newton-Raphson方法研究了该模型参数的极大似然估计.并通过随机模拟试验验证了所提出方法的有效性.最后,结合实际数据验证了该模型和方法具有实用性和可行性.     

An adjusted maximum likelihood method for solving small area estimation problems

For the well-known Fay-Herriot small area model, standard variance component estimation methods frequently produce zero estimates of the strictly positive model variance. As a consequence, an empirical best linear unbiased predictor of a small area mean, commonly used in small area estimation, could reduce to a simple regression estimator, which typically has an overshrinking problem. We propose an adjusted maximum likelihood estimator of the model variance that maximizes an adjusted likelihood defined as a product of the model variance and a standard likelihood (e.g., a profile or residual likelihood) function. The adjustment factor was suggested earlier by Carl Morris in the context of approximating a hierarchical Bayes solution where the hyperparameters, including the model variance, are assumed to follow a prior distribution. Interestingly, the proposed adjustment does not affect the mean squared error property of the model variance estimator or the corresponding empirical best linear unbiased predictors of the small area means in a higher order asymptotic sense. However, as demonstrated in our simulation study, the proposed adjustment has a considerable advantage in small sample inference, especially in estimating the shrinkage parameters and in constructing the parametric bootstrap prediction intervals of the small area means, which require the use of a strictly positive consistent model variance estimate.     

Empirical likelihood for AR-ARCH models based on LAD estimation

By employing the empirical likelihood method,confidence regions for the stationary AR(p)-ARCH(q) models are constructed.A self-weighted LAD estimator is proposed under weak moment conditions.An empirical log-likelihood ratio statistic is derived and its asymptotic distribution is obtained.Simulation studies show that the performance of empirical likelihood method is better than that of normal approximation of the LAD estimator in terms of the coverage accuracy,especially for relative small size of observation.     

双重广义线性模型的经验似然推断

基于截面经验似然方法,将双重广义线性模型的拟似然估计方程作为截面经验似然比函数的约束条件,构造了均值模型和散度模型未知参数的置信区间.最后通过数据模拟,将该方法与正态逼近方法比较,说明了该方法是有效和可行的.     

Maximum likelihood estimation for stochastic volatility in mean models with heavy‐tailed distributions

In this article, we introduce a likelihood‐based estimation method for the stochastic volatility in mean (SVM) model with scale mixtures of normal (SMN) distributions. Our estimation method is based on the fact that the powerful hidden Markov model (HMM) machinery can be applied in order to evaluate an arbitrarily accurate approximation of the likelihood of an SVM model with SMN distributions. Likelihood‐based estimation of the parameters of stochastic volatility models, in general, and SVM models with SMN distributions, in particular, is usually regarded as challenging as the likelihood is a high‐dimensional multiple integral. However, the HMM approximation, which is very easy to implement, makes numerical maximum of the likelihood feasible and leads to simple formulae for forecast distributions, for computing appropriately defined residuals, and for decoding, that is, estimating the volatility of the process. Copyright © 2017 John Wiley & Sons, Ltd.     

面板数据公共变点的非参数最大似然估计

Gao Pengli;Xia Zhiming(School of Mathematics,Northwest University,Xi'an 710127,China)     

An approximate maximum likelihood estimation for non-Gaussian non-minimum phase moving average processes

An approximate maximum likelihood procedure is proposed for the estimation of parameters in possibly nonminimum phase (noninvertible) moving average processes driven by independent and identically distributed non-Gaussian noise. Under appropriate conditions, parameter estimates that are solutions of likelihood-like equations are consistent and are asymptotically normal. A simulation study for MA(2) processes illustrates the estimation procedure.