响应变量缺失下线性EV模型中参数的经验似然推断

考虑了响应变量随机缺失情形下的线性EV模型,通过利用逆概率加权的方法构造未知参数的经验对数似然比统计量,证明了所构造的经验对数似然比统计量渐近于X~2分布,利用这个结果可以构造未知参数的置信域     

单指标模型的统计推断

本文对单指标模型的统计推断方法进行了系统阐述,其中包括联系函数和指标系数的估计,经验似然,模型检验和变量选择等。本文的取材来自近二十年来的最新研究成果。     

单指标模型的统计推断

本文对单指标模型的统计推断方法进行了系统阐述,其中包括联系函数和指标系数的估计,经验似然,模型检验和变量选择等。本文的取材来自近二十年来的最新研究成果。     

基于偏差密度模型的小波估计

讨论了带加权分布且基于分层相协随机变量的密度函数估计问题,提出了线性小波估计器,并给出该估计器的L~p(1≤p∞)风险上界.     

Likelihood-Based Inference for Extreme Value Models

Estimation of the extremal behavior of a process is often based on the fitting of asymptotic extreme value models to relatively short series of data. Maximum likelihood has emerged as a flexible and powerful modeling tool in such applications, but its performance with small samples has been shown to be poor relative to an alternative fitting procedure based on probability weighted moments. We argue here that the small-sample superiority of the probability weighted moments estimator is due to the assumption of a restricted parameter space, corresponding to finite population moments. To incorporate similar information in a likelihood-based analysis, we propose a penalized maximum likelihood estimator that retains the modeling flexibility and large-sample optimality of the maximum likelihood estimator, but improves on its small-sample properties. The properties of the penalized likelihood estimator are verified in a simulation study, and in application to sea-level data, which also enables the procedure to be evaluated in the context of structural models for extremes.     

Adaptive Estimation of FCG Using Nonlinear State-Space Models

Abstract

In this paper, an efficient adaptive nonlinear algorithm for estimation and identification, the so-called adaptive Lainiotis filter (ALF), is applied to the problem of fatigue crack growth (FCG) estimation, identification, and prediction of the final crack (failure). A suitable nonlinear state-space FCG model is introduced for both ALF and extended Kalman filter (EKF). Both algorithms are tested in order to compare their efficiency. Through extensive analysis and simulation, it is demonstrated that the ALF has superior performance both in FCG estimation, as well as in predicting the remaining lifetime to failure. Furthermore, it is shown that the ALF is faster and easier to implement in a parallel/distributed processing mode, and much more robust than the classic EKF.     

Adaptive Mixture Modeling Metropolis Methods for Bayesian Analysis of Nonlinear State-Space Models

We describe a strategy for Markov chain Monte Carlo analysis of nonlinear, non-Gaussian state-space models involving batch analysis for inference on dynamic, latent state variables and fixed model parameters. The key innovation is a Metropolis–Hastings method for the time series of state variables based on sequential approximation of filtering and smoothing densities using normal mixtures. These mixtures are propagated through the nonlinearities using an accurate, local mixture approximation method, and we use a regenerating procedure to deal with potential degeneracy of mixture components. This provides accurate, direct approximations to sequential filtering and retrospective smoothing distributions, and hence a useful construction of global Metropolis proposal distributions for simulation of posteriors for the set of states. This analysis is embedded within a Gibbs sampler to include uncertain fixed parameters. We give an example motivated by an application in systems biology. Supplemental materials provide an example based on a stochastic volatility model as well as MATLAB code.     

Online Variational Bayes Inference for High-Dimensional Correlated Data

High-dimensional data with hundreds of thousands of observations are becoming commonplace in many disciplines. The analysis of such data poses many computational challenges, especially when the observations are correlated over time and/or across space. In this article, we propose flexible hierarchical regression models for analyzing such data that accommodate serial and/or spatial correlation. We address the computational challenges involved in fitting these models by adopting an approximate inference framework. We develop an online variational Bayes algorithm that works by incrementally reading the data into memory one portion at a time. The performance of the method is assessed through simulation studies. The methodology is applied to analyze signal intensity in MRI images of subjects with knee osteoarthritis, using data from the Osteoarthritis Initiative. Supplementary materials for this article are available online.     

Logistic模型中参数的估计

本文得到Ｌｏｇｉｓｔｉｃ模型中参数ａｉ、ｂｉ 的一种便于使用的估计公式,在样本容量较小及精度要求不高时用作试题参数的估计是合适的,也可作为联合极大似然估计中的初始值     

Models and Inference for Corrosion Pit Depth Data

A new regression structure is introduced to several families of distributions, including the Generalized Extreme Value (GEV) distribution, which are available to explain the distribution of the maximum pit depth of a small sample. This regression structure depends on sample sizes, but under a simple assumption it is also available in the case of unknown sample sizes. GEV with the proposed regression structure provides us with a new extrapolation model for time. Compared to ordinary GEV models, effectiveness of our GEV model is demonstrated for our real data set. Also, comparisons are made with GEV and other two families of distributions with respect to the proposed regression structure.     

Inference for SDE Models via Approximate Bayesian Computation

Models defined by stochastic differential equations (SDEs) allow for the representation of random variability in dynamical systems. The relevance of this class of models is growing in many applied research areas and is already a standard tool to model, for example, financial, neuronal, and population growth dynamics. However, inference for multidimensional SDE models is still very challenging, both computationally and theoretically. Approximate Bayesian computation (ABC) allows to perform Bayesian inference for models which are sufficiently complex that the likelihood function is either analytically unavailable or computationally prohibitive to evaluate. A computationally efficient ABC-MCMC algorithm is proposed, halving the running time in our simulations. Focus here is on the case where the SDE describes latent dynamics in state-space models; however, the methodology is not limited to the state-space framework. We consider simulation studies for a pharmacokinetics/pharmacodynamics model and for stochastic chemical reactions and we provide a Matlab package that implements our ABC-MCMC algorithm.     

一类总体参数的统计推断方法

根据一类总体分布函数的特性,对其应用适当的变换,进而给出了这类总体参数的统计推断方法．     

Likelihood-Based Analysis of Linear State-Space Models Using the Cholesky Decomposition

Data associated with the linear state-space model can be assembled as a matrix whose Cholesky decomposition leads directly to a likelihood evaluation. It is possible to build several matrices for which this is true. Although the chosen matrix or assemblage can be very large, rows and columns can usually be rearranged so that sparse matrix factorization is feasible and provides an alternative to the Kalman filter. Moreover, technology for calculating derivatives of the log-likelihood using backward differentiation is available, and hence it is possible to maximize the likelihood using the Newton–Raphson approach. Emphasis is given to the estimation of dispersion parameters by both maximum likelihood and restricted maximum likelihood, and an illustration is provided for an ARMA(1,1) model.     

Parameter Identification for Inelastic Constitutive Models

The identification of material parameters of constitutive models is based on identification experiments. Since even specimens from the same lot show high deviations in the experimental data, the identification of the material parameters leads to different results for one and the same material. The number of identification experiments is usually not large enough for a statistical analysis of the deviations in the identified parameters. In order to overcome this problem we present a method of stochastic simulation which is based on time series analysis for generating artificial data with the same stochastic behaviour as the experimental data. The stochastic simulations allow an investigation of the confidence in the fits of the material parameters. We validate the stochastic simulations by comparing the results of the parameter identification from experimental data with the results from artificial data. The presented simulation method applied here turns out to be a suitable tool for generating artificial data for various kinds of analysis purposes. However, it is very important to take into account that the machines which perform the experiments do not maintain constant strain rates in the loading history of the tension and cyclic experiments.     

Inference for Spatial Autoregressive Models with Infinite Variance Noises

A self-weighted quantile procedure is proposed to study the inference for a spatial unilateral autoregressive model with independent and identically distributed innovations belonging to the domain of attraction of a stable law with index of stability α, α ∈ (0, 2]. It is shown that when the model is stationary, the self-weighted quantile estimate of the parameter has a closed form and converges to a normal limiting distribution, which avoids the difficulty of Roknossadati and Zarepour (2010) in deriving their limiting distribution for an M-estimate. On the contrary, we show that when the model is not stationary, the proposed estimates have the same limiting distributions as those of Roknossadati and Zarepour. Furthermore, a Wald test statistic is proposed to consider the test for a linear restriction on the parameter, and it is shown that under a local alternative, the Wald statistic has a non-central chisquared distribution. Simulations and a real data example are also reported to assess the performance of the proposed method.     

Efficient Bayesian Inference for Multivariate Factor Stochastic Volatility Models

We discuss efficient Bayesian estimation of dynamic covariance matrices in multivariate time series through a factor stochastic volatility model. In particular, we propose two interweaving strategies to substantially accelerate convergence and mixing of standard MCMC approaches. Similar to marginal data augmentation techniques, the proposed acceleration procedures exploit nonidentifiability issues which frequently arise in factor models. Our new interweaving strategies are easy to implement and come at almost no extra computational cost; nevertheless, they can boost estimation efficiency by several orders of magnitude as is shown in extensive simulation studies. To conclude, the application of our algorithm to a 26-dimensional exchange rate dataset illustrates the superior performance of the new approach for real-world data. Supplementary materials for this article are available online.     

Online EM Algorithm for Hidden Markov Models

Online (also called “recursive” or “adaptive”) estimation of fixed model parameters in hidden Markov models is a topic of much interest in times series modeling. In this work, we propose an online parameter estimation algorithm that combines two key ideas. The first one, which is deeply rooted in the Expectation-Maximization (EM) methodology, consists in reparameterizing the problem using complete-data sufficient statistics. The second ingredient consists in exploiting a purely recursive form of smoothing in HMMs based on an auxiliary recursion. Although the proposed online EM algorithm resembles a classical stochastic approximation (or Robbins–Monro) algorithm, it is sufficiently different to resist conventional analysis of convergence. We thus provide limited results which identify the potential limiting points of the recursion as well as the large-sample behavior of the quantities involved in the algorithm. The performance of the proposed algorithm is numerically evaluated through simulations in the case of a noisily observed Markov chain. In this case, the algorithm reaches estimation results that are comparable to those of the maximum likelihood estimator for large sample sizes. The supplemental material for this article available online includes an appendix with the proofs of Theorem 1 and Corollary 1 stated in Section 4 as well as the MATLAB/OCTAVE code used to implement the algorithm in the case of a noisily observed Markov chain considered in Section 5.     

Statistical Inference for Partially Linear Regression Models with Measurement Errors

In this paper,the authors investigate three aspects of statistical inference for the partially linear regression models where some covariates are measured with errors.Firstly, a bandwidth selection procedure is proposed,which is a combination of the differencebased technique and GCV method.Secondly,a goodness-of-fit test procedure is proposed, which is an extension of the generalized likelihood technique.Thirdly,a variable selection procedure for the parametric part is provided based on the nonconcave penalization and corrected profile least squares.Same as＂Variable selection via nonconcave penalized likelihood and its oracle properties＂（J.Amer.Statist.Assoc.,96,2001,1348-1360）,it is shown that the resulting estimator has an oracle property with a proper choice of regularization parameters and penalty function.Simulation studies are conducted to illustrate the finite sample performances of the proposed procedures.     

泊松回归模型中协变量含误差的经验似然推断

在模型的协变量含有测量误差的情况下,考虑一类泊松回归模型的统计推断问题.通过巧妙地构造辅助随机向量,提出一个工具变量类型的经验似然统计推断方法.证明构造的经验对数似然比函数渐近服从标准卡方分布,进而给出了回归系数的置信区间.所提出的估计方法可以有效地消除测量误差对估计精度的影响,并且具有较好的有限样本性质.