A general autoregressive model with Markov switching: Estimation and consistency

In this paper, a general autoregressive model with Markov switching is considered, where the autoregression may be of an infinite order. The consistency of the maximum likelihood estimators for this model is obtained under regularity assumptions. Examples of finite and infinite order autoregressive models with Markov switching are discussed. Simulation studies with these examples illustrate the consistency and asymptotic normality of the estimators.      

On Huber's contaminated model

Huber's contaminated model is a basic model for data with outliers. This paper aims at addressing several fundamental problems about this model. We first study its identifiability properties. Several theorems are presented to determine whether the model is identifiable for various situations. Based on these results, we discuss the problem of estimating the parameters with observations drawn from Huber's contaminated model. A definition of estimation consistency is introduced to handle the general case where the model may be unidentifiable. This consistency is a strong robustness property. After showing that existing estimators cannot be consistent in this sense, we propose a new estimator that possesses the consistency property under mild conditions. Its adaptive version, which can simultaneously possess this consistency property and optimal asymptotic efficiency, is also provided. Numerical examples show that our estimators have better overall performance than existing estimators no matter how many outliers in the data.     

Nonparametric estimation of the bivariate survival function for one modified form of doubly censored data

In this article, we consider estimating the bivariate distribution function when both components are subject to double censoring. We propose three types of estimators, the first two are generalizations of the Dabrowska and Campbell and Földes estimators, and the third is an inverse-probability-weighted estimator. The consistency of the proposed estimators is established. A simulation study is conducted to investigate the performance of the proposed estimators.     

Universal consistency of delta estimators

This paper considers delta estimators of the Radon-Nikodym derivative of a probability function with respect to a σ-finite measure. We provide sufficient conditions for universal consistency, which are checked for some wide classes of nonparametric estimators.     

Bootstrapping the nonparametric ARCH regression model

In this paper we introduce the nonparametric AR(1)–ARCH(1) model and show weak consistency of the Nadaraya–Watson estimators for the model. We propose a residual and a wild bootstrap method and prove weak consistency of the bootstrap estimators.     

Asymptotic properties of some subset vector autoregressive process estimators

We establish consistency and derive asymptotic distributions for estimators of the coefficients of a subset vector autoregressive (SVAR) process. Using a martingale central limit theorem, we first derive the asymptotic distribution of the subset least squares (LS) estimators. Exploiting the similarity of closed form expressions for the LS and Yule–Walker (YW) estimators, we extend the asymptotics to the latter. Using the fact that the subset Yule–Walker and recently proposed Burg estimators satisfy closely related recursive algorithms, we then extend the asymptotic results to the Burg estimators. All estimators are shown to have the same limiting distribution.     

Pointwise Improvement of Multivariate Kernel Density Estimates

Multivariate kernel density estimators are known to systematically deviate from the true value near critical points of the density surface. To overcome this difficulty a method based on Rao–Blackwell's theorem is proposed. Local corrections of kernel density estimators are achieved by conditioning these estimators with respect to locally sufficient statistics. The asymptotic as well as the small sample size behavior of the improved estimators are studied. Asymptotic bias and variance are investigated and weak and complete consistency are derived under mild hypothesis.     

Proving consistency of non-standard kernel estimators

We develop general methods based upon empirical process techniques to prove uniform in bandwidth consistency of a class of non-standard kernel-type function estimators. Examples include projection pursuit regression and conditional distribution estimation. Our results are especially useful to establish uniform consistency of data-driven bandwidth kernel-type function estimators.     

The progressively truncated estimating functions and estimators

We consider the progressively truncated estimating functions and estimators as a generalization of the progressively truncated likelihood estimating functions and maximum likelihood estimators. We show the uniform consistency and weak convergence of the progressively truncated estimators.     

线性模型和线性EV模型中的T-型回归估计和EM算法

本文对于线性函数关系EV模型定义了$t$\,-型回归估计, 并对于普通线性模型和线性函数关系EV模型给出了计算$t$\,-型回归估计的EM算法, 同时获得了估计的相合性\bd 模拟结果表明由EM算法获得的$t$\,-型回归估计的表现良好.     

On Bayes procedures

Summary A result of Doob regarding consistency of Bayes estimators is extended to a large class of Bayes decision procedures in which the loss functions are not necessarily convex. Rather weak conditions are given under which the Bayes procedures are consistent. One set involves restrictions on the a priori distribution and follows an example in which the choice of a priori distribution determines whether the Bayes estimators are consistent. Another example shows that the maximum likelihood estimators may be consistent when the Bayes estimators are not. However, the conditions given are of an essentially weaker nature than those established for consistency of maximum likelihood estimators.This paper was prepared with the partial support of the Office of Ordnance Research, U. S. Army, under Contract DA-04-200-ORD-171. While the paper was in press, its author Dr. Lorraine Schwartz suddenly died. Sit ei terra levis! (L. LC., J. N.)I am deeply indebted to Professor L. LeCam, under whose guidance I obtained the results established in my thesis and given in this paper.     

Robust estimation in single-index models when the errors have a unimodal density with unknown nuisance parameter

This paper develops a robust profile estimation method for the parametric and nonparametric components of a single-index model when the errors have a strongly unimodal density with unknown nuisance parameter. We derive consistency results for the link function estimators as well as consistency and asymptotic distribution results for the single-index parameter estimators. Under a log-Gamma model, the sensitivity to anomalous observations is studied using the empirical influence curve. We also discuss a robust K-fold cross-validation procedure to select the smoothing parameters. A numerical study carried on with errors following a log-Gamma model and for contaminated schemes shows the good robustness properties of the proposed estimators and the advantages of considering a robust approach instead of the classical one. A real data set illustrates the use of our proposal.

     

Weak and universal consistency of moving weighted averages

The properties of weighted averages as linear estimators of a regression function and its derivatives are investigated for the fixed design case. Results on weak consistency and on universal consistency are derived, using a modification of the definition of Stone [10]. As examples we consider kernel estimates and weighted local regression estimators and show that the general results apply.     

Empirical Edgeworth Expansion for Finite Population Statistics. II

For symmetric asymptotically linear statistics based on simple random samples, we construct a one–term empirical Edgeworth expansion, where the moments defining the true Edgeworth expansion are replaced by their jackknife estimators. In order to establish the validity of the empirical Edgeworth expansion (in probability) we prove the consistency of the jackknife estimators.     

附加信息下的局部线性估计

在回归模型中，对一类因变量函数的条件期望方程的附加信息，我们提出了基于极大经验似然方法的局部线性点估计，在一定条件下证明了这些估计的相合性和渐近正态性，而且估计的方差小于通常不带附加信息核估计的方差．模拟结果也显示了估计的优良性．     

Minimum contrast estimation of stationary processes based on the squared periodogram?

We present a class of minimum contrast estimators based on the objective function that is composed using the squared periodogram. We prove the consistency and asymptotic normality of the proposed estimators.     

左删失数据下ARMA(p,q)模型的估计

在观测数据左删失情形下由K—M估计方法得到,严平稳遍历序列{Xt}的均值和自协方差函数的估计,从而获得ARMA（p,q）模型的参数估计,且所给估计量是强相合估计．     

Strong consistency of sample path derivative estimates

We give general conditions for strong consistency of sample-path-based derivative estimators. Such estimators are useful in gradient-based optimization of complex stochastic systems. The results substantially generalize and extend previous results.     

FIXED-DESIGN SEMIPARAMETRIC REGRESSION FOR LINEAR TIME SERIES

This article studies parametric component and nonparametric component estimators in a semiparametric regression model with linear time series errors; their r-th mean consistency and complete consistency are obtained under suitable conditions. Finally, the author shows that the usual weight functions based on nearest neighbor methods satisfy the designed assumptions imposed.     

具有部分缺失数据时两个Poisson总体的估计和检验

讨论了部分缺失数据两个 Poisson总体的参数估计和关于总体相同的似然比检验 ,证明了估计的强相合性和渐近正态性 ,指出了似然比检验统计量的极限分布 ,并讨论了基于精确分布的检验问题