Prediction of Continuous Time Autoregressive Processes via the Reproducing Kernel Spaces

We study the statistical prediction of a continuous time stochastic process admitting a functional autoregressive representation. We construct an approximation of Parzen's optimal predictor in reproducing kernel spaces framework. This approach did not require an estimation of the operator of the autoregressive representation. This revised version was published online in August 2006 with corrections to the Cover Date.     

Large deviations for posterior distributions on the parameter of a multivariate \text{ AR}(p) process

We prove the large deviation principle for the posterior distributions on the (unknown) parameter of a multivariate autoregressive process with i.i.d. Normal innovations. As a particular case, we recover a previous result for univariate first-order autoregressive processes. We also show that the rate function can be expressed in terms of the divergence between two spectral densities.     

Autoregressive functions estimation in nonlinear bifurcating autoregressive models

Bifurcating autoregressive processes, which can be seen as an adaptation of autoregressive processes for a binary tree structure, have been extensively studied during the last decade in a parametric context. In this work we do not specify any a priori form for the two autoregressive functions and we use nonparametric techniques. We investigate both nonasymptotic and asymptotic behaviour of the Nadaraya–Watson type estimators of the autoregressive functions. We build our estimators observing the process on a finite subtree denoted by \(\mathbb {T}_n\), up to the depth n. Estimators achieve the classical rate \(|\mathbb {T}_n|^{-\beta /(2\beta +1)}\) in quadratic loss over Hölder classes of smoothness. We prove almost sure convergence, asymptotic normality giving the bias expression when choosing the optimal bandwidth. Finally, we address the question of asymmetry: we develop an asymptotic test for the equality of the two autoregressive functions which we implement both on simulated and real data.     

Moving-average representation of autoregressive approximations

We study the properties of an MA(∞)-representation of an autoregressive approximation for a stationary, real-valued process. In doing so we give an extension of Wiener's theorem in the deterministic approximation setup. When dealing with data, we can use this new key result to obtain insight into the structure of MA(∞)-representations of fitted autoregressive models where the order increases with the sample size. In particular, we give a uniform bound for estimating the moving-average coefficients via autoregressive approximation being uniform over all integers.     

Asymptotic properties of the MLE for the autoregressive process coefficients under stationary Gaussian noise

In this paper we study the Maximum Likelihood Estimator (MLE) of the vector parameter of an autoregressive process of order p with regular stationary Gaussian noise. We prove the large sample asymptotic properties of the MLE under very mild conditions. We do simulations for fractional Gaussian noise (fGn), autoregressive noise (AR(1)) and moving average noise (MA(1)).     

Model selection of a switching mechanism for financial time series

The threshold autoregressive model with generalized autoregressive conditionally heteroskedastic (GARCH) specification is a popular nonlinear model that captures the well‐known asymmetric phenomena in financial market data. The switching mechanisms of hysteretic autoregressive GARCH models are different from threshold autoregressive model with GARCH as regime switching may be delayed when the hysteresis variable lies in a hysteresis zone. This paper conducts a Bayesian model comparison among competing models by designing an adaptive Markov chain Monte Carlo sampling scheme. We illustrate the performance of three kinds of criteria by comparing models with fat‐tailed and/or skewed errors: deviance information criteria, Bayesian predictive information, and an asymptotic version of Bayesian predictive information. A simulation study highlights the properties of the three Bayesian criteria and the accuracy as well as their favorable performance as model selection tools. We demonstrate the proposed method in an empirical study of 12 international stock markets, providing evidence to strongly support for both models with skew fat‐tailed innovations. Copyright © 2016 John Wiley & Sons, Ltd.     

Diagnosing and modeling extra‐binomial variation for time‐dependent counts

This article considers the modeling of count data time series with a finite range having extra‐binomial variation. We propose a beta‐binomial autoregressive model using the concept of random coefficient thinning. We discuss the stationarity conditions, derive the moments and autocovariance function and consider approaches for parameter estimation. Furthermore, we develop two new tests for detecting extra‐binomial variation, and we derive the asymptotic distributions of the test statistics under the null hypothesis of a binomial autoregressive model. The size and power performance of the two tests are analyzed under various alternatives taken from a beta‐binomial autoregressive model with Monte Carlo experiments. The article ends with a real‐data example about the Harmonised Index of Consumer Prices of the European Union. Copyright © 2013 John Wiley & Sons, Ltd.     

Autoregressive process modeling via the Lasso procedure

The Lasso is a popular model selection and estimation procedure for linear models that enjoys nice theoretical properties. In this paper, we study the Lasso estimator for fitting autoregressive time series models. We adopt a double asymptotic framework where the maximal lag may increase with the sample size. We derive theoretical results establishing various types of consistency. In particular, we derive conditions under which the Lasso estimator for the autoregressive coefficients is model selection consistent, estimation consistent and prediction consistent. Simulation study results are reported.     

Bootstrapping Autoregressive and Moving Average Parameter Estimates of Infinite Order Vector Autoregressive Processes

We consider anr-dimensional multivariate time series {y_t, tZ} which is generated by an infinite order vector autoregressive process. We show that a bootstrap procedure which works by generating time series replicates via an estimated finitek-order vector autoregressive process (k→∞ at an appropriate rate with the sample size) gives asymptotically valid approximations to the joint distribution of the growing set of estimated autoregressive coefficients and to the corresponding set of estimated moving average coefficients (impuls responses).     

Estimation and Simulation of Autoregressive Hilbertian Processes with Exogenous Variables

We present the autoregressive Hilbertian with exogenous variables model (ARHX) which intends to take into account the dependence structure of random curves viewed as H-valued random variables, where H is a Hilbert space of functions, under the influence of explanatory variables. Limit theorems and consistent estimators are derived from an autoregressive representation. A simulation study illustrates the accuracy of the estimation by making a comparison on forecasts with other functional models.     

Subsampling tests for variance changes in the presence of autoregressive parameter shifts

In this paper, we consider the problem of testing for variance changes in the linear autoregressive processes including AR(p) processes when there are autoregressive parameter shifts. In performing a test, we employ the conventional residual CUSUM of squares test (RCUSQ) statistic. The RCUSQ test is based on the subsampling method introduced by Jach and Kokoszka (2004) [16] to eliminate the influence caused by autoregressive parameter shifts. It is shown that under regularity conditions, the test statistic behaves asymptotically the function of a standard Brownian bridge. We establish the asymptotic validity of this method and assess its performance both theoretically and numerically.     

A note on strong mixing of ARMA processes

We establish that certain stationary autoregressive moving average (ARMA) processes are strong mixing.     

Closure of Linear Processes

We consider the sets of moving-average and autoregressive processes and study their closures under the Mallows metric and the total variation convergence on finite dimensional distributions. These closures are unexpectedly large, containing nonergodic processes which are Poisson sums of i.i.d. copies from a stationary process. The presence of these nonergodic Poisson sum processes has immediate implications. In particular, identifiability of the hypothesis of linearity of a process is in question. A discussion of some of these issues for the set of moving-average processes has already been given without proof in Bickel and Bühlmann.⁽²⁾ We establish here the precise mathematical arguments and present some additional extensions: results about the closure of autoregressive processes and natural sub-sets of moving-average and autoregressive processes which are closed.Research supported in part by grants NSA MDA 904-94-H-2020 and NSF DMS 95049555     

Autoregressive-output-analysis methods revisited

We revisit and update the autoregressive-output-analysis method for constructing a confidence interval for the steady-state mean of a simulated process by using Rissanen's predictive least-squares criterion to estimate the autoregressive order of the process. This order estimator is strongly consistent when the output is autoregressive. The order estimator is combined with the standard autoregressive-output-analysis method to form a confidence-interval procedure. Alternatives for estimating the degrees of freedom for the procedure are investigated. The main result is an asymptotically valid confidence-interval procedure that, empirically, has good small-sample properties.     

具有ARCH误差的回归模型参数估计的收敛速度

西方讨论了具有ＡＲＣＨ误差的回归模型参数估计的收敛速度。     

Mittag-leffler process

First-order autoregressive Mittag-Leffler process is studied. Methods for generating dependent (first-order autoregressive Markovian) sequences of random variables with Mittag-Leffier marginal distributions are discussed. Comparison of the first-order autoregressive Mittag-Leffler process with the first-order autoregressive exponential process of Gaver and Lewis [1] is done. As an application, the first-order autoregressive Mittag-Leffier process is fitted to weakly stream flows of the Kallada River in Kerala, India.     

A Combinatorial Approach to Piecewise Linear Time Series Analysis

Over recent years, several nonlinear time series models have been proposed in the literature. One model that has found a large number of successful applications is the threshold autoregressive model (TAR). The TAR model is a piecewise linear process whose central idea is to change the parameters of a linear autoregressive model according to the value of an observable variable, called the threshold variable. If this variable is a lagged value of the time series, the model is called a self-exciting threshold autoregressive (SETAR) model. In this article, we propose a heuristic to estimate a more general SETAR model, where the thresholds are multivariate. We formulate the task of finding multivariate thresholds as a combinatorial optimization problem. We develop an algorithm based on a greedy randomized adaptive search procedure (GRASP) to solve the problem. GRASP is an iterative randomized sampling technique that has been shown to quickly produce good quality solutions for a wide variety of optimization problems. The proposed model performs well on both simulated and real data.     

Walsh spectral analysis of multiple dyadic stationary processes and its applications

In this paper, we investigate some properties of multiple dyadic stationary processes from the viewpoint of their Walsh spectral analysis. It is shown that under certain conditions a dyadic autoregressive and moving average process of finite order is expressed as a dyadic autoregressive process of finite order and also as a dyadic moving average process of finite order. We can see that the principal component process of such a dyadic stationary process has a simple finite structure in the sense that a dyadic filter which generates the principal component process has only one-side finite lags.     

A Hessian Regularized Nonlinear Time Series Model

We introduce a nonparametric nonlinear time series model. The novel idea is to fit a model via penalization, where the penalty term is an unbiased estimator of the integrated Hessian of the underlying function. The underlying model assumption is very general: it has Hessian almost everywhere in its domain. Numerical experiments demonstrate that our model has better predictive power: if the underlying model complies with an existing parametric/semiparametric form (e.g., a threshold autoregressive model (TAR), an additive autoregressive model (AAR), or a functional coefficient autoregressive model (FAR)), our model performs comparably; if the underlying model does not comply with any preexisting form, our model outperforms in nearly all simulations. We name our model a Hessian regularized nonlinear model for time series (HRM). We conjecture on theoretical properties and use simulations to verify. Our method can be viewed as a way to generalize splines to high dimensions (when the number of variates is more than three), under which an analogous analytical derivation cannot work due to the curse of dimensionality. Supplemental materials are provided, and will help readers reproduce all results in the article.     

���������Իع�ģ���лع麯���İ��������

??In this paper, semiparametric estimation of a regression function in the third order partially linear autoregressive model with first order autoregressive errors is mainly studied. We suppose that the regression function has a parametric framework, and use the conditional least squares method to obtain the parameter estimators. Then semiparametric estimators of the regression function can be given by combining with the nonparametric kernel function adjustment. Furthermore, under certain conditions, the consistency of the estimators is proved. Finally, simulation research is presented to evaluate the effectiveness of the proposed method.