Change detection in autoregressive time series

Autoregressive time series models of order p have p+2 parameters, the mean, the variance of the white noise and the p autoregressive parameters. Change in any of these over time is a sign of disturbance that is important to detect. The methods of this paper can test for change in any one of these p+2 parameters separately, or in any collection of them. They are available in forms that make one-sided tests possible, furthermore, they can be used to test for a temporary change. The test statistics are based on the efficient score vector. The large sample properties of the change-point estimator are also explored.     

Maximum likelihood estimation for all-pass time series models

An autoregressive-moving average model in which all roots of the autoregressive polynomial are reciprocals of roots of the moving average polynomial and vice versa is called an all-pass time series model. All-pass models generate uncorrelated (white noise) time series, but these series are not independent in the non-Gaussian case. An approximate likelihood for a causal all-pass model is given and used to establish asymptotic normality for maximum likelihood estimators under general conditions. Behavior of the estimators for finite samples is studied via simulation. A two-step procedure using all-pass models to identify and estimate noninvertible autoregressive-moving average models is developed and used in the deconvolution of a simulated water gun seismogram.     

On the ruin probability in a dependent discrete time risk model with insurance and financial risks

This paper considers the discrete-time risk model with insurance risk and financial risk in some dependence structures. Under assumptions that the insurance risks are heavy tailed (belong to the intersection of the long-tailed class and the dominatedly varying-tailed class) and the financial risks satisfy some moment conditions, the asymptotic and uniformly asymptotic relations for the finite-time and ultimate ruin probabilities are derived.     

The central limit theorem for sums of trimmed variables with heavy tails

Trimming is a standard method to decrease the effect of large sample elements in statistical procedures, used, e.g., for constructing robust estimators and tests. Trimming also provides a profound insight into the partial sum behavior of i.i.d. sequences. There is a wide and nearly complete asymptotic theory of trimming, with one remarkable gap: no satisfactory criteria for the central limit theorem for modulus trimmed sums have been found, except for symmetric random variables. In this paper we investigate this problem in the case when the variables are in the domain of attraction of a stable law. Our results show that for modulus trimmed sums the validity of the central limit theorem depends sensitively on the behavior of the tail ratio P(X>t)/P(|X|>t) of the underlying variable X as t→∞ and paradoxically, increasing the number of trimmed elements does not generally improve partial sum behavior.     

The product of two dependent random variables with regularly varying or rapidly varying tails

Let X and Y be two nonnegative and dependent random variables following a generalized Farlie-Gumbel-Morgenstern distribution. In this short note, we study the impact of a dependence structure of X and Y on the tail behavior of XY. We quantify the impact as the limit, as x→∞, of the quotient of Pr(XY>x) and Pr(X^∗Y^∗>x), where X^∗ and Y^∗ are independent random variables identically distributed as X and Y, respectively. We obtain an explicit expression for this limit when X is regularly varying or rapidly varying tailed.     

Second order optimality for estimators in time series regression models

We consider the second order asymptotic properties of an efficient frequency domain regression coefficient estimator proposed by Hannan [Regression for time series, Proc. Sympos. Time Series Analysis (Brown Univ., 1962), Wiley, New York, 1963, pp. 17-37]. This estimator is a semiparametric estimator based on nonparametric spectral estimators. We derive the second order Edgeworth expansion of the distribution of . Then it is shown that the second order asymptotic properties are independent of the bandwidth choice for residual spectral estimator, which implies that has the same rate of convergence as in regular parametric estimation. This is a sharp contrast with the general semiparametric estimation theory. We also examine the second order Gaussian efficiency of . Numerical studies are given to confirm the theoretical results.     

The asymptotic behavior of linear placement statistics

Orban and Wolfe (1982) and Kim (1999) provided the limiting distribution for linear placement statistics under null hypotheses only when one of the sample sizes goes to infinity. In this paper we prove the asymptotic normality and the weak convergence of the linear placement statistics of Orban and Wolfe (1982) and Kim (1999) when the sample sizes of each group go to infinity simultaneously.     

Blockwise empirical likelihood for time series of counts

Time series of counts have a wide variety of applications in real life. Analyzing time series of counts requires accommodations for serial dependence, discreteness, and overdispersion of data. In this paper, we extend blockwise empirical likelihood (Kitamura, 1997 [15]) to the analysis of time series of counts under a regression setting. In particular, our contribution is the extension of Kitamura’s (1997) [15] method to the analysis of nonstationary time series. Serial dependence among observations is treated nonparametrically using a blocking technique; and overdispersion in count data is accommodated by the specification of a variance-mean relationship. We establish consistency and asymptotic normality of the maximum blockwise empirical likelihood estimator. Simulation studies show that our method has a good finite sample performance. The method is also illustrated by analyzing two real data sets: monthly counts of poliomyelitis cases in the USA and daily counts of non-accidental deaths in Toronto, Canada.     

Testing for equality between two copulas

We develop a test of equality between two dependence structures estimated through empirical copulas. We provide inference for independent or paired samples. The multiplier central limit theorem is used for calculating p-values of the Cramér-von Mises test statistic. Finite sample properties are assessed with Monte Carlo experiments. We apply the testing procedure on empirical examples in finance, psychology, insurance and medicine.     

Jackknife-blockwise empirical likelihood methods under dependence

Empirical likelihood for general estimating equations is a method for testing hypothesis or constructing confidence regions on parameters of interest. If the number of parameters of interest is smaller than that of estimating equations, a profile empirical likelihood has to be employed. In case of dependent data, a profile blockwise empirical likelihood method can be used. However, if too many nuisance parameters are involved, a computational difficulty in optimizing the profile empirical likelihood arises. Recently, Li et al. (2011) [9] proposed a jackknife empirical likelihood method to reduce the computation in the profile empirical likelihood methods for independent data. In this paper, we propose a jackknife-blockwise empirical likelihood method to overcome the computational burden in the profile blockwise empirical likelihood method for weakly dependent data.     

Locally stationary long memory estimation

There exists a wide literature on parametrically or semi-parametrically modelling strongly dependent time series using a long-memory parameter d, including more recent work on wavelet estimation. As a generalization of these latter approaches, in this work we allow the long-memory parameter d to be varying over time. We adopt a semi-parametric approach in order to avoid fitting a time-varying parametric model, such as tvARFIMA, to the observed data. We study the asymptotic behavior of a local log-regression wavelet estimator of the time-dependent d. Both simulations and a real data example complete our work on providing a fairly general approach.     

An asymptotic theory for sample covariances of Bernoulli shifts

Covariances play a fundamental role in the theory of stationary processes and they can naturally be estimated by sample covariances. There is a well-developed asymptotic theory for sample covariances of linear processes. For nonlinear processes, however, many important problems on their asymptotic behaviors are still unanswered. The paper presents a systematic asymptotic theory for sample covariances of nonlinear time series. Our results are applied to the test of correlations.     

Moderate deviations for quadratic forms in Gaussian stationary processes

Moderate deviations limit theorem is proved for quadratic forms in zero-mean Gaussian stationary processes. Two particular cases are the cumulative periodogram and the kernel spectral density estimator. We also derive the exponential decay of moderate deviation probabilities of goodness-of-fit tests for the spectral density and then discuss intermediate asymptotic efficiencies of tests.     

Estimating the inter-arrival time density of Markov renewal processes under structural assumptions on the transition distribution

We consider a stationary Markov renewal process whose inter-arrival time density depends multiplicatively on the distance between the past and present state of the embedded chain. This is appropriate when the jump size is governed by influences that accumulate over time. Then we can construct an estimator for the inter-arrival time density that has the parametric rate of convergence. The estimator is a local von Mises statistic. The result carries over to the corresponding semi-Markov process.     

Minimum Hellinger distance estimation in a two-sample semiparametric model

We investigate the estimation problem of parameters in a two-sample semiparametric model. Specifically, let X₁,…,X_n be a sample from a population with distribution function G and density function g. Independent of the X_i’s, let Z₁,…,Z_m be another random sample with distribution function H and density function h(x)=exp[α+r(x)β]g(x), where α and β are unknown parameters of interest and g is an unknown density. This model has wide applications in logistic discriminant analysis, case-control studies, and analysis of receiver operating characteristic curves. Furthermore, it can be considered as a biased sampling model with weight function depending on unknown parameters. In this paper, we construct minimum Hellinger distance estimators of α and β. The proposed estimators are chosen to minimize the Hellinger distance between a semiparametric model and a nonparametric density estimator. Theoretical properties such as the existence, strong consistency and asymptotic normality are investigated. Robustness of proposed estimators is also examined using a Monte Carlo study.     

On non-parametric estimation of the Lévy kernel of Markov processes

We consider a recurrent Markov process which is an Itô semi-martingale. The Lévy kernel describes the law of its jumps. Based on observations _X0,_XΔ,…,_XnΔ$X_0,X_{\Delta },\dots ,X_{n\Delta }$, we construct an estimator for the Lévy kernel’s density. We prove its consistency (as nΔ→∞$n\Delta \to \infty$ and Δ→0$\Delta \to 0$) and a central limit theorem. In the positive recurrent case, our estimator is asymptotically normal; in the null recurrent case, it is asymptotically mixed normal. Our estimator’s rate of convergence equals the non-parametric minimax rate of smooth density estimation. The asymptotic bias and variance are analogous to those of the classical Nadaraya–Watson estimator for conditional densities. Asymptotic confidence intervals are provided.