Strong approximation for cross-covariances of linear variables with long-range dependence

Suppose {_k, −∞ < k < ∞} is an independent, not necessarily identically distributed sequence of random variables, and {c_j}^∞_j=0, {d_j}^∞_j=0 are sequences of real numbers such that Σ_jc²_j < ∞, Σ_jd²_j < ∞. Then, under appropriate moment conditions on {_k, −∞ < k < ∞}, y_k Σ^∞_j=0c_jk-j, z_k Σ^∞_j=0d_jk-j exist almost surely and in ⁴ and the question of Gaussian approximation to S_t]Σ^t]_k=1 (y_k z_k − E{y_k z_k}) becomes of interest. Prior to this work several related central limit theorems and a weak invariance principle were proven under stationary assumptions. In this note, we demonstrate that an almost sure invariance principle for S_t], with error bound sharp enough to imply a weak invariance principle, a functional law of the iterated logarithm, and even upper and lower class results, also exists. Moreover, we remove virtually all constraints on _k for “time” k ≤ 0, weaken the stationarity assumptions on {_k, −∞ < k < ∞}, and improve the summability conditions on {c_j}^∞_j=0, {d_j}^∞_j=0 as compared to the existing weak invariance principle. Applications relevant to this work include normal approximation and almost sure fluctuation results in sample covariances (let d_j = c_j-m for j ≥ m and otherwise 0), quadratic forms, Whittle's and Hosoya's estimates, adaptive filtering and stochastic approximation.