On the law of large numbers for stationary sequences

We show that if X_i is a stationary sequence for which $\text{S}{}_{\mathrm{n}}\text{B}{}_{\mathrm{n}}$ converges to a finite non zero random variable of constant sign, where S_n=X₁+X₂+?+X_n and B_n is a sequence of constants, then B_n is regularly varying with index 1. If in addition $\text{Σ}\text{P}\text{(|X}{}_1\text{|>B}{}_{\mathrm{n}}$ is finite, then $\text{E}\text{|X}{}_1\text{|}$ is finite, and if in addition to this X_i satisfies an asymptotic independence condition, $\text{E}\text{X}{}_1\text{≠ 0}$.     

“Integer-making” theorems

Let X = {x₁, x₂,…} be a finite set and associate to every x_i a real number α_i. Let f(n) [g (n)] be the least value such that given any family $\text{F}$ of subsets of X having maximum degree n [cardinality n], one can find integers α_i, i=1,2,… so that α_i ? α_i|<1 and

$\text{∑}\text{x}{}_{\mathrm{i\; ?\; E}}\text{a}{}_{\mathrm{i}}\text{?}\text{∑}\text{x}{}_{\mathrm{i\; ?\; E}}\text{α}{}_{\mathrm{i}}\text{≤?(n)}\text{∑}\text{x}{}_{\mathrm{i\; ?\; E}}\text{a}{}_{\mathrm{i}}\text{?}\text{∑}\text{x}{}_{\mathrm{i\; ?\; E}}\text{α}{}_{\mathrm{i}}\text{≤}\text{g(n)}$

for all $\text{E ?}\text{F}$. We prove

$\text{f(n)≤n ? 1 and g(n)≤c(n}\text{log}\text{n)}{}^{\mathrm{<mtext>1</mtext><mtext>2</mtext>}}$

.     

Strong law for the bootstrap

Let X₁, X₂, X₃, … be i.i.d. r.v. with E|X₁| < ∞, E X₁ = μ. Given a realization X = (X₁,X₂,…) and integers n and m, construct Y_n,i, i = 1, 2, …, m as i.i.d. r.v. with conditional distribution $\text{P}{}^1\text{(Y}{}_{\mathrm{n,i}}\text{= X}{}_{\mathrm{j}}\text{) =}\text{1}\text{n}$ for 1 ? j ? n. ($\text{P}{}^1$ denotes conditional distribution given X). Conditions relating the growth rate of m with n and the moments of X₁ are given to ensure the almost sure convergence of $\text{(}\text{1}\text{m}\text{)Σ}{}^{\mathrm{m}}{}_{\mathrm{i=1}}\text{Y}{}_{\mathrm{n,i}}$ toμ. This equation is of some relevance in the theory of Bootstrap as developed by Efron (1979) and Bickel and Freedman (1981).     

On Berry-Esséen rates,a law of the iterated logarithm and an invariance principle for the proportion of the sample below the sample mean

Let F_n(x) be the empirical distribution function based on n independent random variables X₁,…,X_n from a common distribution function F(x), and let $\text{X}\text{= Σ}{}_{\mathrm{i=1}}{}^{\mathrm{n}}\text{X}{}_{\mathrm{i}}\text{n}$ be the sample mean. We derive the rate of convergence of $\text{F}{}_{\mathrm{n}}\text{(}\text{X}\text{)}$ to normality (for the regular as well as nonregular cases), a law of iterated logarithm, and an invariance principle for $\text{F}{}_{\mathrm{n}}\text{(}\text{X}\text{)}$.     

A note on the functional law of iterated logarithm for maxima of Gaussian sequences

Let {X_n, n ≥ 1} be a real-valued stationary Gaussian sequence with mean zero and variance one. Let M_n = max{X_t, i ≤ n} and H_n(t) = (M_[nt] ? b_n)a_n^?1 be the maximum resp. the properly normalised maximum process, where $\text{c}{}_{\mathrm{n}}\text{= (2}\text{log}\text{n)}{}^{\mathrm{<mtext>1</mtext><mtext>2</mtext>}}$, $\text{a}{}_{\mathrm{n}}\text{=}\text{(}\text{log log}\text{n)}\text{c}{}_{\mathrm{n}}$ and $\text{b}{}_{\mathrm{n}}\text{= c}{}_{\mathrm{n}}\text{?}\text{1}\text{2}\text{(}\text{log}\text{(4π}\text{log}\text{n))}\text{c}{}_{\mathrm{n}}$. We characterize the almost sure limit functions of (H_n)_n≥3 in the set of non-negative, non-decreasing, right-continuous, real-valued functions on (0, ∞), if r(n) (log n)^3?Δ = O(1) for all Δ > 0 or if r(n) (log n)^2?Δ = O(1) for all Δ > 0 and r(n) convex and fulfills another regularity condition, where r(n) is the correlation function of the Gaussian sequence.     

An extremal problem for sets with applications to graph theory

Let X₁, …, X_n be n disjoint sets. For 1 ? i ? n and 1 ? j ? h let A_ij and B_ij be subsets of X_i that satisfy |A_ij| ? r_i and |B_ij| ? s_i for 1 ? i ? n, 1 ? j ? h, $\text{(∪}{}_{\mathrm{i}}\text{A}{}_{\mathrm{ij}}\text{) ∩ (∪}{}_{\mathrm{i}}\text{B}{}_{\mathrm{ij}}\text{) = ?}$ for 1 ? j ? h, $\text{(∪}{}_{\mathrm{i}}\text{A}{}_{\mathrm{ij}}\text{) ∩ (∪}{}_{\mathrm{i}}\text{B}{}_{\mathrm{il}}\text{) ≠ ?}$ for 1 ? j < l ? h. We prove that $\text{h?}\text{Π}\text{i=1}\text{n}\text{r}{}_{\mathrm{i}}\text{+s}{}_{\mathrm{i}}\text{r}{}_{\mathrm{i}}$. This result is best possible and has some interesting consequences. Its proof uses multilinear techniques (exterior algebra).     

The inertia of a Hermitian matrix having prescribed complementary principal submatrices

For i=1,2 let H_i be a given n_i×n_i Hermitian matrix. We characterize the set of inertias

$\text{In}\text{H}{}_1\text{X}\text{X}{}^1\text{H}{}_2\text{:X}\text{is}\text{n}{}_1\text{×n}{}_2$

in terms of In(H₁) and In(H₂).     

A central limit theorem for the sojourn times of strongly ergodic Markov chains

Let X_n be an irreducible aperiodic recurrent Markov chain with countable state space I and with the mean recurrence times having second moments. There is proved a global central limit theorem for the properly normalized sojourn times. More precisely, if $\text{t}{}^{\mathrm{(n}}\text{)}{}_{\mathrm{i}}\text{=Σ}{}^{\mathrm{n}}{}_{\mathrm{k=1}}\text{i}\text{?}{}_{\mathrm{i}}\text{(X}{}_{\mathrm{k}}\text{)}$, then the probability measures induced by {t⁽ⁿ⁾_i/√n?√nπ_i}_i?I(π_i being the ergotic distribution) on the Hilbert-space of square summable I-sequences converge weakly in this space to a Gaussian measure determined by a certain weak potential operator.     

Stability of a chain of linear differential equations

The behavior of an infinite sequence of ordinary differential equations of the form:

$\text{dXn}\text{dt}\text{=}\text{∑}\text{i=?M}\text{N}\text{L}{}_{\mathrm{i}}\text{X}{}_{\mathrm{i+n}}\text{, 0 ? n, 0 < N, M < ∞}$

,

$\text{X}{}_{\mathrm{n}}\text{(0) = C}{}_{\mathrm{n}}\text{, (1) X}{}_{\mathrm{n}}\text{≡ 0, n < 0}$

, where X_n(t) is a vector valued function of R⁺, is studied in spaces of infinite sequences of vectors. In particular, sufficient conditions for asymptotic stability of this sequence of linear equations are established and applied to the stability analysis of a string of vehicles with a simple form of automatic control.     

Three problems on the lengths of increasing runs

Let U₁, U₂,… be a sequence of independent, uniform (0, 1) r.v.'s and let R₁, R₂,… be the lengths of increasing runs of {U_i}, i.e., X₁=R₁=inf{i:U_i+1<U_i},…, X_n=R₁+R₂+?+R_n=inf{i:i>X_n?1,U_i+1<U_i}. The first theorem states that the sequence $\text{(}\text{3}\text{2}\text{n)}{}^{\mathrm{<mtext>1</mtext><mtext>2</mtext>}}\text{(X}{}_{\mathrm{n}}\text{?2n)}$ can be approximated by a Wiener process in strong sense.Let τ(n) be the largest integer for which R₁+R₂+?+R_τ(n)?n, $\text{R}{}^1{}_{\mathrm{n}}\text{=n?(R}{}_1\text{+R}{}_2\text{+?+R}{}_{\mathrm{\tau (n)}}\text{)}$ and $\text{M}{}_{\mathrm{n}}\text{=}\text{max}\text{{R}{}_1\text{,R}{}_2\text{,…,R}{}_{\mathrm{\tau (n)}}\text{,R}{}^1{}_{\mathrm{n}}\text{}}$. Here M_n is the length of the longest increasing block. A strong theorem is given to characterize the limit behaviour of M_n.The limit distribution of the lengths of increasing runs is our third problem.     

Extreme value distribution for normalized sums from stationary Gaussian sequences

Let {X_i, i?0} be a sequence of independent identically distributed random variables with finite absolute third moment. Then Darling and Erdös have shown that

for -∞<t<∞ where and $\text{X}{}_{\mathrm{n}}\text{= (2 ln ln n)}{}^{\mathrm{<mtext>1</mtext><mtext>2</mtext>}}$. The result is extended to dependent sequences but assuming that {X_i} is a standard stationary Gaussian sequence with covariance function {r_i}. When {X_i} is moderately dependent (e.g. when $\text{v(∑}{}^{\mathrm{n}}{}_{\mathrm{i=1}}\text{X}{}_{\mathrm{i}}\text{) ? n}{}_{\mathrm{a}}\text{, 0 < a < 2)}$ we get

where H_a is a constant. In the strongly dependent case (e.g. when $\text{v(∑}{}^{\mathrm{n}}{}_{\mathrm{i=1}}\text{X}{}_{\mathrm{i}}\text{) ? n}{}^2\text{r(n))}$ we get

for-∞<t<∞.     

The expected eigenvalue distribution of a large regular graph

Let K₁, K₂,... be a sequence of regular graphs with degree v?2 such that n(X_i)→∞ and ck(X_i)/n(X_i)→0 as i∞ for each k?3, where n(X_i) is the order of X_i, and c_k(X_i) is the number of k- cycles in X₁. We determine the limiting probability density f(x) for the eigenvalues of X>_i as i→∞. It turns out that

$\text{f(x)=}\text{v}\text{4(v?1)?v}{}^2\text{2π(v}{}^2\text{?x}{}^2\text{)}{}_0$

for ?x??2$\text{v-1}$, otherwise It is further shown that f(x) is the expected eigenvalue distribution for every large randomly chosen labeled regular graph with degree v.     

Local asymptotic normality for progressively censored likelihood ratio statistics and applications

Let X_n,1 ≤ X_n,2 ≤ … ≤ X_n,n be the ordered variables corresponding to a random sample of size n with respect to a family of probability measures {P_θ:θ ∈ Θ} where Θ is an open subset of the real line. In many practical situations the X_n,i are the observables and experimentation must be curtailed prior to X_n,n. If τ_n is a stopping variable adapted to the σ-fields {σ(X_n,1,…,X_n,k): 1 ≤ k ≤ n} and P_n,θ the projection of P_θ onto σ(X_n,1,…,X_n,τn), the local asymptotic normality of the stopped progressively censored likelihood ratio statistics is established with θ, $\text{θ}{}_{\mathrm{n}}\text{= θ + un}{}^{\mathrm{<mtext>?1</mtext><mtext>2</mtext>}}\text{∈ Θ}$ and θ, u held fixed, under certain conditions on the underlying distribution and on τ_n. Conditions are also given to ensure the local asymptotic normality of likelihood ratio statistics where the underlying observations are given in a series scheme.     

Hermite series estimates of a probability density and its derivatives

The following estimate of the pth derivative of a probability density function is examined: $\text{Σ}{}_{\mathrm{k\; =\; 0}}{}^{\mathrm{N}}\text{a}\text{?}{}_{\mathrm{k}}\text{h}{}_{\mathrm{k}}\text{(x)}$, where h_k is the kth Hermite function and $\text{a}\text{?}{}_{\mathrm{k}}\text{= (}\text{(?1)}{}^{\mathrm{p}}\text{n}\text{)}$Σ_{i = 1}ⁿh_k^(p)(X_i) is calculated from a sequence X₁,…, X_n of independent random variables having the common unknown density. If the density has r derivatives the integrated square error converges to zero in the mean and almost completely as rapidly as O(n^?α) and O(n^?α log n), respectively, where $\text{α =}\text{2(r ? p)}\text{(2r + 1)}$. Rates for the uniform convergence both in the mean square and almost complete are also given. For any finite interval they are O(n^?β) and $\text{O(n}{}^{\mathrm{<mtext>?\beta </mtext><mtext>2</mtext>}}\text{log}\text{n)}$, respectively, where $\text{β =}\text{(2(r ? p) ? 1)}\text{(2r + 1)}$.     

Common strict character of some sharp infinite-sequence martingale inequalities

A procedure is given for proving strictness of some sharp, infinite-sequence martingale inequalities, which arise from sharp, finite-sequence martingale inequalities attained by degenerating extremal distributions. The procedure is applied to obtain strictness of the sharp inequalities of Cox and Kemperman

$\text{P(|X}{}_{\mathrm{i}}\text{|?1 for some i=1, 2,…)?(ln 2)}{}^{\mathrm{?1}}\text{sup}\text{n}\text{E}\text{∑}\text{i=0}\text{n}\text{X}{}_{\mathrm{i}}$

and of Cox (sharp form of Burkholder's inequality)

$\text{P}\text{∑}\text{i=0}\text{∞}\text{X}{}^2{}_{\mathrm{i}}\text{?1}\text{? e}{}^{\mathrm{<mtext>1</mtext><mtext>2</mtext>}}\text{sup}\text{n}\text{E}\text{∑}\text{i=0}\text{n}\text{X}{}_{\mathrm{i}}$

for all nontrivial martingale difference sequences X₀,X₁,….     

Limit distributions for the maxima of stationary Gaussian processes

Let {X_n} be a stationary Gaussian sequence with E{X₀} = 0, {X²₀} = 1 and E{X₀X_n} = rⁿ_n Let c_n = (2ln n)^{$\text{built1}\text{2}$}, b_n = c_n? $\text{1}\text{2}$c^-1_n ln(4π ln n), and set M_n = max_{0 ?k?n}X_k. A classical result for independent normal random variables is that

$\text{P[c}{}_{\mathrm{n}}\text{(M}{}_{\mathrm{n}}\text{?b}{}_{\mathrm{n}}\text{)?x]→exp[-e}{}^{\mathrm{-x}}\text{] as n → ∞ for all x.}$

Berman has shown that (1) applies as well to dependent sequences provided r_nlnn = o(1). Suppose now that {r_n} is a convex correlation sequence satisfying r_n = o(1), (r_nlnn)^-1 is monotone for large n and o(1). Then

$\text{P[r}{}_{\mathrm{n}}{}^{\mathrm{<mtext>-1</mtext><mtext>2</mtext>}}\text{(M}{}_{\mathrm{n}}\text{? (1?r}{}_{\mathrm{n}}\text{)}{}^{\mathrm{<mtext>1</mtext><mtext>2</mtext>}}\text{b}{}_{\mathrm{n}}\text{)?x] → Ф(x)}$

for all x, where Ф is the normal distribution function. While the normal can thus be viewed as a second natural limit distribution for {M_n}, there are others. In particular, the limit distribution is given below when r_n is (sufficiently close to) γ/ln n. We further exhibit a collection of limit distributions which can arise when r_n decays to zero in a nonsmooth manner. Continuous parameter Gaussian processes are also considered. A modified version of (1) has been given by Pickands for some continuous processes which possess sufficient asymptotic independence properties. Under a weaker form of asymptotic independence, we obtain a version of (2).     

Phase reconstruction from magnitude of band-limited multidimensional signals

In this paper, the problem of phase reconstruction from magnitude of multidimensional band-limited functions is considered. It is shown that any irreducible band-limited function f(z₁…,z_n), z_i ? $\text{C}$, i=1, …, n, is uniquely determined from the magnitude of f(x₁…,x_n): | f(x₁…,x_n)|, x_i ? $\text{R}$, i=1,…, n, except for (1) linear shifts: ^{i(α1z1+…+α_n2n+β}), β, α_i?$\text{R}$, i=1,…, n; and (2) conjugation: $\text{f}{}^1\text{(z}{}_1{}^1\text{,…,z}{}_{\mathrm{n}}{}^1\text{)}$.