Checking the adequacy of the multivariate semiparametric location shift model

Let X,X₁,…,X_m,…, Y,Y₁,…,Y_n,… be independent d-dimensional random vectors, where the X_j are i.i.d. copies of X, and the Y_k are i.i.d. copies of Y. We study a class of consistent tests for the hypothesis that Y has the same distribution as X+μ for some unspecified . The test statistic L is a weighted integral of the squared modulus of the difference of the empirical characteristic functions of and Y₁,…,Y_n, where is an estimator of μ. An alternative representation of L is given in terms of an L²-distance between two nonparametric density estimators. The finite-sample and asymptotic null distribution of L is independent of μ. Carried out as a bootstrap or permutation procedure, the test is asymptotically of a given size, irrespective of the unknown underlying distribution. A large-scale simulation study shows that the permutation procedure performs better than the bootstrap.     

On reducibility of n-ary quasigroups

An n-ary operation Q:Σⁿ→Σ is called an n-ary quasigroup of order |Σ| if in the relation x₀=Q(x₁,…,x_n) knowledge of any n elements of x₀,…,x_n uniquely specifies the remaining one. Q is permutably reducible if Q(x₁,…,x_n)=P(R(x_σ(1),…,x_σ(k)),x_σ(k+1),…,x_σ(n)) where P and R are (n-k+1)-ary and k-ary quasigroups, σ is a permutation, and 1<k<n. An m-ary quasigroup S is called a retract of Q if it can be obtained from Q or one of its inverses by fixing n-m>0 arguments. We prove that if the maximum arity of a permutably irreducible retract of an n-ary quasigroup Q belongs to {3,…,n-3}, then Q is permutably reducible.     

On deviations between empirical and quantile processes for mixing random variables

Let {X_n} be a strictly stationary φ-mixing process with Σ_j=1^∞ φ^1/2(j) < ∞. It is shown in the paper that if X₁ is uniformly distributed on the unit interval, then, for any t [0, 1], |F_n⁻¹(t) − t + F_n(t) − t| = O(n^−3/4(log log n)^3/4) a.s. and sup_0≤t≤1 |F_n⁻¹(t) − t + F_n(t) − t| = (O(n^−3/4(log n)^1/2(log log n)^1/4) a.s., where F_n and F_n⁻¹(t) denote the sample distribution function and tth sample quantile, respectively. In case {X_n} is strong mixing with exponentially decaying mixing coefficients, it is shown that, for any t [0, 1], |F_n⁻¹(t) − t + F_n(t) − t| = O(n^−3/4(log n)^1/2(log log n)^3/4) a.s. and sup_0≤t≤1 |F_n⁻¹(t) − t + F_n(t) − t| = O(n^−3/4(log n)(log log n)^1/4) a.s. The results are further extended to general distributions, including some nonregular cases, when the underlying distribution function is not differentiable. The results for φ-mixing processes give the sharpest possible orders in view of the corresponding results of Kiefer for independent random variables.     

Exponential bounds of mean error for the kernel estimates of regression functions

Let (X, Y), (X₁, Y₁), …, (X_n, Y_n) be i.d.d. R^r × R-valued random vectors with E|Y| < ∞, and let Q_n(x) be a kernel estimate of the regression function Q(x) = E(Y|X = x). In this paper, we establish an exponential bound of the mean deviation between Q_n(x) and Q(x) given the training sample Zⁿ = (X₁, Y₁, …, X_n, Y_n), under conditions as weak as possible.     

On confidence sequences for the mean vector of a multivariate normal distribution

Let X₁, X₂,… be idd random vectors with a multivariate normal distribution N(μ, Σ). A sequence of subsets {R_n(a₁, a₂,…, a_n), n ≥ m} of the space of μ is said to be a (1 − α)-level sequence of confidence sets for μ if P(μ R_n(X₁, X₂,…, X_n) for every n ≥ m) ≥ 1 − α. In this note we use the ideas of Robbins Ann. Math. Statist. 41 (1970) to construct confidence sequences for the mean vector μ when Σ is either known or unknown. The constructed sequence R_n(X₁, X₂, …, X_n) depends on Mahalanobis' or Hotelling's according as Σ is known or unknown. Confidence sequences for the vector-valued parameter in the general linear model are also given.     

On the approximate behavior of the posterior distribution for an extreme multivariate observation

The behavior of the posterior for a large observation is considered. Two basic situations are discussed; location vectors and natural parameters.Let X = (X₁, X₂, …, X_n) be an observation from a multivariate exponential distribution with that natural parameter Θ = (Θ₁, Θ₂, …, Θ_n). Let θ_x^* be the posterior mode. Sufficient conditions are presented for the distribution of Θ − θ_x^* given X = x to converge to a multivariate normal with mean vector 0 as |x| tends to infinity. These same conditions imply that E(Θ | X = x) − θ_x^* converges to the zero vector as |x| tends to infinity.The posterior for an observation X = (X₁, X₂, …, X_n is considered for a location vector Θ = (Θ₁, Θ₂, …, Θ_n) as x gets large along a path, γ, in Rⁿ. Sufficient conditions are given for the distribution of γ(t) − Θ given X = γ(t) to converge in law as t → ∞. Slightly stronger conditions ensure that γ(t) − E(Θ | X = γ(t)) converges to the mean of the limiting distribution.These basic results about the posterior mean are extended to cover other estimators. Loss functions which are convex functions of absolute error are considered. Let δ be a Bayes estimator for a loss function of this type. Generally, if the distribution of Θ − E(Θ | X = γ(t)) given X = γ(t) converges in law to a symmetric distribution as t → ∞, it is shown that δ(γ(t)) − E(Θ | X = γ(t)) → 0 as t → ∞.     

A discrete Korovkin theorem

In this paper we give a sufficient condition for the pointwise Korovkin property on B(X), the space of bounded real valued functions on an arbitrary countable set X = {x_l,…, x_j,…}. Our theorem follows from its L_p(X, μ) analogue (and conversely); here 1 p < ∞ and μ is a positive finite measure on X such that μ({x_j}) > 0 for all j.     

Strong limit theorems for quasi-orthogonal random fields

This is a systematic and unified treatment of a variety of seemingly different strong limit problems. The main emphasis is laid on the study of the a.s. behavior of the rectangular means ζ_mn = 1/(λ₁(m) λ₂(n)) Σ_i=1^m Σ_k=1ⁿ X_ik as either max{m, n} → ∞ or min{m, n} → ∞. Here {X_ik: i, k ≥ 1} is an orthogonal or merely quasi-orthogonal random field, whereas {λ₁(m): m ≥ 1} and {λ₂(n): n ≥ 1} are nondecreasing sequences of positive numbers subject to certain growth conditions. The method applied provides the rate of convergence, as well. The sufficient conditions obtained are shown to be the best possible in general. Results on double subsequences and 1-parameter limit theorems are also included.     

Existence of maximal solutions

Let Ω be a plane bounded region. Let U = {U_μ(P):μ(P)εL∞(Ω), u_μ ε H²_{2, 0}(Ω) and a(P, μ(P))u_μ,xx + 2b(P, μ(P))u_μ,xy + c(P, μ(P))u_μ,vv = ƒ(P) for P ε Ω; here we are given a(P, X), b(P, X), c(P, X) ε L_∞(Ω × E¹), ƒ(P) ε L_p(Ω) with p > 2, and our partial differential equation is uniformly elliptic. The functions μ(P) are called profiles. We establish sufficient conditions—which when they apply are constructive—that there exist a μ₀ ε L_∞(Ω) such that u_μ0 (P) u_μ(P) for all P ε Ω and for each μ ε L_∞(Ω). Similar results are obtained for a difference equation and convergence is proved.     

Consistency of a recursive nearest neighbor regression function estimate

Let (X, Y) be an ^d × -valued random vector and let (X₁, Y₁),…,(X_N, Y_N) be a random sample drawn from its distribution. Divide the data sequence into disjoint blocks of length l₁, …, l_n, find the nearest neighbor to X in each block and call the corresponding couple (X_i^*, Y_i^*). It is shown that the estimate m_n(X) = Σ_{i = 1}ⁿ w_niY_i^*/Σ_{i = 1}ⁿ w_ni of m(X) = E{Y|X} satisfies E{|m_n(X) − m(X)|^p} 0 (p ≥ 1) whenever E{|Y|^p} < ∞, l_n ∞, and the triangular array of positive weights {w_ni} satisfies sup_{i ≤ n}w_ni/Σ_{i = 1}ⁿ w_ni 0. No other restrictions are put on the distribution of (X, Y). Also, some distribution-free results for the strong convergence of E{|m_n(X) − m(X)|^p|X₁, Y₁,…, X_N, Y_N} to zero are included. Finally, an application to the discrimination problem is considered, and a discrimination rule is exhibited and shown to be strongly Bayes risk consistent for all distributions.     

Schur functions and the invariant polynomials characterizing U(n) tensor operators

We give a direct formulation of the invariant polynomials _μG_q⁽ⁿ⁾(, Δ_i,;, x_{i,i + 1},) characterizing U(n) tensor operators p, q, …, q, 0, …, 0 in terms of the symmetric functions S_λ known as Schur functions. To this end, we show after the change of variables Δ_i = γ_i − δ_i and x_{i, i + 1} = δ_i − δ_{i + 1} that_μG_q⁽ⁿ⁾(,Δ_i;, x_{i, i + 1},) becomes an integral linear combination of products of Schur functions S_α(, γ_i,) · S_β(, δ_i,) in the variables {γ₁,…, γ_n} and {δ₁,…, δ_n}, respectively. That is, we give a direct proof that _μG_q⁽ⁿ⁾(,Δ_i,;, x_{i, i + 1},) is a bisymmetric polynomial with integer coefficients in the variables {γ₁,…, γ_n} and {δ₁,…, δ_n}. By making further use of basic properties of Schur functions such as the Littlewood-Richardson rule, we prove several remarkable new symmetries for the yet more general bisymmetric polynomials _μ^mG_q⁽ⁿ⁾(γ₁,…, γ_n; δ₁,…, δ_m). These new symmetries enable us to give an explicit formula for both _μ^mG₁⁽ⁿ⁾(γ; δ) and ₁G₂⁽ⁿ⁾(γ; δ). In addition, we describe both algebraic and numerical integration methods for deriving general polynomial formulas for _μ^mG_q⁽ⁿ⁾(γ; δ).     

Asymptotic distributions of regression and autoregression coefficients with martingale difference disturbances

In this paper a form of the Lindeberg condition appropriate for martingale differences is used to obtain asymptotic normality of statistics for regression and autoregression. The regression model is y_t = Bz_t + v_t. The unobserved error sequence {v_t} is a sequence of martingale differences with conditional covariance matrices {Σ_t} and satisfying sup_{t=1,…, n} {v′_tv_tI(v′_tv_t>a) |z_t, v_t−1, z_t−1, …} 0 as a → ∞. The sample covariance of the independent variables z₁, …, z_n, is assumed to have a probability limit M, constant and nonsingular; max_t=1,…,nz′_tz_t/n 0. If (1/n)Σ_t=1ⁿΣ_t Σ, constant, then √nvec( _n−B) N(0,M⁻¹Σ) and _n Σ. The autoregression model is x_t = Bx_{t − 1} + v_t with the maximum absolute value of the characteristic roots of B less than one, the above conditions on {v_t}, and (1/n)Σ_t=max(r,s)+1(Σ_tv_t−1−rv′_t−1−s) δ_rs(ΣΣ), where δ_rs is the Kronecker delta. Then √nvec( _n−B) N(0,Γ⁻¹Σ), where Γ = Σ_{s = 0}^∞B^sΣ(B′)^s.     

Global nonparametric estimation of conditional quantile functions and their derivatives

Let (X, Y) be a random vector such that X is d-dimensional, Y is real valued, and θ(X) is the conditional αth quantile of Y given X, where α is a fixed number such that 0 < α < 1. Assume that θ is a smooth function with order of smoothness p > 0, and set r = (p − m)/(2p + d), where m is a nonnegative integer smaller than p. Let T(θ) denote a derivative of θ of order m. It is proved that there exists estimate of T(θ), based on a set of i.i.d. observations (X₁, Y₁), …, (X_n, Y_n), that achieves the optimal nonparametric rate of convergence n^−r in L_q-norms (1 ≤ q < ∞) restricted to compacts under appropriate regularity conditions. Further, it has been shown that there exists estimate of T(θ) that achieves the optimal rate (n/log n)^−r in L_∞-norm restricted to compacts.     

On the transition from a Markov chain to a continuous time process

Starting from a real-valued Markov chain X₀,X₁,…,X_n with stationary transition probabilities, a random element {Y(t);t[0, 1]} of the function space D[0, 1] is constructed by letting Y(k/n)=X_k, k= 0,1,…,n, and assuming Y (t) constant in between. Sample tightness criteria for sequences {Y(t);t[0,1]};_n of such random elements in D[0, 1] are then given in terms of the one-step transition probabilities of the underlying Markov chains. Applications are made to Galton-Watson branching processes.     

The Central Limit Theorem for Free Additive Convolution

Let {X_n}^∞_n=1be a sequence of free, identically distributed random variables with common distributionμ. Then there exist sequences {B_n}^∞_n=1and {A_n}^∞_n=1of positive and real numbers, respectively, such that sequence of random variables[formula]converges in distribution to the semicircle law if and only if the function[formula]is slowly varying in Karamata's sense. In other words, the free domain of attraction of the semicircle law coincides with the classical domain of attraction of the Gaussian. We prove an analogous result for normal domains of attraction in the sense of Linnik.     

Completeness of Trigonometric System with Integer Indices {e; x }

Necessary and sufficient conditions are given which ensure the completeness of the trigonometric systems with integer indices; {e^inx; x }^∞_n=−∞ or {e^inx; x }^∞_n=1 in L^α(μ,  ), α1. If there exists a support Λ of the measure μ which is a wandering set, that is, Λ+2kπ, k=0, ±1, ±2, … are mutually disjoint for different k's, then the linear span of our trigonometric system {e^inx; x }^∞_n=−∞ is dense in L^α(μ,  ) α1. The converse statement is also true.     

Ratio asymptotics for orthogonal rational functions on an interval

Let {α₁,α₂,…} be a sequence of real numbers outside the interval [−1,1] and μ a positive bounded Borel measure on this interval satisfying the Erd s–Turán condition μ′>0 a.e., where μ′ is the Radon–Nikodym derivative of the measure μ with respect to the Lebesgue measure. We introduce rational functions _n(x) with poles {α₁,…,α_n} orthogonal on [−1,1] and establish some ratio asymptotics for these orthogonal rational functions, i.e. we discuss the convergence of _n+1(x)/_n(x) as n tends to infinity under certain assumptions on the location of the poles. From this we derive asymptotic formulas for the recurrence coefficients in the three-term recurrence relation satisfied by the orthonormal functions.     

Set-Indexed Conditional Empirical and Quantile Processes Based on Dependent Data

We consider a conditional empirical distribution of the form F_n(C x)=∑ⁿ_t=1 ω_n(X_t−x) I{Y_tC} indexed by C , where {(X_t, Y_t), t=1, …, n} are observations from a strictly stationary and strong mixing stochastic process, {ω_n(X_t−x)} are kernel weights, and is a class of sets. Under the assumption on the richness of the index class in terms of metric entropy with bracketing, we have established uniform convergence and asymptotic normality for F_n(· x). The key result specifies rates of convergences for the modulus of continuity of the conditional empirical process. The results are then applied to derive Bahadur–Kiefer type approximations for a generalized conditional quantile process which, in the case with independent observations, generalizes and improves earlier results. Potential applications in the areas of estimating level sets and testing for unimodality (or multimodality) of conditional distributions are discussed.     

Bounds on margin distributions in learning problems

Let be a probability space and let P_n be the empirical measure based on i.i.d. sample (X₁,…,X_n) from P. Let be a class of measurable real valued functions on For define F_f(t):=P{ft} and F_n,f(t):=P_n{ft}. Given γ(0,1], define _n,γ(δ):=1/(n^1−γ/2δ^γ). We show that if the L₂(P_n)-entropy of the class grows as ^−α for some α(0,2), then, for all and all δ(0,Δ_n), Δ_n=O(n^1/2),

and

where and c(σ)↓1 as σ↓0 (the above inequalities hold for any fixed σ(0,1] with a high probability). Also, define

Then for all

uniformly in and with probability 1 (for the above ratio is bounded away from 0 and from ∞). The results are motivated by recent developments in machine learning, where they are used to bound the generalization error of learning algorithms. We also prove some more general results of similar nature, show the sharpness of the conditions and discuss the applications in learning theory.     

On Rado numbers for

For all integers m3 and all natural numbers a₁,a₂,…,a_m−1, let n=R(a₁,a₂,…,a_m−1) represent the least integer such that for every 2-coloring of the set {1,2,…,n} there exists a monochromatic solution to

a₁x₁+a₂x₂++a_m−1x_m−1=x_m.