More on Stochastic Comparisons and Dependence among Concomitants of Order Statistics

For a sample of iid observations {(X_i, Y_i)} from an absolutely continuous distribution, the multivariate dependence of concomitants Y_[]=(Y_[1], Y_[2], …, Y_[n]) and the stochastic order of subsets of Y_[] are studied. If (X, Y) is totally positive dependent of order 2, Y_[] is multivariate totally positive dependent of order 2. If the conditional hazard rate function of Y given X, h_YX(yx), is decreasing in x for every y, Y_[] is multivariate right corner set increasing. And if Y is stochastically increasing in X, the concomitants are increasing in multivariate stochastic order.     

Exponential bounds of mean error for the kernel estimates of regression functions

Let (X, Y), (X₁, Y₁), …, (X_n, Y_n) be i.d.d. R^r × R-valued random vectors with E|Y| < ∞, and let Q_n(x) be a kernel estimate of the regression function Q(x) = E(Y|X = x). In this paper, we establish an exponential bound of the mean deviation between Q_n(x) and Q(x) given the training sample Zⁿ = (X₁, Y₁, …, X_n, Y_n), under conditions as weak as possible.     

Prophet regions and sharp inequalities for pth absolute moments of martingales

Exact comparisons are made relating E|Y₀|^p, E|Y_n−1|^p, and E(max_j≤n−1 |Y_j|^p), valid for all martingales Y₀,…,Y_n−1, for each p ≥ 1. Specifically, for p > 1, the set of ordered triples {(x, y, z) : X = E|Y₀|^p, Y = E |Y_n−1|^p, and Z = E(max_j≤n−1 |Y_j|^p) for some martingale Y₀,…,Y_n−1} is precisely the set {(x, y, z) : 0≤x≤y≤z≤Ψ_n,p(x, y)}, where Ψ_n,p(x, y) = xψ_n,p(y/x) if x > 0, and = a_n−1,py if x = 0; here ψ_n,p is a specific recursively defined function. The result yields families of sharp inequalities, such as E(max_j≤n−1 |Y_j|^p) + ψ_n,p^*(a) E |Y₀|^p ≤ aE |Y_n−1|^p, valid for all martingales Y₀,…,Y_n−1, where ψ_n,p^* is the concave conjugate function of ψ_n,p. Both the finite sequence and infinite sequence cases are developed. Proofs utilize moment theory, induction, conjugate function theory, and functional equation analysis.     

Some New Results on Stochastic Comparisons of Spacings from Heterogeneous Exponential Distributions

Some new results are obtained on stochastic orderings between random vectors of spacings from heterogeneous exponential distributions and homogeneous ones. LetD₁, …, D_nbe the normalized spacings associated with independent exponential random variablesX₁, …,X_n, whereX_ihas hazard rateλ_i,i=1, 2, …, n. LetD*₁, …, D*_nbe the normalized spacings of a random sampleY₁, …, Y_nof sizenfrom an exponential distribution with hazard rateλ=∑ⁿ_i=1 λ_i/n. It is shown that for anyn2, the random vector (D₁, …, D_n) is greater than the random vector (D*₁, …, D*_n) in the sense of multivariate likelihood ratio ordering. It also follows from the results proved in this paper that for anyjbetween 2 andn, the survival function ofX_j:n−X_1:nis Schur convex.     

Nonparametric Empirical Bayes Estimation of the Matrix Parameter of the Wishart Distribution

We consider independent pairs (X₁, Σ₁), (X₂, Σ₂), …, (X_n, Σ_n), where eachΣ_iis distributed according to some unknown density functiong(Σ) and, givenΣ_i=Σ,X_ihas conditional density functionq(xΣ) of the Wishart type. In each pair the first component is observable but the second is not. After the (n+1)th observationX_n+1is obtained, the objective is to estimateΣ_n+1corresponding toX_n+1. This estimator is called the empirical Bayes (EB) estimator ofΣ. An EB estimator ofΣis constructed without any parametric assumptions ong(Σ). Its posterior mean square risk is examined, and the estimator is demonstrated to be pointwise asymptotically optimal.     

L1-optimal estimates for a regression type function in R

Let X₁, X₂, …, X_n be random vectors that take values in a compact set in R^d, d ≥ 1. Let Y₁, Y₂, …, Y_n be random variables (“the responses”) which conditionally on X₁ = x₁, …, X_n = x_n are independent with densities f(y | x_i, θ(x_i)), i = 1, …, n. Assuming that θ lives in a sup-norm compact space Θ_q,d of real valued functions, an optimal L₁-consistent estimator of θ is constructed via empirical measures. The rate of convergence of the estimator to the true parameter θ depends on Kolmogorov's entropy of Θ_q,d.     

Correlations of functions of normal variables

Let (X₁, X₂,…, X_k, Y₁, Y₂,…, Y_k) be multivariate normal and define a matrix C by C_ij = cov(X_i, Y_j). If (i) (X₁,…, X_k) = (Y₁,…, Y_k) and (ii) C is symmetric positive definite, then 0 < varf(X₁,…, X_k) < ∞ corr(f(X₁,…, X_k),f(Y₁,…, Y_k)) > 0. Condition (i) is necessary for the conclusion. The sufficiency of (i) and (ii) follows from an infinite-dimensional version, which can also be applied to a pair of jointly normal Brownian motions.     

Comonotone Jackson's Inequality

Let 2s points y_i=−πy_2s<…<y₁<π be given. Using these points, we define the points y_i for all integer indices i by the equality y_i=y_i+2s+2π. We shall write fΔ⁽¹⁾(Y) if f is a 2π-periodic continuous function and f does not decrease on [y_i, y_i−1], if i is odd; and f does not increase on [y_i, y_i−1], if i is even. In this article the following Theorem 1—the comonotone analogue of Jackson's inequality—is proved. 1. If fΔ⁽¹⁾(Y), then for each nonnegative integer n there is a trigonometric polynomial τ_n(x) of order n such that τ_nΔ⁽¹⁾(Y), and |f(x)−π_n(x)|c(s) ω(f; 1/(n+1)), x , where ω(f; t) is the modulus of continuity of f, c(s)=const. Depending only on s.     

Set-Indexed Conditional Empirical and Quantile Processes Based on Dependent Data

We consider a conditional empirical distribution of the form F_n(C x)=∑ⁿ_t=1 ω_n(X_t−x) I{Y_tC} indexed by C , where {(X_t, Y_t), t=1, …, n} are observations from a strictly stationary and strong mixing stochastic process, {ω_n(X_t−x)} are kernel weights, and is a class of sets. Under the assumption on the richness of the index class in terms of metric entropy with bracketing, we have established uniform convergence and asymptotic normality for F_n(· x). The key result specifies rates of convergences for the modulus of continuity of the conditional empirical process. The results are then applied to derive Bahadur–Kiefer type approximations for a generalized conditional quantile process which, in the case with independent observations, generalizes and improves earlier results. Potential applications in the areas of estimating level sets and testing for unimodality (or multimodality) of conditional distributions are discussed.     

Consistency of a recursive nearest neighbor regression function estimate

Let (X, Y) be an ^d × -valued random vector and let (X₁, Y₁),…,(X_N, Y_N) be a random sample drawn from its distribution. Divide the data sequence into disjoint blocks of length l₁, …, l_n, find the nearest neighbor to X in each block and call the corresponding couple (X_i^*, Y_i^*). It is shown that the estimate m_n(X) = Σ_{i = 1}ⁿ w_niY_i^*/Σ_{i = 1}ⁿ w_ni of m(X) = E{Y|X} satisfies E{|m_n(X) − m(X)|^p} 0 (p ≥ 1) whenever E{|Y|^p} < ∞, l_n ∞, and the triangular array of positive weights {w_ni} satisfies sup_{i ≤ n}w_ni/Σ_{i = 1}ⁿ w_ni 0. No other restrictions are put on the distribution of (X, Y). Also, some distribution-free results for the strong convergence of E{|m_n(X) − m(X)|^p|X₁, Y₁,…, X_N, Y_N} to zero are included. Finally, an application to the discrimination problem is considered, and a discrimination rule is exhibited and shown to be strongly Bayes risk consistent for all distributions.     

Global nonparametric estimation of conditional quantile functions and their derivatives

Let (X, Y) be a random vector such that X is d-dimensional, Y is real valued, and θ(X) is the conditional αth quantile of Y given X, where α is a fixed number such that 0 < α < 1. Assume that θ is a smooth function with order of smoothness p > 0, and set r = (p − m)/(2p + d), where m is a nonnegative integer smaller than p. Let T(θ) denote a derivative of θ of order m. It is proved that there exists estimate of T(θ), based on a set of i.i.d. observations (X₁, Y₁), …, (X_n, Y_n), that achieves the optimal nonparametric rate of convergence n^−r in L_q-norms (1 ≤ q < ∞) restricted to compacts under appropriate regularity conditions. Further, it has been shown that there exists estimate of T(θ) that achieves the optimal rate (n/log n)^−r in L_∞-norm restricted to compacts.     

Stochastic Comparisons and Dependence among Concomitants of Order Statistics

Let (X_i, Y_i) i=1, 2, …, n be n independent and identically distributed random variables from some continuous bivariate distribution. If X_(r) denotes the rth ordered X-variate then the Y-variate, Y_[r], paired with X_(r) is called the concomitant of the rth order statistic. In this paper we obtain new general results on stochastic comparisons and dependence among concomitants of order statistics under different types of dependence between the parent random variables X and Y. The results obtained apply to any distribution with monotone dependence between X and Y. In particular, when X and Y are likelihood ratio dependent, it is shown that the successive concomitants of order statistics are increasing according to likelihood ratio ordering and they are TP₂ dependent in pairs. If we assume that the conditional hazard rate of Y given X=x is decreasing in x, then the concomitants are increasing according to hazard rate ordering and are dependent according to the right corner set increasing property. Finally, it is proved that if Y is stochastically increasing in X, then the concomitants of order statistics are stochastically increasing and are associated. Analogous results are obtained when the variables X and Y are negatively dependent. We also prove that if the hazard rate of the conditional distribution of Y given X=x is decreasing in x and y, then the concomitants have DFR (decreasing failure rate) distributions and are ordered according to dispersive ordering.     

Estimates of Freud-Christoffel functions for some weights with the whole real line as support

Upper and lower bounds for generalized Christoffel functions, called Freud-Christoffel functions, are obtained. These have the form λ_n,p(W,j,x) = infPW_Lp(R)/|P^(j)(X)| where the infimum is taken over all polynomials P(x) of degree at most n − 1. The upper and lower bounds for λ_n,p(W,j,x) are obtained for all 0 < p ∞ and J = 0, 1, 2, 3,… for weights W(x) = exp(−Q(x)), where, among other things, Q(x) is bounded in [− A, A], and Q″ is continuous in β(−A, A) for some A > 0. For p = ∞, the lower bounds give a simple proof of local and global Markov-Bernstein inequalities. For p = 2, the results remove some restrictions on Q in Freud's work. The weights considered include W(x) = exp(− ¦x¦^α/2), α > 0, and W(x) = exp(− exp(¦x¦)), > 0.     

A discrete Korovkin theorem

In this paper we give a sufficient condition for the pointwise Korovkin property on B(X), the space of bounded real valued functions on an arbitrary countable set X = {x_l,…, x_j,…}. Our theorem follows from its L_p(X, μ) analogue (and conversely); here 1 p < ∞ and μ is a positive finite measure on X such that μ({x_j}) > 0 for all j.     

On improved estimators of the generalized variance

Treated in this paper is the problem of estimating with squared error loss the generalized variance | Σ | from a Wishart random matrix S: p × p W_p(n, Σ) and an independent normal random matrix X: p × k N(ξ, Σ I_k) with ξ(p × k) unknown. Denote the columns of X by X₍₁₎ ,…, X_(k) and set ψ⁽⁰⁾(S, X) = {(n − p + 2)!/(n + 2)!} | S |, ψ⁽ⁱ⁾(X, X) = min[ψ⁽ⁱ⁻¹⁾(S, X), {(n − p + i + 2)!/(n + i + 2)!} | S + X₍₁₎ X′₍₁₎ + + X_(i) X′_(i) |] and Ψ⁽ⁱ⁾(S, X) = min[ψ⁽⁰⁾(S, X), {(n − p + i + 2)!/(n + i + 2)!}| S + X₍₁₎ X′₍₁₎ + + X_(i) X′_(i) |], i = 1,…,k. Our result is that the minimax, best affine equivariant estimator ψ⁽⁰⁾(S, X) is dominated by each of Ψ⁽ⁱ⁾(S, X), i = 1,…,k and for every i, ψ⁽ⁱ⁾(S, X) is better than ψ⁽ⁱ⁻¹⁾(S, X). In particular, ψ^(k)(S, X) = min[{(n − p + 2)!/(n + 2)!} | S |, {(n − p + 2)!/(n + 2)!} | S + X₍₁₎X′₍₁₎|,…,| {(n − p + k + 2)!/(n + k + 2)!} | S + X₍₁₎X′₍₁₎ + + X_(k)X′_(k)|] dominates all other ψ's. It is obtained by considering a multivariate extension of Stein's result (Ann. Inst. Statist. Math. 16, 155–160 (1964)) on the estimation of the normal variance.     

A sufficient condition for pairing problem of generators in symmetrizable Kac–Moody algebras

In a symmetrizable Kac–Moody algebra g(A), let α=∑_i=1ⁿk_iα_i be an imaginary root satisfying k_i>0 and α,α_i<0 for i=1,2,…,n. In this paper, it is proved that for any x_αg_α{0}, satisfying [x_α,f_n]≠0 and [x_α,f_i]=0 for i=1,2,…,n−1, there exists a vector y such that the subalgebra generated by x_α and y contains g′(A), the derived subalgebra of g(A).     

Estimation of the Location of the Maximum of a Regression Function Using Extreme Order Statistics

In this paper, we consider the problem of approximating the location,x₀∈C, of a maximum of a regresion function,θ(x), under certain weak assumptions onθ. HereCis a bounded interval inR. A specific algorithm considered in this paper is as follows. Taking a random sampleX₁, …, X_nfrom a distribution overC, we have (X_i, Y_i), whereY_iis the outcome of noisy measurement ofθ(X_i). Arrange theY_i's in nondecreasing order and take the average of ther X_i's which are associated with therlargest order statistics ofY_i. This average,x₀, will then be used as an estimate ofx₀. The utility of such an algorithm with fixed r is evaluated in this paper. To be specific, the convergence rates ofx₀tox₀are derived. Those rates will depend on the right tail of the noise distribution and the shape ofθ(·) nearx₀.     

On the convergence rate of maximal deviation distribution for kernel regression estimates

Let (X, Y), X R^p, Y R¹ have the regression function r(x) = E(Y¦X = x). We consider the kernel nonparametric estimate r_n(x) of r(x) and obtain a sequence of distribution functions approximating the distribution of the maximal deviation with power rate. It is shown that the distribution of the maximal deviation tends to double exponent (which is a conventional form of such theorems) with logarithmic rate and this rate cannot be improved.     

On the transition from a Markov chain to a continuous time process

Starting from a real-valued Markov chain X₀,X₁,…,X_n with stationary transition probabilities, a random element {Y(t);t[0, 1]} of the function space D[0, 1] is constructed by letting Y(k/n)=X_k, k= 0,1,…,n, and assuming Y (t) constant in between. Sample tightness criteria for sequences {Y(t);t[0,1]};_n of such random elements in D[0, 1] are then given in terms of the one-step transition probabilities of the underlying Markov chains. Applications are made to Galton-Watson branching processes.     

The Descent Monomials and a Basis for the Diagonally Symmetric Polynomials

Let R(X) = Q[x ₁, x ₂, ..., x _n] be the ring of polynomials in the variables X = {x ₁, x ₂, ..., x _n} and R*(X) denote the quotient of R(X) by the ideal generated by the elementary symmetric functions. Given a S _n, we let g In the late 1970s I. Gessel conjectured that these monomials, called the descent monomials, are a basis for R*(X). Actually, this result was known to Steinberg [10]. A. Garsia showed how it could be derived from the theory of Stanley-Reisner Rings [3]. Now let R(X, Y) denote the ring of polynomials in the variables X = {x ₁, x ₂, ..., x _n} and Y = {y ₁, y ₂, ..., y _n}. The diagonal action of S _n on polynomial P(X, Y) is defined as Let R (X, Y) be the subring of R(X, Y) which is invariant under the diagonal action. Let R *(X, Y) denote the quotient of R (X, Y) by the ideal generated by the elementary symmetric functions in X and the elementary symmetric functions in Y. Recently, A. Garsia in [4] and V. Reiner in [8] showed that a collection of polynomials closely related to the descent monomials are a basis for R *(X, Y). In this paper, the author gives elementary proofs of both theorems by constructing algorithms that show how to expand elements of R*(X) and R *(X, Y) in terms of their respective bases.