Strong Universal Pointwise Consistency of Recursive Regression Estimates

For semi-recursive and recursive kernel estimates of a regression of Y on X (d-dimensional random vector X, integrable real random variable Y), introduced by Devroye and Wagner and by Révész, respectively, strong universal pointwise consistency is shown, i.e. strong consistency P _X -almost everywhere for general distribution of (X, Y). Similar results are shown for the corresponding partitioning estimates.     

Stochastic comparisons of order statistics from gamma distributions

Let (X₁,X₂,…,X_n) and (Y₁,Y₂,…,Y_n) be gamma random vectors with common shape parameter α(0<α?1) and scale parameters (λ₁,λ₂,…,λ_n), (μ₁,μ₂,…,μ_n), respectively. Let X₍₎=(X₍₁₎,X₍₂₎,…,X_(n)), Y₍₎=(Y₍₁₎,Y₍₂₎,…,Y_(n)) be the order statistics of (X₁,X₂,…,X_n) and (Y₁,Y₂,…,Y_n). Then (λ₁,λ₂,…,λ_n) majorizes (μ₁,μ₂,…,μ_n) implies that X₍₎ is stochastically larger than Y₍₎. However if the common shape parameter α>1, we can only compare the the first- and last-order statistics. Some earlier results on stochastically comparing proportional hazard functions are shown to be special cases of our results.     

On the dependence between the extreme order statistics in the proportional hazards model

Let X₁,…,X_n be a random sample from an absolutely continuous distribution with non-negative support, and let Y₁,…,Y_n be mutually independent lifetimes with proportional hazard rates. Let also X₍₁₎<?<X_(n) and Y₍₁₎<?<Y_(n) be their associated order statistics. It is shown that the pair (X₍₁₎,X_(n)) is then more dependent than the pair (Y₍₁₎,Y_(n)), in the sense of the right-tail increasing ordering of Avérous and Dortet-Bernadet [LTD and RTI dependence orderings, Canad. J. Statist. 28 (2000) 151-157]. Elementary consequences of this fact are highlighted.     

On the range of heterogeneous samples

Let R_n be the range of a random sample X₁,…,X_n of exponential random variables with hazard rate λ. Let S_n be the range of another collection Y₁,…,Y_n of mutually independent exponential random variables with hazard rates λ₁,…,λ_n whose average is λ. Finally, let r and s denote the reversed hazard rates of R_n and S_n, respectively. It is shown here that the mapping t?s(t)/r(t) is increasing on (0,∞) and that as a result, R_n=X_(n)−X₍₁₎ is smaller than S_n=Y_(n)−Y₍₁₎ in the likelihood ratio ordering as well as in the dispersive ordering. As a further consequence of this fact, X_(n) is seen to be more stochastically increasing in X₍₁₎ than Y_(n) is in Y₍₁₎. In other words, the pair (X₍₁₎,X_(n)) is more dependent than the pair (Y₍₁₎,Y_(n)) in the monotone regression dependence ordering. The latter finding extends readily to the more general context where X₁,…,X_n form a random sample from a continuous distribution while Y₁,…,Y_n are mutually independent lifetimes with proportional hazard rates.     

Asymptotic confidence intervals for Poisson regression

Let (X,Y) be a R^d×N₀-valued random vector where the conditional distribution of Y given X=x is a Poisson distribution with mean m(x). We estimate m by a local polynomial kernel estimate defined by maximizing a localized log-likelihood function. We use this estimate of m(x) to estimate the conditional distribution of Y given X=x by a corresponding Poisson distribution and to construct confidence intervals of level α of Y given X=x. Under mild regularity conditions on m(x) and on the distribution of X we show strong convergence of the integrated L₁ distance between Poisson distribution and its estimate. We also demonstrate that the corresponding confidence interval has asymptotically (i.e., for sample size tending to infinity) level α, and that the probability that the length of this confidence interval deviates from the optimal length by more than one converges to zero with the number of samples tending to infinity.     

The product of two dependent random variables with regularly varying or rapidly varying tails

Let X and Y be two nonnegative and dependent random variables following a generalized Farlie-Gumbel-Morgenstern distribution. In this short note, we study the impact of a dependence structure of X and Y on the tail behavior of XY. We quantify the impact as the limit, as x→∞, of the quotient of Pr(XY>x) and Pr(X^∗Y^∗>x), where X^∗ and Y^∗ are independent random variables identically distributed as X and Y, respectively. We obtain an explicit expression for this limit when X is regularly varying or rapidly varying tailed.     

Robustness of A-optimal designs

Suppose that Y=(Y_i) is a normal random vector with mean Xb and covariance σ²I_n, where b is a p-dimensional vector (b_j),X=(X_ij) is an n×p matrix. A-optimal designs X are chosen from the traditional set D of A-optimal designs for ρ=0 such that X is still A-optimal in D when the components Y_i are dependent, i.e., for i≠i′, the covariance of Y_i,Y_i^′ is ρ with ρ≠0. Such designs depend on the sign of ρ. The general results are applied to X=(X_ij), where X_ij∈{-1,1}; this corresponds to a factorial design with -1,1 representing low level or high level respectively, or corresponds to a weighing design with -1,1 representing an object j with weight b_j being weighed on the left and right of a chemical balance respectively.     

A characterization of the multivariate normal distribution

Let X_j (j = 1,…,n) be i.i.d. random variables, and let Y′ = (Y₁,…,Y_m) and X′ = (X₁,…,X_n) be independently distributed, and A = (a_jk) be an n × n random coefficient matrix with a_jk = a_jk(Y) for j, k = 1,…,n. Consider the equation U = AX, Kingman and Graybill [Ann. Math. Statist.41 (1970)] have shown U ～ N(O,I) if and only if X ～ N(O,I). provided that certain conditions defined in terms of the a_jk are satisfied. The task of this paper is to delete the identical assumption on X₁,…,X_n and then generalize the results to the vector case. Furthermore, the condition of independence on the random components within each vector is relaxed, and also the question raised by the above authors is answered.     

Distribution-free consistency of kernel non-parametric M-estimators

We prove that in the case of independent and identically distributed random vectors (X_i,Y_i) a class of kernel type M-estimators is universally and strongly consistent for conditional M-functionals. The term universal means that the strong consistency holds for all joint probability distributions of (X,Y). The conditional M-functional minimizes (2.2) for almost every x. In the case M(y)=|y| the conditional M-functional coincides with the L₁-functional and with the conditional median.     

On characterization of multivariate stable distributions via random linear statistics

LetX ₁,X ₂, ...,X _n be independent and identically distributed random vectors inR ^d , and letY=(Y ₁,Y ₂, ...,Y _n )′ be a random coefficient vector inR ⁿ , independent ofX _j ^/′ . We characterize the multivariate stable distributions by considering the independence of the random linear statistic $$U = Y_1 X_1 + Y_2 X_2 + \cdot \cdot \cdot + Y_n X_n $$ and the random coefficient vectorY.     

Flexible modeling based on copulas in nonparametric median regression

Consider the model Y=m(X)+ε, where m(⋅)=med(Y|⋅) is unknown but smooth. It is often assumed that ε and X are independent. However, in practice this assumption is violated in many cases. In this paper we propose modeling the dependence between ε and X by means of a copula model, i.e. (ε,X)∼C_θ(F_ε(⋅),F_X(⋅)), where C_θ is a copula function depending on an unknown parameter θ, and F_ε and F_X are the marginals of ε and X. Since many parametric copula families contain the independent copula as a special case, the so-obtained regression model is more flexible than the ‘classical’ regression model.We estimate the parameter θ via a pseudo-likelihood method and prove the asymptotic normality of the estimator, based on delicate empirical process theory. We also study the estimation of the conditional distribution of Y given X. The procedure is illustrated by means of a simulation study, and the method is applied to data on food expenditures in households.     

Strong law for the bootstrap

Let X₁, X₂, X₃, … be i.i.d. r.v. with E|X₁| < ∞, E X₁ = μ. Given a realization X = (X₁,X₂,…) and integers n and m, construct Y_n,i, i = 1, 2, …, m as i.i.d. r.v. with conditional distribution $\text{P}{}^1\text{(Y}{}_{\mathrm{n,i}}\text{= X}{}_{\mathrm{j}}\text{) =}\text{1}\text{n}$ for 1 ? j ? n. ($\text{P}{}^1$ denotes conditional distribution given X). Conditions relating the growth rate of m with n and the moments of X₁ are given to ensure the almost sure convergence of $\text{(}\text{1}\text{m}\text{)Σ}{}^{\mathrm{m}}{}_{\mathrm{i=1}}\text{Y}{}_{\mathrm{n,i}}$ toμ. This equation is of some relevance in the theory of Bootstrap as developed by Efron (1979) and Bickel and Freedman (1981).     

Linear combination of concomitants of order statistics with application to testing and estimation

Summary Let (X ₁,Y ₁), (X ₂,Y ₂),…, (X _n,Y _n) be i.i.d. as (X, Y). TheY-variate paired with therth orderedX-variateX _rn is denoted byY _rn and terms the concomitant of therth order statistic. Statistics of the form are considered. The asymptotic normality ofT _n is established. The asymptotic results are used to test univariate and bivariate normality, to test independence and linearity ofX andY, and to estimate regression coefficient based on complete and censored samples.     

Confidence intervals for marginal parameters under fractional linear regression imputation for missing data

Item nonresponse occurs frequently in sample surveys and other applications. Imputation is commonly used to fill in the missing item values in a random sample {Y_i;i=1,…,n}. Fractional linear regression imputation, based on the model with independent zero mean errors ?_i, is used to create one or more imputed values in the data file for each missing item Y_i, where {X_i,i=1,…,n}, is observed completely. Asymptotic normality of the imputed estimators of the mean μ=E(Y), distribution function θ=F(y) for a given y, and qth quantile θ_q=F^-1(q),0<q<1 is established, assuming that Y is missing at random (MAR) given X. This result is used to obtain normal approximation (NA)-based confidence intervals on μ,θ and θ_q. In the case of θ_q, a Bahadur-type representation and Woodruff-type confidence intervals are also obtained. Empirical likelihood (EL) ratios are also obtained and shown to be asymptotically scaled variables. This result is used to obtain asymptotically correct EL-based confidence intervals on μ,θ and θ_q. Results of a simulation study on the finite sample performance of NA-based and EL-based confidence intervals are reported.     

Wishart distributions associated with matrix quadratic forms

For a normally distributed random matrix Y with mean zero and general covariance matrix Σ_Y and for a symmetric matrix W, necessary and sufficient conditions are derived for the Wishartness of Y′WY.     

Probabilities of maximal deviations for nonparametric regression function estimates

Let (X, Y) have regression function m(x) = E(Y | X = x), and let X have a marginal density f₁(x). We consider two nonparameteric estimates of m(x): the Watson estimate when f₁ is known and the Yang estimate when f₁ is known or unknown. For both estimates the asymptotic distribution of the maximal deviation from m(x) is proved, thus extending results of Bickel and Rosenblatt for the estimation of density functions.     

Characterization of a class of bivariate distribution functions

Let F_X,Y(x,y) be a bivariate distribution function and P_n(x), Q_m(y), n, m = 0, 1, 2,…, the orthonormal polynomials of the two marginal distributions F_X(x) and F_Y(y), respectively. Some necessary conditions are derived for the co-efficients c_n, n = 0, 1, 2,…, if the conditional expectation E[P_n(X) ∥ Y] = c_nQ_n(Y) holds for n = 0, 1, 2,…. Several examples are given to show the application of these necessary conditions.     

A result on hypothesis testing for a multivariate normal distribution when some observations are missing

Let U_i = (X_i, Y_i), i = 1, 2,…, n, be a random sample from a bivariate normal distribution with mean μ = (μ_x, μ_y) and covariance matrix

. Let X_i, i = n + 1,…, N represent additional independent observations on the X population. Consider the hypothesis testing problem H₀ : μ = 0 vs. H₁ : μ ≠ 0. We prove that Hotelling's T² test, which uses (X_i, Y_i), i = 1, 2,…, n (and discards X_i, i = n + 1,…, N) is an admissible test. In addition, and from a practical point of view, the proof will enable us to identify the region of the parameter space where the T²-test cannot be beaten. A similar result is also proved for the problem of testing μ_x ? μ_y = 0. A Bayes test and other competitors which are similar tests are discussed.     

On asymptotic distributions of exceedance statistics

In this study, two independent samples X₁,X₂,…,X_n and Y₁,Y₂,…,Y_m with respective distribution functions F and Q are considered. The joint asymptotic distributions of exceedance statistics defined as the number of Y observations falling into a random interval of order statistics constructed from the X sample is investigated. The results can be used in the context of a two-sample problem.     

Minimum Hellinger distance estimation in a two-sample semiparametric model

We investigate the estimation problem of parameters in a two-sample semiparametric model. Specifically, let X₁,…,X_n be a sample from a population with distribution function G and density function g. Independent of the X_i’s, let Z₁,…,Z_m be another random sample with distribution function H and density function h(x)=exp[α+r(x)β]g(x), where α and β are unknown parameters of interest and g is an unknown density. This model has wide applications in logistic discriminant analysis, case-control studies, and analysis of receiver operating characteristic curves. Furthermore, it can be considered as a biased sampling model with weight function depending on unknown parameters. In this paper, we construct minimum Hellinger distance estimators of α and β. The proposed estimators are chosen to minimize the Hellinger distance between a semiparametric model and a nonparametric density estimator. Theoretical properties such as the existence, strong consistency and asymptotic normality are investigated. Robustness of proposed estimators is also examined using a Monte Carlo study.