An asymptotic expansion of the distribution of Rao's U-statistic under a general condition

In this paper we consider the problem of testing the hypothesis about the sub-mean vector. For this propose, the asymptotic expansion of the null distribution of Rao's U-statistic under a general condition is obtained up to order of n^-1. The same problem in the k-sample case is also investigated. We find that the asymptotic distribution of generalized U-statistic in the k-sample case is identical to that of the generalized Hotelling's T² distribution up to n^-1. A simulation experiment is carried out and its results are presented. It shows that the asymptotic distributions have significant improvement when comparing with the limiting distributions both in the small sample case and the large sample case. It also demonstrates the equivalence of two testing statistics mentioned above.     

Gauss inequalities on ordered linear spaces

Markov inequalities on ordered linear spaces are tightened through the α-unimodality of the corresponding measures. Modality indices are studied for various induced measures, including the singular values of a random matrix and the periodogram of a time series. These tools support a detailed study of linear inference and the ordering of random matrices, to include fixed and random designs and probability bounds on their comparative efficiencies. Other applications include probability bounds on quadratic forms and of order statistics on Rⁿ, on periodograms in the analysis of time series, and on run-length distributions in multivariate statistical process control. Connections to other topics in applied probability and statistics are noted.     

Multivariate linear rank statistics for profile analysis

For some general multivariate linear models, linear rank statistics are used in conjunction with Roy's Union-Intersection Principle to develop some tests for inference on the parameter (vector) when they are subject to certain linear constraints. More powerful tests are designed by incorporating the a priori information on these constraints. Profile analysis is an important application of this type of hypothesis testing problem; it consists of a set of hypothesis testing problem for the p responses q-sample model, where it is a priori assumed that the response-sample interactions are null.     

Nonnegative quadratic estimation and quadratic sufficiency in general linear models

Notions of linear sufficiency and quadratic sufficiency are of interest to some authors. In this paper, the problem of nonnegative quadratic estimation for β^′Hβ+hσ² is discussed in a general linear model and its transformed model. The notion of quadratic sufficiency is considered in the sense of generality, and the corresponding necessary and sufficient conditions for the transformation to be quadratically sufficient are investigated. As a direct consequence, the result on (ordinary) quadratic sufficiency is obtained. In addition, we pose a practical problem and extend a special situation to the multivariate case. Moreover, a simulated example is conducted, and applications to a model with compound symmetric covariance matrix are given. Finally, we derive a remark which indicates that our main results could be extended further to the quasi-normal case.     

New families of estimators and test statistics in log-linear models

In this paper we consider categorical data that are distributed according to a multinomial, product-multinomial or Poisson distribution whose expected values follow a log-linear model and we study the inference problem of hypothesis testing in a log-linear model setting. The family of test statistics considered is based on the family of ?-divergence measures. The unknown parameters in the log-linear model under consideration are also estimated using ?-divergence measures: Minimum ?-divergence estimators. A simulation study is included to find test statistics that offer an attractive alternative to the Pearson chi-square and likelihood-ratio test statistics.     

A Bahadur efficiency comparison between one and two sample rank statistics and their sequential rank statistic analogues

One and two sample rank statistics are shown in general to be more efficient in the Bahadur sense than their sequential rank statistic analogues as defined by Mason (1981, Ann. Statist.9 424–436) and Lombard (1981, South African Statist. J.15 129–152), even though the two families of statistics (those based on full ranks and those based on sequential ranks) have the same Pitman efficiency against local alternatives. In the process, general results on large deviation probabilities and laws of large numbers for statistics based on sequential ranks are obtained.     

Asymptotically efficient two-sample rank tests for modal directions on spheres

A general class of optimal and distribution-free rank tests for the two-sample modal directions problem on (hyper-) spheres is proposed, along with an asymptotic distribution theory for such spherical rank tests. The asymptotic optimality of the spherical rank tests in terms of power-equivalence to the spherical likelihood ratio tests is studied, while the spherical Wilcoxon rank test, an important case for the class of spherical rank tests, is further investigated. A data set is reanalyzed and some errors made in previous studies are corrected. On the usual sphere, a lower bound on the asymptotic Pitman relative efficiency relative to Hotelling’s T²-type test is established, and a new distribution for which the spherical Wilcoxon rank test is optimal is also introduced.     

Affine-invariant aligned rank tests for the multivariate general linear model with VARMA errors

We develop optimal rank-based procedures for testing affine-invariant linear hypotheses on the parameters of a multivariate general linear model with elliptical VARMA errors. We propose a class of optimal procedures that are based either on residual (pseudo-)Mahalanobis signs and ranks, or on absolute interdirections and lift-interdirection ranks, i.e., on hyperplane-based signs and ranks. The Mahalanobis versions of these procedures are strictly affine-invariant, while the hyperplane-based ones are asymptotically affine-invariant. Both versions generalize the univariate signed rank procedures proposed by Hallin and Puri (J. Multivar. Anal. 50 (1994) 175), and are locally asymptotically most stringent under correctly specified radial densities. Their AREs with respect to Gaussian procedures are shown to be convex linear combinations of the AREs obtained in Hallin and Paindaveine (Ann. Statist. 30 (2002) 1103; Bernoulli 8 (2002) 787) for the pure location and purely serial models, respectively. The resulting test statistics are provided under closed form for several important particular cases, including multivariate Durbin-Watson tests, VARMA order identification tests, etc. The key technical result is a multivariate asymptotic linearity result proved in Hallin and Paindaveine (Asymptotic linearity of serial and nonserial multivariate signed rank statistics, submitted).     

Equivalent conditions for noncentral generalized Laplacianness and independence of matrix quadratic forms

Let Y be an n×p multivariate normal random matrix with general covariance Σ_Y and W be a symmetric matrix. In the present article, the property that a matrix quadratic form Y^′WY is distributed as a difference of two independent (noncentral) Wishart random matrices is called the (noncentral) generalized Laplacianness (GL). Then a set of algebraic results are obtained which will give the necessary and sufficient conditions for the (noncentral) GL of a matrix quadratic form. Further, two extensions of Cochran’s theorem concerning the (noncentral) GL and independence of a family of matrix quadratic forms are developed.     

A class of semidefinite programs with rank-one solutions

We show that a class of semidefinite programs (SDP) admits a solution that is a positive semidefinite matrix of rank at most r, where r is the rank of the matrix involved in the objective function of the SDP. The optimization problems of this class are semidefinite packing problems, which are the SDP analogs to vector packing problems. Of particular interest is the case in which our result guarantees the existence of a solution of rank one: we show that the computation of this solution actually reduces to a Second Order Cone Program (SOCP). We point out an application in statistics, in the optimal design of experiments.     

Hájek-Šidák approach to the asymptotic distribution of multivariate rank order statistics

Let X_α = (X_1α,…, X_pα), 1 ≤ α ≤ N_ν, ν ≥ 1 be N_ν independent observations from a density function f(x) where x ∈ R^p, the p-dimensional real space. Let R_νjα denote the rank of X_jα in the ordered array of X_j1 ,…, X_jNν; 1 ≤ j ≤ p and consider the multivariate rank order statistics

$\text{T}{}_{\mathrm{vj}}\text{=}\text{∑}\text{α = 1}\text{N}{}_{\mathrm{v}}\text{C}{}_{\mathrm{y\alpha }}\text{a}{}_{\mathrm{vj}}\text{(R}{}_{\mathrm{vj\alpha }}\text{),}$

where the constants, c_να, 1 ≤ α ≤ N_ν satisfy the Noether condition and the scores, a_νj(α), 1 ≤ j ≤ p, 1 ≤ α ≤ N_ν converge as ν → ∞, for each j, in quadratic mean to a nonconstant, square integrable function π_j(u), 0 < u < 1. Under the hypothesis of randomness, the joint asymptotic conditional and uncoditional normality of the statistics T_νj, 1 ≤ j ≤ p is established. Further, under mild conditions on the underlying density functions and assuming contiguous location shift alternatives, the joint asymptotic normality of these statistics is also established.     

On some nonparametric tests for profile analysis of several multivariate samples

For profile analysis of independent samples from several multivariate populations, a nonparametric analog of the hypothesis of parallelism of population profiles is formulated. A class of asymptotically distribution-free statistics is offered to test this hypothesis. These are based on generalized U statistics and are in some sense modifications of statistics offered previously by one of the authors for testing the homogeneity hypothesis. Consistency of these statistics is established for suitable alternatives and also asymptotic power is investigated.     

Rank test for heteroscedastic functional data

In this paper, we consider (mid-)rank based inferences for testing hypotheses in a fully nonparametric marginal model for heteroscedastic functional data that contain a large number of within subject measurements from possibly only a limited number of subjects. The effects of several crossed factors and their interactions with time are considered. The results are obtained by establishing asymptotic equivalence between the rank statistics and their asymptotic rank transforms. The inference holds under the assumption ofα-mixing without moment assumptions. As a result, the proposed tests are applicable to data from heavy-tailed or skewed distributions, including both continuous and ordered categorical responses. Simulation results and a real application confirm that the (mid-)rank procedures provide both robustness and increased power over the methods based on original observations for non-normally distributed data.     

The likelihood ratio tests for the dimensionality of regression coefficients

In this paper we give a unified derivation of the likelihood ratio (LR) statistics for testing the hypothesis on the dimensionality of regression coefficients under a usual MANOVA model. We also derive the LR statistics under a general MANOVA model and study their asymptotic null and nonnull distributions. Further it is shown that the test statistic used by Bartlett [4] for testing the hypothesis that the last p?k canonical correlations are all zero is the LR statistic.     

On the performance of some statistics in discriminant analysis based on covariates

In this paper we study the behavior of three statistics suggested for testing the hypothesis, H₀ : μ₁ = μ₂, in the two sample case, in the presence of covariables. Power comparisons are made in the case when δ₂, the difference of the mean vectors in the covariates, is not equal to zero. This extends an earlier paper of the authors [Sanklya Ser. B35 51–78], where δ₂ was assumed to be equal to zero. The results reiterate those obtained in the above cited paper that for low observed values of D_q² one would use t₂ otherwise t₃ would be recommended. The statistic t₁ does not seem to be appropriate for testing this hypothesis.     

Estimation of the mean vector of a multivariate normal distribution: subspace hypothesis

This paper considers the estimation of the mean vector θ of a p-variate normal distribution with unknown covariance matrix Σ when it is suspected that for a p×r known matrix B the hypothesis θ=Bη, η∈R^r may hold. We consider empirical Bayes estimators which includes (i) the unrestricted unbiased (UE) estimator, namely, the sample mean vector (ii) the restricted estimator (RE) which is obtained when the hypothesis θ=Bη holds (iii) the preliminary test estimator (PTE), (iv) the James-Stein estimator (JSE), and (v) the positive-rule Stein estimator (PRSE). The biases and the risks under the squared loss function are evaluated for all the five estimators and compared. The numerical computations show that PRSE is the best among all the five estimators even when the hypothesis θ=Bη is true.     

K-sample subsampling in general spaces: The case of independent time series

The problem of subsampling in two-sample and K-sample settings is addressed where both the data and the statistics of interest take values in general spaces. We focus on the case where each sample is a stationary time series, and construct subsampling confidence intervals and hypothesis tests with asymptotic validity. Some examples are also given, and the problem of optimal block size choice is discussed.     

Least squares problems with inequality constraints as quadratic constraints

Linear least squares problems with box constraints are commonly solved to find model parameters within bounds based on physical considerations. Common algorithms include Bounded Variable Least Squares (BVLS) and the Matlab function lsqlin. Here, the goal is to find solutions to ill-posed inverse problems that lie within box constraints. To do this, we formulate the box constraints as quadratic constraints, and solve the corresponding unconstrained regularized least squares problem. Using box constraints as quadratic constraints is an efficient approach because the optimization problem has a closed form solution. The effectiveness of the proposed algorithm is investigated through solving three benchmark problems and one from a hydrological application. Results are compared with solutions found by lsqlin, and the quadratically constrained formulation is solved using the L-curve, maximum a posteriori estimation (MAP), and the χ² regularization method. The χ² regularization method with quadratic constraints is the most effective method for solving least squares problems with box constraints.     

On necessary and sufficient conditions for uniform strong consistency of estimators of a density and its derivatives

Based on a random sample from a population with (unknown) probability density f, this note exhibits a class of statistics f^(p) for each fixed integer $\text{p ≧ 0}$. It is shown that f^(p) are uniformly strongly consistent estimators of f^(p), the pth order derivative of f, if and only iff^(p)is bounded and uniformly continuous.     

Wishartness and independence of matrix quadratic forms in a normal random matrix

Let Y be an n×p multivariate normal random matrix with general covariance Σ_Y. The general covariance Σ_Y of Y means that the collection of all np elements in Y has an arbitrary np×np covariance matrix. A set of general, succinct and verifiable necessary and sufficient conditions is established for matrix quadratic forms Y^′W_iY's with the symmetric W_i's to be an independent family of random matrices distributed as Wishart distributions. Moreover, a set of general necessary and sufficient conditions is obtained for matrix quadratic forms Y^′W_iY's to be an independent family of random matrices distributed as noncentral Wishart distributions. Some usual versions of Cochran's theorem are presented as the special cases of these results.