Noncentral matrix quadratic forms of the skew elliptical variables

In this paper, the noncentral matrix quadratic forms of the skew elliptical variables are studied. A family of the matrix variate noncentral generalized Dirichlet distributions is introduced as the extension of the noncentral Wishart distributions, the Dirichlet distributions and the noncentral generalized Dirichlet distributions. Main distributional properties are investigated. These include probability density and closure property under linear transformation and marginalization, the joint distribution of the sub-matrices of the matrix quadratic forms in the skew elliptical variables and the moment generating functions and Bartlett's decomposition of the matrix quadratic forms in the skew normal variables. Two versions of the noncentral Cochran's Theorem for the matrix variate skew normal distributions are obtained, providing sufficient and necessary conditions for the quadratic forms in the skew normal variables to have the matrix variate noncentral generalized Dirichlet distributions. Applications include the properties of the least squares estimation in multivariate linear model and the robustness property of the Wilk's likelihood ratio statistic in the family of the matrix variate skew elliptical distributions.     

Conditional independence models for seemingly unrelated regressions with incomplete data

We consider normal ≡ Gaussian seemingly unrelated regressions (SUR) with incomplete data (ID). Imposing a natural minimal set of conditional independence constraints, we find a restricted SUR/ID model whose likelihood function and parameter space factor into the product of the likelihood functions and the parameter spaces of standard complete data multivariate analysis of variance models. Hence, the restricted model has a unimodal likelihood and permits explicit likelihood inference. In the development of our methodology, we review and extend existing results for complete data SUR models and the multivariate ID problem.     

Near-exact distributions for the independence and sphericity likelihood ratio test statistics

In this paper we show how, based on a decomposition of the likelihood ratio test for sphericity into two independent tests and a suitably developed decomposition of the characteristic function of the logarithm of the likelihood ratio test statistic to test independence in a set of variates, we may obtain extremely well-fitting near-exact distributions for both test statistics. Since both test statistics have the distribution of the product of independent Beta random variables, it is possible to obtain near-exact distributions for both statistics in the form of Generalized Near-Integer Gamma distributions or mixtures of these distributions. For the independence test statistic, numerical studies and comparisons with asymptotic distributions proposed by other authors show the extremely high accuracy of the near-exact distributions developed as approximations to the exact distribution. Concerning the sphericity test statistic, comparisons with formerly developed near-exact distributions show the advantages of these new near-exact distributions.     

Stein's Lemma for elliptical random vectors

For the family of multivariate normal distribution functions, Stein's Lemma presents a useful tool for calculating covariances between functions of the component random variables. Motivated by applications to corporate finance, we prove a generalization of Stein's Lemma to the family of elliptical distributions.     

Nonparametric tests for conditional independence in two-way contingency tables

Testing for the independence between two categorical variables R and S forming a contingency table is a well-known problem: the classical chi-square and likelihood ratio tests are used. Suppose now that for each individual a set of p characteristics is also observed. Those explanatory variables, likely to be associated with R and S, can play a major role in their possible association, and it can therefore be interesting to test the independence between R and S conditionally on them. In this paper, we propose two nonparametric tests which generalise the chi-square and the likelihood ratio ideas to this case. The procedure is based on a kernel estimator of the conditional probabilities. The asymptotic law of the proposed test statistics under the conditional independence hypothesis is derived; the finite sample behaviour of the procedure is analysed through some Monte Carlo experiments and the approach is illustrated with a real data example.     

One-step estimation of spatial dependence parameters: Properties and extensions of the APLE statistic

We consider one-step estimation of parameters that represent the strength of spatial dependence in a geostatistical or lattice spatial model. While the maximum likelihood estimators (MLE) of spatial dependence parameters are known to have various desirable properties, they do not have closed-form expressions. Therefore, we consider a one-step alternative to maximum likelihood estimation based on solving an approximate (i.e., one-step) profile likelihood estimating equation. The resulting approximate profile likelihood estimator (APLE) has a closed-form representation, making it a suitable alternative to the widely used Moran’s I statistic. Since the finite-sample and asymptotic properties of one-step estimators of covariance-function parameters have not been studied rigorously, we explore these properties for the APLE of the spatial dependence parameter in the simultaneous autoregressive (SAR) model. Motivated by the APLE statistic’s closed from, we develop exploratory spatial data analysis tools that capture regions of local clustering or the extent to which the strength of spatial dependence varies across space. We illustrate these exploratory tools using both simulated data and observed crime rates in Columbus, OH.     

On the comparison of the pre-test and shrinkage phi-divergence test estimators for the symmetry model of categorical data

The estimation problem of the parameters in a symmetry model for categorical data has been considered for many authors in the statistical literature (for example, Bowker (1948) [1], Ireland et al. (1969) [2], Quade and Salama (1975) [3], Cressie and Read (1988) [4], Menéndez et al. (2005) [5]) without using uncertain prior information. It is well known that many new and interesting estimators, using uncertain prior information, have been studied by a host of researchers in different statistical models, and many papers have been published on this topic (see Saleh (2006) [9] and references therein). In this paper, we consider the symmetry model of categorical data and we study, for the first time, some new estimators when non-sample information about the symmetry of the probabilities is considered. The decision to use a “restricted” estimator or an “unrestricted” estimator is based on the outcome of a preliminary test, and then a shrinkage technique is used. It is interesting to note that we present a unified study in the sense that we consider not only the maximum likelihood estimator and likelihood ratio test or chi-square test statistic but we consider minimum phi-divergence estimators and phi-divergence test statistics. Families of minimum phi-divergence estimators and phi-divergence test statistics are wide classes of estimators and test statistics that contain as a particular case the maximum likelihood estimator, likelihood ratio test and chi-square test statistic. In an asymptotic set-up, the biases and the risk under the squared loss function for the proposed estimators are derived and compared. A numerical example clarifies the content of the paper.     

Semiparametric Bayesian measurement error modeling

This work presents a Bayesian semiparametric approach for dealing with regression models where the covariate is measured with error. Given that (1) the error normality assumption is very restrictive, and (2) assuming a specific elliptical distribution for errors (Student-t for example), may be somewhat presumptuous; there is need for more flexible methods, in terms of assuming only symmetry of errors (admitting unknown kurtosis). In this sense, the main advantage of this extended Bayesian approach is the possibility of considering generalizations of the elliptical family of models by using Dirichlet process priors in dependent and independent situations. Conditional posterior distributions are implemented, allowing the use of Markov Chain Monte Carlo (MCMC), to generate the posterior distributions. An interesting result shown is that the Dirichlet process prior is not updated in the case of the dependent elliptical model. Furthermore, an analysis of a real data set is reported to illustrate the usefulness of our approach, in dealing with outliers. Finally, semiparametric proposed models and parametric normal model are compared, graphically with the posterior distribution density of the coefficients.     

A statistical model for random rotations

This paper studies the properties of the Cayley distributions, a new family of models for random p×p rotations. This class of distributions is related to the Cayley transform that maps a p(p-1)/2×1 vector s into SO(p), the space of p×p rotation matrices. First an expression for the uniform measure on SO(p) is derived using the Cayley transform, then the Cayley density for random rotations is investigated. A closed-form expression is derived for its normalizing constant, a simple simulation algorithm is proposed, and moments are derived. The efficiencies of moment estimators of the parameters of the new model are also calculated. A Monte Carlo investigation of tests and of confidence regions for the parameters of the new density is briefly summarized. A numerical example is presented.     

On Mardia's and Song's measures of kurtosis in elliptical distributions

The main objective of this paper is the calculation and the comparative study of two general measures of multivariate kurtosis, namely Mardia's measure β_2,p and Song's measure S(f). In this context, general formulas for the said measures are derived for the broad family of the elliptically contoured symmetric distributions and also for specific members of this family, like the multivariate t-distribution, the multivariate Pearson type II, the multivariate Pearson type VII, the multivariate symmetric Kotz type distribution and the uniform distribution in the unit sphere. Analytic expressions for computing Shannon and Rényi entropies are obtained under the elliptic family. The behaviour of Mardia's and Song's measures, their similarities and differences, possible interpretations and uses in practice are investigated by comparing them in specific members of the elliptic family of multivariate distributions. An empirical estimator of Song's measure is moreover proposed and its asymptotic distribution is investigated under the elliptic family of multivariate distributions.     

Analysis of two-sample truncated data using generalized logistic models

Parallel to Cox's [JRSS B34 (1972) 187-230] proportional hazards model, generalized logistic models have been discussed by Anderson [Bull. Int. Statist. Inst. 48 (1979) 35-53] and others. The essential assumption is that the two densities ratio has a known parametric form. A nice property of this model is that it naturally relates to the logistic regression model for categorical data. In astronomic, demographic, epidemiological, and other studies the variable of interest is often truncated by an associated variable. This paper studies generalized logistic models for the two-sample truncated data problem, where the two lifetime densities ratio is assumed to have the form exp{α+φ(x;β)}. Here φ is a known function of x and β, and the baseline density is unspecified. We develop a semiparametric maximum likelihood method for the case where the two samples have a common truncation distribution. It is shown that inferences for β do not depend the nonparametric components. We also derive an iterative algorithm to maximize the semiparametric likelihood for the general case where different truncation distributions are allowed. We further discuss how to check goodness of fit of the generalized logistic model. The developed methods are illustrated and evaluated using both simulated and real data.     

Maximum entropy characterizations of the multivariate Liouville distributions

A random vector X=(X₁,X₂,…,X_n) with positive components has a Liouville distribution with parameter θ=(θ₁,θ₂,…,θ_n) if its joint probability density function is proportional to , θ_i>0 [R.D. Gupta, D.S.P. Richards, Multivariate Liouville distributions, J. Multivariate Anal. 23 (1987) 233-256]. Examples include correlated gamma variables, Dirichlet and inverted Dirichlet distributions. We derive appropriate constraints which establish the maximum entropy characterization of the Liouville distributions among all multivariate distributions. Matrix analogs of the Liouville distributions are considered. Some interesting results related to I-projection from a Liouville distribution are presented.     

Predictivistic characterizations of multivariate student-t models

De Finetti style theorems characterize models (predictive distributions) as mixtures of the likelihood function and the prior distribution, beginning from some judgment of invariance about observable quantities. The likelihood function generally has its functional form identified from invariance assumptions only. However, we need additional conditions on observable quantities (typically, assumptions on conditional expectations) to identify the prior distribution. In this paper, we consider some well-known invariance assumptions and establish additional conditions on observable quantities in order to obtain a predictivistic characterization of the multivariate and matrix-variate Student-t distributions as well as for the Student-t linear model. As a byproduct, a characterization for the Pearson type II distribution is provided.     

A test of location for exchangeable multivariate normal data with unknown correlation

We consider the problem of testing whether the common mean of a single n-vector of multivariate normal random variables with known variance and unknown common correlation ρ is zero. We derive the standardized likelihood ratio test for known ρ and explore different ways of proceeding with ρ unknown. We evaluate the performance of the standardized statistic where ρ is replaced with an estimate of ρ and determine the critical value c_n that controls the type I error rate for the least favorable ρ in [0,1]. The constant c_n increases with n and this procedure has pathological behavior if ρ depends on n and ρ_n converges to zero at a certain rate. As an alternate approach, we replace ρ with the upper limit of a (1−β_n) confidence interval chosen so that c_n=c for all n. We determine β_n so that the type I error rate is exactly controlled for all ρ in [0,1]. We also investigate a simpler approach where we bound the type I error rate. The former method performs well for all n while the less powerful bound method may be a useful in some settings as a simple approach. The proposed tests can be used in different applications, including within-cluster resampling and combining exchangeable p-values.     

A note on bias due to fitting prospective multivariate generalized linear models to categorical outcomes ignoring retrospective sampling schemes

Outcome-dependent sampling designs are commonly used in economics, market research and epidemiological studies. Case-control sampling design is a classic example of outcome-dependent sampling, where exposure information is collected on subjects conditional on their disease status. In many situations, the outcome under consideration may have multiple categories instead of a simple dichotomization. For example, in a case-control study, there may be disease sub-classification among the “cases” based on progression of the disease, or in terms of other histological and morphological characteristics of the disease. In this note, we investigate the issue of fitting prospective multivariate generalized linear models to such multiple-category outcome data, ignoring the retrospective nature of the sampling design. We first provide a set of necessary and sufficient conditions for the link functions that will allow for equivalence of prospective and retrospective inference for the parameters of interest. We show that for categorical outcomes, prospective-retrospective equivalence does not hold beyond the generalized multinomial logit link. We then derive an approximate expression for the bias incurred when link functions outside this class are used. Most popular models for ordinal response fall outside the multiplicative intercept class and one should be cautious while performing a naive prospective analysis of such data as the bias could be substantial. We illustrate the extent of bias through a real data example, based on the ongoing Prostate, Lung, Colorectal and Ovarian (PLCO) cancer screening trial by the National Cancer Institute. The simulations based on the real study illustrate that the bias approximations work well in practice.     

A multivariate extension of Sarhan and Balakrishnan’s bivariate distribution and its ageing and dependence properties

A new class of bivariate distributions (NBD) was recently introduced by Sarhan and Balakrishnan [A.M. Sarhan, N. Balakrishnan, A new class of bivariate distributions and its mixture, J. Multivariate Anal. 98 (2007) 1508-1527]. In this note, we give the joint survival function of a multivariate extension of the NBD, which is not an absolutely continuous multivariate distribution, and its marginal and extreme order statistics distributions are also derived. The multivariate ageing and dependence properties of the proposed n-dimensional distribution are also discussed, and then we analyze the stochastic ageing of its marginals and its minimum and maximum order statistics.     

Testing multivariate normality in incomplete data of small sample size

In longitudinal studies with small samples and incomplete data, multivariate normal-based models continue to be a powerful tool for analysis. This has included a broad scope of biomedical studies. Testing the assumption of multivariate normality (MVN) is critical. Although many methods are available for testing normality in complete data with large samples, a few deal with the testing in small samples. For example, Liang et al. (J. Statist. Planning and Inference 86 (2000) 129) propose a projection procedure for testing MVN for complete-data with small samples where the sample sizes may be close to the dimension. To our knowledge, no statistical methods for testing MVN in incomplete data with small samples are yet available. This article develops a test procedure in such a setting using multiple imputations and the projection test. To utilize the incomplete data structure in multiple imputation, we adopt a noniterative inverse Bayes formulae (IBF) sampling procedure instead of the iterative Gibbs sampling to generate iid samples. Simulations are performed for both complete and incomplete data when the sample size is less than the dimension. The method is illustrated with a real study on an anticancer drug.     

From Archimedean to Liouville copulas

We use a recent characterization of the d-dimensional Archimedean copulas as the survival copulas of d-dimensional simplex distributions (McNeil and Nešlehová (2009) [1]) to construct new Archimedean copula families, and to examine the relationship between their dependence properties and the radial parts of the corresponding simplex distributions. In particular, a new formula for Kendall’s tau is derived and a new dependence ordering for non-negative random variables is introduced which generalises the Laplace transform order. We then generalise the Archimedean copulas to obtain Liouville copulas, which are the survival copulas of Liouville distributions and which are non-exchangeable in general. We derive a formula for Kendall’s tau of Liouville copulas in terms of the radial parts of the corresponding Liouville distributions.     

Completeness and unbiased estimation of mean vector in the multivariate group sequential case

We consider estimation after a group sequential test about a multivariate normal mean, such as a χ² test or a sequential version of the Bonferroni procedure. We derive the density function of the sufficient statistics and show that the sample mean remains to be the maximum likelihood estimator but is no longer unbiased. We propose an alternative Rao-Blackwell type unbiased estimator. We show that the family of distributions of the sufficient statistic is not complete, and there exist infinitely many unbiased estimators of the mean vector and none has uniformly minimum variance. However, when restricted to truncation-adaptable statistics, completeness holds and the Rao-Blackwell estimator has uniformly minimum variance.     

B-splines and discretization in an inverse problem for Poisson processes

Recent results on quasi-maximum likelihood histogram sieve estimators in inverse problems for Poisson processes are generalized to B-spline sieves. The impact of discretization effects on strong L² consistency and convergence rates are studied in detail. In particular, a “rates saturation effect”, caused by discretization, is demonstrated. Finite-sample implementation is proposed and tested in a Monte Carlo experiment with the Wicksell problem, which shows a superior performance of the new approach, when compared to other methods commonly used in that context. The proposed algorithm can also be used in cases with only approximately known folding kernel.