Estimation of the entropy of a multivariate normal distribution

Motivated by problems in molecular biosciences wherein the evaluation of entropy of a molecular system is important for understanding its thermodynamic properties, we consider the efficient estimation of entropy of a multivariate normal distribution having unknown mean vector and covariance matrix. Based on a random sample, we discuss the problem of estimating the entropy under the quadratic loss function. The best affine equivariant estimator is obtained and, interestingly, it also turns out to be an unbiased estimator and a generalized Bayes estimator. It is established that the best affine equivariant estimator is admissible in the class of estimators that depend on the determinant of the sample covariance matrix alone. The risk improvements of the best affine equivariant estimator over the maximum likelihood estimator (an estimator commonly used in molecular sciences) are obtained numerically and are found to be substantial in higher dimensions, which is commonly the case for atomic coordinates in macromolecules such as proteins. We further establish that even the best affine equivariant estimator is inadmissible and obtain Stein-type and Brewster–Zidek-type estimators dominating it. The Brewster–Zidek-type estimator is shown to be generalized Bayes.     

Homogeneous spaces with invariant projectively flat affine connections

We characterize invariant projectively flat affine connections in terms of affine representations of Lie algebras, and show that a homogeneous space admits an invariant projectively flat affine connection if and only if it has an equivariant centro-affine immersion. We give a correspondence between semi-simple symmetric spaces with invariant projectively flat affine connections and central-simple Jordan algebras.

     

Robustifying principal component analysis with spatial sign vectors

In this paper, we apply orthogonally equivariant spatial sign covariance matrices as well as their affine equivariant counterparts in principal component analysis. The influence functions and asymptotic covariance matrices of eigenvectors based on robust covariance estimators are derived in order to compare the robustness and efficiency properties. We show in particular that the estimators that use pairwise differences of the observed data have very good efficiency properties, providing practical robust alternatives to classical sample covariance matrix based methods.     

Equivariant deformations of the affine multicone over a flag variety

We prove that the invariant Hilbert scheme parameterising the equivariant deformations of the affine multicone over a flag variety is, under certain hypotheses, an affine space. More specifically, we obtain that the isomorphism classes of equivariant deformations of such a multicone are in correspondence with the orbits of a well-determined wonderful variety.     

Other Classes of Minimax Estimators of Variance Covariance Matrix in Multivariate Normal Distribution

It is well known that the best equivariant estimator of the variance covariance matrix of the multivariate normal distribution with respect to the full affine group of transformation is not even minimax. Some minimax estimators have been proposed. Here we treat this problem in the framework of a multivariate analysis of variance (MANOVA) model and give other classes of minimax estimators.     

On Affine Equivariant Multivariate Quantiles

An extension of univariate quantiles in the multivariate set-up has been proposed and studied. The proposed approach is affine equivariant, and it is based on an adaptive transformation retransformation procedure. Behadur type linear representations of the proposed quantiles are established and consequently asymptotic distributions are also derived. As applications of these multivariate quantiles, we develop some affine equivariant quantile contour plots which can be used to study the geometry of the data cloud as well as the underlying probability distribution and to detect outliers. These quantiles can also be used to construct affine invariant versions of multivariate Q-Q plots which are useful in checking how well a given multivariate probability distribution fits the data and for comparing the distributions of two data sets. We illustrate these applications with some simulated and real data sets. We also indicate a way of extending the notion of univariate L-estimates and trimmed means in the multivariate set-up using these affine equivariant quantiles.     

Discriminant analysis for compositional data and robust parameter estimation

Compositional data, i.e. data including only relative information, need to be transformed prior to applying the standard discriminant analysis methods that are designed for the Euclidean space. Here it is investigated for linear, quadratic, and Fisher discriminant analysis, which of the transformations lead to invariance of the resulting discriminant rules. Moreover, it is shown that for robust parameter estimation not only an appropriate transformation, but also affine equivariant estimators of location and covariance are needed. An example and simulated data demonstrate the effects of working in an inappropriate space for discriminant analysis.     

Random Point Attractors Versus Random Set Attractors

The notion of an attractor for a random dynamical system withrespect to a general collection of deterministic sets is introduced.This comprises, in particular, global point attractors and globalset attractors. After deriving a necessary and sufficient conditionfor existence of the corresponding attractors it is proved thata global set attractor always contains all unstable sets ofall of its subsets. Then it is shown that in general randompoint attractors, in contrast to deterministic point attractors,do not support all invariant measures of the system. However,for white noise systems it holds that the minimal point attractorsupports all invariant Markov measures of the system.     

截尾样本下,具有共同尺度参数的多总体指数分布的参数估计

讨论了在截尾样本下,具有共同尺度参数的多总体指数分布的参数估计问题,证明了尺度参数及位置参数的最佳仿射同变估计是不容许的,且给出了相应的改进估计.     

Influence functions and efficiencies of the canonical correlation and vector estimates based on scatter and shape matrices

In this paper, the influence functions and limiting distributions of the canonical correlations and coefficients based on affine equivariant scatter matrices are developed for elliptically symmetric distributions. General formulas for limiting variances and covariances of the canonical correlations and canonical vectors based on scatter matrices are obtained. Also the use of the so-called shape matrices in canonical analysis is investigated. The scatter and shape matrices based on the affine equivariant Sign Covariance Matrix as well as the Tyler's shape matrix serve as examples. Their finite sample and limiting efficiencies are compared to those of the Minimum Covariance Determinant estimators and S-estimator through theoretical and simulation studies. The theory is illustrated by an example.     

Some modifications of improved estimators of a normal variance

Consider the problem of estimating a normal variance based on a random sample when the mean is unknown. Scale equivariant estimators which improve upon the best scale and translation equivariant one have been proposed by several authors for various loss functions including quadratic loss. However, at least for quadratic loss function, improvement is not much. Herein, some methods are proposed to construct improving estimators which are not scale equivariant and are expected to be considerably better when the true variance value is close to the specified one. The idea behind the methods is to modify improving equivariant shrinkage estimators, so that the resulting ones shrink little when the usual estimate is less than the specified value and shrink much more otherwise. Sufficient conditions are given for the estimators to dominate the best scale and translation equivariant rule under the quadratic loss and the entropy loss. Further, some results of a Monte Carlo experiment are reported which show the significant improvements by the proposed estimators.     

A gaussian upper bound for gaussian multi-stage stochastic linear programs

This paper deals with two-stage and multi-stage stochastic programs in which the right-hand sides of the constraints are Gaussian random variables. Such problems are of interest since the use of Gaussian estimators of random variables is widespread. We introduce algorithms to find upper bounds on the optimal value of two-stage and multi-stage stochastic (minimization) programs with Gaussian right-hand sides. The upper bounds are obtained by solving deterministic mathematical programming problems with dimensions that do not depend on the sample space size. The algorithm for the two-stage problem involves the solution of a deterministic linear program and a simple semidefinite program. The algorithm for the multi-stage problem invovles the solution of a quadratically constrained convex programming problem.     

Estimating the covariance matrix and the generalized variance under a symmetric loss

For estimating the power of a generalized variance under a multivariate normal distribution with unknown means, the inadmissibility of the best affine equivariant estimator relative to the symmetric loss is shown, and a class of improved estimators is given. The problem of estimating the covariance matrix is also discussed.     

Affine Invariant Detection: Edge Maps, Anisotropic Diffusion, and Active Contours

In this paper we undertake a systematic investigation of affine invariant object detection and image denoising. Edge detection is first presented from the point of view of the affine invariant scale-space obtained by curvature based motion of the image level-sets. In this case, affine invariant maps are derived as a weighted difference of images at different scales. We then introduce the affine gradient as an affine invariant differential function of lowest possible order with qualitative behavior similar to the Euclidean gradient magnitude. These edge detectors are the basis for the extension of the affine invariant scale-space to a complete affine flow for image denoising and simplification, and to define affine invariant active contours for object detection and edge integration. The active contours are obtained as a gradient flow in a conformally Euclidean space defined by the image on which the object is to be detected. That is, we show that objects can be segmented in an affine invariant manner by computing a path of minimal weighted affine distance, the weight being given by functions of the affine edge detectors. The gradient path is computed via an algorithm which allows to simultaneously detect any number of objects independently of the initial curve topology. Based on the same theory of affine invariant gradient flows we show that the affine geometric heat flow is minimizing, in an affine invariant form, the area enclosed by the curve.     

The finite sample breakdown point of PCS

The Projection Congruent Subset (PCS) is a new method for finding multivariate outliers. PCS returns an outlyingness index which can be used to construct affine equivariant estimates of multivariate location and scatter. In this note, we derive the finite sample breakdown point of these estimators.     

Classes of improved estimators for parameters of a Pareto distribution

The problem of estimating parameters of a Pareto distribution is investigated under a general scale invariant loss function when the scale parameter is restricted to the interval (0, 1]. We consider the estimation of shape parameter when the scale parameter is unknown. Techniques for improving equivariant estimators developed by Stein, Brewster–Zidek and Kubokawa are applied to derive improved estimators. In particular improved classes of estimators are obtained for the entropy loss and a symmetric loss. Risk functions of various estimators are compared numerically using simulations. It is also shown that the technique of Kubokawa produces improved estimators for estimating the scale parameter when the shape parameter is known.     

Nonparametric Estimation of Distributions in Random Effects Models

We propose using minimum distance to obtain nonparametric estimates of the distributions of components in random effects models. A main setting considered is equivalent to having a large number of small datasets whose locations, and perhaps scales, vary randomly, but which otherwise have a common distribution. Interest focuses on estimating the distribution that is common to all datasets, knowledge of which is crucial in multiple testing problems where a location/scale invariant test is applied to every small dataset. A detailed algorithm for computing minimum distance estimates is proposed, and the usefulness of our methodology is illustrated by a simulation study and an analysis of microarray data. Supplemental materials for the article, including R-code and a dataset, are available online.     

Estimation of the ratio of the scale parameters of two exponential distributions with unknown location parameters

We consider the estimation of the ratio of the scale parameters of two independent two-parameter exponential distributions with unknown location parameters. It is shown that the best affine equivariant estimator (BAEE) is inadmissible under any loss function from a large class of bowl-shaped loss functions. Two new classes of improved estimators are obtained. Some values of the risk functions of the BAEE and two improved estimators are evaluated for two particular loss functions. Our results are parallel to those of Zidek (1973, Ann. Statist., 1, 264–278), who derived a class of estimators that dominate the BAEE of the scale parameter of a two-parameter exponential distribution.