Influence functions and efficiencies of the canonical correlation and vector estimates based on scatter and shape matrices

In this paper, the influence functions and limiting distributions of the canonical correlations and coefficients based on affine equivariant scatter matrices are developed for elliptically symmetric distributions. General formulas for limiting variances and covariances of the canonical correlations and canonical vectors based on scatter matrices are obtained. Also the use of the so-called shape matrices in canonical analysis is investigated. The scatter and shape matrices based on the affine equivariant Sign Covariance Matrix as well as the Tyler's shape matrix serve as examples. Their finite sample and limiting efficiencies are compared to those of the Minimum Covariance Determinant estimators and S-estimator through theoretical and simulation studies. The theory is illustrated by an example.     

Asymptotic expansions of the distributions of estimators in canonical correlation analysis under nonnormality

Asymptotic expansions of the distributions of typical estimators in canonical correlation analysis under nonnormality are obtained. The expansions include the Edgeworth expansions up to order O(1/n) for the parameter estimators standardized by the population standard errors, and the corresponding expansion by Hall's method with variable transformation. The expansions for the Studentized estimators are also given using the Cornish-Fisher expansion and Hall's method. The parameter estimators are dealt with in the context of estimation for the covariance structure in canonical correlation analysis. The distributions of the associated statistics (the structure of the canonical variables, the scaled log likelihood ratio and Rozeboom's between-set correlation) are also expanded. The robustness of the normal-theory asymptotic variances of the sample canonical correlations and associated statistics are shown when a latent variable model holds. Simulations are performed to see the accuracy of the asymptotic results in finite samples.     

Asymptotic expansions for distributions of latent roots in multivariate analysis

Asymptotic expansions are given for the distributions of latent roots of matrices in three multivariate situations. The distribution of the roots of the matrix S₁(S₁ + S₂)^?1, where S₁ is $\text{W}{}_{\mathrm{<mtext>m</mtext>}}\text{(n}{}_1\text{, Σ, Ω)}$ and S₂ is W_m(n₂, Σ), is studied in detail and asymptotic series for the distribution are obtained which are valid for some or all of the roots of the noncentrality matrix Ω large. These expansions are obtained using partial-differential equations satisfied by the distribution. Asymptotic series are also obtained for the distributions of the roots of n^?1S, where S in W_m(n, Σ), for large n, and S₁S₂^?1, where S₁ is W_m(n₁, Σ) and S₂ is W_m(n₂, Σ), for large n₁ + n₂.     

Asymptotic distributions of two “synthetic data” estimators for censored single-index models

The censored single-index model provides a flexible way for modelling the association between a response and a set of predictor variables when the response variable is randomly censored and the link function is unknown. It presents a technique for “dimension reduction” in semiparametric censored regression models and generalizes the existing accelerated failure time models for survival analysis. This paper proposes two methods for estimation of single-index models with randomly censored samples. We first transform the censored data into synthetic data or pseudo-responses unbiasedly, then obtain estimates of the index coefficients by the rOPG or rMAVE procedures of Xia (2006) [1]. Finally, we estimate the unknown nonparametric link function using techniques for univariate censored nonparametric regression. The estimators for the index coefficients are shown to be root-n consistent and asymptotically normal. In addition, the estimator for the unknown regression function is a local linear kernel regression estimator and can be estimated with the same efficiency as the parameters are known. Monte Carlo simulations are conducted to illustrate the proposed methodologies.     

The one- and multi-sample problem for functional data with application to projective shape analysis

In this paper tests are derived for testing neighborhood hypotheses for the one- and multi-sample problem for functional data. Our methodology is used to generalize testing in projective shape analysis, which has traditionally involving data consisting of finite number of points, to the functional case. The one-sample test is applied to the problem of scene identification, in the context of the projective shape of a planar curve.     

Symmetrised M-estimators of multivariate scatter

In this paper we introduce a family of symmetrised M-estimators of multivariate scatter. These are defined to be M-estimators only computed on pairwise differences of the observed multivariate data. Symmetrised Huber's M-estimator and Dümbgen's estimator serve as our examples. The influence functions of the symmetrised M-functionals are derived and the limiting distributions of the estimators are discussed in the multivariate elliptical case to consider the robustness and efficiency properties of estimators. The symmetrised M-estimators have the important independence property; they can therefore be used to find the independent components in the independent component analysis (ICA).     

A contribution to multivariate L-moments: L-comoment matrices

Multivariate statistical analysis relies heavily on moment assumptions of second order and higher. With increasing interest in heavy-tailed distributions, however, it is desirable to describe dispersion, skewness, and kurtosis under merely first order moment assumptions. Here, the univariate L-moments of Hosking [L-moments: analysis and estimation of distributions using linear combinations of order statistics, J. Roy. Statist. Soc. Ser. B 52 (1990) 105-124] are extended to “L-comoments” analogous to covariance. For certain models, the second order case yields correlational analysis coherent with classical correlation but also meaningful under just first moment assumptions. We develop properties and estimators for L-comoments, illustrate for several multivariate models, examine behavior of sample multivariate L-moments with heavy-tailed data, and discuss applications to financial risk analysis and regional frequency analysis.     

Asymptotic distributions for the elementary symmetric functions of two matrices under the assumption of linearity

The asymptotic distributions of the elementary symmetric functions (esf's) of the characteristic roots of a noncentral multivariate beta matrix and of the generalized correlation matrix (noncentral under the assumption of linearity) are derived.     

Asymptotic nonnull distributions for tests for reality of a covariance matrix

In this paper asymptotic nonnull distributions are derived for two statistics used in testing for the reality of the covariance matrix in a complex Gaussian distribution.     

Asymptotic bias and variance for a general class of varying bandwidth density estimators

Summary We consider a general class of varying bandwidth estimators of a probability density function. The class includes the Abramson estimator, transformation kernel density estimator (TKDE), Jones transformation kernel density estimator (JTKDE), nearest neighbour type estimator (NN), Jones-Linton-Nielsen estimator (JLN), Taylor series approximations of TKDE (TTKDE) and Simpson's formula approximations of TKDE (STKDE). Each of these estimators needs a pilot estimator. Starting with an ordinary kernel estimator , it is possible to iterate and compute a sequence of estimates , using each estimate as a pilot estimator in the next step. The first main result is a formula for the bias order. If the bandwidths used in different steps have a common orderh=h(n), the bias of is of orderh ^2km ,k=1, ...,t. Hereh ^m is the bias order of the ideal estimator (defined by using the unknownf as pilot). The second main result is a recursive formula for the leading bias and stochastic terms in an asymptotic expansion of the density estimates. Ifm<, it is possible to make asymptotically equivalent to the ideal estimator.     

Asymptotic normality and Berry-Esseen results for conditional density estimator with censored and dependent data

In this paper we derive the asymptotic normality and a Berry-Esseen type bound for the kernel conditional density estimator proposed in Ould-Saïd and Cai (2005) [26] when the censored observations with multivariate covariates form a stationary α-mixing sequence.     

Asymptotic expansions for the distributions of some functions of the latent roots of matrices in three situations

In this paper we derive asymptotic expansions for the distributions of some functions of the latent roots of the matrices in three situations in multivariate normal theory, i.e., (i) principal component analysis, (ii) MANOVA model and (iii) canonical correlation analysis. These expansions are obtained by using a perturbation method. Confidence intervals for the functions of the corresponding population roots are also obtained.     

Local polynomial maximum likelihood estimation for Pareto-type distributions

We discuss the estimation of the tail index of a heavy-tailed distribution when covariate information is available. The approach followed here is based on the technique of local polynomial maximum likelihood estimation. The generalized Pareto distribution is fitted locally to exceedances over a high specified threshold. The method provides nonparametric estimates of the parameter functions and their derivatives up to the degree of the chosen polynomial. Consistency and asymptotic normality of the proposed estimators will be proven under suitable regularity conditions. This approach is motivated by the fact that in some applications the threshold should be allowed to change with the covariates due to significant effects on scale and location of the conditional distributions. Using the asymptotic results we are able to derive an expression for the asymptotic mean squared error, which can be used to guide the selection of the bandwidth and the threshold. The applicability of the method will be demonstrated with a few practical examples.     

Nonparametric inference for extrinsic means on size-and-(reflection)-shape manifolds with applications in medical imaging

For all p>2,k>p, a size-and-reflection-shape space of k-ads in general position in R^p, invariant under translation, rotation and reflection, is shown to be a smooth manifold and is equivariantly embedded in a space of symmetric matrices, allowing a nonparametric statistical analysis based on extrinsic means. Equivariant embeddings are also given for the reflection-shape-manifold , a space of orbits of scaled k-ads in general position under the group of isometries of R^p, providing a methodology for statistical analysis of three-dimensional images and a resolution of the mathematical problems inherent in the use of the Kendall shape spaces in p-dimensions, p>2. The Veronese embedding of the planar Kendall shape manifold is extended to an equivariant embedding of the size-and-shape manifold , which is useful in the analysis of size-and-shape. Four medical imaging applications are provided to illustrate the theory.     

Asymptotic efficient estimation in semiparametric nonlinear regression models

§１ＩｎｔｒｏｄｕｃｔｉｏｎＣｏｎｓｉｄｅｒｔｈｅｆｉｘｅｄｄｅｓｉｇｎｓｅｍｉｐａｒａｍｅｔｒｉｃｎｏｎｌｉｎｅａｒｒｅｇｒｅｓｓｉｏｎｍｏｄｅｌｓｇｉｖｅｎｂｙｙｉ＝ｆ（ｘｉ,θ）＋λ（ｔｉ）＋εｉ,ｉ＝１,．．．,ｎ,（１）ｗｈｅｒｅｆ（,）ｉ...     

A robust and efficient adaptive reweighted estimator of multivariate location and scatter

This article proposes a reweighted estimator of multivariate location and scatter, with weights adaptively computed from the data. Its breakdown point and asymptotic behavior under elliptical distributions are established. This adaptive estimator is able to attain simultaneously the maximum possible breakdown point for affine equivariant estimators and full asymptotic efficiency at the multivariate normal distribution. For the special case of hard-rejection weights and the MCD as initial estimator, it is shown to be more efficient than its non-adaptive counterpart for a broad range of heavy-tailed elliptical distributions. A Monte Carlo study shows that the adaptive estimator is as robust as its non-adaptive relative for several types of bias-inducing contaminations, while it is remarkably more efficient under normality for sample sizes as small as 200.     

Second-order accurate inference on eigenvalues of covariance and correlation matrices

Edgeworth expansions and saddlepoint approximations for the distributions of estimators of certain eigenfunctions of covariance and correlation matrices are developed. These expansions depend on second-, third-, and fourth-order moments of the sample covariance matrix. Expressions for and estimators of these moments are obtained. The expansions and moment expressions are used to construct second-order accurate confidence intervals for the eigenfunctions. The expansions are illustrated and the results of a small simulation study that evaluates the finite-sample performance of the confidence intervals are reported.     

Single-index quantile regression

Nonparametric quantile regression with multivariate covariates is a difficult estimation problem due to the “curse of dimensionality”. To reduce the dimensionality while still retaining the flexibility of a nonparametric model, we propose modeling the conditional quantile by a single-index function , where a univariate link function g₀(⋅) is applied to a linear combination of covariates , often called the single-index. We introduce a practical algorithm where the unknown link function g₀(⋅) is estimated by local linear quantile regression and the parametric index is estimated through linear quantile regression. Large sample properties of estimators are studied, which facilitate further inference. Both the modeling and estimation approaches are demonstrated by simulation studies and real data applications.