Multivariate Recursive M-Estimators of Location and Scatter for Dependent Sequences

This paper treats strong convergence of adaptive multivariate recursive M-estimators of location when the scatter matrices are unknown. The observations are elliptically distributed and form a strictly stationary strong mixing sequence. The main algorithm handles a recursive estimator of location and scatter which corresponds to the non-recursive robust M-estimator of location and scatter proposed by Maronna.     

A KERNEL ESTIMATOR OF A DENSITY FUNCTION IN MULTIVARIATE CASE FROM RANDOMLY CENSORED DATA

ＡＫＥＲＮＥＬＥＳＴＩＭＡＴＯＲＯＦＡＤＥＮＳＩＴＹＦＵＮＣＴＩＯＮＩＮＭＵＬＴＩＶＡＲＩＡＴＥＣＡＳＥＦＲＯＭＲＡＮＤＯＭＬＹＣＥＮＳＯＲＥＤＤＡＴＡ￥ＺｈｏｕＹｏｎｇ（周勇）（ＰｒｏｂａｂｉｌｉｔｙｌａｂｏｒａｔｏｒｙｉｎＩｎｓｔ．ｏｆＡｐｐｌ．...     

Multivariate generalized S-estimators

In this paper we introduce generalized S-estimators for the multivariate regression model. This class of estimators combines high robustness and high efficiency. They are defined by minimizing the determinant of a robust estimator of the scatter matrix of differences of residuals. In the special case of a multivariate location model, the generalized S-estimator has the important independence property, and can be used for high breakdown estimation in independent component analysis. Robustness properties of the estimators are investigated by deriving their breakdown point and the influence function. We also study the efficiency of the estimators, both asymptotically and at finite samples. To obtain inference for the regression parameters, we discuss the fast and robust bootstrap for multivariate generalized S-estimators. The method is illustrated on a real data example.     

Robust and bias-corrected estimation of the coefficient of tail dependence

We introduce a robust and asymptotically unbiased estimator for the coefficient of tail dependence in multivariate extreme value statistics. The estimator is obtained by fitting a second order model to the data by means of the minimum density power divergence criterion. The asymptotic properties of the estimator are investigated. The efficiency of our methodology is illustrated on a small simulation study and by a real dataset from the actuarial context.     

Flexible Multivariate Density Estimation With Marginal Adaptation

This article is concerned with multivariate density estimation. We discuss deficiencies in two popular multivariate density estimators—mixture and copula estimators, and propose a new class of estimators that combines the advantages of both mixture and copula modeling, while being more robust to their weaknesses. Our method adapts any multivariate density estimator using information obtained by separately estimating the marginals. We propose two marginally adapted estimators based on a multivariate mixture of normals and a mixture of factor analyzers estimators. These estimators are implemented using computationally efficient split-and-elimination variational Bayes algorithms. It is shown through simulation and real-data examples that the marginally adapted estimators are capable of improving on their original estimators and compare favorably with other existing methods. Supplementary materials for this article are available online.     

Asymptotic Normality of a Combined Regression Estimator

In this paper, we propose a combined regression estimator by using a parametric estimator and a nonparametric estimator of the regression function. The asymptotic distribution of this estimator is obtained for cases where the parametric regression model is correct, incorrect, and approximately correct. These distributional results imply that the combined estimator is superior to the kernel estimator in the sense that it can never do worse than the kernel estimator in terms of convergence rate and it has the same convergence rate as the parametric estimator in the case where the parametric model is correct. Unlike the parametric estimator, the combined estimator is robust to model misspecification. In addition, we also establish the asymptotic distribution of the estimator of the weight given to the parametric estimator in constructing the combined estimator. This can be used to construct consistent tests for the parametric regression model used to form the combined estimator.     

投影绝对中位离差估计及其应用

投影绝对中位离差估计及其应用崔恒健，田玉斌（北京师范大学，１００８７５）国家自然科学基金资助项目１９９１年６月８日收到，１９９２年９月５日收到修改稿．一、引言与记号设Ｙ；，Ｙｚ，…，Ｙ。ｉ．ｉ．ｄ．一Ｙ为１维ｒ．ｖ，记Ｈ为Ｙ的分布函数，Ｈ。为其经验分...     

The Multivariate Partially Linear EV Model with B-spline

A multivariate partially linear EV model is considered in this paper. By correcting the attenuation, a modified B-spline least squares estimator for both the parametric and the nonparametric components is proposed. Moreover, we investigate the asymptotical normality of the modified estimator of the parametric components and the convergence rate of the estimator of the nonparametric function.     

A robust and efficient adaptive reweighted estimator of multivariate location and scatter

This article proposes a reweighted estimator of multivariate location and scatter, with weights adaptively computed from the data. Its breakdown point and asymptotic behavior under elliptical distributions are established. This adaptive estimator is able to attain simultaneously the maximum possible breakdown point for affine equivariant estimators and full asymptotic efficiency at the multivariate normal distribution. For the special case of hard-rejection weights and the MCD as initial estimator, it is shown to be more efficient than its non-adaptive counterpart for a broad range of heavy-tailed elliptical distributions. A Monte Carlo study shows that the adaptive estimator is as robust as its non-adaptive relative for several types of bias-inducing contaminations, while it is remarkably more efficient under normality for sample sizes as small as 200.     

Asymptotic analysis for a stochastic semidefinite programming

Stochastic semidefinite programming (SSDP) is a new class of optimization problems with a wide variety of applications. In this article, asymptotic analysis results of sample average approximation estimator for SSDP are established. Asymptotic analysis result already existing for stochastic nonlinear programming is extended to SSDP, that is, the conditions ensuring the convergence in distribution of sample average approximation estimator for SSDP to a multivariate normal are obtained and the corresponding covariance matrix is described in a closed form.     

多元部分线性模型的B-样条估计(英文)

本文考虑多元部分线性回归模型的估计问题,得到了该模型参数的最小二乘估计和非参数函数的B-样条估计,并证明了参数估计的渐近正态性,给出了非参数函数估计的最优收敛速度.     

Influence Function and Efficiency of the Minimum Covariance Determinant Scatter Matrix Estimator

The minimum covariance determinant (MCD) scatter estimator is a highly robust estimator for the dispersion matrix of a multivariate, elliptically symmetric distribution. It is relatively fast to compute and intuitively appealing. In this note we derive its influence function and compute the asymptotic variances of its elements. A comparison with the one step reweighted MCD and with S-estimators is made. Also finite-sample results are reported.     

Conditional Quantile Estimation with Truncated, Censored and Dependent Data

This paper deals with the conditional quantile estimation based on left-truncated and right-censored data.Assuming that the observations with multivariate covariates form a stationary α-mixing sequence,the authors derive the strong convergence with rate,strong representation as well as asymptotic normality of the conditional quantile estimator.Also,a Berry-Esseen-type bound for the estimator is established.In addition,the finite sample behavior of the estimator is investigated via simulations.     

A multivariate version of Hoeffding’s Phi-Square

A multivariate measure of association is proposed, which extends the bivariate copula-based measure Phi-Square introduced by Hoeffding [22]. We discuss its analytical properties and calculate its explicit value for some copulas of simple form; a simulation procedure to approximate its value is provided otherwise. A nonparametric estimator for multivariate Phi-Square is derived and its asymptotic behavior is established based on the weak convergence of the empirical copula process both in the case of independent observations and dependent observations from strictly stationary strong mixing sequences. The asymptotic variance of the estimator can be estimated by means of nonparametric bootstrap methods. For illustration, the theoretical results are applied to financial asset return data.     

Rate optimal estimation with the integration method in the presence of many covariates

For multivariate regressors, integrating the Nadaraya–Watson regression smoother produces estimators of the lower-dimensional marginal components that are asymptotically normally distributed, at the optimal rate of convergence. Some heuristics, based on consistency of the pilot estimator, suggested that the estimator would not converge at the optimal rate of convergence in the presence of more than four covariates. This paper shows first that marginal integration with its internally normalized counterpart leads to rate-optimal estimators of the marginal components. We introduce the necessary modifications and give central limit theorems. Then, it is shown that the method apply also to more general models, in particular we discuss feasible estimation of partial linear models. The proofs reveal that the pilot estimator shall over-smooth the variables to be integrated, and, that the resulting estimator is itself a lower-dimensional regression smoother. Hence, finite sample properties of the estimator are comparable to those of low-dimensional nonparametric regression. Further advantages when starting with the internally normalized pilot estimator are its computational attractiveness and better performance (compared to its classical counterpart) when the covatiates are correlated and nonuniformly distributed. Simulation studies underline the excellent performance in comparison with so far known methods.     

Robust weighted orthogonal regression in the errors-in-variables model

This paper focuses on robust estimation in the structural errors-in-variables (EV) model. A new class of robust estimators, called weighted orthogonal regression estimators, is introduced. Robust estimators of the parameters of the EV model are simply derived from robust estimators of multivariate location and scatter such as the M-estimators, the S-estimators and the MCD estimator. The influence functions of the proposed estimators are calculated and shown to be bounded. Moreover, we derive the asymptotic distributions of the estimators and illustrate the results on simulated examples and on a real-data set.     

The multivariate Révész’s online estimator of a regression function and its averaging

The first aim of this paper is to generalize the online estimator of a regression function introduced by Révész [26, 27] to the multivariate framework. Similarly to the univariate framework, the study of the convergence rate of the multivariate Révész’s estimator requires a tedious condition connecting the stepsize of the algorithm and the unknown value of the density of the regressor variable at the point at which the regression function is estimated. The second aim of this paper is to apply the averaging principle of stochastic approximation algorithms to remove this tedious condition.     

The Distribution of Robust Distances

Mahalanobis-type distances in which the shape matrix is derived from a consistent, high-breakdown robust multivariate location and scale estimator have an asymptotic chi-squared distribution as is the case with those derived from the ordinary covariance matrix. For example, Rousseeuw's minimum covariance determinant (MCD) is a robust estimator with a high breakdown. However, even in quite large samples, the chi-squared approximation to the distances of the sample data from the MCD center with respect to the MCD shape is poor. We provide an improved F approximation that gives accurate outlier rejection points for various sample sizes.     

A Subsampling Method for the Computation of Multivariate Estimators with High Breakdown Point

Abstract

All known robust location and scale estimators with high breakdown point for multivariate samples are very expensive to compute. In practice, this computation has to be carried out using an approximate subsampling procedure. In this article we describe an alternative subsampling scheme, applicable to both the Stahel-Donoho estimator and the minimum volume ellipsoid estimator, with the property that the number of subsamples required can be substantially reduced with respect to the standard subsampling procedures used in both cases. We also discuss some bias and variability properties of the estimator obtained from the proposed subsampling process.     

元回归模型中最大值点的BRPA估计的收敛速度

BRPA估计是Changchien (1990)提出的一种具有良好性质的回归函数最大值点的估计, Chen, Huang and Huang (1996), Bai and Huang (1999), 吴and王(2000)和Bai, Chen and Wu (2003)分别讨论了BRPA的极限性质\bd 本篇文章中, 我们在很一般的条件下研究了$x$为多维向量时BRPA估计的收敛速度, 推广了Bai, Chen and Wu (2003)的结果