Bias-reduced estimators for bivariate tail modelling

Ledford and Tawn (1997) introduced a flexible bivariate tail model based on the coefficient of tail dependence and on the dependence of the extreme values of the random variables. In this paper, we extend the concept by specifying the slowly varying part of the model as done by Hall (1982) with the univariate case. Based on Beirlant et al. (2009), we propose a bias-reduced estimator for the coefficient of tail dependence and for the estimation of small tail probabilities. We discuss the properties of these estimators via simulations and a real-life example. Furthermore, we discuss some theoretical asymptotic aspects of this approach.     

Bootstrap of deviation probabilities with applications

We show that under different moment bounds on the underlying variables, bootstrap approximation to the large deviation probabilities of standardized sample sum, based on independent random variables, is valid for a wider zone of n, the sample size, compared to the classical normal tail probability approximation. As an application, different notions of efficiency for statistical tests are considered from Bayesian point of view. In particular, efficiency due to Pitman (1938) [11], Chernoff (1952) [1], and Bayes risk efficiency due to Rubin and Sethuraman (1965) [12] turn out to be special cases with the choice of the weight function; i.e., prior density times loss.     

Nonparametric estimation of the dependence function for a multivariate extreme value distribution

Understanding and modeling dependence structures for multivariate extreme values are of interest in a number of application areas. One of the well-known approaches is to investigate the Pickands dependence function. In the bivariate setting, there exist several estimators for estimating the Pickands dependence function which assume known marginal distributions [J. Pickands, Multivariate extreme value distributions, Bull. Internat. Statist. Inst., 49 (1981) 859-878; P. Deheuvels, On the limiting behavior of the Pickands estimator for bivariate extreme-value distributions, Statist. Probab. Lett. 12 (1991) 429-439; P. Hall, N. Tajvidi, Distribution and dependence-function estimation for bivariate extreme-value distributions, Bernoulli 6 (2000) 835-844; P. Capéraà, A.-L. Fougères, C. Genest, A nonparametric estimation procedure for bivariate extreme value copulas, Biometrika 84 (1997) 567-577]. In this paper, we generalize the bivariate results to p-variate multivariate extreme value distributions with p?2. We demonstrate that the proposed estimators are consistent and asymptotically normal as well as have excellent small sample behavior.     

Estimation of intrinsic processes affected by additive fractal noise

Fractal Gaussian models have been widely used to represent the singular behavior of phenomena arising in different applied fields; for example, fractional Brownian motion and fractional Gaussian noise are considered as monofractal models in subsurface hydrology and geophysical studies Mandelbrot [The Fractal Geometry of Nature, Freeman Press, San Francisco, 1982 [13]]. In this paper, we address the problem of least-squares linear estimation of an intrinsic fractal input random field from the observation of an output random field affected by fractal noise (see Angulo et al. [Estimation and filtering of fractional generalised random fields, J. Austral. Math. Soc. A 69 (2000) 1-26 [2]], Ruiz-Medina et al. [Fractional generalized random fields on bounded domains, Stochastic Anal. Appl. 21 (2003a) 465-492], Ruiz-Medina et al. [Fractional-order regularization and wavelet approximation to the inverse estimation problem for random fields, J. Multivariate Anal. 85 (2003b) 192-216]. Conditions on the fractality order of the additive noise are studied to obtain a bounded inversion of the associated Wiener-Hopf equation. A stable solution is then obtained in terms of orthogonal bases of the reproducing kernel Hilbert spaces associated with the random fields involved. Such bases are constructed from orthonormal wavelet bases (see Angulo and Ruiz-Medina [Multiresolution approximation to the stochastic inverse problem, Adv. in Appl. Probab. 31 (1999) 1039-1057], Angulo et al. [Wavelet-based orthogonal expansions of fractional generalized random fields on bounded domains, Theoret. Probab. Math. Stat. (2004), in press]). A simulation study is carried out to illustrate the influence of the fractality orders of the output random field and the fractal additive noise on the stability of the solution derived.     

Bootstrap,wild bootstrap,and asymptotic normality

Summary We show for an i.i.d. sample that bootstrap estimates consistently the distribution of a linear statistic if and only if the normal approximation with estimated variance works. An asymptotic approach is used where everything may depend onn. The result is extended to the case of independent, but not necessarily identically distributed random variables. Furthermore it is shown that wild bootstrap works under the same conditions as bootstrap.This work has been supported by the Deutsche Forschungsgemeinschaft, Sonderforschungsbereich 123 Stochastische Mathematische Modelle     

Properties of nonparametric estimators of autocovariance for stationary random fields

Summary We introduce nonparametric estimators of the autocovariance of a stationary random field. One of our estimators has the property that it is itself an autocovatiance. This feature enables the estimator to be used as the basis of simulation studies such as those which are necessary when constructing bootstrap confidence intervals for unknown parameters. Unlike estimators proposed recently by other authors, our own do not require assumptions such as isotropy or monotonicity. Indeed, like nonparametric function estimators considered more widely in the context of curve estimation, our approach demands only smoothness and tail conditions on the underlying curve or surface (here, the autocovariance), and moment and mixing conditions on the random field. We show that by imposing the condition that the estimator be a covariance function we actually reduce the numerical value of integrated squared error.     

Variance function estimation in multivariate nonparametric regression with fixed design

Variance function estimation in multivariate nonparametric regression is considered and the minimax rate of convergence is established in the iid Gaussian case. Our work uses the approach that generalizes the one used in [A. Munk, Bissantz, T. Wagner, G. Freitag, On difference based variance estimation in nonparametric regression when the covariate is high dimensional, J. R. Stat. Soc. B 67 (Part 1) (2005) 19-41] for the constant variance case. As is the case when the number of dimensions d=1, and very much contrary to standard thinking, it is often not desirable to base the estimator of the variance function on the residuals from an optimal estimator of the mean. Instead it is desirable to use estimators of the mean with minimal bias. Another important conclusion is that the first order difference based estimator that achieves minimax rate of convergence in the one-dimensional case does not do the same in the high dimensional case. Instead, the optimal order of differences depends on the number of dimensions.     

Low dimensional semiparametric estimation in a censored regression model

A new estimation procedure for a partial linear additive model with censored responses is proposed. To this aim, ideas of Lewbel and Linton [A. Lewbel, O. Linton, Nonparametric censored and truncated regression, Econometrica 70 (2002) 765-779] on censored model regression are combined with those of Kim et al. [W. Kim, O. Linton, N.W. Hengartner, A computationally efficient estimator for additive nonparametric regression with bootstrap confidence intervals, Journal of Computational and Graphical Statistics, 8 (1999) 278-297] on marginal integration and those on average derivatives. This allows for dimension reduction, interpretability and — depending on the context — for weights yielding computationally attractive estimates. Asymptotic behavior is provided for all proposed estimators.     

On a mapping approach to investigating the bootstrap accuracy

Summary. A simple mapping approach is proposed to study the bootstrap accuracy in a rather general setting. It is demonstrated that the bootstrap accuracy can be obtained through this method for a broad class of statistics to which the commonly used Edgeworth expansion approach may not be successfully applied. We then consider some examples to illustrate how this approach may be used to find the bootstrap accuracy and show the advantage of the bootstrap approximation over the Gaussian approximation. For the multivariate Kolmogorov–Smirnov statistic, we show the error of bootstrap approximation is as small as that of the Gaussian approximation. For the multivariate kernel type density estimate, we obtain an order of the bootstrap error which is smaller than the order of the error of the Gaussian approximation given in Rio (1994). We also consider an application of the bootstrap accuracy for empirical process to that for the copula process. Received: 23 June 1995 / In revised form: 18 June 1996     

Nonparametric estimation of an extreme-value copula in arbitrary dimensions

Inference on an extreme-value copula usually proceeds via its Pickands dependence function, which is a convex function on the unit simplex satisfying certain inequality constraints. In the setting of an i.i.d. random sample from a multivariate distribution with known margins and an unknown extreme-value copula, an extension of the Capéraà-Fougères-Genest estimator was introduced by D. Zhang, M. T. Wells and L. Peng [Nonparametric estimation of the dependence function for a multivariate extreme-value distribution, Journal of Multivariate Analysis 99 (4) (2008) 577-588]. The joint asymptotic distribution of the estimator as a random function on the simplex was not provided. Moreover, implementation of the estimator requires the choice of a number of weight functions on the simplex, the issue of their optimal selection being left unresolved.A new, simplified representation of the CFG-estimator combined with standard empirical process theory provides the means to uncover its asymptotic distribution in the space of continuous, real-valued functions on the simplex. Moreover, the ordinary least-squares estimator of the intercept in a certain linear regression model provides an adaptive version of the CFG-estimator whose asymptotic behavior is the same as if the variance-minimizing weight functions were used. As illustrated in a simulation study, the gain in efficiency can be quite sizable.     

Second-order accuracy of depth-based bootstrap confidence regions

We consider the problem of setting bootstrap confidence regions for multivariate parameters based on data depth functions. We prove, under mild regularity conditions, that depth-based bootstrap confidence regions are second-order accurate in the sense that their coverage error is of order n⁻¹, given a random sample of size n. The results hold in general for depth functions of types A and D, which cover as special cases the Tukey depth, the majority depth, and the simplicial depth. A simulation study is also provided to investigate empirically the bootstrap confidence regions constructed using these three depth functions.     

Kernel-based goodness-of-fit tests for copulas with fixed smoothing parameters

We study a test statistic based on the integrated squared difference between a kernel estimator of the copula density and a kernel smoothed estimator of the parametric copula density. We show for fixed smoothing parameters that the test is consistent and that the asymptotic properties are driven by a U-statistic of order 4 with degeneracy of order 1. For practical implementation we suggest to compute the critical values through a semiparametric bootstrap. Monte Carlo results show that the bootstrap procedure performs well in small samples. In particular, size and power are less sensitive to smoothing parameter choice than they are under the asymptotic approximation obtained for a vanishing bandwidth.     

A new dependence ordering with applications

In this paper, we introduce a new copula-based dependence order to compare the relative degree of dependence between two pairs of random variables. Relationship of the new order to the existing dependence orders is investigated. In particular, the new ordering is stronger than the partial ordering, more monotone regression dependence as developed by Avérous et al. [J. Avérous, C. Genest, S.C. Kochar, On dependence structure of order statistics, Journal of Multivariate Analysis 94 (2005) 159-171]. Applications of this partial order to order statistics, k-record values and frailty models are given.     

Consistency of the generalized MLE of a joint distribution function with multivariate interval-censored data

Wong and Yu [Generalized MLE of a joint distribution function with multivariate interval-censored data, J. Multivariate Anal. 69 (1999) 155-166] discussed generalized maximum likelihood estimation of the joint distribution function of a multivariate random vector whose coordinates are subject to interval censoring. They established uniform consistency of the generalized MLE (GMLE) of the distribution function under the assumption that the random vector is independent of the censoring vector and that both of the vector distributions are discrete. We relax these assumptions and establish consistency results of the GMLE under a multivariate mixed case interval censorship model. van der Vaart and Wellner [Preservation theorems for Glivenko-Cantelli and uniform Glivenko-Cantelli class, in: E. Gine, D.M. Mason, J.A. Wellner (Eds.), High Dimensional Probability, vol. II, Birkhäuser, Boston, 2000, pp. 115-133] and Yu [Consistency of the generalized MLE with multivariate mixed case interval-censored data, Ph.D Dissertation, Binghamton University, 2000] independently proved strong consistency of the GMLE in the L₁(μ)-topology, where μ is a measure derived from the joint distribution of the censoring variables. We establish strong consistency of the GMLE in the topologies of weak convergence and pointwise convergence, and eventually uniform convergence under appropriate distributional assumptions and regularity conditions.     

On testing equality of pairwise rank correlations in a multivariate random vector

Spearman’s rank-correlation coefficient (also called Spearman’s rho) represents one of the best-known measures to quantify the degree of dependence between two random variables. As a copula-based dependence measure, it is invariant with respect to the distribution’s univariate marginal distribution functions. In this paper, we consider statistical tests for the hypothesis that all pairwise Spearman’s rank correlation coefficients in a multivariate random vector are equal. The tests are nonparametric and their asymptotic distributions are derived based on the asymptotic behavior of the empirical copula process. Only weak assumptions on the distribution function, such as continuity of the marginal distributions and continuous partial differentiability of the copula, are required for obtaining the results. A nonparametric bootstrap method is suggested for either estimating unknown parameters of the test statistics or for determining the associated critical values. We present a simulation study in order to investigate the power of the proposed tests. The results are compared to a classical parametric test for equal pairwise Pearson’s correlation coefficients in a multivariate random vector. The general setting also allows the derivation of a test for stochastic independence based on Spearman’s rho.     

Nonparametric rank-based tests of bivariate extreme-value dependence

A new class of tests of extreme-value dependence for bivariate copulas is proposed. It is based on the process comparing the empirical copula with a natural nonparametric rank-based estimator of the unknown copula under extreme-value dependence. A multiplier technique is used to compute approximate p-values for several candidate test statistics. Extensive Monte Carlo experiments were carried out to compare the resulting procedures with the tests of extreme-value dependence recently studied in Ben Ghorbal et al. (2009) [1] and Kojadinovic and Yan (2010) [19]. The finite-sample performance study of the tests is complemented by local power calculations.     

Adaptive minimax testing in the discrete regression scheme

We consider the problem of testing hypotheses on the regression function from n observations on the regular grid on [0,1]. We wish to test the null hypothesis that the regression function belongs to a given functional class (parametric or even nonparametric) against a composite nonparametric alternative. The functions under the alternative are separated in the L₂-norm from any function in the null hypothesis. We assume that the regression function belongs to a wide range of Hölder classes but as the smoothness parameter of the regression function is unknown, an adaptive approach is considered. It leads to an optimal and unavoidable loss of order Open image in new window in the minimax rate of testing compared with the non-adaptive setting. We propose a smoothness-free test that achieves the optimal rate, and finally we prove the lower bound showing that no test can be consistent if in the distance between the functions under the null hypothesis and those in the alternative, the loss is of order smaller than the optimal loss.     

TESTS OF COVARIANCE MATRIX BY USING PROJECTION PURSUIT AND BOOTSTRAP METHOD

Testing equality of covariance matrix has long been an interesting issue in statistics inference, To overcome the sparseness of data points in high-dimensional space and deal with the general cases, the author suggests several projection pursuit type statistics. Some results on the limiting distidbutions of the statistics are obtained. Some properties of bootstrap approximation are investigated. Furthermore, for computational reasons an approximation for the statistics based on number-theoretic roethod is applied. Several simulation experiments are performed.     

Tail order and intermediate tail dependence of multivariate copulas

In order to study copula families that have tail patterns and tail asymmetry different from multivariate Gaussian and t copulas, we introduce the concepts of tail order and tail order functions. These provide an integrated way to study both tail dependence and intermediate tail dependence. Some fundamental properties of tail order and tail order functions are obtained. For the multivariate Archimedean copula, we relate the tail heaviness of a positive random variable to the tail behavior of the Archimedean copula constructed from the Laplace transform of the random variable, and extend the results of Charpentier and Segers [7] [A. Charpentier, J. Segers, Tails of multivariate Archimedean copulas, Journal of Multivariate Analysis 100 (7) (2009) 1521–1537] for upper tails of Archimedean copulas. In addition, a new one-parameter Archimedean copula family based on the Laplace transform of the inverse Gamma distribution is proposed; it possesses patterns of upper and lower tails not seen in commonly used copula families. Finally, tail orders are studied for copulas constructed from mixtures of max-infinitely divisible copulas.     

Measures of influence for the functional linear model with scalar response

This paper studies how to identify influential observations in the functional linear model in which the predictor is functional and the response is scalar. Measurement of the effects of a single observation on estimation and prediction when the model is estimated by the principal components method is undertaken. For that, three statistics are introduced for measuring the influence of each observation on estimation and prediction of the functional linear model with scalar response that are generalizations of the measures proposed for the standard regression model by [D.R. Cook, Detection of influential observations in linear regression, Technometrics 19 (1977) 15-18; D. Peña, A new statistic for influence in linear regression, Technometrics 47 (2005) 1-12] respectively. A smoothed bootstrap method is proposed to estimate the quantiles of the influence measures, which allows us to point out which observations have the larger influence on estimation and prediction. The behavior of the three statistics and the quantile estimation bootstrap based method is analyzed via a simulation study. Finally, the practical use of the proposed statistics is illustrated by the analysis of a real data example, which show that the proposed measures are useful for detecting heterogeneity in the functional linear model with scalar response.