Estimating the error distribution in nonparametric multiple regression with applications to model testing

In this paper we consider the estimation of the error distribution in a heteroscedastic nonparametric regression model with multivariate covariates. As estimator we consider the empirical distribution function of residuals, which are obtained from multivariate local polynomial fits of the regression and variance functions, respectively. Weak convergence of the empirical residual process to a Gaussian process is proved. We also consider various applications for testing model assumptions in nonparametric multiple regression. The model tests obtained are able to detect local alternatives that converge to zero at an n^−1/2-rate, independent of the covariate dimension. We consider in detail a test for additivity of the regression function.     

Composing the cumulative quantile regression function and the Goldie concentration curve

The model we discuss in this paper deals with inequality in distribution in the presence of a covariate. To elucidate that dependence, we propose to consider the composition of the cumulative quantile regression (CQR) function and the Goldie concentration curve, the standardized counterpart of which gives a fraction to fraction plot of the response and the covariate. It has the merit of enhancing the visibility of inequality in distribution when the latter is present. We shall examine the asymptotic properties of the corresponding empirical estimator. The associated empirical process involves a randomly stopped partial sum process of induced order statistics. Strong Gaussian approximations of the processes are constructed. The result forms the basis for the asymptotic theory of functional statistics based on these processes.     

Nonparametric estimation of an extreme-value copula in arbitrary dimensions

Inference on an extreme-value copula usually proceeds via its Pickands dependence function, which is a convex function on the unit simplex satisfying certain inequality constraints. In the setting of an i.i.d. random sample from a multivariate distribution with known margins and an unknown extreme-value copula, an extension of the Capéraà-Fougères-Genest estimator was introduced by D. Zhang, M. T. Wells and L. Peng [Nonparametric estimation of the dependence function for a multivariate extreme-value distribution, Journal of Multivariate Analysis 99 (4) (2008) 577-588]. The joint asymptotic distribution of the estimator as a random function on the simplex was not provided. Moreover, implementation of the estimator requires the choice of a number of weight functions on the simplex, the issue of their optimal selection being left unresolved.A new, simplified representation of the CFG-estimator combined with standard empirical process theory provides the means to uncover its asymptotic distribution in the space of continuous, real-valued functions on the simplex. Moreover, the ordinary least-squares estimator of the intercept in a certain linear regression model provides an adaptive version of the CFG-estimator whose asymptotic behavior is the same as if the variance-minimizing weight functions were used. As illustrated in a simulation study, the gain in efficiency can be quite sizable.     

On testing equality of pairwise rank correlations in a multivariate random vector

Spearman’s rank-correlation coefficient (also called Spearman’s rho) represents one of the best-known measures to quantify the degree of dependence between two random variables. As a copula-based dependence measure, it is invariant with respect to the distribution’s univariate marginal distribution functions. In this paper, we consider statistical tests for the hypothesis that all pairwise Spearman’s rank correlation coefficients in a multivariate random vector are equal. The tests are nonparametric and their asymptotic distributions are derived based on the asymptotic behavior of the empirical copula process. Only weak assumptions on the distribution function, such as continuity of the marginal distributions and continuous partial differentiability of the copula, are required for obtaining the results. A nonparametric bootstrap method is suggested for either estimating unknown parameters of the test statistics or for determining the associated critical values. We present a simulation study in order to investigate the power of the proposed tests. The results are compared to a classical parametric test for equal pairwise Pearson’s correlation coefficients in a multivariate random vector. The general setting also allows the derivation of a test for stochastic independence based on Spearman’s rho.     

Joint distributions of numbers of occurrences of a discrete pattern and weak convergence of an empirical process for the pattern

For a {0, 1}-pattern of finite length, an empirical process is introduced in order to describe the number of overlapping occurrences of the pattern at each level t[0,1] in a sequence of the corresponding indicators of i.i.d. [0, 1]-valued observations of length n. A method for obtaining the exact finite-dimensional distributions of the empirical process is given. The weak convergence of the process to a Gaussian process in D[0,1] as n tends to infinity is also established. The limiting process depends on the given pattern. The exact covariance function is compared with the asymptotic covariance function in a numerical example.     

Empirical processes of multidimensional systems with multiple mixing properties

We establish a multivariate empirical process central limit theorem for stationary R^d-valued stochastic processes (X_i)_i≥1 under very weak conditions concerning the dependence structure of the process. As an application, we can prove the empirical process CLT for ergodic torus automorphisms. Our results also apply to Markov chains and dynamical systems having a spectral gap on some Banach space of functions. Our proof uses a multivariate extension of the techniques introduced by Dehling et al. (2009) [9] in the univariate case. As an important technical ingredient, we prove a 2pth moment bound for partial sums in multiple mixing systems.     

On the asymptotic properties of multivariate sample autocovariances

We show that if a process can be obtained by filtering an autoregressive process, then the asymptotic distribution of sample autocovariances of the former is the same as the asymptotic distribution of linear combinations of sample autocovariances of the latter. This result is used to show that for small lags the sample autocovariances of the filtered process have the same asymptotic distribution as estimators utilizing more information (observations on the associated autoregression process and knowledge of the parameters of the filter). In particular, for a Gaussian ARMA process the first few sample autocovariances are jointly asymptotically efficient.     

Local asymptotic normality in a stationary model for spatial extremes

De Haan and Pereira (2006) [6] provided models for spatial extremes in the case of stationarity, which depend on just one parameter β>0 measuring tail dependence, and they proposed different estimators for this parameter. We supplement this framework by establishing local asymptotic normality (LAN) of a corresponding point process of exceedances above a high multivariate threshold. Standard arguments from LAN theory then provide the asymptotic minimum variance within the class of regular estimators of β. It turns out that the relative frequency of exceedances is a regular estimator sequence with asymptotic minimum variance, if the underlying observations follow a multivariate extreme value distribution or a multivariate generalized Pareto distribution.     

Multivariate extreme value distributions for stationary Gaussian sequences

Under weak regularity conditions of the covariance sequence, it is shown that the joint limiting distribution of the maxima on each coordinate of a stationary Gaussian multivariate sequence is that of independent random variables with marginal Gumbel distributions.     

Nonparametric tests of independence between random vectors

A nonparametric test of the mutual independence between many numerical random vectors is proposed. This test is based on a characterization of mutual independence defined from probabilities of half-spaces in a combinatorial formula of Möbius. As such, it is a natural generalization of tests of independence between univariate random variables using the empirical distribution function. If the number of vectors is p and there are n observations, the test is defined from a collection of processes R_n,A, where A is a subset of {1,…,p} of cardinality |A|>1, which are asymptotically independent and Gaussian. Without the assumption that each vector is one-dimensional with a continuous cumulative distribution function, any test of independence cannot be distribution free. The critical values of the proposed test are thus computed with the bootstrap which is shown to be consistent. Another similar test, with the same asymptotic properties, for the serial independence of a multivariate stationary sequence is also proposed. The proposed test works when some or all of the marginal distributions are singular with respect to Lebesgue measure. Moreover, in singular cases described in Section 4, the test inherits useful invariance properties from the general affine invariance property.     

On the extremes of a class of non-linear processes with heavy tailed innovations

The aim of this paper is to look at the limiting form of certain empirical point processes induced by a particular class of non-linear processes generated by heavy tailed innovations. Such asymptotic results will be highly useful in obtaining the weak limiting behavior of various functionals of the underlying process including the asymptotic distribution of upper and lower order statistics. In particular, we investigate the maximum limiting distribution and its corresponding extremal index. The results are applied to the study of the extremal properties of bilinear processes.     

On the asymptotic power of some k-sample statistics based on the multivariate empirical process

Some k-sample Kolmogorov-Smirnov and Cramér-von Mises-type statistics, based on the multivariate empirical process, are studied. Expressions for their asymptotic power are obtained against various classes of alternative distribution functions.     

Multivariate maximum entropy identification, transformation, and dependence

This paper shows that multivariate distributions can be characterized as maximum entropy (ME) models based on the well-known general representation of density function of the ME distribution subject to moment constraints. In this approach, the problem of ME characterization simplifies to the problem of representing the multivariate density in the ME form, hence there is no need for case-by-case proofs by calculus of variations or other methods. The main vehicle for this ME characterization approach is the information distinguishability relationship, which extends to the multivariate case. Results are also formulated that encapsulate implications of the multiplication rule of probability and the entropy transformation formula for ME characterization. The dependence structure of multivariate ME distribution in terms of the moments and the support of distribution is studied. The relationships of ME distributions with the exponential family and with bivariate distributions having exponential family conditionals are explored. Applications include new ME characterizations of many bivariate distributions, including some singular distributions.     

Local efficiency of a Cramér-von Mises test of independence

Deheuvels proposed a rank test of independence based on a Cramér-von Mises functional of the empirical copula process. Using a general result on the asymptotic distribution of this process under sequences of contiguous alternatives, the local power curve of Deheuvels’ test is computed in the bivariate case and compared to that of competing procedures based on linear rank statistics. The Gil-Pelaez inversion formula is used to make additional comparisons in terms of a natural extension of Pitman's measure of asymptotic relative efficiency.     

Weak convergence of non-stationary multivariate marked processes with applications to martingale testing

This paper establishes the weak convergence of a class of marked empirical processes of possibly non-stationary and/or non-ergodic multivariate time series sequences under martingale conditions. The assumptions involved are similar to those in Brown's martingale central limit theorem. In particular, no mixing conditions are imposed. As an application, we propose a test statistic for the martingale hypothesis and we derive its asymptotic null distribution. Finally, a Monte Carlo study shows that the asymptotic results provide good approximations for small and moderate sample sizes. An application to the S&P 500 is also considered.     

Limit distribution of the sum and maximum from multivariate Gaussian sequences

In this paper we study the asymptotic joint behavior of the maximum and the partial sum of a multivariate Gaussian sequence. The multivariate maximum is defined to be the coordinatewise maximum. Results extend univariate results of McCormick and Qi. We show that, under regularity conditions, if the maximum has a limiting distribution it is asymptotically independent of the partial sum. We also prove that the maximum of a stationary sequence, when normalized in a special sense which includes subtracting the sample mean, is asymptotically independent of the partial sum (again, under regularity conditions). The limiting distributions are also obtained.     

Limit laws for upper and lower extremes from stationary mixing sequences

The aim of this paper is to examine the weak limiting behavior of upper and lower extremes from stationary sequences satisfying dependence conditions similar to D and D′ introduced by Leadbetter (Z. Wahrsch. Verw. Gebiete28 (1974), 289–303). By establishing the convergence in distribution of an associated sequence of point processes, the joint limiting distribution of any collection of upper and lower extremes can be determined. Sufficient and, in some cases, necessary conditions for the asymptotic independence of the upper and lower extremes are also given.     

Semi-aligned rank tests

Summary The distribution-free test based on semi-aligned rankings for no treatment effects in a two-way layout, with unequal number of replications in each cell is considered. The asymptotic χ-square distribution of the test statistic under the null hypothesis is derived. The Pitman asymptotic relative efficiency of the test (i) based on semi-aligned rankings with respect to the test (ii) based on within-block rankings, is shown to be larger than one as the number of blocks tends to infinity. Also the asymptotic properties of linear rank statistics (i) and (ii) are investigated and the asymptotic relative efficiency of the test (i) with respect to the test (ii) is again shown to be larger than one.     

Empirical distributions in marked point processes

We study the asymptotic behaviour of the empirical distribution function derived from a stationary marked point process when a convex sampling window is expanding without bounds in all directions. We consider a random field model which assumes that the marks and the points are independent and admits dependencies between the marks. The main result is the weak convergence of the empirical process under strong mixing conditions on both independent components of the model. Applying an approximation principle weak convergence can be also shown for appropriately weighted empirical process defined from a stationary d-dimensional germ-grain process with dependent grains.     

Multivariate quadratic forms of random vectors

We obtain the distribution of the sum of n random vectors and the distribution of their quadratic forms: their densities are expanded in series of Hermite and Laguerre polynomials. We do not suppose that these vectors are independent. In particular, we apply these results to multivariate quadratic forms of Gaussian vectors. We obtain also their densities expanded in Mac Laurin series or in the form of an integral. By this last result, we introduce a new method of computation which can be much simpler than the previously known techniques. In particular, we introduce a new method in the very classical univariate case. We remark that we do not assume the independence of normal variables.