Modified Whittle estimation of multilateral models on a lattice

In the estimation of parametric models for stationary spatial or spatio-temporal data on a d-dimensional lattice, for d?2, the achievement of asymptotic efficiency under Gaussianity, and asymptotic normality more generally, with standard convergence rate, faces two obstacles. One is the “edge effect”, which worsens with increasing d. The other is the possible difficulty of computing a continuous-frequency form of Whittle estimate or a time domain Gaussian maximum likelihood estimate, due mainly to the Jacobian term. This is especially a problem in “multilateral” models, which are naturally expressed in terms of lagged values in both directions for one or more of the d dimensions. An extension of the discrete-frequency Whittle estimate from the time series literature deals conveniently with the computational problem, but when subjected to a standard device for avoiding the edge effect has disastrous asymptotic performance, along with finite sample numerical drawbacks, the objective function lacking a minimum-distance interpretation and losing any global convexity properties. We overcome these problems by first optimizing a standard, guaranteed non-negative, discrete-frequency, Whittle function, without edge-effect correction, providing an estimate with a slow convergence rate, then improving this by a sequence of computationally convenient approximate Newton iterations using a modified, almost-unbiased periodogram, the desired asymptotic properties being achieved after finitely many steps. The asymptotic regime allows increase in both directions of all d dimensions, with the central limit theorem established after re-ordering as a triangular array. However our work offers something new for “unilateral” models also. When the data are non-Gaussian, asymptotic variances of all parameter estimates may be affected, and we propose consistent, non-negative definite estimates of the asymptotic variance matrix.     

Nonparametric estimation for pure jump Lévy processes based on high frequency data

In this paper, we study nonparametric estimation of the Lévy density for pure jump Lévy processes. We consider n$n$ discrete time observations with step Δ$\Delta$. The asymptotic framework is: n$n$ tends to infinity, Δ=_Δn$\Delta ={\Delta }_n$ tends to zero while n_Δn$n{\Delta }_n$ tends to infinity. First, we use a Fourier approach (“frequency domain”): this allows us to construct an adaptive nonparametric estimator and to provide a bound for the global L²${\mathbb{L}}^2$-risk. Second, we use a direct approach (“time domain”) which allows us to construct an estimator on a given compact interval. We provide a bound for L²${\mathbb{L}}^2$-risk restricted to the compact interval. We discuss rates of convergence and give examples and simulation results for processes fitting in our framework.     

Statistical inference of spectral estimation for continuous-time MA processes with finite second moments

In this paper we investigate a continuous-time MA (moving average) process (X _t ) _t≥0 sampled at an equally spaced time grid {Δ,2Δ, …, nΔ}, where the grid distance Δ > 0 is fixed and n denotes the number of observations, in the frequency domain. We derive for the process (X _kΔ) _k∈? with finite second moments the asymptotic behavior of the periodogram and of the lag-window spectral density estimator. The periodogram is not a consistent estimator for the spectral density of (X _kΔ) _k∈?. Different periodogram frequencies are asymptotically independent and exponentially distributed like for ARMA processes in discrete time. This result is basic for frequency bootstraps. In contrast, the lag-window spectral density estimator is a consistent estimator for the spectral density of (X _kΔ) _k∈? and moreover, it is asymptotically normally distributed.     

Adaptive estimation of the transition density of a particular hidden Markov chain

We study the following model of hidden Markov chain: with (X_i) a real-valued positive recurrent and stationary Markov chain, and (?_i)_1?i?n+1 a noise independent of the sequence (X_i) having a known distribution. We present an adaptive estimator of the transition density based on the quotient of a deconvolution estimator of the density of X_i and an estimator of the density of (X_i,X_i+1). These estimators are obtained by contrast minimization and model selection. We evaluate the L² risk and its rate of convergence for ordinary smooth and supersmooth noise with regard to ordinary smooth and supersmooth chains. Some examples are also detailed.     

Quantile regression for longitudinal data

The penalized least squares interpretation of the classical random effects estimator suggests a possible way forward for quantile regression models with a large number of “fixed effects”. The introduction of a large number of individual fixed effects can significantly inflate the variability of estimates of other covariate effects. Regularization, or shrinkage of these individual effects toward a common value can help to modify this inflation effect. A general approach to estimating quantile regression models for longitudinal data is proposed employing ?₁ regularization methods. Sparse linear algebra and interior point methods for solving large linear programs are essential computational tools.     

Asymptotics for functionals of self-normalized residuals of discretely observed stochastic processes

The purpose of this paper is to derive the stochastic expansion of self-normalized-residual functionals stemming from a class of diffusion type processes observed at high frequency, where total observing period may or may not tend to infinity. The result enables us to construct some explicit statistics for goodness of fit tests, consistent against “presence of a jump component” and “diffusion-coefficient misspecification”; then, the acceptance of the null hypothesis may serve as a collateral evidence for using the correctly specified diffusion type model. Especially, our asymptotic result clarifies how to remove the bias caused by plugging in a diffusion-coefficient estimator.     

Improved estimation of a covariance matrix in an elliptically contoured matrix distribution

In this paper, the problem of estimating the covariance matrix of the elliptically contoured distribution (ECD) is considered. A new class of estimators which shrink the eigenvalues towards their arithmetic mean is proposed. It is shown that this new estimator dominates the unbiased estimator under the squared error loss function. Two special classes of ECD, namely, the multivariate-elliptical t distribution and the ε-contaminated normal distribution are considered. A simulation study is carried out and indicates that this new shrinkage estimator provides a substantial improvement in risk under most situations.     

Moderate deviations for quadratic forms in Gaussian stationary processes

Moderate deviations limit theorem is proved for quadratic forms in zero-mean Gaussian stationary processes. Two particular cases are the cumulative periodogram and the kernel spectral density estimator. We also derive the exponential decay of moderate deviation probabilities of goodness-of-fit tests for the spectral density and then discuss intermediate asymptotic efficiencies of tests.     

Wishart ratios with dependent structure: New members of the bimatrix beta type IV

In multivariate statistics under normality, the problems of interest are random covariance matrices (known as Wishart matrices) and “ratios” of Wishart matrices that arise in multivariate analysis of variance (MANOVA) (see 24). The bimatrix variate beta type IV distribution (also known in the literature as bimatrix variate generalised beta; matrix variate generalization of a bivariate beta type I) arises from “ratios” of Wishart matrices. In this paper, we add a further independent Wishart random variate to the “denominator” of one of the ratios; this results in deriving the exact expression for the density function of the bimatrix variate extended beta type IV distribution. The latter leads to the proposal of the bimatrix variate extended F distribution. Some interesting characteristics of these newly introduced bimatrix distributions are explored. Lastly, we focus on the bivariate extended beta type IV distribution (that is an extension of bivariate Jones’ beta) with emphasis on P(X₁<X₂) where X₁ is the random stress variate and X₂ is the random strength variate.     

On improved estimation of normal precision matrix and discriminant coefficients

The problem of estimating the precision matrix of a multivariate normal distribution model is considered with respect to a quadratic loss function. A number of covariance estimators originally intended for a variety of loss functions are adapted so as to obtain alternative estimators of the precision matrix. It is shown that the alternative estimators have analytically smaller risks than the unbiased estimator of the precision matrix. Through numerical studies of risk values, it is shown that the new estimators have substantial reduction in risk. In addition, we consider the problem of the estimation of discriminant coefficients, which arises in linear discriminant analysis when Fisher's linear discriminant function is viewed as the posterior log-odds under the assumption that two classes differ in mean but have a common covariance matrix. The above method is also adapted for this problem in order to obtain improved estimators of the discriminant coefficients under the quadratic loss function. Furthermore, a numerical study is undertaken to compare the properties of a collection of alternatives to the “unbiased” estimator of the discriminant coefficients.     

The Topological Tverberg Theorem and winding numbers

The Topological Tverberg Theorem claims that any continuous map of a (q-1)(d+1)-simplex to R^d identifies points from q disjoint faces. (This has been proved for affine maps, for d?1, and if q is a prime power, but not yet in general.)The Topological Tverberg Theorem can be restricted to maps of the d-skeleton of the simplex. We further show that it is equivalent to a “Winding Number Conjecture” that concerns only maps of the (d-1)-skeleton of a (q-1)(d+1)-simplex to R^d. “Many Tverberg partitions” arise if and only if there are “many q-winding partitions.”The d=2 case of the Winding Number Conjecture is a problem about drawings of the complete graphs K_3q-2 in the plane. We investigate graphs that are minimal with respect to the winding number condition.     

HAC estimation and strong linearity testing in weak ARMA models

In the framework of ARMA models, we consider testing the reliability of the standard asymptotic covariance matrix (ACM) of the least-squares estimator. The standard formula for this ACM is derived under the assumption that the errors are independent and identically distributed, and is in general invalid when the errors are only uncorrelated. The test statistic is based on the difference between a conventional estimator of the ACM of the least-squares estimator of the ARMA coefficients and its robust HAC-type version. The asymptotic distribution of the HAC estimator is established under the null hypothesis of independence, and under a large class of alternatives. The asymptotic distribution of the proposed statistic is shown to be a standard χ² under the null, and a noncentral χ² under the alternatives. The choice of the HAC estimator is discussed through asymptotic power comparisons. The finite sample properties of the test are analyzed via Monte Carlo simulation.     

Curve denoising by multiscale singularity detection and geometric shrinkage

We propose a method for denoising piecewise smooth curves, given a number of noisy sample points. Using geometric variants of wavelet shrinkage methods, our algorithm preserves corners while enforcing that the smoothed arcs lie in an L² Sobolev space Hα of order α chosen by the operator. The reconstruction is scale-invariant when using the Sobolev space H3/2, adapts to the local noise level, and is essentially free of tuning parameters. In particular, our noise-adaptivity ensures that there is no arbitrarily-chosen “diffusion time” parameter in the denoising. Further, in cases where the distinction between signal and noise is unclear, we show how statistics gathered from the curve can be used to identify a finite number of “good” choices for the denoising.     

Semi-varying coefficient models with a diverging number of components

Semiparametric models with both nonparametric and parametric components have become increasingly useful in many scientific fields, due to their appropriate representation of the trade-off between flexibility and efficiency of statistical models. In this paper we focus on semi-varying coefficient models (a.k.a. varying coefficient partially linear models) in a “large n, diverging p” situation, when both the number of parametric and nonparametric components diverges at appropriate rates, and we only consider the case p=o(n). Consistency of the estimator based on B-splines and asymptotic normality of the linear components are established under suitable assumptions. Interestingly (although not surprisingly) our analysis shows that the number of parametric components can diverge at a faster rate than the number of nonparametric components and the divergence rates of the number of the nonparametric components constrain the allowable divergence rates of the parametric components, which is a new phenomenon not established in the existing literature as far as we know. Finally, the finite sample behavior of the estimator is evaluated by some Monte Carlo studies.     

An arithmetic formula for certain coefficients of the Euler product of Hecke polynomials

In 1997 the author found a criterion for the Riemann hypothesis for the Riemann zeta function, involving the nonnegativity of certain coefficients associated with the Riemann zeta function. In 1999 Bombieri and Lagarias obtained an arithmetic formula for these coefficients using the “explicit formula” of prime number theory. In this paper, the author obtains an arithmetic formula for corresponding coefficients associated with the Euler product of Hecke polynomials, which is essentially a product of L-functions attached to weight 2 cusp forms (both newforms and oldforms) over Hecke congruence subgroups Γ₀(N). The nonnegativity of these coefficients gives a criterion for the Riemann hypothesis for all these L-functions at once.     

On kernel method for sliced average variance estimation

In this paper, we use the kernel method to estimate sliced average variance estimation (SAVE) and prove that this estimator is both asymptotically normal and root n consistent. We use this kernel estimator to provide more insight about the differences between slicing estimation and other sophisticated local smoothing methods. Finally, we suggest a Bayes information criterion (BIC) to estimate the dimensionality of SAVE. Examples and real data are presented for illustrating our method.     

Finite sample tail behavior of multivariate location estimators

A finite sample performance measure of multivariate location estimators is introduced based on “tail behavior”. The tail performance of multivariate “monotone” location estimators and the halfspace depth based “non-monotone” location estimators including the Tukey halfspace median and multivariate L-estimators is investigated. The connections among the finite sample performance measure, the finite sample breakdown point, and the halfspace depth are revealed. It turns out that estimators with high breakdown point or halfspace depth have “appealing” tail performance. The tail performance of the halfspace median is very appealing and also robust against underlying population distributions, while the tail performance of the sample mean is very sensitive to underlying population distributions. These findings provide new insights into the notions of the halfspace depth and breakdown point and identify the important role of tail behavior as a quantitative measure of robustness in the multivariate location setting.     

Optimal global rate of convergence in nonparametric regression with left-truncated and right-censored data

In this paper we consider nonparametric regression with left-truncated and right-censored data. An estimator of the regression function is developed when censoring and truncation are independent of covariates and the response. The estimation is based on the product limit estimator of the response variable. Under certain conditions, the L₂ rate of convergence of the estimated regression function is obtained when tensor products of B-splines are used.     

The multiple hybrid bootstrap — Resampling multivariate linear processes

The paper reconsiders the autoregressive aided periodogram bootstrap (AAPB) which has been suggested in Kreiss and Paparoditis (2003) [18]. Their idea was to combine a time domain parametric and a frequency domain nonparametric bootstrap to mimic not only a part but as much as possible the complete covariance structure of the underlying time series. We extend the AAPB in two directions. Our procedure explicitly leads to bootstrap observations in the time domain and it is applicable to multivariate linear processes, but agrees exactly with the AAPB in the univariate case, when applied to functionals of the periodogram. The asymptotic theory developed shows validity of the multiple hybrid bootstrap procedure for the sample mean, kernel spectral density estimates and, with less generality, for autocovariances.     

Corrected version of AIC for selecting multivariate normal linear regression models in a general nonnormal case

This paper deals with the bias reduction of Akaike information criterion (AIC) for selecting variables in multivariate normal linear regression models when the true distribution of observation is an unknown nonnormal distribution. We propose a corrected version of AIC which is partially constructed by the jackknife method and is adjusted to the exact unbiased estimator of the risk when the candidate model includes the true model. It is pointed out that the influence of nonnormality in the bias of our criterion is smaller than the ones in AIC and TIC. We verify that our criterion is better than the AIC, TIC and EIC by conducting numerical experiments.