A profile-type smoothed score function for a varying coefficient partially linear model

The varying coefficient partially linear model is considered in this paper. When the plug-in estimators of coefficient functions are used, the resulting smoothing score function becomes biased due to the slow convergence rate of nonparametric estimations. To reduce the bias of the resulting smoothing score function, a profile-type smoothed score function is proposed to draw inferences on the parameters of interest without using the quasi-likelihood framework, the least favorable curve, a higher order kernel or under-smoothing. The resulting profile-type statistic is still asymptotically Chi-squared under some regularity conditions. The results are then used to construct confidence regions for the parameters of interest. A simulation study is carried out to assess the performance of the proposed method and to compare it with the profile least-squares method. A real dataset is analyzed for illustration.     

Canonical correlation for stochastic processes

A general notion of canonical correlation is developed that extends the classical multivariate concept to include function-valued random elements X$X$ and Y$Y$. The approach is based on the polar representation of a particular linear operator defined on reproducing kernel Hilbert spaces corresponding to the random functions X$X$ and Y$Y$. In this context, canonical correlations and variables are limits of finite-dimensional subproblems thereby providing a seamless transition between Hotelling’s original development and infinite-dimensional settings. Several infinite-dimensional treatments of canonical correlations that have been proposed for specific problems are shown to be special cases of this general formulation. We also examine our notion of canonical correlation from a large sample perspective and show that the asymptotic behavior of estimators can be tied to that of estimators from standard, finite-dimensional, multivariate analysis.     

Statistical inference for panel data semiparametric partially linear regression models with heteroscedastic errors

We consider a panel data semiparametric partially linear regression model with an unknown parameter vector for the linear parametric component, an unknown nonparametric function for the nonlinear component, and a one-way error component structure which allows unequal error variances (referred to as heteroscedasticity). We develop procedures to detect heteroscedasticity and one-way error component structure, and propose a weighted semiparametric least squares estimator (WSLSE) of the parametric component in the presence of heteroscedasticity and/or one-way error component structure. This WSLSE is asymptotically more efficient than the usual semiparametric least squares estimator considered in the literature. The asymptotic properties of the WSLSE are derived. The nonparametric component of the model is estimated by the local polynomial method. Some simulations are conducted to demonstrate the finite sample performances of the proposed testing and estimation procedures. An example of application on a set of panel data of medical expenditures in Australia is also illustrated.     

Multivariate fractionally integrated CARMA processes

A multivariate analogue of the fractionally integrated continuous time autoregressive moving average (FICARMA) process defined by Brockwell [Representations of continuous-time ARMA processes, J. Appl. Probab. 41 (A) (2004) 375-382] is introduced. We show that the multivariate FICARMA process has two kernel representations: as an integral over the fractionally integrated CARMA kernel with respect to a Lévy process and as an integral over the original (not fractionally integrated) CARMA kernel with respect to the corresponding fractional Lévy process (FLP). In order to obtain the latter representation we extend FLPs to the multivariate setting. In particular we give a spectral representation of FLPs and consequently, derive a spectral representation for FICARMA processes. Moreover, various probabilistic properties of the multivariate FICARMA process are discussed. As an example we consider multivariate fractionally integrated Ornstein-Uhlenbeck processes.     

Multivariate CARMA processes

A multivariate Lévy-driven continuous time autoregressive moving average (CARMA) model of order (p,q$p,q$), q<p$q<p$, is introduced. It extends the well-known univariate CARMA and multivariate discrete time ARMA models. We give an explicit construction using a state space representation and a spectral representation of the driving Lévy process. Furthermore, various probabilistic properties of the state space model and the multivariate CARMA process itself are discussed in detail.     

Consistency of the generalized MLE of a joint distribution function with multivariate interval-censored data

Wong and Yu [Generalized MLE of a joint distribution function with multivariate interval-censored data, J. Multivariate Anal. 69 (1999) 155-166] discussed generalized maximum likelihood estimation of the joint distribution function of a multivariate random vector whose coordinates are subject to interval censoring. They established uniform consistency of the generalized MLE (GMLE) of the distribution function under the assumption that the random vector is independent of the censoring vector and that both of the vector distributions are discrete. We relax these assumptions and establish consistency results of the GMLE under a multivariate mixed case interval censorship model. van der Vaart and Wellner [Preservation theorems for Glivenko-Cantelli and uniform Glivenko-Cantelli class, in: E. Gine, D.M. Mason, J.A. Wellner (Eds.), High Dimensional Probability, vol. II, Birkhäuser, Boston, 2000, pp. 115-133] and Yu [Consistency of the generalized MLE with multivariate mixed case interval-censored data, Ph.D Dissertation, Binghamton University, 2000] independently proved strong consistency of the GMLE in the L₁(μ)-topology, where μ is a measure derived from the joint distribution of the censoring variables. We establish strong consistency of the GMLE in the topologies of weak convergence and pointwise convergence, and eventually uniform convergence under appropriate distributional assumptions and regularity conditions.     

Non-parametric kernel regression for multinomial data

This paper presents a kernel smoothing method for multinomial regression. A class of estimators of the regression functions is constructed by minimizing a localized power-divergence measure. These estimators include the bandwidth and a single parameter originating in the power-divergence measure as smoothing parameters. An asymptotic theory for the estimators is developed and the bias-adjusted estimators are obtained. A data-based algorithm for selecting the smoothing parameters is also proposed. Simulation results reveal that the proposed algorithm works efficiently.     

Nonlinear least-squares estimation

The paper uses empirical process techniques to study the asymptotics of the least-squares estimator (LSE) for the fitting of a nonlinear regression function. By combining and extending ideas of Wu and Van de Geer, it establishes new consistency and central limit theorems that hold under only second moment assumptions on the errors. An application to a delicate example of Wu's illustrates the use of the new theorems, leading to a normal approximation to the LSE with unusual logarithmic rescalings.     

Power variation for Gaussian processes with stationary increments

We develop the asymptotic theory for the realised power variation of the processes X=?•G$X=?•G$, where G$G$ is a Gaussian process with stationary increments. More specifically, under some mild assumptions on the variance function of the increments of G$G$ and certain regularity conditions on the path of the process ?$?$ we prove the convergence in probability for the properly normalised realised power variation. Moreover, under a further assumption on the Hölder index of the path of ?$?$, we show an associated stable central limit theorem. The main tool is a general central limit theorem, due essentially to Hu and Nualart [Y. Hu, D. Nualart, Renormalized self-intersection local time for fractional Brownian motion, Ann. Probab. (33) (2005) 948–983], Nualart and Peccati [D. Nualart, G. Peccati, Central limit theorems for sequences of multiple stochastic integrals, Ann. Probab. (33) (2005) 177–193] and Peccati and Tudor [G. Peccati, C.A. Tudor, Gaussian limits for vector-valued multiple stochastic integrals, in: M. Emery, M. Ledoux, M. Yor (Eds.), Seminaire de Probabilites XXXVIII, in: Lecture Notes in Math, vol. 1857, Springer-Verlag, Berlin, 2005, pp. 247–262], for sequences of random variables which admit a chaos representation.     

Nonparametric tests for conditional independence in two-way contingency tables

Testing for the independence between two categorical variables R and S forming a contingency table is a well-known problem: the classical chi-square and likelihood ratio tests are used. Suppose now that for each individual a set of p characteristics is also observed. Those explanatory variables, likely to be associated with R and S, can play a major role in their possible association, and it can therefore be interesting to test the independence between R and S conditionally on them. In this paper, we propose two nonparametric tests which generalise the chi-square and the likelihood ratio ideas to this case. The procedure is based on a kernel estimator of the conditional probabilities. The asymptotic law of the proposed test statistics under the conditional independence hypothesis is derived; the finite sample behaviour of the procedure is analysed through some Monte Carlo experiments and the approach is illustrated with a real data example.     

Asymptotic expansions of test statistics for dimensionality and additional information in canonical correlation analysis when the dimension is large

This paper examines asymptotic expansions of test statistics for dimensionality and additional information in canonical correlation analysis based on a sample of size N=n+1 on two sets of variables, i.e.,  and . These problems are related to dimension reduction. The asymptotic approximations of the statistics have been studied extensively when dimensions p₁ and p₂ are fixed and the sample size N tends to infinity. However, the approximations worsen as p₁ and p₂ increase. This paper derives asymptotic expansions of the test statistics when both the sample size and dimension are large, assuming that and have a joint (p₁+p₂)-variate normal distribution. Numerical simulations revealed that this approximation is more accurate than the classical approximation as the dimension increases.     

Some theoretical properties of Silverman's method for Smoothed functional principal component analysis

Principal component analysis (PCA) is one of the key techniques in functional data analysis. One important feature of functional PCA is that there is a need for smoothing or regularizing of the estimated principal component curves. Silverman’s method for smoothed functional principal component analysis is an important approach in a situation where the sample curves are fully observed due to its theoretical and practical advantages. However, lack of knowledge about the theoretical properties of this method makes it difficult to generalize it to the situation where the sample curves are only observed at discrete time points. In this paper, we first establish the existence of the solutions of the successive optimization problems in this method. We then provide upper bounds for the bias parts of the estimation errors for both eigenvalues and eigenfunctions. We also prove functional central limit theorems for the variation parts of the estimation errors. As a corollary, we give the convergence rates of the estimations for eigenvalues and eigenfunctions, where these rates depend on both the sample size and the smoothing parameters. Under some conditions on the convergence rates of the smoothing parameters, we can prove the asymptotic normalities of the estimations.     

PRIM analysis

This paper analyzes a data mining/bump hunting technique known as PRIM [1]. PRIM finds regions in high-dimensional input space with large values of a real output variable. This paper provides the first thorough study of statistical properties of PRIM. Amongst others, we characterize the output regions PRIM produces, and derive rates of convergence for these regions. Since the dimension of the input variables is allowed to grow with the sample size, the presented results provide some insight about the qualitative behavior of PRIM in very high dimensions. Our investigations also reveal some shortcomings of PRIM, resulting in some proposals for modifications.     

Extreme value theory for stochastic integrals of Legendre polynomials

We study in this paper the extremal behavior of stochastic integrals of Legendre polynomial transforms with respect to Brownian motion. As the main results, we obtain the exact tail behavior of the supremum of these integrals taken over intervals [0,h] with h>0 fixed, and the limiting distribution of the supremum on intervals [0,T] as T→∞. We show further how this limit distribution is connected to the asymptotic of the maximally selected quasi-likelihood procedure that is used to detect changes at an unknown time in polynomial regression models. In an application to global near-surface temperatures, we demonstrate that the limit results presented in this paper perform well for real data sets.     

On a dimension reduction regression with covariate adjustment

In this paper, we consider a semiparametric modeling with multi-indices when neither the response nor the predictors can be directly observed and there are distortions from some multiplicative factors. In contrast to the existing methods in which the response distortion deteriorates estimation efficacy even for a simple linear model, the dimension reduction technique presented in this paper interestingly does not have to account for distortion of the response variable. The observed response can be used directly whether distortion is present or not. The resulting dimension reduction estimators are shown to be consistent and asymptotically normal. The results can be employed to test whether the central dimension reduction subspace has been estimated appropriately and whether the components in the basis directions in the space are significant. Thus, the method provides an alternative for determining the structural dimension of the subspace and for variable selection. A simulation study is carried out to assess the performance of the proposed method. The analysis of a real dataset demonstrates the potential usefulness of distortion removal.     

Some notes on extremal discriminant analysis

Classical discriminant analysis focusses on Gaussian and nonparametric models where in the second case the unknown densities are replaced by kernel densities based on the training sample. In the present article we assume that it suffices to base the classification on exceedances above higher thresholds, which can be interpreted as observations in a conditional framework. Therefore, the statistical modeling of truncated distributions is merely required. In this context, a nonparametric modeling is not adequate because the kernel method is inaccurate in the upper tail region. Yet one may deal with truncated parametric distributions like the Gaussian ones. Our primary aim is to replace truncated Gaussian distributions by appropriate generalized Pareto distributions and to explore properties and the relationship of discriminant functions in both models.     

Likelihood and conditional likelihood inference for generalized additive mixed models for clustered data

Lin and Zhang (J. Roy. Statist. Soc. Ser. B 61 (1999) 381) proposed the generalized additive mixed model (GAMM) as a framework for analysis of correlated data, where normally distributed random effects are used to account for correlation in the data, and proposed to use double penalized quasi-likelihood (DPQL) to estimate the nonparametric functions in the model and marginal likelihood to estimate the smoothing parameters and variance components simultaneously. However, the normal distributional assumption for the random effects may not be realistic in many applications, and it is unclear how violation of this assumption affects ensuing inferences for GAMMs. For a particular class of GAMMs, we propose a conditional estimation procedure built on a conditional likelihood for the response given a sufficient statistic for the random effect, treating the random effect as a nuisance parameter, which thus should be robust to its distribution. In extensive simulation studies, we assess performance of this estimator under a range of conditions and use it as a basis for comparison to DPQL to evaluate the impact of violation of the normality assumption. The procedure is illustrated with application to data from the Multicenter AIDS Cohort Study (MACS).     

High-dimensional asymptotic expansions for the distributions of canonical correlations

This paper examines asymptotic distributions of the canonical correlations between and with q≤p, based on a sample of size of N=n+1. The asymptotic distributions of the canonical correlations have been studied extensively when the dimensions q and p are fixed and the sample size N tends toward infinity. However, these approximations worsen when q or p is large in comparison to N. To overcome this weakness, this paper first derives asymptotic distributions of the canonical correlations under a high-dimensional framework such that q is fixed, m=n−p→∞ and c=p/n→c₀∈[0,1), assuming that and have a joint (q+p)-variate normal distribution. An extended Fisher’s z-transformation is proposed. Then, the asymptotic distributions are improved further by deriving their asymptotic expansions. Numerical simulations revealed that our approximations are more accurate than the classical approximations for a large range of p,q, and n and the population canonical correlations.     

Stopping for two-dimensional stochastic processes

The aim of this paper is to introduce some techniques that can be used in the study of stochastic processes which have as parameter set the positive quadrant of the plane R²₊. We define stopping lines and derive an interesting property of measurability for them. The notion of predictability is developed, and we show the connection between predictable processes, fields associated with stopping lines, and predictable stopping lines. We also give a theorem of section for predictable sets. Extension to processes indexed by any partially ordered set with some regularity assumptions can be carried out quite easily with the same techniques.     

Semiparametric analysis of longitudinal zero-inflated count data

In this article, we consider a semiparametric zero-inflated Poisson mixed model that postulates a possible nonlinear relationship between the natural logarithm of the mean of the counts and a particular covariate in the longitudinal studies. A penalized log-likelihood function is proposed and Monte Carlo expectation-maximization algorithm is used to derive the estimates. Under some mild conditions, we establish the consistency and asymptotic normality of the resulting estimators. Simulation studies are carried out to investigate the finite sample performance of the proposed method. For illustration purposes, the method is applied to a data set from a pharmaceutical company where the variable of interest is the number of episodes of side effects after the patient has taken the treatments.