Semiparametric quantile modelling of hierarchical data

The classic hierarchical linear model formulation provides a considerable flexibility for modelling the random effects structure and a powerful tool for analyzing nested data that arise in various areas such as biology, economics and education. However, it assumes the within-group errors to be independently and identically distributed （i.i.d.） and models at all levels to be linear. Most importantly, traditional hierarchical models （just like other ordinary mean regression methods） cannot characterize the entire conditional distribution of a dependent variable given a set of covariates and fail to yield robust estimators. In this article, we relax the aforementioned and normality assumptions, and develop a so-called Hierarchical Semiparametric Quantile Regression Models in which the within-group errors could be heteroscedastic and models at some levels are allowed to be nonparametric. We present the ideas with a 2-level model. The level-1 model is specified as a nonparametric model whereas level-2 model is set as a parametric model. Under the proposed semiparametric setting the vector of partial derivatives of the nonparametric function in level-1 becomes the response variable vector in level 2. The proposed method allows us to model the fixed effects in the innermost level （i.e., level 2） as a function of the covariates instead of a constant effect. We outline some mild regularity conditions required for convergence and asymptotic normality for our estimators. We illustrate our methodology with a real hierarchical data set from a laboratory study and some simulation studies.     

Random-covariances and mixed-effects models for imputing multivariate multilevel continuous data

Principled techniques for incomplete-data problems are increasingly part of mainstream statistical practice. Among many proposed techniques so far, inference by multiple imputation (MI) has emerged as one of the most popular. While many strategies leading to inference by MI are available in cross-sectional settings, the same richness does not exist in multilevel applications. The limited methods available for multilevel applications rely on the multivariate adaptations of mixed-effects models. This approach preserves the mean structure across clusters and incorporates distinct variance components into the imputation process. In this paper, I add to these methods by considering a random covariance structure and develop computational algorithms. The attraction of this new imputation modeling strategy is to correctly reflect the mean and variance structure of the joint distribution of the data, and allow the covariances differ across the clusters. Using Markov Chain Monte Carlo techniques, a predictive distribution of missing data given observed data is simulated leading to creation of multiple imputations. To circumvent the large sample size requirement to support independent covariance estimates for the level-1 error term, I consider distributional impositions mimicking random-effects distributions assigned a priori. These techniques are illustrated in an example exploring relationships between victimization and individual and contextual level factors that raise the risk of violent crime.     

Kernel quantile estimator with ICI adaptive bandwidth selection technique

In this article, we consider a class of kernel quantile estimators which is the linear combi- nation of order statistics. This class of kernel quantile estimators can be regarded as an extension of some existing estimators. The exact mean square error expression for this class of estimators will be provided when data are uniformly distributed. The implementation of these estimators depends mostly on the bandwidth selection. We then develop an adaptive method for bandwidth selection based on the intersection confidence intervals （ICI） principle. Monte Carlo studies demonstrate that our proposed approach is comparatively remarkable. We illustrate our method with a real data set.     

On the comparison of the pre-test and shrinkage phi-divergence test estimators for the symmetry model of categorical data

The estimation problem of the parameters in a symmetry model for categorical data has been considered for many authors in the statistical literature (for example, Bowker (1948) [1], Ireland et al. (1969) [2], Quade and Salama (1975) [3], Cressie and Read (1988) [4], Menéndez et al. (2005) [5]) without using uncertain prior information. It is well known that many new and interesting estimators, using uncertain prior information, have been studied by a host of researchers in different statistical models, and many papers have been published on this topic (see Saleh (2006) [9] and references therein). In this paper, we consider the symmetry model of categorical data and we study, for the first time, some new estimators when non-sample information about the symmetry of the probabilities is considered. The decision to use a “restricted” estimator or an “unrestricted” estimator is based on the outcome of a preliminary test, and then a shrinkage technique is used. It is interesting to note that we present a unified study in the sense that we consider not only the maximum likelihood estimator and likelihood ratio test or chi-square test statistic but we consider minimum phi-divergence estimators and phi-divergence test statistics. Families of minimum phi-divergence estimators and phi-divergence test statistics are wide classes of estimators and test statistics that contain as a particular case the maximum likelihood estimator, likelihood ratio test and chi-square test statistic. In an asymptotic set-up, the biases and the risk under the squared loss function for the proposed estimators are derived and compared. A numerical example clarifies the content of the paper.     

Asymptotic theory for varying coefficient regression models with dependent data

The varying coefficient models (VCMs) are extremely important tools in the statistical literature and are widely used in many subject areas for data modeling and exploration. In linear VCMs, typically the errors are assumed to be independent. However, in many situations, especially in spatial or spatiotemporal settings, this is not a viable assumption. In this article, we consider nonparametric VCMs with a general dependent error structure which allows for both spatially autoregressive and spatial moving average models as special cases. We investigate asymptotic properties of local polynomial estimators of the model components. Specifically, we show that the estimates of the unknown functions and their derivatives are consistent and asymptotically normally distributed. We show that the rate of convergence and the asymptotic covariance matrix depend on the error dependence structure and we derive the explicit formula for the convergence results.     

Adaptive multilevel finite element approximations of semilinear elliptic boundary value problems

Summary. In this paper we consider two aspects of the problem of designing efficient numerical methods for the approximation of semilinear boundary value problems. First we consider the use of two and multilevel algorithms for approximating the discrete solution. Secondly we consider adaptive mesh refinement based on feedback information from coarse level approximations. The algorithms are based on an a posteriori error estimate, where the error is estimated in terms of computable quantities only. The a posteriori error estimate is used for choosing appropriate spaces in the multilevel algorithms, mesh refinements, as a stopping criterion and finally it gives an estimate of the total error. Received April 8, 1997 / Revised version received July 27, 1998 / Published online September 24, 1999     

Multivariate moment based extreme value index estimators

Modeling extreme events is of paramount importance in various areas of science—biostatistics, climatology, finance, geology, and telecommunications, to name a few. Most of these application areas involve multivariate data. Estimation of the extreme value index plays a crucial role in modeling rare events. There is an affine invariant multivariate generalization of the well known Hill estimator—the separating Hill estimator. However, the Hill estimator is only suitable for heavy tailed distributions. As in the case of the separating multivariate Hill estimator, we consider estimation of the extreme value index under the assumptions of multivariate ellipticity and independent identically distributed observations. We provide affine invariant multivariate generalizations of the moment estimator and the mixed moment estimator. These estimators are suitable for both light and heavy tailed distributions. Asymptotic properties of the new extreme value index estimators are derived under multivariate elliptical distribution with known location and scatter. The effect of replacing true location and scatter by estimates is examined in a thorough simulation study. We also consider two data examples: one financial application and one meteorological application.     

Statistical inference for coherent systems with Weibull distributed component lifetimes under complete and incomplete information

Point estimators for the parameters of the component lifetime distribution in coherent systems are evolved assuming to be independently and identically Weibull distributed component lifetimes. We study both complete and incomplete information under continuous monitoring of the essential component lifetimes. First, we prove that the maximum likelihood estimator (MLE) under complete information based on progressively Type‐II censored system lifetimes uniquely exists and we present two approaches to compute the estimates. Furthermore, we consider an ad hoc estimator, a max‐probability plan estimator and the MLE for the parameters under incomplete information. In order to compute the MLEs, we consider a direct maximization of the likelihood and an EM‐algorithm–type approach, respectively. In all cases, we illustrate the results by simulations of the five‐component bridge system and the 10‐component parallel system, respectively.     

On consistency of the likelihood moment estimators for a linear process with regularly varying innovations

In 1975 James Pickands III showed that the excesses over a high threshold are approximatly Generalized Pareto distributed. Since then, a variety of estimators for the parameters of this cdf have been studied, but always assuming the underlying data to be independent. In this paper we consider the special case where the underlying data arises from a linear process with regularly varying (i.e. heavy-tailed) innovations. Using this setup, we then show that the likelihood moment estimators introduced by Zhang Aust. N.Z. J. Stat. 49, 69–77 (2007) are consistent estimators for the parameters of the Generalized Pareto distribution.     

Multivariate logistic regression with incomplete covariate and auxiliary information

In this article, we propose and explore a multivariate logistic regression model for analyzing multiple binary outcomes with incomplete covariate data where auxiliary information is available. The auxiliary data are extraneous to the regression model of interest but predictive of the covariate with missing data. Horton and Laird [N.J. Horton, N.M. Laird, Maximum likelihood analysis of logistic regression models with incomplete covariate data and auxiliary information, Biometrics 57 (2001) 34–42] describe how the auxiliary information can be incorporated into a regression model for a single binary outcome with missing covariates, and hence the efficiency of the regression estimators can be improved. We consider extending the method of [9] to the case of a multivariate logistic regression model for multiple correlated outcomes, and with missing covariates and completely observed auxiliary information. We demonstrate that in the case of moderate to strong associations among the multiple outcomes, one can achieve considerable gains in efficiency from estimators in a multivariate model as compared to the marginal estimators of the same parameters.     

Asymptotic properties of the least squares estimators of the parameters of the chirp signals

Chirp signals are quite common in different areas of science and engineering. In this paper we consider the asymptotic properties of the least squares estimators of the parameters of the chirp signals. We obtain the consistency property of the least squares estimators and also obtain the asymptotic distribution under the assumptions that the errors are independent and identically distributed. We also consider the generalized chirp signals and obtain the asymptotic properties of the least squares estimators of the unknown parameters. Finally we perform some simulations experiments to see how the asymptotic results behave for small sample and the performances are quite satisfactory.     

AIC type statistics for discretely observed ergodic diffusion processes

We consider the model selection problem for ergodic diffusion processes based on sampled data. The adaptive estimators for parameters of drift and diffusion coefficients are used in order to construct Akaike’s information criterion (AIC) type model selection statistics. Asymptotic properties of our proposed criteria are given for three kinds of the adaptive estimators.     

The 3/2th and 2nd order asymptotic efficiency of maximum probability estimators in non-regular cases

In this paper we consider the estimation problem on independent and identically distributed observations from a location parameter family generated by a density which is positive and symmetric on a finite interval, with a jump and a nonnegative right differential coefficient at the left endpoit. It is shown that the maximum probability estimator (MPE) is 3/2th order two-sided asymptotically efficient at a point in the sense that it has the most concentration probability around the true parameter at the point in the class of 3/2th order asymptotically median unbiased (AMU) estimators only when the right differential coefficient vanishes at the left endpoint. The second order upper bound for the concentration probability of second order AMU estimators is also given. Further, it is shown that the MPE is second order two-sided asymptotically efficient at a point in the above case only.Research supported by University of Tsukuba Project Research.     

A Posteriori Error Estimators for Elliptic Equations with Discontinuous Coefficients

We consider linear elliptic equations with discontinuous coefficients in two and three space dimensions with varying boundary conditions. The problem is discretized with linear finite elements. An adaptive procedure based on a posteriori error estimators for the treatment of singularities is proposed. Within the class of quasi-monotonically distributed coefficients we derive a posteriori error estimators with bounds that are independent of the variation of the coefficients. In numerical test cases we confirm the robustness of the error estimators and observe that on adaptively refined meshes the reduction of the error is optimal with respect to the number of unknowns.     

Estimate of the Constant in Two Strengthened C.B.S. Inequalities for F.E.M. Systems of 2D Elasticity: Application to Multilevel Methods and a Posteriori Error Estimators

The constant γ in the strengthened Cauchy-Buniakowski-Schwarz (C.B.S.) inequality plays a crucial role in the convergence rate of multilevel iterative methods as well as in the efficiency of a posteriori error estimators, that is in the framework of finite element approximations of SPD problems. We consider the approximation of the 2D elasticity problem by the Courant element. Concerning multilevel convergence rate, that is the γ corresponding to nested general triangular meshes of size h and 2h, we have proved that γ²≤ 3/4$ uniformly on the mesh and the Poisson ratio. Concerning error estimator, that is the γ corresponding to quadratic and linear approximations on the same mesh, numerical computations have shown that the exact γ for a reference element deteriorates that is goes to one, when the Poisson ratio tends to 1/2     

A comparison of minimax and least squares estimators in linear regression with polyhedral prior information

We consider the linear regression model where prior information in the form of linear inequalities restricts the parameter space to a polyhedron. Since the linear minimax estimator has, in general, to be determined numerically, it was proposed to minimize an upper bound of the maximum risk instead. The resulting so-called quasiminimax estimator can be easily calculated in closed form. Unfortunately, both minimax estimators may violate the prior information. Therefore, we consider projection estimators which are obtained by projecting the estimate in an optional second step. The performance of these estimators is investigated in a Monte Carlo study together with several least squares estimators, including the inequality restricted least squares estimator. It turns out that both the projected and the unprojected quasiminimax estimators have the best average performance.     

Shrinkage drift parameter estimation for multi‐factor Ornstein–Uhlenbeck processes

We consider some inference problems concerning the drift parameters of multi‐factors Vasicek model (or multivariate Ornstein–Uhlebeck process). For example, in modeling for interest rates, the Vasicek model asserts that the term structure of interest rate is not just a single process, but rather a superposition of several analogous processes. This motivates us to develop an improved estimation theory for the drift parameters when homogeneity of several parameters may hold. However, the information regarding the equality of these parameters may be imprecise. In this context, we consider Stein‐rule (or shrinkage) estimators that allow us to improve on the performance of the classical maximum likelihood estimator (MLE). Under an asymptotic distributional quadratic risk criterion, their relative dominance is explored and assessed. We illustrate the suggested methods by analyzing interbank interest rates of three European countries. Further, a simulation study illustrates the behavior of the suggested method for observation periods of small and moderate lengths of time. Our analytical and simulation results demonstrate that shrinkage estimators (SEs) provide excellent estimation accuracy and outperform the MLE uniformly. An over‐ridding theme of this paper is that the SEs provide powerful extensions of their classical counterparts. Copyright © 2009 John Wiley & Sons, Ltd.     

Asymptotic Theory for Relative-Risk Models with Missing Time-Dependent Covariates

Relative-risk models are often used to characterize the relationship between survival time and time-dependent covariates. When the covariates are observed, the estimation and asymptotic theory for parameters of interest are available; challenges remain when missingness occurs. A popular approach at hand is to jointly model survival data and longitudinal data. This seems efficient, in making use of more information, but the rigorous theoretical studies have long been ignored. For both additive risk models and relative-risk models, we consider the missing data nonignorable. Under general regularity conditions, we prove asymptotic normality for the nonparametric maximum likelihood estimators.     

带有辅助信息的多元失效时间数据的估计标准部分似然方法

在许多实际研究中, 由于预算限制, 主协变量值只能对某一个有效集进行准确测量, 但同时对应此主协变量的辅助信息则对全部个体均可以观测. 利用这些辅助协变量的信息有助于提高统计研究的效率. 本文在基于共同基准危险率的边际模型框架下, 我们提出了一些统计推断方法来分析多元失效时间数据. 对于回归参数, 我们提出标准的估计部分似然方程来估计它, 同时也给出了累积基准危险率函数的Breslow 型估计. 得到的估计可以证明是相合的和渐近正态的. 利用模拟分析结果来表明了提出的方法在有限样本下的可行性.     

Upper Bound of the Constant in Strengthened C.B.S. Inequality for Systems of Linear Partial Differential Equations

The constant in the strengthened Cauchy–Bunyakowski–Schwarz (C.B.S.) inequality plays a crucial role in the convergence rate of multilevel iterative methods as well as in the efficiency of a posteriori error estimators, that is the framework of finite element approximations of systems of partial differential equations. We consider an approximation of general systems of linear partial differential equations in R ³. Concerning a multilevel convergence rate corresponding to nested general tetrahedral meshes of size h and 2h, we give an estimate of this constant for general three-dimensional cases.