Preliminary test estimators and phi-divergence measures in generalized linear models with binary data

We consider the problem of estimation of the parameters in Generalized Linear Models (GLM) with binary data when it is suspected that the parameter vector obeys some exact linear restrictions which are linearly independent with some degree of uncertainty. Based on minimum -divergence estimation (ME), we consider some estimators for the parameters of the GLM: Unrestricted ME, restricted ME, Preliminary ME, Shrinkage ME, Shrinkage preliminary ME, James–Stein ME, Positive-part of Stein-Rule ME and Modified preliminary ME. Asymptotic bias as well as risk with a quadratic loss function are studied under contiguous alternative hypotheses. Some discussion about dominance among the estimators studied is presented. Finally, a simulation study is carried out.     

Fixed-gain estimation in continuous time

We prove that the parameter estimation error of continuous-time linear stochastic systems that is obtained in connection with a fixed-gain estimation method can be written as a stochastic integral plus a residual term, the moments of which are of order+o(1) where is the forgetting factor.     

Item response theory for longitudinal data: population parameter estimation

In this work we propose IRT models to estimate ability distribution parameters of a population of individuals submitted to different tests along the time, having or not common items. The item parameters are considered known and several covariance structures are proposed to accommodate the possible dependence among the abilities of the same individual, measured at different instants. Maximum likelihood equations and some simulation results are presented.     

New insights into best linear unbiased estimation and the optimality of least-squares

New results in matrix algebra applied to the fundamental bordered matrix of linear estimation theory pave the way towards obtaining additional and informative closed-form expressions for the best linear unbiased estimator (BLUE). The results prove significant in several respects. Indeed, more light is shed on the BLUE structure and on the working of the OLS estimator under nonsphericalness in (possibly) singular models.     

Unbiased estimation in the multivariate natural exponential family with simple quadratic variance function

We give expansions for the unbiased estimator of a parametric function of the mean vector in a multivariate natural exponential family with simple quadratic variance function. This expansion is given in terms of a system of multivariate orthogonal polynomials with respect to the density of the sample mean. We study some limit properties of the system of orthogonal polynomials. We show that these properties are useful to establish the limit distribution of unbiased estimators.     

An adjusted maximum likelihood method for solving small area estimation problems

For the well-known Fay-Herriot small area model, standard variance component estimation methods frequently produce zero estimates of the strictly positive model variance. As a consequence, an empirical best linear unbiased predictor of a small area mean, commonly used in small area estimation, could reduce to a simple regression estimator, which typically has an overshrinking problem. We propose an adjusted maximum likelihood estimator of the model variance that maximizes an adjusted likelihood defined as a product of the model variance and a standard likelihood (e.g., a profile or residual likelihood) function. The adjustment factor was suggested earlier by Carl Morris in the context of approximating a hierarchical Bayes solution where the hyperparameters, including the model variance, are assumed to follow a prior distribution. Interestingly, the proposed adjustment does not affect the mean squared error property of the model variance estimator or the corresponding empirical best linear unbiased predictors of the small area means in a higher order asymptotic sense. However, as demonstrated in our simulation study, the proposed adjustment has a considerable advantage in small sample inference, especially in estimating the shrinkage parameters and in constructing the parametric bootstrap prediction intervals of the small area means, which require the use of a strictly positive consistent model variance estimate.     

Density estimation for linear processes

Summary LetX _t , ...,X _n be random variables forming a realization from a linear process where {Z _t } is a sequence of independent and identically distributed random variables with E|Z _t |<∞ for some ε>0, andg _r →0 asr→∞ at some specified rate. LetX ₁ have a probability density functionf. It is then established that for every realx, the standard kernel type estimator based onX _t (1≦t≦n) is, under some general regularity conditions, asymptotically normal and converges a.s. tof(x) asn→∞. Research was supported in part by the Air Force Office of Scientific Research Grant No. AFOSR-81-0058.     

Sparse graphical models for exploring gene expression data

We discuss the theoretical structure and constructive methodology for large-scale graphical models, motivated by their potential in evaluating and aiding the exploration of patterns of association in gene expression data. The theoretical discussion covers basic ideas and connections between Gaussian graphical models, dependency networks and specific classes of directed acyclic graphs we refer to as compositional networks. We describe a constructive approach to generating interesting graphical models for very high-dimensional distributions that builds on the relationships between these various stylized graphical representations. Issues of consistency of models and priors across dimension are key. The resulting methods are of value in evaluating patterns of association in large-scale gene expression data with a view to generating biological insights about genes related to a known molecular pathway or set of specified genes. Some initial examples relate to the estrogen receptor pathway in breast cancer, and the Rb-E2F cell proliferation control pathway.     

Asymptotics of Bayesian median loss estimation

We establish the consistency, asymptotic normality, and efficiency for estimators derived by minimizing the median of a loss function in a Bayesian context. We contrast this procedure with the behavior of two Frequentist procedures, the least median of squares (LMS) and the least trimmed squares (LTS) estimators, in regression problems. The LMS estimator is the Frequentist version of our estimator, and the LTS estimator approaches a median-based estimator as the trimming approaches 50% on each side. We argue that the Bayesian median-based method is a good tradeoff between the two Frequentist estimators.     

Quasi-maximum likelihood estimation in GARCH processes when some coefficients are equal to zero

The asymptotic distribution of the quasi-maximum likelihood (QML) estimator is established for generalized autoregressive conditional heteroskedastic (GARCH) processes, when the true parameter may have zero coefficients. This asymptotic distribution is the projection of a normal vector distribution onto a convex cone. The results are derived under mild conditions. For an important subclass of models, no moment condition is imposed on the GARCH process. The main practical implication of these results concerns the estimation of overidentified GARCH models.     

Modified Whittle estimation of multilateral models on a lattice

In the estimation of parametric models for stationary spatial or spatio-temporal data on a d-dimensional lattice, for d?2, the achievement of asymptotic efficiency under Gaussianity, and asymptotic normality more generally, with standard convergence rate, faces two obstacles. One is the “edge effect”, which worsens with increasing d. The other is the possible difficulty of computing a continuous-frequency form of Whittle estimate or a time domain Gaussian maximum likelihood estimate, due mainly to the Jacobian term. This is especially a problem in “multilateral” models, which are naturally expressed in terms of lagged values in both directions for one or more of the d dimensions. An extension of the discrete-frequency Whittle estimate from the time series literature deals conveniently with the computational problem, but when subjected to a standard device for avoiding the edge effect has disastrous asymptotic performance, along with finite sample numerical drawbacks, the objective function lacking a minimum-distance interpretation and losing any global convexity properties. We overcome these problems by first optimizing a standard, guaranteed non-negative, discrete-frequency, Whittle function, without edge-effect correction, providing an estimate with a slow convergence rate, then improving this by a sequence of computationally convenient approximate Newton iterations using a modified, almost-unbiased periodogram, the desired asymptotic properties being achieved after finitely many steps. The asymptotic regime allows increase in both directions of all d dimensions, with the central limit theorem established after re-ordering as a triangular array. However our work offers something new for “unilateral” models also. When the data are non-Gaussian, asymptotic variances of all parameter estimates may be affected, and we propose consistent, non-negative definite estimates of the asymptotic variance matrix.     

Evaluation of reproducibility for paired functional data

Evaluation of reproducibility is important in assessing whether a new method or instrument can reproduce the results from a traditional gold standard approach. In this paper, we propose a measure to assess measurement agreement for functional data which are frequently encountered in medical research and many other research fields. Formulae to compute the standard error of the proposed estimator and confidence intervals for the proposed measure are derived. The estimators and the coverage probabilities of the confidence intervals are empirically tested for small-to-moderate sample sizes via Monte Carlo simulations. A real data example in physiology study is used to illustrate the proposed statistical inference procedures.     

Asymptotic expansions in sequential estimation for the first-order random coefficient autoregressive model: Regenerative approach

Edgeworth expansions for the distribution of a sequential least squares estimator in the random coefficient autoregressive (RCA) model are derived. The regenerative approach to second-order asymptotic analysis of Markov-type statistical models is developed.     

Parametric estimation of a bivariate stable Lévy process

We propose a parametric model for a bivariate stable Lévy process based on a Lévy copula as a dependence model. We estimate the parameters of the full bivariate model by maximum likelihood estimation. As an observation scheme we assume that we observe all jumps larger than some ε>0 and base our statistical analysis on the resulting compound Poisson process. We derive the Fisher information matrix and prove asymptotic normality of all estimates when the truncation point ε→0. A simulation study investigates the loss of efficiency because of the truncation.     

Parameter estimation under ambiguity and contamination with the spurious model

Recently, we proposed variants as a statistical model for treating ambiguity. If data are extracted from an object with a machine then it might not be able to give a unique safe answer due to ambiguity about the correct interpretation of the object. On the other hand, the machine is often able to produce a finite number of alternative feature sets (of the same object) that contain the desired one. We call these feature sets variants of the object. Data sets that contain variants may be analyzed by means of statistical methods and all chapters of multivariate analysis can be seen in the light of variants. In this communication, we focus on point estimation in the presence of variants and outliers. Besides robust parameter estimation, this task requires also selecting the regular objects and their valid feature sets (regular variants). We determine the mixed MAP-ML estimator for a model with spurious variants and outliers as well as estimators based on the integrated likelihood. We also prove asymptotic results which show that the estimators are nearly consistent.The problem of variant selection turns out to be computationally hard; therefore, we also design algorithms for efficient approximation. We finally demonstrate their efficacy with a simulated data set and a real data set from genetics.     

UMVU estimation of the ratio of powers of normal generalized variances under correlation

We consider estimation of the ratio of arbitrary powers of two normal generalized variances based on two correlated random samples. First, the result of Iliopoulos [Decision theoretic estimation of the ratio of variances in a bivariate normal distribution, Ann. Inst. Statist. Math. 53 (2001) 436-446] on UMVU estimation of the ratio of variances in a bivariate normal distribution is extended to the case of the ratio of any powers of the two variances. Motivated by these estimators’ forms we derive the UMVU estimator in the multivariate case. We show that it is proportional to the ratio of the corresponding powers of the two sample generalized variances multiplied by a function of the sample canonical correlations. The mean squared errors of the derived UMVU estimator and the maximum likelihood estimator are compared via simulation for some special cases.     

Angular Gaussian and Cauchy estimation

This paper proposes a unified treatment of maximum likelihood estimates of angular Gaussian and multivariate Cauchy distributions in both the real and the complex case. The complex case is relevant in shape analysis. We describe in full generality the set of maxima of the corresponding log-likelihood functions with respect to an arbitrary probability measure. Our tools are the convexity of log-likelihood functions and their behaviour at infinity.     

Adaptive estimation of an ergodic diffusion process based on sampled data

We consider adaptive maximum likelihood type estimation of both drift and diffusion coefficient parameters for an ergodic diffusion process based on discrete observations. Two kinds of adaptive maximum likelihood type estimators are proposed and asymptotic properties of the adaptive estimators, including convergence of moments, are obtained.