Representations of best linear unbiased estimators in the Gauss-Markoff model with a singular dispersion matrix

In the general Gauss-Markoff model (Y, Xβ, σ²V), when V is singular, there exist linear functions of Y which vanish with probability 1 imposing some restrictions on Y as well as on the unknown β. In all earlier work on linear estimation, representations of best-linear unbiased estimators (BLUE's) are obtained under the assumption: “L′Y is unbiased for Xβ ? L′X = X.” Such a condition is not, however, necessary. The present paper provides all possible representations of the BLUE's some of which violate the condition L′X = X. Representations of X for given classes of BLUE's are also obtained.     

The solution of the linear complementarity problem by the matrix analogue of the accelerated overrelaxation iterative method

The Linear Complementarity Problem (LCP), with an H₊?matrix coefficient, is solved by using the new “(Projected) Matrix Analogue of the AOR (MAAOR)” iterative method; this new method constitutes an extension of the “Generalized AOR (GAOR)” iterative method. In this work two sets of convergence intervals of the parameters involved are determined by the theories of “Perron-Frobenius” and of “Regular Splittings”. It is shown that the intervals in question are better than any similar convergence intervals found so far by similar iterative methods. A deeper analysis reveals that the “best” values of the parameters involved are those of the (projected) scalar Gauss-Seidel iterative method. A theoretical comparison of the “best” (projected) Gauss-Seidel and the “best” modulus-based splitting Gauss-Seidel method is in favor of the former method. A number of numerical examples support most of our theoretical findings.     

A new representation of Student's t as a function of independent t's,with a generalization to the matrix t

A new synthetic representation of Student's t statistic is given which exhibits the random variable as a nonlinear function of two independent t variables. A generalization is given to the matricvariate t with an interpretation in terms of “natural conjugate” inference for multivariate normal sampling.     

Asymptotic theory for multivariate GARCH processes

We provide in this paper asymptotic theory for the multivariate GARCH(p,q) process. Strong consistency of the quasi-maximum likelihood estimator (MLE) is established by appealing to conditions given by Jeantheau (Econometric Theory14 (1998), 70) in conjunction with a result given by Boussama (Ergodicity, mixing and estimation in GARCH models, Ph.D. Dissertation, University of Paris 7, 1998) concerning the existence of a stationary and ergodic solution to the multivariate GARCH(p,q) process. We prove asymptotic normality of the quasi-MLE when the initial state is either stationary or fixed.     

Semiparametric inference for transformation models via empirical likelihood

Recent advances in the transformation model have made it possible to use this model for analyzing a variety of censored survival data. For inference on the regression parameters, there are semiparametric procedures based on the normal approximation. However, the accuracy of such procedures can be quite low when the censoring rate is heavy. In this paper, we apply an empirical likelihood ratio method and derive its limiting distribution via U-statistics. We obtain confidence regions for the regression parameters and compare the proposed method with the normal approximation based method in terms of coverage probability. The simulation results demonstrate that the proposed empirical likelihood method overcomes the under-coverage problem substantially and outperforms the normal approximation based method. The proposed method is illustrated with a real data example. Finally, our method can be applied to general U-statistic type estimating equations.     

Trimmed estimates in simultaneous estimation of parameters in exponential families

Let X₁,…, X_p be p (≥ 3) independent random variables, where each X_i has a distribution belonging to the one-parameter exponential family of distributions. The problem is to estimate the unknown parameters simultaneously in the presence of extreme observations. C. Stein (Ann. Statist.9 (1981), 1135–1151) proposed a method of estimating the mean vector of a multinormal distribution, based on order statistics corresponding to the |X_i|'s, which permitted improvement over the usual maximum likelihood estimator, for long-tailed empirical distribution functions. In this paper, the ideas of Stein are extended to the general discrete and absolutely continuous exponential families of distributions. Adaptive versions of the estimators are also discussed.     

A novel trace test for the mean parameters in a multivariate growth curve model

A trace test for the mean parameters of the growth curve model is proposed. It is constructed using the restricted maximum likelihood followed by an estimated likelihood ratio approach. The statistic reduces to the Lawley-Hotelling trace test for the Multivariate Analysis of Variance (MANOVA) models. Our test statistic is, therefore, a natural extension of the classical trace test to GMANOVA models. We show that the distribution of the test under the null hypothesis does not depend on the unknown covariance matrix Σ. We also show that the distributions under the null and alternative hypotheses can be represented as sums of weighted central and non-central chi-square random variables, respectively. Under the null hypothesis, the Satterthwaite approximation is used to get an approximate critical point. A novel Satterthwaite type approximation is proposed to obtain an approximate power. A simulation study is performed to evaluate the performance of our proposed test and numerical examples are provided as illustrations.     

The restricted EM algorithm under inequality restrictions on the parameters

One of the most powerful algorithms for maximum likelihood estimation for many incomplete-data problems is the EM algorithm. The restricted EM algorithm for maximum likelihood estimation under linear restrictions on the parameters has been handled by Kim and Taylor (J. Amer. Statist. Assoc. 430 (1995) 708-716). This paper proposes an EM algorithm for maximum likelihood estimation under inequality restrictions A₀β?0, where β is the parameter vector in a linear model W=Xβ+ε and ε is an error variable distributed normally with mean zero and a known or unknown variance matrix Σ>0. Some convergence properties of the EM sequence are discussed. Furthermore, we consider the consistency of the restricted EM estimator and a related testing problem.     

Non-Liouville numbers and a Theorem of Hörmander

It is shown in this paper that Theorem 1 of [G. H. Meisters, “Translation-invariant linear forms and a formula for the Dirac measure,” J. Functional Analysis 8 (1971), 173–188] can be deduced from a very general result of Lars Hörmander, namely, Theorem 1 of “Generators for some rings of analytic functions” [Bull. Amer. Math. Soc.73 (1967), 943–949]. However, Hörmander's theorem is evidently not applicable in several other cases where Meisters'-type results have been obtained (e.g., Theorem 1 of G.H. Meisters and Wolfgang M. Schmidt, “Translation-invariant linear forms on L²(G) for compact abelian groups G,” J. Functional Analysis11 (1972), 407–424).     

Empirical likelihood for LAD estimators in infinite variance ARMA models

In this paper, we use an empirical likelihood method to construct confidence regions for the stationary ARMA(p,q) models with infinite variance. An empirical log-likelihood ratio is derived by the estimating equation of the self-weighted LAD estimator. It is proved that the proposed statistic has an asymptotic standard chi-squared distribution. Simulation studies show that in a small sample case, the performance of empirical likelihood method is better than that of normal approximation of the LAD estimator in terms of the coverage accuracy.     

Fitting an item response theory model with random item effects across groups by a variational approximation method

Purpose. Data from international educational assessments conducted in many countries are mostly analyzed using item response theory. The assumption that all items behave the same in all countries is often not tenable. The variability of item parameters across countries can be taken into account by assuming that the item parameters are random effects (De Jong et al. in J. Consum. Res. 34:260–278, 2007; De Jong and Steenkamp in Psychometrika 75:3–32, 2010). However, the complex latent structure of such a model, with latent variables both at the item and the person level, renders maximum likelihood estimation computationally challenging. We describe a variational estimation technique that consists of approximating the likelihood function by a computationally tractable lower bound. Methods. A mean field approximation to the posterior distribution of the latent variables was used. The update equations were derived for the specific case of discrete random effects and implemented in a Maximization Maximization algorithm (Neal and Hinton in M.I. Jordan (Ed.) Learning in Graphical Models, Kluwer Academic, Dordrecht, pp. 355–368, 1998). Parameter recovery was investigated in a simulation study. The method was also applied to the Progress in International Reading Study of 2006. Results. The model parameters were recovered well under all conditions of the simulation study. In the application, the estimated variances of the random item effects showed a high positive correlation with traditional measures for the lack of item invariance across groups. Conclusions. The mean field approximation and variational methods in general offer a computationally tractable alternative to exact maximum likelihood estimation.     

Empirical likelihood inference in partially linear single-index models for longitudinal data

The empirical likelihood method is especially useful for constructing confidence intervals or regions of parameters of interest. Yet, the technique cannot be directly applied to partially linear single-index models for longitudinal data due to the within-subject correlation. In this paper, a bias-corrected block empirical likelihood (BCBEL) method is suggested to study the models by accounting for the within-subject correlation. BCBEL shares some desired features: unlike any normal approximation based method for confidence region, the estimation of parameters with the iterative algorithm is avoided and a consistent estimator of the asymptotic covariance matrix is not needed. Because of bias correction, the BCBEL ratio is asymptotically chi-squared, and hence it can be directly used to construct confidence regions of the parameters without any extra Monte Carlo approximation that is needed when bias correction is not applied. The proposed method can naturally be applied to deal with pure single-index models and partially linear models for longitudinal data. Some simulation studies are carried out and an example in epidemiology is given for illustration.     

Parameter estimation under ambiguity and contamination with the spurious model

Recently, we proposed variants as a statistical model for treating ambiguity. If data are extracted from an object with a machine then it might not be able to give a unique safe answer due to ambiguity about the correct interpretation of the object. On the other hand, the machine is often able to produce a finite number of alternative feature sets (of the same object) that contain the desired one. We call these feature sets variants of the object. Data sets that contain variants may be analyzed by means of statistical methods and all chapters of multivariate analysis can be seen in the light of variants. In this communication, we focus on point estimation in the presence of variants and outliers. Besides robust parameter estimation, this task requires also selecting the regular objects and their valid feature sets (regular variants). We determine the mixed MAP-ML estimator for a model with spurious variants and outliers as well as estimators based on the integrated likelihood. We also prove asymptotic results which show that the estimators are nearly consistent.The problem of variant selection turns out to be computationally hard; therefore, we also design algorithms for efficient approximation. We finally demonstrate their efficacy with a simulated data set and a real data set from genetics.     

Nonstationary value-iteration and adaptive control of discounted semi-Markov processes

We consider in this paper discounted-reward, denumerable state space, semi-Markov decision processes which depend on unknown parameters. The problems we are interested in are: Given that the true parameter value is unknown, (I) give an iterative scheme to determine the total maximal discounted reward, and (II) find an asymptotically discount optimal (adaptive) policy. Our solutions are inspired by the nonstationary value iteration (NVI) scheme of Federgruen and Schweitzer (J. Optim. Theory Appl.34 (1981), 207–241) combined with the ideas of Schäl (Preprint No. 428, Inst. Angew. Math. Univ. Bonn, 1981) concerning the “principle of estimation and control” for the adaptive control of semi-Markov processes.     

Analysis of two-sample truncated data using generalized logistic models

Parallel to Cox's [JRSS B34 (1972) 187-230] proportional hazards model, generalized logistic models have been discussed by Anderson [Bull. Int. Statist. Inst. 48 (1979) 35-53] and others. The essential assumption is that the two densities ratio has a known parametric form. A nice property of this model is that it naturally relates to the logistic regression model for categorical data. In astronomic, demographic, epidemiological, and other studies the variable of interest is often truncated by an associated variable. This paper studies generalized logistic models for the two-sample truncated data problem, where the two lifetime densities ratio is assumed to have the form exp{α+φ(x;β)}. Here φ is a known function of x and β, and the baseline density is unspecified. We develop a semiparametric maximum likelihood method for the case where the two samples have a common truncation distribution. It is shown that inferences for β do not depend the nonparametric components. We also derive an iterative algorithm to maximize the semiparametric likelihood for the general case where different truncation distributions are allowed. We further discuss how to check goodness of fit of the generalized logistic model. The developed methods are illustrated and evaluated using both simulated and real data.     

Robust regression function estimation

A robust estimator of the regression function is proposed combining kernel methods as introduced for density estimation and robust location estimation techniques. Weak and strong consistency and asymptotic normality are shown under mild conditions on the kernel sequence. The asymptotic variance is a product from a factor depending only on the kernel and a factor similar to the asymptotic variance in robust estimation of location. The estimation is minimax robust in the sense of Huber (1964). Robust estimation of a location parameter. Ann. Math. Statist.33 73–101.     

Parallel X-ray tomography of convex domains as a search problem in two dimensions

In 1961, at A.M.S. Symposium on Convexity, P.C. Hammer proposed the following problem: how many X-ray pictures of a convex planar domain D must be taken to permit its exact reconstruction? Richard Gardner writes in his fundamental 2006 book [4] that X-rays in four different directions would do the job. The present paper points at the possibility that in certain asymptotical sense X-rays in only three different directions can be enough for approximate reconstruction of centrally symmetric convex domains. The accuracy of reconstruction would tend to become perfect in the limit, as the directions of the three X-rays change, all three converging to some given direction. The analysis leading to that conclusion is based on two lemmas of Section 1 and Pleijel type identity for parallel X-rays derived in Sections 2 and 3. These tools together supply a systemof two differential equations with respect to two unknown functions that describe the two branches of the domain boundary D. The system is easily resolved. The solution intended to provide a complete tomography reconstruction of D, happens however to depend on a two dimensional parameter, whose “real value” remains unknown. So tomography reconstruction of D becomes possible if a satisfactory approximation to that unknown “real value” can be found. In the last section a test procedure for the individual candidates for “approximate real value” of the parameter is described. A uniqueness theorem concerning tomography of circular discs is proved.     

On the robustness of least squares procedures in regression models

The criterion robustness of the standard likelihood ratio test (LRT) under the multivariate normal regression model and also the inference robustness of the same test under the univariate set up are established for certain nonnormal distributions of errors. Restricting attention to the normal distribution of errors in the context of univariate regression models, conditions on the design matrix are established under which the usual LRT of a linear hypothesis (under homoscedasticity of errors) remains valid if the errors have an intraclass covariance structure. The conditions hold in the case of some standard designs. The relevance of C. R. Rao's (1967 In Proceedings Fifth Berkeley Symposium on Math. Stat. and Prob., Vol. 1, pp. 355–372) and G. Zyskind's (1967, Ann. Math. Statist.38 1092–1110) conditions in this context is discussed.     

Extensions and generalizations of a theorem of Widder and of the theory of symmetric local semigroups

The theory of symmetric local semigroups due to A. Klein and L. Landau (J. Funct. Anal.44 (1981), 121–136) is generalized to semigroups indexed by subsets of $\text{R}$ⁿ for n > 1. The result implies a similar result of A. E. Nussbaum (J. Funct. Anal.48 (1982), 213–223). It is further generalized to semigroups that are symmetric local in some directions and unitary in others. The results are used to give a simple proof of A. Devinatz's (Duke Math. J.22 (1955), 185–192) and N. I. Akhiezer's (“the Classical Moment Problem and Some Related Questions,” Hafner, New York, 1965) generalization of a theorem of Widder concerning the representation of functions as Laplace integrals. This result is extended to the representation as a Laplace integral of a function taking values in $\text{B}$($\text{R}$), the set of bounded linear operators on a Hilbert space $\text{R}$. Also, a theorem is proved encompassing both the result of Devinatz and Akhiezer, and Bochner's theorem on the representation of positive definite functions as Fourier integrals.