Spectral methods in linear minimax estimation

We consider the minimax-linear estimator in a linear regression model with circular constraints. Two necessary and sufficient conditions for the optimality of an estimator, the socalled left spectral equation and the right spectral equation (Girko spectral equation), are derived. For the special case of a simple maximal eigenvalue and a single eigenspace explicit estimation formulas are derived. These formulas also show some of the shortcomings of the minimax-linear estimator (MILE). Finally, the relation with Bayesian analysis and the Hoffmann-Läuter estimator is outlined.     

On the equivalence of spectral theory and bayesian analysis in minimax linear estimation

The Bayesian point of view of the linear regression model is used to deal with some minimax problems. New tools for spectral theory make it possible to give an alternative equivalence of the Bayesian and the minimax approach.     

Linear minimax estimation with ellipsoidal constraints

We consider the simultaneous linear minimax estimation problem in linear models with ellipsoidal constraints imposed on an unknown parameter. Using convex analysis, we derive necessary and sufficient optimality conditions for a matrix to define the linear minimax estimator. For certain regions of the set of characteristics of linear models and constraints, we exploit these optimality conditions and get explicit formulae for linear minimax estimators.     

Nonnegative quadratic estimation of the mean squared errors of minimax estimators in the linear regression model

In this paper, the problem of nonnegative quadratic estimation of the mean squared errors of minimax estimators of in the linear regression modelE(y)=X, VAR(y) = ² is discussed. An explicit formula for the admissible nonnegative minimum biased estimator is given. Some applications to one-way classification model are also considered.     

Item response theory for longitudinal data: population parameter estimation

In this work we propose IRT models to estimate ability distribution parameters of a population of individuals submitted to different tests along the time, having or not common items. The item parameters are considered known and several covariance structures are proposed to accommodate the possible dependence among the abilities of the same individual, measured at different instants. Maximum likelihood equations and some simulation results are presented.     

Rank estimation in reduced-rank regression

Reduced rank regression assumes that the coefficient matrix in a multivariate regression model is not of full rank. The unknown rank is traditionally estimated under the assumption of normal responses. We derive an asymptotic test for the rank that only requires the response vector have finite second moments. The test is extended to the nonconstant covariance case. Linear combinations of the components of the predictor vector that are estimated to be significant for modelling the responses are obtained.     

Minimax estimation with random coefficients: Theory and application to stock returns

Testing the reliability of the capital asset pricing model (CAPM) for various stock market returns is an important task in capital market research. In all previous studies, a common feature consists in the application of ordinary least squares or Bayesian methods when it comes to estimation of parameters. The Bayesian approach seems to be fairly intractable by practitioners whereas the OLS approach often yields imprecise and thus doubtful results. In this paper, the CAPM is estimated by approximate minimax techniques extended to a random coefficient regression model (RCR). The method turns out to be efficient from both the economical and computational point of view.     

A subclass of bayes linear estimators that are minimax

In the linear regression model with ellipsoidal parameter constraints, the problem of estimating the unknown parameter vector is studied. A well-described subclass of Bayes linear estimators is proposed in the paper. It is shown that for each member of this subclass, a generalized quadratic risk function exists so that the estimator is minimax. Moreover, some of the proposed Bayes linear estimators are admissible with respect to all possible generalized quadratic risks. Also, a necessary and sufficient condition is given to ensure that the considered Bayes linear estimator improves the least squares estimator over the whole ellipsoid whatever generalized risk function is chosen.     

Biased estimation and hypothesis testing in linear regression

We consider a test of the simple hypothesis =₀ based on some biased estimator. Under a certain condition the corresponding test statistic coincides with the usualF-statistic based on the least squares estimator. Surprisingly, this condition is met by several well-known biased estimators.     

Restricted estimation in multivariate measurement error regression model

We study a multivariate ultrastructural measurement error (MUME) model with more than one response variable. This model is a synthesis of multivariate functional and structural models. Three consistent estimators of regression coefficients, satisfying the exact linear restrictions have been proposed. Their asymptotic distributions are derived under the assumption of a non-normal measurement error and random error components. A simulation study is carried out to investigate the small sample properties of the estimators. The effect of departure from normality of the measurement errors on the estimators is assessed.     

A comparison of minimax and least squares estimators in linear regression with polyhedral prior information

We consider the linear regression model where prior information in the form of linear inequalities restricts the parameter space to a polyhedron. Since the linear minimax estimator has, in general, to be determined numerically, it was proposed to minimize an upper bound of the maximum risk instead. The resulting so-called quasiminimax estimator can be easily calculated in closed form. Unfortunately, both minimax estimators may violate the prior information. Therefore, we consider projection estimators which are obtained by projecting the estimate in an optional second step. The performance of these estimators is investigated in a Monte Carlo study together with several least squares estimators, including the inequality restricted least squares estimator. It turns out that both the projected and the unprojected quasiminimax estimators have the best average performance.     

Unbiased invariant minimum norm estimation in generalized growth curve model

This paper considers the generalized growth curve model subject to R(X_m)⊆R(X_m-1)⊆?⊆R(X₁), where B_i are the matrices of unknown regression coefficients, X_i,Z_i and U are known covariate matrices, i=1,2,…,m, and E splits into a number of independently and identically distributed subvectors with mean zero and unknown covariance matrix Σ. An unbiased invariant minimum norm quadratic estimator (MINQE(U,I)) of tr(CΣ) is derived and the conditions for its optimality under the minimum variance criterion are investigated. The necessary and sufficient conditions for MINQE(U,I) of tr(CΣ) to be a uniformly minimum variance invariant quadratic unbiased estimator (UMVIQUE) are obtained. An unbiased invariant minimum norm quadratic plus linear estimator (MINQLE(U,I)) of is also given. To compare with the existing maximum likelihood estimator (MLE) of tr(CΣ), we conduct some simulation studies which show that our proposed estimator performs very well.     

Minimax least squares and quasiminimax estimation in linear models with missing values

We consider the problem of estimating the parameter vector in the linear model when observations on the independent variables are partially missing or incorrect. New estimators are developed, which systematically combine prior information with the incomplete data. We compare these methods with the alternative strategy of deleting incomplete observations.Support by Deutsche Forschungsgemeinschaft, Grant No. 284/1-2 is gratefully acknowledged.     

Some data-analytic modifications to Bayes-Stein estimation

Summary The usual Bayes-Stein shrinkages of maximum likelihood estimates towards a common value may be refined by taking fuller account of the locations of the individual observations. Under a Bayesian formulation, the types of shrinkages depend critically upon the nature of the common distribution assumed for the parameters at the second stage of the prior model. In the present paper this distribution is estimated empirically from the data, permitting the data to determine the nature of the shrinkages. For example, when the observations are located in two or more clearly distinct groups, the maximum likelihood estimates are roughly speaking constrained towards common values within each group. The method also detects outliers; an extreme observation will either the regarded as an outlier and not substantially adjusted towards the other observations, or it will be rejected as an outlier, in which case a more radical adjustment takes place. The method is appropriate for a wide range of sampling distributions and may also be viewed as an alternative to standard multiple comparisons, cluster analysis, and nonparametric kernel methods.     

Linear plus quadratic (LPQ) quasiminimax estimation in the linear regression model

If the errors in the linear regression model are assumed to be independent with nonvanishing third and finite fourth moments, then it is possible to improve all linear estimators by so-called linear plus quadratic (LPQ) estimators. These consist of linear and quadratic terms in the endogeneous variable and depend on the unknown moments of the errors which, in general, have to be estimated from the data. In this paper, we will use LPQ estimators for quasiminimax estimation and some related problems.Support by Deutsche Forschungsgemeinschaft Grant No. Tr 253/1-2 is gratefully acknowledged.     

Uniformly minimum variance nonnegative quadratic unbiased estimation in a generalized growth curve model

Consider the generalized growth curve model subject to R(X_m)⊆?⊆R(X₁), where B_i are the matrices of unknown regression coefficients, and E=(ε₁,…,ε_s)^′ and are independent and identically distributed with the same first four moments as a random vector normally distributed with mean zero and covariance matrix Σ. We derive the necessary and sufficient conditions under which the uniformly minimum variance nonnegative quadratic unbiased estimator (UMVNNQUE) of the parametric function with C≥0 exists. The necessary and sufficient conditions for a nonnegative quadratic unbiased estimator with of to be the UMVNNQUE are obtained as well.     

On an asymptotically more efficient estimation of the single-index model

In this note, we revisit the single-index model with heteroscedastic error, and recommend an estimating equation method in terms of transferring restricted least squares to unrestricted least squares: the estimator of the index parameter is asymptotically more efficient than existing estimators in the literature in the sense that it is of a smaller limiting variance.     

Exact asymptotic minimax constants for the estimation of analytical functions in L p

The L _p minimax risks (1≤p<∞) are studied for statistical estimation in the Gaussian white noise model. The asymptotic rate and constants are given, and the optimal estimator is proposed. This, together with the work of Golubev, Levit and Tsybakov (1996) establishes the classification of the L _p minimax constants on the classes of analytical functions. Received: 10 December 1996 / Revised version: 14 December 1997     

Strong consistency of least-squares estimation in linear regression models with vague concepts

Linear regression models with vague concepts extend the classical single equation linear regression models by admitting observations in form of fuzzy subsets instead of real numbers. They have recently been introduced [cf. Krätschmer, Induktive statistik auf basis unscharfer meßkonzepte am beispiel linearer regressionsmodelle, Unpublished Habilitation Monograph, Faculty of Law and Economics of the University of Saarland, Saarbrücken, 2001] to improve the empirical meaningfulness of the relationship between the involved items by a more sensitive attention to the problems of data measurement, in particular the fundamental problem of adequacy. The parameters of such models are still real numbers, and a method of estimation can be applied which extends directly the ordinary least-squares method. This paper deals with some first asymptotic properties of estimators obtained by the method. Firstly, strong consistency will be shown, and secondly, the convergence rate will be investigated. The later result will be the starting point for a future study which will calculate the limit distributions of the estimators.     

Bayes estimation in linear models: A coordinate-free approach

The unified theory of Bayes estimation in linear models is presented, using a coordinate-free approach. The results are applied to the problem of linear and quadratic estimation in linear regression model.