Admissibility under the Frequentist′s Validity Constraint in Estimating the Loss of the Least-Squares Estimator

We consider the problem of estimating the sum of squared error loss L = |β− |² of the least-squares esitmator for β, the regression coefficient. The standard estimator ₀ is the expected value of L. Here the error variance is assumed to be known. Previous results of Johnstone (1988. In Statistical Decision Theory and Related Topics IV (S. Gupta and J. Berger, Eds.), 1, 361-379, Springer-Verlag, New York) show that ₀ is inadmissible under the loss ( −L)² if the dimension of is five or more. However, since we are estimating the loss, a typical frequentist principle will lead to the usage of estimators which are frequentist valid. Johnston′s improved esitmator, however, violates this principle. In this paper, we prove that it is impossible to improve upon ₀ among the class of frequentist valid estimators. The work parallels Hwang and Brown (1991, Ann. Statist.10 1964-1977) for the corresponding confidence set problems, although the argument is entirely different and much simpler.