On uniform asymptotic normality of sequential least squares estimators for the parameters in a stable AR(p)

For a stable autoregressive process of order p with unknown vector parameter θ, it is shown that under a sequential sampling scheme with the stopping time defined by the trace of the observed Fisher information matrix, the least-squares estimator of θ is asymptotically normally distributed uniformly in θ belonging to any compact set in the parameter region.     

一般Gauss-Markov模型的线性充分性

This paper provides further contributions to the theory of linear sufficiency in the general Gauss-Markov model E(y)= Xt3, Var (y)= V. The notion of linear sufficiency introduced by Baksalary and Kala(1981) and Drygas(1983) is extended for any specific estimable function c‘β. Some general results with respect to the extended concept are obtained. An essential result concerning the former notion is a direct consequence of this paper.     

Different kinds of sufficiency in the general Gauss-Markov model

Sufficiency is one of the fundamental notions in mathematical statistics. In connection with the general linear Gauss-Markov model GM (y,Xβ, σ ² V), there are some modifications of this notion such as linear sufficiency (Baksalary and Kala, Drygas) invariant linearly sufficiency (Oktaba, Kornacki, Wawrzosek) and quadratic sufficiency (Mueller). All these variants denote such transformations of the model GM that preserve properties essential in statistical inference. In the present paper we give mutual relations between above three classes of statistics. Communicated by Gejza Wimmer     

Least-squares solutions of multi-valued linear operator equations in Hilbert spaces

Let M be a linear manifold in H₁ H₂, where H₁, and H₂ are Hilbert spaces. Two notions of least-squares solutions for the multi-valued linear operator equation (inclusion) y ε M(x) are introduced and investigated. The main results include (i) equivalent conditions for least-squares solvability, (ii) properties of a least-squares solution, (iii) characterizations of the set of all least-squares solutions in terms of algebraic operator parts and generalized inverses of linear manifolds, and (iv) best approximation properties of generalized inverses and operator parts of multi-valued linear operators. The principal tools in this investigation are an abstract adjoint theory, orthogonal operator parts, and orthogonal generalized inverses of linear manifolds in Hilbert spaces.     

Application of continuous-time programming problems to a class of variational-type inequalities

In this paper, we establish sufficiency criteria under generalized ρ−(η,θ)-invexity conditions for general continuous-time programming problems with nonlinear equality/inequality constraints. Using this we establish some existence criteria for solutions of a class of variational-type inequalities.     

Sufficiency and completeness in the linear model

This paper provides further contributions to the theory of linear sufficiency and linear completeness. The notion of linear sufficiency was introduced by [2], Ann. Statist. 9, 913–916) and Drygas (in press, Sankhya) with respect to the linear model Ey = Xβ, var y = V. In addition to correcting an inadequate proof of [8], the relationship to an earlier definition and to the theory of linear prediction is also demonstrated. Moreover, the notion is extended to the model Ey = Xβ, var y = δ²V. Its connection with sufficiency under normality is investigated. An example illustrates the results.     

Risk and Pitman closeness properties of feasible generalized double k-class estimators in linear regression models with non-spherical disturbances under balanced loss function

In this article, a family of feasible generalized double k-class estimator in a linear regression model with non-spherical disturbances is considered. The performance of this estimator is judged with feasible generalized least-squares and feasible generalized Stein-rule estimators under balanced loss function using the criteria of quadratic risk and general Pitman closeness. A Monte-Carlo study investigates the finite sample properties of several estimators arising from the family of feasible double k-class estimators.     

Locally efficient estimation of regression parameters using current status data

In biostatistics applications interest often focuses on the estimation of the distribution of a time-variable T. If one only observes whether or not T exceeds an observed monitoring time C, then the data structure is called current status data, also known as interval censored data, case I. We consider this data structure extended to allow the presence of both time-independent covariates and time-dependent covariate processes that are observed until the monitoring time. We assume that the monitoring process satisfies coarsening at random.Our goal is to estimate the regression parameter β of the regression model T=Zβ+ε. The curse of dimensionality implies no globally efficient nonparametric estimator with good practical performance at moderate sample sizes exists. We present an estimator of the parameter β that attains the semiparametric efficiency bound if we correctly specify (a) a model for the monitoring mechanism and (b) a lower-dimensional model for the conditional distribution of T given the covariates. In addition, our estimator is robust to model misspecification. If only (a) is correctly specified, the estimator remains consistent and asymptotically normal. We conclude with a simulation experiment and a data analysis.     

Shrinkage Estimators under Spherical Symmetry for the General Linear Model

This paper is primarily concerned with extending the results of Brandwein and Strawderman in the usual canonical setting of a general linear model when sampling from a spherically symmetric distribution. When the location parameter belongs to a proper linear subspace of the sampling space, we give an unbiased estimator of the difference of the risks between the least squares estimator φ₀ and a general shrinkage estimator φ = φ₀ − X − φ₀ ² · g φ₀. We obtain a general condition of domination for φ over φ₀ which is weaker than that of Brandwein and Strawderman. We do not need any superharmonicity condition on g. Our results are valid for general quadratic loss.     

Likelihood-Based Local Polynomial Fitting for Single-Index Models

The parametric generalized linear model assumes that the conditional distribution of a response Y given a d-dimensional covariate X belongs to an exponential family and that a known transformation of the regression function is linear in X. In this paper we relax the latter assumption by considering a nonparametric function of the linear combination β^TX, say η₀(β^TX). To estimate the coefficient vector β and the nonparametric component η₀ we consider local polynomial fits based on kernel weighted conditional likelihoods. We then obtain an estimator of the regression function by simply replacing β and η₀ in η₀(β^TX) by these estimators. We derive the asymptotic distributions of these estimators and give the results of some numerical experiments.     

Minimum <Emphasis Type="Italic">Φ</Emphasis>-Divergence Estimator and <Emphasis Type="Italic">Φ</Emphasis>-Divergence Statistics in Generalized Linear Models with Binary Data

In this paper, we assume that the data are distributed according to a binomial distribution whose probabilities follow a generalized linear model. To fit the data the minimum φ-divergence estimator is studied as a generalization of the maximum likelihood estimator. We use the minimum φ-divergence estimator, which is the basis of some new statistics, for solving the problems of testing in a generalized linear model with binary data. A wide simulation study is carried out for studying the behavior of the new family of estimators as well as of the new family of test statistics. This work was partially supported by Grant MTM2006-06872 and UCM2006-910707.     

Adaptive Semiparametric Estimation of the Memory Parameter

In Giraitis, Robinson, and Samarov (1997), we have shown that the optimal rate for memory parameter estimators in semiparametric long memory models with degree of “local smoothness” β is n^−r(β), r(β)=β/(2β+1), and that a log-periodogram regression estimator (a modified Geweke and Porter-Hudak (1983) estimator) with maximum frequency m=m(β)n^2r(β) is rate optimal. The question which we address in this paper is what is the best obtainable rate when β is unknown, so that estimators cannot depend on β. We obtain a lower bound for the asymptotic quadratic risk of any such adaptive estimator, which turns out to be larger than the optimal nonadaptive rate n^−r(β) by a logarithmic factor. We then consider a modified log-periodogram regression estimator based on tapered data and with a data-dependent maximum frequency m=m(β), which depends on an adaptively chosen estimator β of β, and show, using methods proposed by Lepskii (1990) in another context, that this estimator attains the lower bound up to a logarithmic factor. On one hand, this means that this estimator has nearly optimal rate among all adaptive (free from β) estimators, and, on the other hand, it shows near optimality of our data-dependent choice of the rate of the maximum frequency for the modified log-periodogram regression estimator. The proofs contain results which are also of independent interest: one result shows that data tapering gives a significant improvement in asymptotic properties of covariances of discrete Fourier transforms of long memory time series, while another gives an exponential inequality for the modified log-periodogram regression estimator.     

Generalized ridge regression,least squares with stochastic prior information,and Bayesian estimators

The ridge estimator of the usual linear model is generalized by the introduction of an a priori vector r and an associated positive semidefinite matrix S. It is then shown that the generalized ridge estimator can be justified in two ways: (a) by the minimization of the residual sum of squares subject to a constraint on the length, in the metric S, of the vector of differences between r and the estimated linear model coefficients, (b) by incorporating prior knowledge, r playing the role of the vector of means and S proportional to the precision matrix. Both a Bayesian and an Aitken generalized least squares frameworks are used for the latter. The properties of the new estimator are derived and compared to the ordinary least squares estimator. The new method is illustrated with different assumptions on the form of the S matrix.     

The Latent Scale Covariogram: A Tool for Exploring the Spatial Dependence Structure of Nonnormal Responses

When modeling spatially distributed normal responses Y_i in terms of vectors x_i of explanatory variables, one may fit a linear model assuming independence, and then use the empirical variogram of the residuals to determine an appropriate parametric form for the autocorrelation function. Suppose, however, that the responses are not normally distributed—for example, Poisson or Bernoulli. One may model spatial dependence using a hierarchical generalized linear model in which, conditional on a latent Gaussian field Z = {Z_i}, the Y_i have independent distributions from the exponential family, with an appropriate link function connecting their conditional means with the linear predictors x^t_iβ + Z_i. The question then is how to determine an appropriate model for the autocorrelation function of Z. The empirical variogram of the Y_i is no longer appropriate, since (unless the link function is the identity) it is on the wrong scale. We propose here an alternative, the latent scale covariogram, whose graph reflects the autocorrelation structure of the underlying normal field. We illustrate its use on several real datasets, together with a simulated dataset, and obtain results quite different from those obtained using the variogram. Supplementary materials for this article are available online.     

Statistical inference on parametric part for partially linear single-index model

Statistical inference on parametric part for the partially linear single-index model (PLSIM) is considered in this paper. A profile least-squares technique for estimating the parametric part is proposed and the asymptotic normality of the profile least-squares estimator is given. Based on the estimator, a generalized likelihood ratio (GLR) test is proposed to test whether parameters on linear part for the model is under a contain linear restricted condition. Under the null model, the proposed GLR statistic follows asymptotically the χ²-distribution with the scale constant and degree of freedom independent of the nuisance parameters, known as Wilks phenomenon. Both simulated and real data examples are used to illustrate our proposed methods.     

Discrete time parametric models with long memory and infinite variance

We study a large class of infinite variance time series that display long memory. They can be represented as linear processes (infinite order moving averages) with coefficients that decay slowly to zero and with innovations that are in the domain of attraction of a stable distribution with index 1 < α < 2 (stable fractional ARIMA is a particular example). Assume that the coefficients of the linear process depend on an unknown parameter vector β which is to be estimated from a series of length n. We show that a Whittle-type estimator β_n for β is consistent (β_n converges to the true value β₀ in probability as n → ∞), and, under some additional conditions, we characterize the limiting distribution of the rescaled differences (n/logn)^1/ga(β_n − β₀).     

Nonnegative Minimum Biased Quadratic Estimation in Mixed Linear Models

The problem of nonnegative quadratic estimation of a parametric function γ(β, σ)=β′Fβ+∑^r_i=1 f_iσ²_i in a general mixed linear model {y, Xβ, V(σ)=∑^r_i=1 σ²_iV_i} is discussed. Necessary and sufficient conditions are given for y′A₀y to be a minimum biased estimator for γ. It is shown how to formulate the problem of finding a nonnegative minimium biased estimator of γ as a conic optimization problem, which can be efficiently solved using convex optimization techniques. Models with two variance components are considered in detail. Some applications to one-way classification mixed models are given. For these models minimum biased estimators with minimum norms for square of expectation β² and for σ²₁ are presented in explicit forms.     

On Bayes and unbiased estimators of loss

We consider estimation of loss for generalized Bayes or pseudo-Bayes estimators of a multivariate normal mean vector, θ. In 3 and higher dimensions, the MLEX is UMVUE and minimax but is inadmissible. It is dominated by the James-Stein estimator and by many others. Johnstone (1988, On inadmissibility of some unbiased estimates of loss,Statistical Decision Theory and Related Topics, IV (eds. S. S. Gupta and J. O. Berger), Vol. 1, 361–379, Springer, New York) considered the estimation of loss for the usual estimatorX and the James-Stein estimator. He found improvements over the Stein unbiased estimator of risk. In this paper, for a generalized Bayes point estimator of θ, we compare generalized Bayes estimators to unbiased estimators of loss. We find, somewhat surprisingly, that the unbiased estimator often dominates the corresponding generalized Bayes estimator of loss for priors which give minimax estimators in the original point estimation problem. In particular, we give a class of priors for which the generalized Bayes estimator of θ is admissible and minimax but for which the unbiased estimator of loss dominates the generalized Bayes estimator of loss. We also give a general inadmissibility result for a generalized Bayes estimator of loss. Research supported by NSF Grant DMS-97-04524.     

Nonparametric Approach for Non-Gaussian Vector Stationary Processes

Suppose that {z(t)} is a non-Gaussian vector stationary process with spectral density matrixf(λ). In this paper we consider the testing problemH: ∫^π_−π K{f(λ)} dλ=cagainstA: ∫^π_−π K{f(λ)} dλ≠c, whereK{·} is an appropriate function andcis a given constant. For this problem we propose a testT_nbased on ∫^π_−π K{f(λ)} dλ=c, wheref(λ) is a nonparametric spectral estimator off(λ), and we define an efficacy ofT_nunder a sequence of nonparametric contiguous alternatives. The efficacy usually depnds on the fourth-order cumulant spectraf₄^Zofz(t). If it does not depend onf₄^Z, we say thatT_nis non-Gaussian robust. We will give sufficient conditions forT_nto be non-Gaussian robust. Since our test setting is very wide we can apply the result to many problems in time series. We discuss interrelation analysis of the components of {z(t)} and eigenvalue analysis off(λ). The essential point of our approach is that we do not assume the parametric form off(λ). Also some numerical studies are given and they confirm the theoretical results.     

Notes on the Length,the Structure and the Cardinality of a Chain

For a linearly ordered set (Z,≤) the length l(Z) of Z is the supremum of all cardinals that can be order-embedded or reverse order-embedded into Z. In this paper we give new proofs of two theorems relating the length and the cardinality of Z. The first one sets the following general inequality: |Z|≤2^l(Z). The second one says that in the case that Z is a scattered chain (i.e. it does not contain rationals) we have |Z|=2^l(Z). Mathematics Subject Classifications (2000) 06A05, 03E04.