Second order optimality for estimators in time series regression models

We consider the second order asymptotic properties of an efficient frequency domain regression coefficient estimator proposed by Hannan [Regression for time series, Proc. Sympos. Time Series Analysis (Brown Univ., 1962), Wiley, New York, 1963, pp. 17-37]. This estimator is a semiparametric estimator based on nonparametric spectral estimators. We derive the second order Edgeworth expansion of the distribution of . Then it is shown that the second order asymptotic properties are independent of the bandwidth choice for residual spectral estimator, which implies that has the same rate of convergence as in regular parametric estimation. This is a sharp contrast with the general semiparametric estimation theory. We also examine the second order Gaussian efficiency of . Numerical studies are given to confirm the theoretical results.     

Maximum likelihood estimation for all-pass time series models

An autoregressive-moving average model in which all roots of the autoregressive polynomial are reciprocals of roots of the moving average polynomial and vice versa is called an all-pass time series model. All-pass models generate uncorrelated (white noise) time series, but these series are not independent in the non-Gaussian case. An approximate likelihood for a causal all-pass model is given and used to establish asymptotic normality for maximum likelihood estimators under general conditions. Behavior of the estimators for finite samples is studied via simulation. A two-step procedure using all-pass models to identify and estimate noninvertible autoregressive-moving average models is developed and used in the deconvolution of a simulated water gun seismogram.     

Admissibility and minimaxity of Bayes estimators for a normal mean matrix

In some invariant estimation problems under a group, the Bayes estimator against an invariant prior has equivariance as well. This is useful notably for evaluating the frequentist risk of the Bayes estimator. This paper addresses the problem of estimating a matrix of means in normal distributions relative to quadratic loss. It is shown that a matricial shrinkage Bayes estimator against an orthogonally invariant hierarchical prior is admissible and minimax by means of equivariance. The analytical improvement upon every over-shrinkage equivariant estimator is also considered and this paper justifies the corresponding positive-part estimator preserving the order of the sample singular values.     

A nonparametric regression cross spectrum for multivariate time series

We consider dependence structures in multivariate time series that are characterized by deterministic trends. Results from spectral analysis for stationary processes are extended to deterministic trend functions. A regression cross covariance and spectrum are defined. Estimation of these quantities is based on wavelet thresholding. The method is illustrated by a simulated example and a three-dimensional time series consisting of ECG, blood pressure and cardiac stroke volume measurements.     

Some mixing properties of time series models

Sufficient conditions are given for linear processes and ARMA processes to have the Gaswirth and Rubin mixing condition. The mixing rates are also determined.     

Asymptotic properties of the maximum likelihood estimate in the first order autoregressive process

Summary In this paper we obtain an asymptotic expansion of the distribution of the maximum likelihood estimate (MLE) based onT observations from the first order Gaussian process up to the term of orderT ⁻¹. The expansion is used to compare with a generalized estimate including the least square estimate (LSE) , based on the asymptotic probabilities around the true value of the estimates up to the terms of orderT ⁻¹. It is shown that (or the modified MLE ) is better than (or the modified estimate ). Further, we note that does not attain the bound for third order asymptotic median unbiased estimates.     

On consistent testing for serial correlation of unknown form in vector time series models

Multivariate autoregressive models with exogenous variables (VARX) are often used in econometric applications. Many properties of the basic statistics for this class of models rely on the assumption of independent errors. Using results of Hong (Econometrica 64 (1996) 837), we propose a new test statistic for checking the hypothesis of non-correlation or independence in the Gaussian case. The test statistic is obtained by comparing the spectral density of the errors under the null hypothesis of independence with a kernel-based spectral density estimator. The asymptotic distribution of the statistic is derived under the null hypothesis. This test generalizes the portmanteau test of Hosking (J. Amer. Statist. Assoc. 75 (1980) 602). The consistency of the test is established for a general class of static regression models with autocorrelated errors. Its asymptotic slope is derived and the asymptotic relative efficiency within the class of possible kernels is also investigated. Finally, the level and power of the resulting tests are also studied by simulation.     

Innovations algorithm asymptotics for periodically stationary time series with heavy tails

The innovations algorithm can be used to obtain parameter estimates for periodically stationary time series models. In this paper we compute the asymptotic distribution for these estimates in the case where the underlying noise sequence has infinite fourth moment but finite second moment. In this case, the sample covariances on which the innovations algorithm are based are known to be asymptotically stable. The asymptotic results developed here are useful to determine which model parameters are significant. In the process, we also compute the asymptotic distributions of least squares estimates of parameters in an autoregressive model.     

Difference based ridge and Liu type estimators in semiparametric regression models

We consider a difference based ridge regression estimator and a Liu type estimator of the regression parameters in the partial linear semiparametric regression model, y=Xβ+f+ε. Both estimators are analyzed and compared in the sense of mean-squared error. We consider the case of independent errors with equal variance and give conditions under which the proposed estimators are superior to the unbiased difference based estimation technique. We extend the results to account for heteroscedasticity and autocovariance in the error terms. Finally, we illustrate the performance of these estimators with an application to the determinants of electricity consumption in Germany.     

Bayesian shrinkage prediction for the regression problem

We consider Bayesian shrinkage predictions for the Normal regression problem under the frequentist Kullback-Leibler risk function.Firstly, we consider the multivariate Normal model with an unknown mean and a known covariance. While the unknown mean is fixed, the covariance of future samples can be different from that of training samples. We show that the Bayesian predictive distribution based on the uniform prior is dominated by that based on a class of priors if the prior distributions for the covariance and future covariance matrices are rotation invariant.Then, we consider a class of priors for the mean parameters depending on the future covariance matrix. With such a prior, we can construct a Bayesian predictive distribution dominating that based on the uniform prior.Lastly, applying this result to the prediction of response variables in the Normal linear regression model, we show that there exists a Bayesian predictive distribution dominating that based on the uniform prior. Minimaxity of these Bayesian predictions follows from these results.     

Latent models for cross-covariance

We consider models for the covariance between two blocks of variables. Such models are often used in situations where latent variables are believed to present. In this paper we characterize exactly the set of distributions given by a class of models with one-dimensional latent variables. These models relate two blocks of observed variables, modeling only the cross-covariance matrix. We describe the relation of this model to the singular value decomposition of the cross-covariance matrix. We show that, although the model is underidentified, useful information may be extracted. We further consider an alternative parameterization in which one latent variable is associated with each block, and we extend the result to models with r-dimensional latent variables.     

Infinite divisibility,completeness and regression properties of the univariate generalized waring distribution

Summary This paper is concerned with properties of the univariate generalized Waring distribution such as infinite divisibility, discrete self-decomposability, completeness and regression.     

On minimaxity and admissibility of hierarchical Bayes estimators

This paper obtains conditions for minimaxity of hierarchical Bayes estimators in the estimation of a mean vector of a multivariate normal distribution. Hierarchical prior distributions with three types of second stage priors are treated. Conditions for admissibility and inadmissibility of the hierarchical Bayes estimators are also derived using the arguments in Berger and Strawderman [Choice of hierarchical priors: admissibility in estimation of normal means, Ann. Statist. 24 (1996) 931-951]. Combining these results yields admissible and minimax hierarchical Bayes estimators.     

Existence of MLEs for discrete linear exponential models

Necessary and sufficient conditions are given for the existence of an MLE for log-linear and regression models for contingency tables. A partial compactification of the parameter space is used to elucidate a more abstract compactification given by Lauritzen [14]. A modification of the Newton-Raphson approximation yields MLEs in the partial compactification. This work was done while the author was Assistant Professor, Department of Mathematics, Arizona State University, Tempe 85281.     

The asymptotic distribution of the likelihood ratio for autoregressive time series with a regression trend

It is shown that the likelihood ratio of an autoregressive time series of finite order with a regression trend is asymptotically normal. This result is used to derive the power of a test for positive correlation of the residuals under local autoregressive alternatives. The test is based on the Durbin-Watson statistics.     

Tests for independence in non-parametric heteroscedastic regression models

Consistent procedures are constructed for testing independence between the regressor and the error in non-parametric regression models. The tests are based on the Fourier formulation of independence, and utilize the joint and the marginal empirical characteristic functions of the regressor and of estimated residuals. The asymptotic null distribution as well as the behavior of the test statistic under alternatives is investigated. A simulation study compares bootstrap versions of the proposed tests to corresponding procedures utilizing the empirical distribution function.     

All admissible linear estimators of a regression coefficient under a balanced loss function

Admissibility of linear estimators of a regression coefficient in linear models with and without the assumption that the underlying distribution is normal is discussed under a balanced loss function. In the non-normal case, a necessary and sufficient condition is given for linear estimators to be admissible in the space of homogeneous linear estimators. In the normal case, a sufficient condition is provided for restricted linear estimators to be admissible in the space of all estimators having finite risks under the balanced loss function. Furthermore, the sufficient condition is proved to be necessary in the normal case if additional conditions are assumed.     

Linear relations in time series models. I

A multiple time series is defined as the sum of an autoregressive process on a line and independent Gaussian white noise on a hyperplane that goes through the origin and intersects the line at a single point. This process is a multiple autoregressive time series in which the regression matrices satisfy suitable conditions. It is shown that the maximum likelihood estimates of the line and the autoregression coefficients can be obtained as the values that minimize a given function, and that the remaining maximum likelihood estimates can be computed as simple functions of the first ones. It is also shown that the maximum likelihood estimates are equivariant with respect to the group of bijective linear transformations.     

Empirical likelihood for LAD estimators in infinite variance ARMA models

In this paper, we use an empirical likelihood method to construct confidence regions for the stationary ARMA(p,q) models with infinite variance. An empirical log-likelihood ratio is derived by the estimating equation of the self-weighted LAD estimator. It is proved that the proposed statistic has an asymptotic standard chi-squared distribution. Simulation studies show that in a small sample case, the performance of empirical likelihood method is better than that of normal approximation of the LAD estimator in terms of the coverage accuracy.