Estimating Functions for Nonlinear Time Series Models

This paper discusses the problem of estimation for two classes of nonlinear models, namely random coefficient autoregressive (RCA) and autoregressive conditional heteroskedasticity (ARCH) models. For the RCA model, first assuming that the nuisance parameters are known we construct an estimator for parameters of interest based on Godambe's asymptotically optimal estimating function. Then, using the conditional least squares (CLS) estimator given by Tjøstheim (1986, Stochastic Process. Appl., 21, 251–273) and classical moment estimators for the nuisance parameters, we propose an estimated version of this estimator. These results are extended to the case of vector parameter. Next, we turn to discuss the problem of estimating the ARCH model with unknown parameter vector. We construct an estimator for parameters of interest based on Godambe's optimal estimator allowing that a part of the estimator depends on unknown parameters. Then, substituting the CLS estimators for the unknown parameters, the estimated version is proposed. Comparisons between the CLS and estimated optimal estimator of the RCA model and between the CLS and estimated version of the ARCH model are given via simulation studies.     

Comparisons among some estimators in misspecified linear models with multicollinearity

In this paper we deal with comparisons among several estimators available in situations of multicollinearity (e.g., the r-k class estimator proposed by Baye and Parker, the ordinary ridge regression (ORR) estimator, the principal components regression (PCR) estimator and also the ordinary least squares (OLS) estimator) for a misspecified linear model where misspecification is due to omission of some relevant explanatory variables. These comparisons are made in terms of the mean square error (mse) of the estimators of regression coefficients as well as of the predictor of the conditional mean of the dependent variable. It is found that under the same conditions as in the true model, the superiority of the r-k class estimator over the ORR, PCR and OLS estimators and those of the ORR and PCR estimators over the OLS estimator remain unchanged in the misspecified model. Only in the case of comparison between the ORR and PCR estimators, no definite conclusion regarding the mse dominance of one over the other in the misspecified model can be drawn.     

Admissibility of estimators of the probability of unobserved outcomes

The problem of estimating the probability of unobserved outcomes or, as it is sometimes called, the conditional probability of a new species, is studied. Good's estimator, which is essentially the same as Robbins' estimator, namely the number of singleton species observed divided by the sample size, is studied from a decision theory point of view. The results obtained are as follows: (1) When the total number of different species is assumed bounded by some known number, Good's and Robbins' estimators are inadmissible for squared error loss. (2) If the number of different species can be infinite, Good's and Robbins' estimators are admissible for squared error loss. (3) Whereas Robbins' estimator is a UMVUE for theunconditional probability of a new species obtained in one extra sample point, Robbins' estimator is not a uniformly minimum mean squared error unbiased estimator of the conditional probability of a new species. This answers a question raised by Robbins. (4) It is shown that for Robbins' model and squared error loss, there are admissible Bayes estimators which do not depend only on a minimal sufficient statistic. A discussion of interpretations and significance of the results is offered. Research supported by NSF Grant DMS-88-22622.     

Second-order nonlinear least squares estimation

The ordinary least squares estimation is based on minimization of the squared distance of the response variable to its conditional mean given the predictor variable. We extend this method by including in the criterion function the distance of the squared response variable to its second conditional moment. It is shown that this “second-order” least squares estimator is asymptotically more efficient than the ordinary least squares estimator if the third moment of the random error is nonzero, and both estimators have the same asymptotic covariance matrix if the error distribution is symmetric. Simulation studies show that the variance reduction of the new estimator can be as high as 50% for sample sizes lower than 100. As a by-product, the joint asymptotic covariance matrix of the ordinary least squares estimators for the regression parameter and for the random error variance is also derived, which is only available in the literature for very special cases, e.g. that random error has a normal distribution. The results apply to both linear and nonlinear regression models, where the random error distributions are not necessarily known.     

r-k Class estimation in regression model with concomitant variables

We treat with the r-k class estimation in a regression model, which includes the ordinary least squares estimator, the ordinary ridge regression estimator and the principal component regression estimator as special cases of the r-k class estimator. Many papers compared total mean square error of these estimators. Sarkar (1989, Ann. Inst. Statist. Math., 41, 717–724) asserts that the results of this comparison are still valid in a misspecified linear model. We point out some confusions of Sarkar and show additional conditions under which his assertion holds.     

One-step jackknife for M-estimators computed using Newton's method

To estimate the dispersion of an M-estimator computed using Newton's iterative method, the jackknife method usually requires to repeat the iterative process n times, where n is the sample size. To simplify the computation, one-step jackknife estimators, which require no iteration, are proposed in this paper. Asymptotic properties of the one-step jackknife estimators are obtained under some regularity conditions in the i.i.d. case and in a linear or nonlinear model. All the one-step jackknife estimators are shown to be asymptotically equivalent and they are also asymptotically equivalent to the original jackknife estimator. Hence one may use a dispersion estimator whose computation is the simplest. Finite sample properties of several one-step jackknife estimators are examined in a simulation study.The research was supported by Natural Sciences and Engineering Research Council of Canada.     

A sequence of improvements over the James-Stein estimator

In this article, we consider the problem of estimating a p-variate (p ≥ 3) normal mean vector in a decision-theoretic setup. Using a simple property of the noncentral chi-square distribution, we have produced a sequence of smooth estimators dominating the James-Stein estimator and each improved estimator is better than the previous one. It is also shown by using a technique of [5]. J. Multivariate Anal.36 121–126) that our smooth estimators can be dominated by non-smooth estimators.     

Robust estimation ofk-component univariate normal mixtures

The estimating equations derived from minimising aL ₂ distance between the empirical distribution function and the parametric distribution representing a mixture ofk normal distributions with possibly different means and/or different dispersion parameters are given explicitly. The equations are of theM estimator form in which the function is smooth, bounded and has bounded partial derivatives. As a consequence it is shown that there is a solution of the equations which is robust. In particular there exists a weakly continuous, Fréchet differentiable root and hence there is a consistent root of the equations which is asymptotically normal. These estimating equations offer a robust alternative to the maximum likelihood equations, which are known to yield nonrobust estimators.     

Statistical estimation in partial linear models with covariate data missing at random

In this paper, we consider the partial linear model with the covariables missing at random. A model calibration approach and a weighting approach are developed to define the estimators of the parametric and nonparametric parts in the partial linear model, respectively. It is shown that the estimators for the parametric part are asymptotically normal and the estimators of g(·) converge to g(·) with an optimal convergent rate. Also, a comparison between the proposed estimators and the complete case estimator is made. A simulation study is conducted to compare the finite sample behaviors of these estimators based on bias and standard error.     

Locally efficient estimation of regression parameters using current status data

In biostatistics applications interest often focuses on the estimation of the distribution of a time-variable T. If one only observes whether or not T exceeds an observed monitoring time C, then the data structure is called current status data, also known as interval censored data, case I. We consider this data structure extended to allow the presence of both time-independent covariates and time-dependent covariate processes that are observed until the monitoring time. We assume that the monitoring process satisfies coarsening at random.Our goal is to estimate the regression parameter β of the regression model T=Zβ+ε. The curse of dimensionality implies no globally efficient nonparametric estimator with good practical performance at moderate sample sizes exists. We present an estimator of the parameter β that attains the semiparametric efficiency bound if we correctly specify (a) a model for the monitoring mechanism and (b) a lower-dimensional model for the conditional distribution of T given the covariates. In addition, our estimator is robust to model misspecification. If only (a) is correctly specified, the estimator remains consistent and asymptotically normal. We conclude with a simulation experiment and a data analysis.     

Bayesian tail‐risk forecasting using realized GARCH

A realized generalized autoregressive conditional heteroskedastic (GARCH) model is developed within a Bayesian framework for the purpose of forecasting value at risk and conditional value at risk. Student‐t and skewed‐t return distributions are combined with Gaussian and student‐t distributions in the measurement equation to forecast tail risk in eight international equity index markets over a 4‐year period. Three realized measures are considered within this framework. A Bayesian estimator is developed that compares favourably, in simulations, with maximum likelihood, both in estimation and forecasting. The realized GARCH models show a marked improvement compared with ordinary GARCH for both value‐at‐risk and conditional value‐at‐risk forecasting. This improvement is consistent across a variety of data and choice of distributions. Realized GARCH models incorporating a skewed student‐t distribution for returns are favoured overall, with the choice of measurement equation error distribution and realized measure being of lesser importance. Copyright © 2017 John Wiley & Sons, Ltd.     

Robust residual‐ and recovery‐based a posteriori error estimators for a multipoint flux mixed finite element discretization of interface problems

We consider a posteriori error estimation for a multipoint flux mixed finite element method for two‐dimensional elliptic interface problems. Within the class of modified quasi‐monotonically distributed coefficients, we derive a residual‐type a posteriori error estimator of the weighted sum of the scalar and flux errors which is robust with respect to the jumps of the coefficients. Moreover, we develop robust implicit and explicit recovery‐type estimators through gradient recovery in an H(curl)‐conforming finite element space. In particular, we apply a modified L² projection in the implicit recovery procedure so as to reduce the computational cost of the recovered gradient. Numerical experiments confirm the theoretical results.     

Methodology for the invariant estimation of a continuous distribution function

Consider both the calssical and some more general invariant decision problems of estimating a continuous distribution function, with the loss function {ie503-1} and a sample of sizen fromF. It is proved that any nonrandomized estimator can be approximated in Lebesgue measure by the more general invariant estimators. Some methods for investigating the finite sample problem are discussed. As an application, a proof that the best invariant estimator is minimax when the sample size is 1 is given.     

Improved Estimation of Parameter Matrices in a One-Sample and Two-Sample Problems

In this paper, the problems of estimating the covariance matrix in a Wishart distribution (refer as one-sample problem) and the scale matrix in a multi-variate F distribution (which arise naturally from a two-sample setting) are considered. A new class of estimators which shrink the eigenvalues towards their harmonic mean is proposed. It is shown that the new estimator dominates the best linear estimator under two scale invariant loss functions.     

Least median of squares estimation by optimization heuristics with an application to the CAPM and a multi-factor model

For estimating the parameters of models for financial market data, the use of robust techniques is of particular interest. Conditional forecasts, based on the capital asset pricing model, and a factor model are considered. It is proposed to consider least median of squares estimators as one possible alternative to ordinary least squares. Given the complexity of the objective function for the least median of squares estimator, the estimates are obtained by means of optimization heuristics. The performance of two heuristics is compared, namely differential evolution and threshold accepting. It is shown that these methods are well suited to obtain least median of squares estimators for real world problems. Furthermore, it is analyzed to what extent parameter estimates and conditional forecasts differ between the two estimators. The empirical analysis considers daily and monthly data on some stocks from the Dow Jones Industrial Average Index.     

Consistent least squares fitting of ellipsoids

Summary. A parameter estimation problem for ellipsoid fitting in the presence of measurement errors is considered. The ordinary least squares estimator is inconsistent, and due to the nonlinearity of the model, the orthogonal regression estimator is inconsistent as well, i.e., these estimators do not converge to the true value of the parameters, as the sample size tends to infinity. A consistent estimator is proposed, based on a proper correction of the ordinary least squares estimator. The correction is explicitly given in terms of the true value of the noise variance.Mathematics Subject Classification (2000): 65D15, 65D10, 15A63Revised version received August 15, 2003     

New estimators of discriminant coefficients as the gradient of log-odds

We consider the problem of estimating the discriminant coefficients, η=∑^1-(θ⁽¹⁾-θ⁽²⁾) based on two independent normal samples fromN _p (θ⁽¹⁾,∑) andN _p (θ⁽²⁾,∑). We are concerned with the estimation of η as the gradient of log-odds between two extreme situations. A decision theoretic approach is taken with the quadratic loss function. We derive the unbiased estimator of the essential part of the risk which is applicable for general estimators. We propose two types of new estimators and prove their dominance over the traditional estimator using this unbiased estimator.     

时空模型的局部众数回归

时空数据经常含有奇异点或来自重尾分布,此时基于最小二乘的估计方法效果欠佳,需要更稳健的估计方法.本文提出时空模型的基于局部众数(local modal, LM)的局部线性估计方法.理论和数据分析结果都显示,若数据含有奇异点或来自重尾分布,基于局部众数的局部线性方法比基于最小二乘的局部线性方法有效;若数据无奇异点且来自正态分布,两种方法效率渐近一致.本文采用众数期望最大化(modal expectation-maximization, MEM)算法,并在数据相依情形下得出估计量的渐近正态性.     

Estimation of the extreme value index and extreme quantiles under random censoring

In this paper, we consider the estimation of the extreme value index and extreme quantiles in the presence of random right censoring. The generalization of the peaks over threshold method is discussed and an adaptation of the moment estimator is proposed. The corresponding extreme quantile estimators are also introduced. We make a start with the analysis of the asymptotic properties of the moment estimator and the corresponding extreme quantile estimator. The finite sample behaviour is illustrated with a small simulation study and through practical examples from survival data analysis.      

Closer estimators of a common mean in the sense of Pitman

Consider the problem of estimating the common mean of two normal populations with different unknown variances. Suppose a random sample of sizem is drawn from the first population and a random sample of sizen is drawn from the second population. The paper gives a family of estimators closer than the sample mean of the first population in the sense of Pitman (1937,Proc. Cambridge Phil. Soc.,33, 212–222). In particular, the Graybill-Deal estimator (1959,Biometrics,15, 543–550) is shown to be closer than each of the sample means ifm5 andn5.