Minimum disparity estimation for continuous models: Efficiency,distributions and robustness

A general class of minimum distance estimators for continuous models called minimum disparity estimators are introduced. The conventional technique is to minimize a distance between a kernel density estimator and the model density. A new approach is introduced here in which the model and the data are smoothed with the same kernel. This makes the methods consistent and asymptotically normal independently of the value of the smoothing parameter; convergence properties of the kernel density estimate are no longer necessary. All the minimum distance estimators considered are shown to be first order efficient provided the kernel is chosen appropriately. Different minimum disparity estimators are compared based on their characterizing residual adjustment function (RAF); this function shows that the robustness features of the estimators can be explained by the shrinkage of certain residuals towards zero. The value of the second derivative of theRAF at zero,A ₂, provides the trade-off between efficiency and robustness. The above properties are demonstrated both by theorems and by simulations.     

Comparisons among some estimators in misspecified linear models with multicollinearity

In this paper we deal with comparisons among several estimators available in situations of multicollinearity (e.g., the r-k class estimator proposed by Baye and Parker, the ordinary ridge regression (ORR) estimator, the principal components regression (PCR) estimator and also the ordinary least squares (OLS) estimator) for a misspecified linear model where misspecification is due to omission of some relevant explanatory variables. These comparisons are made in terms of the mean square error (mse) of the estimators of regression coefficients as well as of the predictor of the conditional mean of the dependent variable. It is found that under the same conditions as in the true model, the superiority of the r-k class estimator over the ORR, PCR and OLS estimators and those of the ORR and PCR estimators over the OLS estimator remain unchanged in the misspecified model. Only in the case of comparison between the ORR and PCR estimators, no definite conclusion regarding the mse dominance of one over the other in the misspecified model can be drawn.     

广义偏最小二乘(PLS)估计类

本文研究了一类含有偏最小二乘（partialleastsquaresPLS）估计的估计类．给出了PLS估计的一般代数形式；讨论了含有PLS估计的广义PPLS估计类的统计性质；给出了该估计类优于最小二乘估计的条件．     

Sobolev-Hermite versus Sobolev nonparametric density estimation on $${\mathbb {R}}$$

In this paper, our aim is to revisit the nonparametric estimation of a square integrable density f on \({\mathbb {R}}\), by using projection estimators on a Hermite basis. These estimators are studied from the point of view of their mean integrated squared error on \({\mathbb {R}}\). A model selection method is described and proved to perform an automatic bias variance compromise. Then, we present another collection of estimators, of deconvolution type, for which we define another model selection strategy. Although the minimax asymptotic rates of these two types of estimators are mainly equivalent, the complexity of the Hermite estimators is usually much lower than the complexity of their deconvolution (or kernel) counterparts. These results are illustrated through a small simulation study.

     

Improved ridge regression estimators for the logistic regression model

The estimation of the regression parameters for the ill-conditioned logistic regression model is considered in this paper. We proposed five ridge regression (RR) estimators, namely, unrestricted RR, restricted ridge regression, preliminary test RR, shrinkage ridge regression and positive rule RR estimators for estimating the parameters $(\beta )$ when it is suspected that the parameter $\beta $ may belong to a linear subspace defined by $H\beta =h$ . Asymptotic properties of the estimators are studied with respect to quadratic risks. The performances of the proposed estimators are compared based on the quadratic bias and risk functions under both null and alternative hypotheses, which specify certain restrictions on the regression parameters. The conditions of superiority of the proposed estimators for departure and ridge parameters are given. Some graphical representations and efficiency analysis have been presented which support the findings of the paper.     

Universally consistent conditionalU-statistics for absolutely regular processes and its applications for hidden Markov models

A general class of conditionalU-statistics was introduced by W. Stute as a generalization of the Nadaraya-Watson estimates of a regression function. It was shown that such statistics are universally consistent. Also, universal consistentcies of the window andk _n -nearest neighbor estimators (as two special cases of the conditionalU-statistics) were proved. In this paper, we extend these results from the independent case to dependent case. The result is applied to verify the Bayes risk consistency of the corresponding discrimination rules. Research supported by the Office of Naval Research Contract N00014-91-J-1020.     

On moment-type estimators for a class of log-symmetric distributions

In this paper, we propose three simple closed form estimators for a class of log-symmetric distributions on \({\mathbb {R}}^{+}\). The proposed methods make use of some key properties of this class of distributions. We derive the asymptotic distributions of these estimators. The performance of the proposed estimators are then compared with those of the maximum likelihood estimators through Monte Carlo simulations. Finally, some illustrative examples are presented to illustrate the methods of estimation developed here.     

Semiparametric regression analysis for clustered doubly-censored data

This paper considers clustered doubly-censored data that occur when there exist several correlated survival times of interest and only doubly censored data are available for each survival time. In this situation, one approach is to model the marginal distribution of failure times using semiparametric linear transformation models while leaving the dependence structure completely arbitrary. We demonstrate that the approach of Cai et al. (Biometrika 87:867–878, 2000) can be extended to clustered doubly censored data. We propose two estimators by using two different estimated censoring weights. A simulation study is conducted to investigate the proposed estimators.     

Nonparametric estimation of a regression function by delta sequences

A somewhat more general class of nonparametric estimators for estimating an unknown regression functiong from noisy data is proposed. The regressor is assumed to be defined on the closed interval [0, 1]. This class of estimators is shown to be pointwisely consistent in the mean square sense and with probability one. Further, it turns out that these estimators can be applied to a wide class of noises.     

A Unified and Broadened Class of Admissible Minimax Estimators of a Multivariate Normal Mean

The problem of estimating the mean of a multivariate normal distribution is considered. A class of admissible minimax estimators is constructed. This class includes two well-known classes of estimators, Strawderman's and Alam's. Further, this class is much broader than theirs.     

On consistency of the likelihood moment estimators for a linear process with regularly varying innovations

In 1975 James Pickands III showed that the excesses over a high threshold are approximatly Generalized Pareto distributed. Since then, a variety of estimators for the parameters of this cdf have been studied, but always assuming the underlying data to be independent. In this paper we consider the special case where the underlying data arises from a linear process with regularly varying (i.e. heavy-tailed) innovations. Using this setup, we then show that the likelihood moment estimators introduced by Zhang Aust. N.Z. J. Stat. 49, 69–77 (2007) are consistent estimators for the parameters of the Generalized Pareto distribution.     

On the lower bounds for mean square error of empirical bayes estimators

The usual empirical Bayes setting is considered with θ being a shift or a scale parameter. A class of empirical Bayes estimators of a function b(θ) is proposed. The properties of the estimates are studied and mean square errors are calculated. The lower bounds are constructed for mean square errors of the empirical Bayes estimators over the class of all empirical Bayes estimators of b(θ). The results are applied to the case b(θ)=θ. The examples of the upper and lower bounds for mean square error are presented for the most popular families of conditional distributions. Added to the English translaion.     

On the lower bound in second order estimation for Poisson processes: Asymptotic efficiency

In the estimation problem of the mean function of an inhomogeneous Poisson process there is a class of kernel type estimators that are asymptotically efficient alongside with the empirical mean function. We start by describing such a class of estimators which we call first order efficient estimators. To choose the best one among them we prove a lower bound that compares the second order term of the mean integrated square error of all estimators. The proof is carried out under the assumption on the mean function Λ(·) that Λ(τ) = S, where S is a known positive number. In the end, we discuss the possibility of the construction of an estimator which attains this lower bound, thus, is asymptotically second order efficient.     

Operational Variants of the Minimum Mean Squared Error Estimator in Linear Regression Models with Non-Spherical Disturbances

There is a good deal of literature that investigates the properties of various operational variants of Theil's (1971, Principles of Econometrics, Wiley, New York) minimum mean squared error estimator. It is interesting that virtually all of the existing analysis to date is based on the premise that the model's disturbances are i.i.d., an assumption which is not satisfied in many practical situations. In this paper, we consider a model with non-spherical errors and derive the asymptotic distribution, bias and mean squared error of a general class of feasible minimum mean squared error estimators. A Monte-Carlo experiment is conducted to examine the performance of this class of estimators in finite samples.     

Kernel quantile estimator with ICI adaptive bandwidth selection technique

In this article, we consider a class of kernel quantile estimators which is the linear combi- nation of order statistics. This class of kernel quantile estimators can be regarded as an extension of some existing estimators. The exact mean square error expression for this class of estimators will be provided when data are uniformly distributed. The implementation of these estimators depends mostly on the bandwidth selection. We then develop an adaptive method for bandwidth selection based on the intersection confidence intervals （ICI） principle. Monte Carlo studies demonstrate that our proposed approach is comparatively remarkable. We illustrate our method with a real data set.     

Criteria for the strong regularity of J-inner functions and γ-generating matrices

The class of left and right strongly regular J-inner mvf's plays an important role in bitangential interpolation problems and in bitangential direct and inverse problems for canonical systems of integral and differential equations. A new criterion for membership in this class is presented in terms of the matricial Muckenhoupt condition (A₂) that was introduced for other purposes by Treil and Volberg. Analogous results are also obtained for the class of γ-generating functions that intervene in the Nehari problem. The new criterion is simpler than the criterion that we presented earlier. A determinental criterion is also presented.     

混合模型中方差分量估计的容许性及非负估计

对含有两个方差分量的线性混合模型, 本文构造了方差分量的一个线性估计类, 它包含许多常见的方差分量估计. 在这个类中我们建立了容许性的必要条件, 据此得到了两个新的改进估计. 最后我们讨论了方差分量的非负估计, 得到了优于方差分析估计和Tatsuya估计的正估计.     

More Higher-Order Efficiency: Concentration Probability

Based on concentration probability of estimators about a true parameter, third-order asymptotic efficiency of the first-order bias-adjusted MLE within the class of first-order bias-adjusted estimators has been well established in a variety of probability models. In this paper we consider the class of second-order bias-adjusted Fisher consistent estimators of a structural parameter vector on the basis of an i.i.d. sample drawn from a curved exponential-type distribution, and study the asymptotic concentration probability, about a true parameter vector, of these estimators up to the fifth-order. In particular, (i) we show that third-order efficient estimators are always fourth-order efficient; (ii) a necessary and sufficient condition for fifth-order efficiency is provided; and finally (iii) the MLE is shown to be fifth-order efficient.     

2SUR回归模型系数估计的均方误差比较

对于2SUR回归模型的参数估计问题,给出了一些一航均方误差矩阵比较结果,据此提出了一类线性估计和一类基于离差阵广义非限定估计的非线性两步估计,并获得了该两步估计类的一些有限样本性质。     

A class of estimators of the mean survival time from interval censored data with application to linear regression

A class of estimators of the mean survival time with interval censored data are studied by unbiased transformation method. The estimators are constructed based on the observations to ensure unbiasedness in the sense that the estimators in a certain class have the same expectation as the mean survival time. The estimators have good properties such as strong consistency （with the rate of O（n^-1/1 （log log n）^1/2）） and asymptotic normality. The application to linear regression is considered and the simulation reports are given.