Nonparametric variance function estimation with missing data

In this paper, a fixed design regression model where the errors follow a strictly stationary process is considered. In this model the conditional mean function and the conditional variance function are unknown curves. Correlated errors when observations are missing in the response variable are assumed. Four nonparametric estimators of the conditional variance function based on local polynomial fitting are proposed. Expressions of the asymptotic bias and variance of these estimators are obtained. A simulation study illustrates the behavior of the proposed estimators.     

Conditional and unconditional methods for selecting variables in linear mixed models

In the problem of selecting the explanatory variables in the linear mixed model, we address the derivation of the (unconditional or marginal) Akaike information criterion (AIC) and the conditional AIC (cAIC). The covariance matrices of the random effects and the error terms include unknown parameters like variance components, and the selection procedures proposed in the literature are limited to the cases where the parameters are known or partly unknown. In this paper, AIC and cAIC are extended to the situation where the parameters are completely unknown and they are estimated by the general consistent estimators including the maximum likelihood (ML), the restricted maximum likelihood (REML) and other unbiased estimators. We derive, related to AIC and cAIC, the marginal and the conditional prediction error criteria which select superior models in light of minimizing the prediction errors relative to quadratic loss functions. Finally, numerical performances of the proposed selection procedures are investigated through simulation studies.     

Detection of the jump points of a heteroscedastic regression model by wavelets

1. IntroductionDetection of jump points often arises in many practical problems such as signal analysis,.... fimage processing, seismic exploratioll and phonetic identification. FOr examPle, financialeconollilsts often wad to know if abrupt changes occur in an exchange rate series sincethese changes edicted, are affecting or will affect fin-ancial market; engineers concern abolltwhether there exist jumps in a seismic signal in oil exploration bacause these jumps maypredict that there exists br…     

���ЧӦģ���з��������Bayes���Ƽ���������

??The Bayes estimators of variance components are derived under weighted square loss function for the balanced one-way classification random effects model with the assumption that variance component has the conjugate prior distribution. The superiorities of the Bayes estimators for variance components to traditional ANOVA estimators are studied in terms of the mean square error (MSE) criterion. Finally, a remark for main results is given.     

线性混合效应模型中方差分量的估计

本文首先研究了含三个方差分量的线性混合随机效应模型改进的ANOVA估计, 此估计在均方损失下一致优于ANOVA估计. 由于这些方差估计取负值的概率大于零, 对得到的估计在某非负点采用截尾的方法得到非负估计是一种常用的方法. 对文章中提出的估计, 研究了此估计在某非负点截尾之后得到的估计在均方损失意义下优于截尾之前的估计的充分条件, 同时给出ANOVA估计在截尾之后优于它本身的充分条件, 而且将得到的结论推广到更一般的线性混合随机效应模型.     

平衡随机模型中方差分量的非负估计

众所周知, 对于平衡随机模型, 方差分量的方差分析估计为一致最小方差无偏估计. 本文基于方差分量的方差分析估计, 构造了一个二次不变估计类, 它包含了一些常用重要估计. 证明了该估计类在一定条件下在均方误差意义下一致优于方差分析估计, 并在此估计类基础上, 给出了方差分量的两种非负估计, 它们在均方误差意义下分别一致优于方差分析估计和限制极大似然估计, 且有显式解、容易计算.     

Estimating and Visualizing Conditional Densities

Abstract

We consider the kernel estimator of conditional density and derive its asymptotic bias, variance, and mean-square error. Optimal bandwidths (with respect to integrated mean-square error) are found and it is shown that the convergence rate of the density estimator is order n ^–2/3. We also note that the conditional mean function obtained from the estimator is equivalent to a kernel smoother. Given the undesirable bias properties of kernel smoothers, we seek a modified conditional density estimator that has mean equivalent to some other nonparametric regression smoother with better bias properties. It is also shown that our modified estimator has smaller mean square error than the standard estimator in some commonly occurring situations. Finally, three graphical methods for visualizing conditional density estimators are discussed and applied to a data set consisting of maximum daily temperatures in Melbourne, Australia.     

Inferences in semi-parametric dynamic mixed models for longitudinal count data

This paper considers a semi-parametric mixed model for longitudinal counts under the assumption that for conditional on a common random effect over time the repeated count responses of an individual follow a Poisson AR(1) (auto-regressive order 1) non-stationary correlation structure. A step-by-step estimation approach is developed which provides consistent estimators for the non-parametric function, regression parameters, variance of the random effects, and auto-correlation structure of the model. Proofs for the consistency properties of the estimators along with their convergence rates are derived. A simulation study is conducted to examine first the estimation effects on parameters when the non-parametric function is ignored, and then an overall estimation study is carried out in the presence of the non-parametric function by including its estimation as well.     

Combining conditional and unconditional moment restrictions with missing responses

Many statistical models, e.g. regression models, can be viewed as conditional moment restrictions when distributional assumptions on the error term are not assumed. For such models, several estimators that achieve the semiparametric efficiency bound have been proposed. However, in many studies, auxiliary information is available as unconditional moment restrictions. Meanwhile, we also consider the presence of missing responses. We propose the combined empirical likelihood (CEL) estimator to incorporate such auxiliary information to improve the estimation efficiency of the conditional moment restriction models. We show that, when assuming responses are strongly ignorable missing at random, the CEL estimator achieves better efficiency than the previous estimators due to utilization of the auxiliary information. Based on the asymptotic property of the CEL estimator, we also develop Wilks’ type tests and corresponding confidence regions for the model parameter and the mean response. Since kernel smoothing is used, the CEL method may have difficulty for problems with high dimensional covariates. In such situations, we propose an instrumental variable-based empirical likelihood (IVEL) method to handle this problem. The merit of the CEL and IVEL are further illustrated through simulation studies.     

The Asymptotic Distribution of REML Estimators

Restricted maximum likelihood (REML) estimation is a method employed to estimate variance-covariance parameters from data that follow a Gaussian linear model. In applications, it has either been conjectured or assumed that REML estimators are asymptotically Gaussian with zero mean and variance matrix equal to the inverse of the restricted information matrix. In this article, we give conditions under which the conjecture is true and apply our results to variance-components models. An important application of variance components is to census undercount; a simulation is carried out to verify REML′s properties for a typical census undercount model.     

Cross-validated bagged learning

Many applications aim to learn a high dimensional parameter of a data generating distribution based on a sample of independent and identically distributed observations. For example, the goal might be to estimate the conditional mean of an outcome given a list of input variables. In this prediction context, bootstrap aggregating (bagging) has been introduced as a method to reduce the variance of a given estimator at little cost to bias. Bagging involves applying an estimator to multiple bootstrap samples and averaging the result across bootstrap samples. In order to address the curse of dimensionality, a common practice has been to apply bagging to estimators which themselves use cross-validation, thereby using cross-validation within a bootstrap sample to select fine-tuning parameters trading off bias and variance of the bootstrap sample-specific candidate estimators. In this article we point out that in order to achieve the correct bias variance trade-off for the parameter of interest, one should apply the cross-validation selector externally to candidate bagged estimators indexed by these fine-tuning parameters. We use three simulations to compare the new cross-validated bagging method with bagging of cross-validated estimators and bagging of non-cross-validated estimators.     

随机化应答调查方案的参数估计问题

随机化应答调查是一种特殊的数据采集技术,使得调查者既得到了某个敏感问题的信息又保护了被调查者的隐私,本文研究从两种随机化答调查方案采得数据后的参数估计问题,在应用Ｂａｙｅｓ估计时,给出了便于Ｍａｔｈｅｍａｔｉｃａ软件计算的后验均值和方差的公式,通过模拟实验,比较了两个方案所得估计量的优劣。     

Efficient Mean Estimation in Log-Normal Linear Models with First-Order Correlated Errors

In this paper, we propose a log-normal linear model whose errors are first-order correlated, and suggest a two-stage method for the efficient estimation of the conditional mean of the response variable at the original scale. We obtain two estimators which minimize the asymptotic mean squared error (MM) and the asymptotic bias (MB), respectively. Both the estimators are very easy to implement, and simulation studies show that they are perform better.     

Some closed form robust moment‐based estimators for the MEM(1,1)

In this paper, we extend the closed form moment estimator (ordinary MCFE) for the autoregressive conditional duration model given by Lu et al (2016) and propose some closed form robust moment‐based estimators for the multiplicative error model to deal with the additive and innovational outliers. The robustification of the closed form estimator is done by replacing the sample mean and sample autocorrelation with some robust estimators. These estimators are more robust than the quasi‐maximum likelihood estimator (QMLE) often used to estimate this model, and they are easy to implement and do not require the use of any numerical optimization procedure and the choice of initial value. The performance of our proposal in estimating the parameters and forecasting conditional mean μ_t of the MEM(1,1) process is compared with the proposals existing in the literature via Monte Carlo experiments, and the results of these experiments show that our proposal outperforms the ordinary MCFE, QMLE, and least absolute deviation estimator in the presence of outliers in general. Finally, we fit the price durations of IBM stock with the robust closed form estimators and the benchmarks and analyze their performances in estimating model parameters and forecasting the irregularly spaced intraday Value at Risk.     

附加信息下的局部线性估计

在回归模型中，对一类因变量函数的条件期望方程的附加信息，我们提出了基于极大经验似然方法的局部线性点估计，在一定条件下证明了这些估计的相合性和渐近正态性，而且估计的方差小于通常不带附加信息核估计的方差．模拟结果也显示了估计的优良性．     

A generalized partially linear framework for variance functions

When model the heteroscedasticity in a broad class of partially linear models, we allow the variance function to be a partial linear model as well and the parameters in the variance function to be different from those in the mean function. We develop a two-step estimation procedure, where in the first step some initial estimates of the parameters in both the mean and variance functions are obtained and then in the second step the estimates are updated using the weights calculated based on the initial estimates. The resulting weighted estimators of the linear coefficients in both the mean and variance functions are shown to be asymptotically normal, more efficient than the initial un-weighted estimators, and most efficient in the sense of semiparametric efficiency for some special cases. Simulation experiments are conducted to examine the numerical performance of the proposed procedure, which is also applied to data from an air pollution study in Mexico City.     

Multiple imputations and the missing censoring indicator model

Semiparametric random censorship (SRC) models (Dikta, 1998) provide an attractive framework for estimating survival functions when censoring indicators are fully or partially available. When there are missing censoring indicators (MCIs), the SRC approach employs a model-based estimate of the conditional expectation of the censoring indicator given the observed time, where the model parameters are estimated using only the complete cases. The multiple imputations approach, on the other hand, utilizes this model-based estimate to impute the missing censoring indicators and form several completed data sets. The Kaplan-Meier and SRC estimators based on the several completed data sets are averaged to arrive at the multiple imputations Kaplan-Meier (MIKM) and the multiple imputations SRC (MISRC) estimators. While the MIKM estimator is asymptotically as efficient as or less efficient than the standard SRC-based estimator that involves no imputations, here we investigate the performance of the MISRC estimator and prove that it attains the benchmark variance set by the SRC-based estimator. We also present numerical results comparing the performances of the estimators under several misspecified models for the above mentioned conditional expectation.     

BOOTSTRAP WAVELET IN THE NONPARAMETRIC REGRESSION MODEL WITH WEAKLY DEPENDENT PROCESSES

This paper introduces a method of bootstrap wavelet estimation in a nonparametric regression model with weakly dependent processes for both fixed and random designs. The asymptotic bounds for the bias and variance of the bootstrap wavelet estimators are given in the fixed design model. The conditional normality for a modified version of the bootstrap wavelet estimators is obtained in the fixed model. The consistency for the bootstrap wavelet estimator is also proved in the random design model. These results show that the bootstrap wavelet method is valid for the model with weakly dependent processes.     

响应变量随机缺失下的半参变系数模型的均值估计

在响应变量随机缺失时,研究了半参数变系数模型响应变量均值的借补估计.首先利用完整个体估计模型中的参数与非参数部分,然后再用借补方法与加权借补方法估计响应变量的均值.最后求出了估计的渐近偏差与渐近方差,研究了所得到的估计的渐近性质,并进行模拟比较.     

协变量区间删失时线性模型的参数估计

本文研究了当协变量为区间数据时的线性模型，通过构造区间数据变量的条件均值，得到了回归参数的估计，当协变量的分布已知时，证明了估计的无偏性与强相合性．时协变量的分布未知的情形也作了讨论．文中还作了若干模拟计算，从模拟的结果不难发现，利用本文提出的方法所获得的估计简便且具有较高的精度．