线性模型和线性EV模型中的T-型回归估计和EM算法

本文对于线性函数关系EV模型定义了$t$\,-型回归估计, 并对于普通线性模型和线性函数关系EV模型给出了计算$t$\,-型回归估计的EM算法, 同时获得了估计的相合性\bd 模拟结果表明由EM算法获得的$t$\,-型回归估计的表现良好.     

Estimation in additive cox models by marginal integration

Assuming an additive model on the covariate effect in proportional hazards regression, we consider the estimation of the component functions. The estimator is based on the marginal integration method. Then we use a new kind of nonparametric estimator as the pilot estimator of the marginal integration. The pilot estimator is constructed by an analogy to the two-sample problems and by appealing to the principles of local partial likelihood and local linear fitting. We derive the asymptotic distribution of the marginal integration estimator of the component functions. The result of a simulation study is also given.     

Multivariate Failure Times Regression with a Continuous Auxiliary Covariate

How to take advantage of the available auxiliary covariate information when the primary covariate of interest is not measured is a frequently encountered question in biomedical study. In this paper, we consider the multivariate failure times regression analysis in which the primary covariate is assessed only in a validation set, but a continuous auxiliary covariate for it is available for all subjects in the study cohort. Under the frame of marginal hazard model, we propose to estimate the induced relative risk function in the non-validation set through kernel smoothing method and then obtain an estimated pseudo-partial likelihood function. The proposed estimator which maximizes the estimated pseudo-partial likelihood is shown to be consistent and asymptotically normal. We also give an estimator of the marginal cumulative baseline hazard function. Simulation studies are conducted to evaluate the finite sample performance of our proposed estimator. The proposed method is illustrated by analyzing a heart disease data from the Study of Left Ventricular Dysfunction (SOLVD).     

Penalized maximum likelihood estimation of a stochastic multivariate regression model

We study the large-sample properties of the penalized maximum likelihood estimator of a multivariate stochastic regression model with contemporaneously correlated data. The penalty is in terms of the square norm of some (vector) linear function of the regression coefficients. The model subsumes the so-called common transfer function model useful for extracting common signals in a panel of short time series. We show that, under mild regularity conditions, the penalized maximum likelihood estimator is consistent and asymptotically normal. The asymptotic bias of the regression coefficient estimator is also derived.     

带辅助协变量的分组相关失效时间数据的边际模型

本文研究了带有辅助协变量的分组相关失效时间数据的边际风险模型,获得了未知参数的伪偏似然估计,证明了所得估计的相合性和渐进正态性.     

Targeting Bayes factors with direct-path non-equilibrium thermodynamic integration

Thermodynamic integration (TI) for computing marginal likelihoods is based on an inverse annealing path from the prior to the posterior distribution. In many cases, the resulting estimator suffers from high variability, which particularly stems from the prior regime. When comparing complex models with differences in a comparatively small number of parameters, intrinsic errors from sampling fluctuations may outweigh the differences in the log marginal likelihood estimates. In the present article, we propose a TI scheme that directly targets the log Bayes factor. The method is based on a modified annealing path between the posterior distributions of the two models compared, which systematically avoids the high variance prior regime. We combine this scheme with the concept of non-equilibrium TI to minimise discretisation errors from numerical integration. Results obtained on Bayesian regression models applied to standard benchmark data, and a complex hierarchical model applied to biopathway inference, demonstrate a significant reduction in estimator variance over state-of-the-art TI methods.     

带有辅助信息的多元失效时间数据的估计标准部分似然方法

在许多实际研究中, 由于预算限制, 主协变量值只能对某一个有效集进行准确测量, 但同时对应此主协变量的辅助信息则对全部个体均可以观测. 利用这些辅助协变量的信息有助于提高统计研究的效率. 本文在基于共同基准危险率的边际模型框架下, 我们提出了一些统计推断方法来分析多元失效时间数据. 对于回归参数, 我们提出标准的估计部分似然方程来估计它, 同时也给出了累积基准危险率函数的Breslow 型估计. 得到的估计可以证明是相合的和渐近正态的. 利用模拟分析结果来表明了提出的方法在有限样本下的可行性.     

Minimax Hierarchical Empirical Bayes Estimation in Multivariate Regression

The multivariate normal regression model, in which a vector y of responses is to be predicted by a vector x of explanatory variables, is considered. A hierarchical framework is used to express prior information on both x and y. An empirical Bayes estimator is developed which shrinks the maximum likelihood estimator of the matrix of regression coefficients across rows and columns to nontrivial subspaces which reflect both types of prior information. The estimator is shown to be minimax and is applied to a set of chemometrics data for which it reduces the cross-validated predicted mean squared error of the maximum likelihood estimator by 38%.     

Safe density ratio modeling

An important problem in logistic regression modeling is the existence of the maximum likelihood estimators. In particular, when the sample size is small, the maximum likelihood estimator of the regression parameters does not exist if the data are completely, or quasicompletely separated. Recognizing that this phenomenon has a serious impact on the fitting of the density ratio model–which is a semiparametric model whose profile empirical log-likelihood has the logistic form because of the equivalence between prospective and retrospective sampling–we suggest a linear programming methodology for examining whether the maximum likelihood estimators of the finite dimensional parameter vector of the model exist. It is shown that the methodology can be effectively utilized in the analysis of case–control gene expression data by identifying cases where the density ratio model cannot be applied. It is demonstrated that naive application of the density ratio model yields erroneous conclusions.     

Local asymptotic behavior of regression splines for marginal semiparametric models with longitudinal data

In this paper, we study the local asymptotic behavior of the regression spline estimator in the framework of marginal semiparametric model. Similarly to Zhu, Fung and He (2008), we give explicit expression for the asymptotic bias of regression spline estimator for nonparametric function f. Our results also show that the asymptotic bias of the regression spline estimator does not depend on the working covariance matrix, which distinguishes the regression splines from the smoothing splines and the seemingly u...     

�������ݾ�ֵ��Э����������Ч�Ƚ�����

In this article, we develop efficient robust method for estimation of mean and covariance simultaneously for longitudinal data in regression model. Based on Cholesky decomposition for the covariance matrix and rewriting the regression model, we propose a weighted least square estimator, in which the weights are estimated under generalized empirical likelihood framework. The proposed estimator obtains high efficiency from the close connection to empirical likelihood method, and achieves robustness by bounding the weighted sum of squared residuals. Simulation study shows that, compared to existing robust estimation methods for longitudinal data, the proposed estimator has relatively high efficiency and comparable robustness. In the end, the proposed method is used to analyse a real data set.     

Tail Index Estimation and an Exponential Regression Model

One of the most important problems involved in the estimation of Pareto indices is the reduction of bias in case the slowly varying part of the Pareto type model disappears at a very slow rate. In other cases, when the bias problem is not so severe, the application of well-known estimators such as the Hill (1975) and the moment estimator (Dekkers et al. (1989)) still asks for an adaptive selection of the sample fraction to be used in such estimation procedures. We show that in both circumstances, solutions can be constructed for the given problems using maximum likelihood estimators based on a regression model for upper order statistics. Via this technique one can also infer about the bias-variance trade-off for a given data set. The behavior of the new maximum likelihood estimator is illustrated through simulation experiments, among others for ARCH processes.     

Asymptotic properties of the Bayes modal estimators of item parameters in item response theory

Asymptotic cumulants of the Bayes modal estimators of item parameters using marginal likelihood in item response theory are derived up to the fourth order with added higher-order asymptotic variances under possible model misspecification. Among them, only the first asymptotic cumulant and the higher-order asymptotic variance for an estimator are different from those by maximum likelihood. Corresponding results for studentized Bayes estimators and asymptotically bias-corrected ones are also obtained. It was found that all the asymptotic cumulants of the bias-corrected Bayes estimator up to the fourth order and the higher-order asymptotic variance are identical to those by maximum likelihood with bias correction. Numerical illustrations are given with simulations in the case when the 2-parameter logistic model holds. In the numerical illustrations, the maximum likelihood and Bayes estimators are used, where the same independent log-normal priors are employed for discriminant parameters and the hierarchical model is adopted for the prior of difficulty parameters.     

Spline-based sieve maximum likelihood estimation in the partly linear model under monotonicity constraints

We study a spline-based likelihood method for the partly linear model with monotonicity constraints. We use monotone B-splines to approximate the monotone nonparametric function and apply the generalized Rosen algorithm to compute the estimators jointly. We show that the spline estimator of the nonparametric component achieves the possible optimal rate of convergence under the smooth assumption and that the estimator of the regression parameter is asymptotically normal and efficient. Moreover, a spline-based semiparametric likelihood ratio test is established to make inference of the regression parameter. Also an observed profile information method to consistently estimate the standard error of the spline estimator of the regression parameter is proposed. A simulation study is conducted to evaluate the finite sample performance of the proposed method. The method is illustrated by an air pollution study.     

Bernstein Polynomial Estimation in the Partially Linear Model under Monotonicity Constraints

In this paper, a Bernstein-polynomial-based likelihood method is proposed for the partially linear model under monotonicity constraints. Monotone Bernstein polynomials are employed to approximate the monotone nonparametric function in the model. The estimator of the regression parameter is shown to be asymptotically normal and efficient, and the rate of convergence of the estimator of the nonparametric component is established, which could be the optimal under the smooth assumptions. A simulation study and a real data analysis are conducted to evaluate the finite sample performance of the proposed method.     

Efficient estimation of a varying-coefficient partially linear binary regression model

This article considers a semiparametric varying-coefficient partially linear binary regression model. The semiparametric varying-coefficient partially linear regression binary model which is a generalization of binary regression model and varying-coefficient regression model that allows one to explore the possibly nonlinear effect of a certain covariate on the response variable. A Sieve maximum likelihood estimation method is proposed and the asymptotic properties of the proposed estimators are discussed. One of our main objects is to estimate nonparametric component and the unknowen parameters simultaneously. It is easier to compute, and the required computation burden is much less than that of the existing two-stage estimation method. Under some mild conditions, the estimators are shown to be strongly consistent. The convergence rate of the estimator for the unknown smooth function is obtained, and the estimator for the unknown parameter is shown to be asymptotically efficient and normally distributed. Simulation studies are carried out to investigate the performance of the proposed method.     

Asymptotic properties of the maximum likelihood estimator for the proportional hazards model with doubly censored data

Doubly censored data, which include left as well as right censored observations, are frequently met in practice. Though estimation of the distribution function with doubly censored data has seen much study, relatively little is known about the inference of regression coefficients in the proportional hazards model for doubly censored data. In particular, theoretical properties of the maximum likelihood estimator of the regression coefficients in the proportional hazards model have not been proved yet. In this paper, we show the consistency and asymptotic normality of the maximum likelihood estimator and prove its semiparametric efficiency. The proposed methods are illustrated with simulation studies and analysis of an application from a medical study.     

Nonparametric estimation of multivariate density with direct and auxiliary data and application

We consider the problem of multivariate density estimation, using samples from the distribution of interest as well as auxiliary samples from a related distribution. We assume that the data from the target distribution and the related distribution may occur individually as well as in pairs. Using nonparametric maximum likelihood estimator of the joint distribution, we derive a kernel density estimator of the marginal density. We show theoretically, in a simple special case, that the implied estimator of the marginal density has smaller integrated mean squared error than that of a similar estimator obtained by ignoring dependence of the paired observations. We establish consistency of the marginal density estimator under suitable conditions. We demonstrate small sample superiority of the proposed estimator over the estimator that ignores dependence of the samples, through a simulation study with dependent and non-normal populations. The application of the density estimator in nonparametric classification is also discussed. It is shown that the misclassification probability of the resulting classifier is asymptotically equivalent to that of the Bayes classifier. We also include a data analytic illustration.     

Asymptotic Normality of a Combined Regression Estimator

In this paper, we propose a combined regression estimator by using a parametric estimator and a nonparametric estimator of the regression function. The asymptotic distribution of this estimator is obtained for cases where the parametric regression model is correct, incorrect, and approximately correct. These distributional results imply that the combined estimator is superior to the kernel estimator in the sense that it can never do worse than the kernel estimator in terms of convergence rate and it has the same convergence rate as the parametric estimator in the case where the parametric model is correct. Unlike the parametric estimator, the combined estimator is robust to model misspecification. In addition, we also establish the asymptotic distribution of the estimator of the weight given to the parametric estimator in constructing the combined estimator. This can be used to construct consistent tests for the parametric regression model used to form the combined estimator.     

Empirical likelihood analysis of the Buckley-James estimator

The censored linear regression model, also referred to as the accelerated failure time (AFT) model when the logarithm of the survival time is used as the response variable, is widely seen as an alternative to the popular Cox model when the assumption of proportional hazards is questionable. Buckley and James [Linear regression with censored data, Biometrika 66 (1979) 429-436] extended the least squares estimator to the semiparametric censored linear regression model in which the error distribution is completely unspecified. The Buckley-James estimator performs well in many simulation studies and examples. The direct interpretation of the AFT model is also more attractive than the Cox model, as Cox has pointed out, in practical situations. However, the application of the Buckley-James estimation was limited in practice mainly due to its illusive variance. In this paper, we use the empirical likelihood method to derive a new test and confidence interval based on the Buckley-James estimator of the regression coefficient. A standard chi-square distribution is used to calculate the P-value and the confidence interval. The proposed empirical likelihood method does not involve variance estimation. It also shows much better small sample performance than some existing methods in our simulation studies.