对部分线性模型用惩罚最小二乘估计时最优光滑化的注记

部分线性模型也就是响应变量关于一个或者多个协变量是线性的, 但对于其他的协变量是非线性的关系\bd 对于部分线性模型中的参数和非参数部分的估计方法, 惩罚最小二乘估计是重要的估计方法之一\bd 对于这种估计方法, 广义交叉验证法提供了一种确定光滑参数的方法\bd 但是, 在部分线性模型中, 用广义交叉验证法确定光滑参数的最优性还没有被证明\bd 本文证明了利用惩罚最小二乘估计对于部分线性模型估计时, 用广义交叉验证法选择光滑参数的最优性\bd 通过模拟验证了本文中所提出的用广义交叉验证法选择光滑参数具有很好的效果, 同时, 本文在模拟部分比较了广义交叉验证和最小二乘交叉验证的优劣.     

Normal Approximation Rate of the Kernel Smoothing Estimator in a Partial Linear Model

By establishing the asymptotic normality for the kernel smoothing estimatorβ_nof the parametric componentsβin the partial linear modelY=X′β+g(T)+, P. Speckman (1988,J. Roy. Statist. Soc. Ser. B50, 413–456) proved that the usual parametric raten^−1/2is attainable under the usual “optimal” bandwidth choice which permits the achievement of the optimal nonparametric rate for the estimation of the nonparametric componentg. In this paper we investigate the accuracy of the normal approximation forβ_nand find that, contrary to what we might expect, the optimal Berry–Esseen raten^−1/2is not attainable unlessgis undersmoothed, that is, the bandwidth is chosen with faster rate of tending to zero than the “optimal” bandwidth choice.     

部分线性自回归模型中误差方差的核估计

基于非参数函数的核估计,构造了部分线性自回归模型中误差四阶矩的相合估计,从而给出了误差方差核估计的渐近正态性,并通过模拟算例和实例说明了其应用.     

分位数变系数模型基于核光滑的变量选择

分位数变系数模型是一种稳健的非参数建模方法.使用变系数模型分析数据时,一个自然的问题是如何同时选择重要变量和从重要变量中识别常数效应变量.本文基于分位数方法研究具有稳健和有效性的估计和变量选择程序.利用局部光滑和自适应组变量选择方法,并对分位数损失函数施加双惩罚,我们获得了惩罚估计.通过BIC准则合适地选择调节参数,提出的变量选择方法具有oracle理论性质,并通过模拟研究和脂肪实例数据分析来说明新方法的有用性.数值结果表明,在不需要知道关于变量和误差分布的任何信息前提下,本文提出的方法能够识别不重要变量同时能区分出常数效应变量.     

The Asymptotic Variance of the Continuous-Time Kernel Estimator with Applications to Bandwidth Selection

We derive simple expressions for the asymptotic variance of the kernel-density estimator of a stationary continuous-time process in one and d dimensions and relate convergence rates to sample path smoothness. Important applications include methods for selecting optimal smoothing parameters and construction of confidence bands for testing hypotheses about the density. In a simulation study the results are applied to bandwidth selection for discrete-time processes that can be modelled as continuous-time processes sampled at a high rate.     

广义线性回归极大似然估计的强相合性

设有该文第1节所描述的广义线性回归模型,以$\underline{\lambda}_n$和$\overline{\lambda}_n$分别记$\sum\limits_{i=1}^{n}Z_iZ_i^{\prime}$的最小和最大特征根,$\hat{\beta}_n$记$\beta_0$的极大似然估计.在文献[1]中,当\{$Z_i,i\ge1$\}有界时得到$\hat{\beta}_n$强相合的充分条件,在自然联系和非自然联系下分别为$\underline{\lambda}_n\rightarrow\infty$, $(\overline{\lambda}_n)^{1/2+\delta}=O(\underline{\lambda}_n)$（对某$\delta>0$)以及$\underline{\lambda}_n\rightarrow\infty$, $\overline{\lambda}_n=O(\underline{\lambda}_n)$.作者将后一结果改进为只要求$(\overline{\lambda}_n)^{1/2+\delta}=O(\underline{\lambda}_n)$,从而与自然联系情况下的条件达到一致.     

纵向数据部分线性模型的广义经验似然推断

考虑纵向数据部分线性模型,针对纵向数据个体内的相关性特点,通过引入估计的作业协方差矩阵,构造了模型中未知参数的三种经验对数似然比统计量.在适当条件下,证明了所提出的统计量依分布收敛于χ~2分布,所得结果可以构造未知参数的置信域.最后通过模拟研究对所提方法进行了说明.     

部分线性变系数模型中估计的渐进正态性

作为部分线性模型与变系数模型的推广,部分线性变系数模型是一类应用非常广泛的模型,本文基于Profile最小二乘方法给出了模型中参数分量与非参数分量的估计,并在异方差情形下证明了这些估计的渐进正态性.     

高维部分线性模型的变量选择和估计

考虑高维部分线性模型,提出了同时进行变量选择和估计兴趣参数的变量选择方法.将Dantzig变量选择应用到线性部分及非参数部分的各阶导数,从而获得参数和非参数部分的估计,且参数部分的估计具有稀疏性,证明了估计的非渐近理论界.最后,模拟研究了有限样本的性质.     

因变量缺失下变系数部分线性测量误差模型的变量选择

主要研究因变量存在缺失且协变量部分包含测量误差情形下,如何对变系数部分线性模型同时进行参数估计和变量选择.我们利用插补方法来处理缺失数据,并结合修正的profile最小二乘估计和SCAD惩罚对参数进行估计和变量选择.并且证明所得的估计具有渐近正态性和Oracle性质.通过数值模拟进一步研究所得估计的有限样本性质.     

部分线性模型的随机约束岭估计

研究了部分线性回归模型附加有随机约束条件时的估计问题.基于Profile最小二乘方法和混合估计方法提出了参数分量随机约束下的Profile混合估计,并研究了其性质.为了克服共线性问题,构造了参数分量的Profile混合岭估计,并给出了估计量的偏和方差.     

删失数据下变系数部分线性模型的经验似然变量选择

In this paper, we consider the variable selection for the parametric components of varying coefficient partially linear models with censored data. By constructing a penalized auxiliary vector ingeniously, we propose an empirical likelihood based variable selection procedure, and show that it is consistent and satisfies the sparsity. The simulation studies show that the proposed variable selection method is workable.     

�������ݹ��岿������ģ�͵Ķ����ƶ��ƶϺ�������

In this paper, the semiparametric generalized partially linear models (GPLMs) for longitudinal data is studied. We approximate the nonparametric function in the GPLMs by a regression spline, and use quadratic inference functions (QIF) to take the within-cluster correlation into account without involving direct estimation of nuisance parameters in the correlation matrix. We establish the asymptotic normality of the resulting estimators. The finite sample performance of the proposed methods is evaluated through simulation studies and a real data analysis.     

含测量误差的部分线性模型的发散参数估计(英文)

本文考虑了部分线性模型中,线性部分协变量含有测量误差,并且线性部分的参数随着样本量的增大而发散的估计问题.我们考虑了用可观测的替代变量来替代不可观察到的真实变量,这种替代变量的期望与真实变量存在线性关系.我们提出了估计方法,并研究了估计量的相合性与渐进正态性.此外,我们研究了发散参数的发散速度.我们通过模拟来说明该估计的实际效果.     

带有不可忽略缺失数据的广义部分线性模型的贝叶斯分析

广义部分线性模型是广义线性模型和部分线性模型的推广,是一种应用广泛的半参数模型.本文讨论的是该模型在线性协变量和响应变量均存在非随机缺失数据情形下参数的Bayes估计和基于Bayes因子的模型选择问题,在分析过程中,采用了惩罚样条来估计模型中的非参数成分,并建立了Bayes层次模型;为了解决Gibbs抽样过程中因参数高度相关带来的混合性差以及因维数增加导致出现不稳定性的问题,引入了潜变量做为添加数据并应用了压缩Gibbs抽样方法,改进了收敛性;同时,为了避免计算多重积分,利用了M-H算法估计边缘密度函数后计算Bayes因子,为模型的选择比较提供了一种准则.最后,通过模拟和实例验证了所给方法的有效性.     

Penalized Estimation in Large-Scale Generalized Linear Array Models

Large-scale generalized linear array models (GLAMs) can be challenging to fit. Computation and storage of its tensor product design matrix can be impossible due to time and memory constraints, and previously considered design matrix free algorithms do not scale well with the dimension of the parameter vector. A new design matrix free algorithm is proposed for computing the penalized maximum likelihood estimate for GLAMs, which, in particular, handles nondifferentiable penalty functions. The proposed algorithm is implemented and available via the R package glamlasso. It combines several ideas—previously considered separately—to obtain sparse estimates while at the same time efficiently exploiting the GLAM structure. In this article, the convergence of the algorithm is treated and the performance of its implementation is investigated and compared to that of glmnet on simulated as well as real data. It is shown that the computation time for glamlasso scales favorably with the size of the problem when compared to glmnet. Supplementary materials, in the form of R code, data and visualizations of results, are available online.     

对于部分线性模型的乘积调整半参估计

本文使用一种带有乘积调整的半参方法估计部分线性模型的非参数部分并给出所得估计的渐近性质。与传统的非参估计方法相比,我们所使用的半参数方法能够有效的降低所得估计的偏差,而方差不受影响。因此在积分均方误差(MISE)的意义下,该半参数方法要优于传统的估计方法。数值模拟也表明了这一点.     

广义线性模型中极大拟似然估计的强收敛速度

在sup_{i ≥1}E||y_i||^2+α < ∞(对某个α > 0)和其它正则条件下, 证明了一般联系函数的多维广义线性模型拟似然估计的强相合性, 并得到了强收敛速度, 其中 y_i 是响应变量. 此结果是对文献中相应结果的改进.     

Covariate Selection in High-Dimensional Generalized Linear Models With Measurement Error

In many problems involving generalized linear models, the covariates are subject to measurement error. When the number of covariates p exceeds the sample size n, regularized methods like the lasso or Dantzig selector are required. Several recent papers have studied methods which correct for measurement error in the lasso or Dantzig selector for linear models in the p > n setting. We study a correction for generalized linear models, based on Rosenbaum and Tsybakov’s matrix uncertainty selector. By not requiring an estimate of the measurement error covariance matrix, this generalized matrix uncertainty selector has a great practical advantage in problems involving high-dimensional data. We further derive an alternative method based on the lasso, and develop efficient algorithms for both methods. In our simulation studies of logistic and Poisson regression with measurement error, the proposed methods outperform the standard lasso and Dantzig selector with respect to covariate selection, by reducing the number of false positives considerably. We also consider classification of patients on the basis of gene expression data with noisy measurements. Supplementary materials for this article are available online.     

检验两个部分线性模型中非参函数相等

We propose the test statistic to check whether the nonparametric func-tions in two partially linear models are equality or not in this paper. We estimate the nonparametric function both in null hypothesis and the alternative by the local linear method, where we ignore the parametric components, and then estimate the parameters by the two stage method. The test statistic is derived, and it is shown to be asymptotically normal under the null hypothesis.