鞅差误差序列下半参数EV回归模型的近邻估计

本文研究了误差为鞅差序列的条件下的一维半参数EV回归模型.利用两步估计的方法构造了参数分量和非参数分量的近邻估计,并且分别证明了估计量的L2相合性和强相合性,从而推广了在普通半参数回归模型已有的相关结论.     

弱误差结构下非参数,半参数回归模型

在弱误差结构下，该文获得了一类非参数模型回归函数估计量的强一致相合性，进而获得了一类半参数模型的参数分量估计的强相合性．     

部分线性变系数模型改进的加权混合Profile-Liu估计

研究半参数部分线性变系数模型的有偏估计,当回归模型参数部分自变量存在多重共线性时,在随机线性约束条件下,融合Profile最小二乘估计、加权混合估计和Liu估计构造回归模型参数分量改进的加权混合Profile-Liu估计,并在一定正则条件下证明估计量的渐近性质,最后利用蒙特卡洛数值模拟验证所提出估计量的有限样本表现性.     

纵向数据下半参数回归模型估计的收敛速度

考虑纵向数据下半参数回归模型:yij=x′ijβ+g(tij)+eij,i=1,…,n,j=1,…,mi.基于最小二乘法和一般的非参数权函数方法给出了模型中参数β和回归函数g(·)的估计,并在适当条件下证明了参数分量β的估计量的强收敛速度和未知函数g(·)的估计量的一致强收敛速度.     

可加模型的两阶段局部M-估计

研究了可加模型分量回归函数的局部M-估计, 针对分量回归函数及其导数提出了两阶段局部M-估计的方法. 在较广泛的条件下建立了估计量的渐近正态性理论, 估计量具有先知性质(oracle property), 即在估计某一分量回归函数时,其他分量回归函数是否已知不影响估计量的渐近性质. 渐近理论包括了两类常用的估计量,即最小二乘估计和最小一乘估计. 当ψ是连续的且是非线性时,估计量的实施非常耗时,为了减轻计算的负担, 提出了一步局部M-估计量, 并证明了在初始估计量足够好的情形下, 一步局部M-估计量与完全迭代所得到的估计量具有相同的渐近估计效率, 这使得两阶段局部M-估计的方法较为实用. 两阶段局部M-估计量继承了局部多项式估计的优点, 同时克服了其在最小二乘准则下不稳健的缺点. 另外, 还讨论了估计方法实施方面的细节及有关参数的选择方法. 数值模拟结果及实际例子说明了两阶段局部M-估计方法的优点及实用性.     

半相依部分线性可加回归模型的统计推断

受实际问题研究的启发, 为减少模型偏差, 提出了一类半相依部分线性可加的半参数回归模型. 这类半相依模型中, 响应变量与 一部分解释变量之间的关系是线性的, 与另一部分解释变量之间的关系未知但具有可加结构, 各方程的误差之间是相关的. 将级 数逼近法、最小二乘法和同期相关的估计结合起来, 提出了用于估计模型参数分量的加权半参数最小二乘估计量(WSLSEs), 和用于估 计模型非参数分量的加权级数逼近估计量(WSEs). 证明了这些加权的估计量比相应的不加权的估计量渐近有效, 并导出了相应的渐近正态性. 另外, 还讨论了利用这些估计量的渐近性质来对模型的参数及非参数分量作统计推断. 用大量的模拟实验考察 了所提出的方法在有限样本情况下的表现, 并对美国的一个关于妇女工资问题的全国纵向调查(NLS)数据集进行了统计分析.     

一类非参数回归模型核估计的渐近性质

研究一类新的非参数回归模型回归函数的核估计问题,其中误差项为一阶非参数自回归方程.通过重复利用Watson-Nadaraya核估计方法,构造了回归函数及误差回归函数的估计量分别为m(.)和ρ(.),在适当的条件下,证明了估计量m(.)和ρ(.)的渐近正态性.     

部分线性模型的随机约束岭估计

研究了部分线性回归模型附加有随机约束条件时的估计问题.基于Profile最小二乘方法和混合估计方法提出了参数分量随机约束下的Profile混合估计,并研究了其性质.为了克服共线性问题,构造了参数分量的Profile混合岭估计,并给出了估计量的偏和方差.     

协变量缺失情形下的逆概率加权众数回归估计

数据缺失在实际应用中普遍存在,数据缺失会降低研究效率,导致参数估计有偏.在协变量随机缺失(MAR)的假定下,本文基于众数回归和逆概率加权估计方法对线性模型进行参数估计.该方法结合参数Logistic回归和非参数Nadaraya-Watson估计两种倾向得分估计方法,分别构建IPWM-L估计量和IPWM-NW估计量.模拟研究和实例分析表明,众数回归模型比均值回归模型更具稳健性,逆概率加权众数(IPWM)估计方法在缺失数据下表现出了更好的拟合效果,与IPWM-L估计量相比, IPWM-NW估计量更稳健.     

多类型复发间隔时间下广义半参数风险模型

本文在多类型复发间隔时间数据下,研究了一类广义半参数风险回归模型的参数估计问题,给出了该模型中未知参数和非参数函数的一种估计方法,并证明了估计量的相合性和渐近正态性.最后利用数值模拟来评估估计量在有限样本下的表现.     

Asymptotic properties of Lasso in high-dimensional partially linear models

We study the properties of the Lasso in the high-dimensional partially linear model where the number of variables in the linear part can be greater than the sample size. We use truncated series expansion based on polynomial splines to approximate the nonparametric component in this model. Under a sparsity assumption on the regression coefficients of the linear component and some regularity conditions, we derive the oracle inequalities for the prediction risk and the estimation error. We also provide sufficient conditions under which the Lasso estimator is selection consistent for the variables in the linear part of the model. In addition, we derive the rate of convergence of the estimator of the nonparametric function. We conduct simulation studies to evaluate the finite sample performance of variable selection and nonparametric function estimation.     

Bernstein Polynomial Estimation in the Partially Linear Model under Monotonicity Constraints

In this paper, a Bernstein-polynomial-based likelihood method is proposed for the partially linear model under monotonicity constraints. Monotone Bernstein polynomials are employed to approximate the monotone nonparametric function in the model. The estimator of the regression parameter is shown to be asymptotically normal and efficient, and the rate of convergence of the estimator of the nonparametric component is established, which could be the optimal under the smooth assumptions. A simulation study and a real data analysis are conducted to evaluate the finite sample performance of the proposed method.     

Spline-based sieve maximum likelihood estimation in the partly linear model under monotonicity constraints

We study a spline-based likelihood method for the partly linear model with monotonicity constraints. We use monotone B-splines to approximate the monotone nonparametric function and apply the generalized Rosen algorithm to compute the estimators jointly. We show that the spline estimator of the nonparametric component achieves the possible optimal rate of convergence under the smooth assumption and that the estimator of the regression parameter is asymptotically normal and efficient. Moreover, a spline-based semiparametric likelihood ratio test is established to make inference of the regression parameter. Also an observed profile information method to consistently estimate the standard error of the spline estimator of the regression parameter is proposed. A simulation study is conducted to evaluate the finite sample performance of the proposed method. The method is illustrated by an air pollution study.     

Censored multiple regression by the method of average derivatives

This paper proposes a technique [termed censored average derivative estimation (CADE)] for studying estimation of the unknown regression function in nonparametric censored regression models with randomly censored samples. The CADE procedure involves three stages: firstly-transform the censored data into synthetic data or pseudo-responses using the inverse probability censoring weighted (IPCW) technique, secondly estimate the average derivatives of the regression function, and finally approximate the unknown regression function by an estimator of univariate regression using techniques for one-dimensional nonparametric censored regression. The CADE provides an easily implemented methodology for modelling the association between the response and a set of predictor variables when data are randomly censored. It also provides a technique for “dimension reduction” in nonparametric censored regression models. The average derivative estimator is shown to be root-n consistent and asymptotically normal. The estimator of the unknown regression function is a local linear kernel regression estimator and is shown to converge at the optimal one-dimensional nonparametric rate. Monte Carlo experiments show that the proposed estimators work quite well.     

一类纵向数据半参数模型估计的收敛速度

本文研究了一类纵向数据半参数模型参数和回归函数的估计问题.利用最小二乘法和一般的非参数权函数方法,获得了参数估计量的强收敛速度和回归函数估计量的一致收敛速度,推广了文献[4]的相应结果.     

Modal Regression Based on Nonparametric Quantile Estimator

Modal regression based on nonparametric quantile estimator is given. Unlike the traditional mean and median regression, modal regression uses mode but not mean or median to represent the center of a conditional distribution, which helps the model to be more robust for outliers, asymmetric or heavy-taileddistribution. Most of solutions for modal regression are based on kernel estimation of density. This paper studies a new solution for modal regression by means of nonparametric quantile estimator. This method builds on the fact that the distribution function is the inverse of the quantile function, then the flexibility of nonparametric quantile estimator is utilized to improve the estimation of modal function. The simulations and application show that the new model outperforms the modal regression model via linear quantile function estimation.     

Statistical inference of partially linear regression models with heteroscedastic errors

The authors study a heteroscedastic partially linear regression model and develop an inferential procedure for it. This includes a test of heteroscedasticity, a two-step estimator of the heteroscedastic variance function, semiparametric generalized least-squares estimators of the parametric and nonparametric components of the model, and a bootstrap goodness of fit test to see whether the nonparametric component can be parametrized.     

Optimal global rate of convergence in nonparametric regression with left-truncated and right-censored data

In this paper we consider nonparametric regression with left-truncated and right-censored data. An estimator of the regression function is developed when censoring and truncation are independent of covariates and the response. The estimation is based on the product limit estimator of the response variable. Under certain conditions, the L₂ rate of convergence of the estimated regression function is obtained when tensor products of B-splines are used.     

Wavelet regression estimation in nonparametric mixed effect models

We show that a nonparametric estimator of a regression function, obtained as solution of a specific regularization problem is the best linear unbiased predictor in some nonparametric mixed effect model. Since this estimator is intractable from a numerical point of view, we propose a tight approximation of it easy and fast to implement. This second estimator achieves the usual optimal rate of convergence of the mean integrated squared error over a Sobolev class both for equispaced and nonequispaced design. Numerical experiments are presented both on simulated and ERP real data.     

Efficient estimation of a varying-coefficient partially linear binary regression model

This article considers a semiparametric varying-coefficient partially linear binary regression model. The semiparametric varying-coefficient partially linear regression binary model which is a generalization of binary regression model and varying-coefficient regression model that allows one to explore the possibly nonlinear effect of a certain covariate on the response variable. A Sieve maximum likelihood estimation method is proposed and the asymptotic properties of the proposed estimators are discussed. One of our main objects is to estimate nonparametric component and the unknowen parameters simultaneously. It is easier to compute, and the required computation burden is much less than that of the existing two-stage estimation method. Under some mild conditions, the estimators are shown to be strongly consistent. The convergence rate of the estimator for the unknown smooth function is obtained, and the estimator for the unknown parameter is shown to be asymptotically efficient and normally distributed. Simulation studies are carried out to investigate the performance of the proposed method.