纵向数据半参数回归模型的最小二乘局部线性估计

本文考虑纵向数据半参数回归模型:Yij=XiTjβ+g(Tij)+iεj,基于最小二乘法和局部线性拟合的方法建立了模型中参数分量β,回归函数g(.)和误差方差σ2的估计,在适当条件下给出了估计量的相合性,通过模拟研究说明了该方法在有限样本情况下具有良好的性质。     

部分线性模型的随机约束岭估计

研究了部分线性回归模型附加有随机约束条件时的估计问题.基于Profile最小二乘方法和混合估计方法提出了参数分量随机约束下的Profile混合估计,并研究了其性质.为了克服共线性问题,构造了参数分量的Profile混合岭估计,并给出了估计量的偏和方差.     

非参数异方差回归模型的局部多项式估计——基于农村居民消费与收入的实证分析

本文主要研究非参数异方差回归模型的局部多项式估计问题.首先利用局部线性逼近的技巧,得到了回归均值函数的局部极大似然估计.然后,考虑到回归方差函数的非负性,利用局部对数多项式拟合,得到了方差函数的局部多项式估计,保证了估计量的非负性,并证明了估计量的渐近性质.最后,通过对农村居民消费与收入的实证研究,说明了非参数异方差回归模型的局部多项式方法比普通最小二乘估计法的拟合效果更好,并且预测的精度更高.     

部分线性变系数模型改进的加权混合Profile-Liu估计

研究半参数部分线性变系数模型的有偏估计,当回归模型参数部分自变量存在多重共线性时,在随机线性约束条件下,融合Profile最小二乘估计、加权混合估计和Liu估计构造回归模型参数分量改进的加权混合Profile-Liu估计,并在一定正则条件下证明估计量的渐近性质,最后利用蒙特卡洛数值模拟验证所提出估计量的有限样本表现性.     

变系数部分线性模型的加权随机约束s-K估计

研究随机约束条件下半参数变系数部分线性模型的参数估计问题,当回归模型线性部分变量存在多重共线性时,基于Profile最小二乘方法、s-K估计和加权混合估计构造参数向量的加权随机约束s-K估计,并在均方误差矩阵准则下给出新估计量优于s-K估计和加权混合估计的充要条件,最后通过蒙特卡洛数值模拟验证所提出估计量的有限样本性质.     

半参数可加模型的广义Liu估计

作为部分线性模型和可加模型的推广,半参数可加模型在统计建模中应用广泛.考虑这类半参数模型在线性部分自变量存在共线性时的估计问题.基于Profile最小二乘方法,提出了参数分量的广义Profile-Liu估计,并给出了该估计量的偏和方差以及均方误差.最后利用数值模拟验证了所提方法的有效性.     

局部平稳扩散模型中时变参数的加权最小二乘估计

基于离散观测样本,利用局部线性拟合,得到了局部平稳扩散模型中时变漂移参数的加权最小二乘估计,并讨论了估计量的相合性,渐近正态性和一致收敛速度.同时,通过模拟研究说明了估计量的有效性.     

一类纵向数据半参数模型中的强相合估计

本文考虑如下纵向数据半参数回归模型:y_(ij)=x′_(ij)β+g(x_(ij))+e_(ij).结合最小二乘法和非参数权函数估计方法得到模型中参数β,回归函数g(·)的估计,并在适当条件下证明了估计量的强相合性.     

基于半参数可加自回归模型的黄金价格实证分析

大量实证研究表明,半参数自回归模型较传统的线性回归而言,能更好的拟合实际数据。本文构造了一类半参数可加自回归模型,基于条件最小二乘方法及核估计方法给出了估计模型参数和未知函数的迭代算法,讨论了估计量的渐近性质。通过数值模拟验证了估计的效果。并将模型应用于黄金价格数据的实证分析之中。实证分析结果表明,我们对现有模型的改进是必要的。     

一个有效估计:半参数非时齐扩散模型的局部线性复合分位回归估计

主要研究半参数非时齐扩散模型的参数估计问题.基于非时齐扩散模型的离散观测样本,首先得到漂移参数的局部线性复合分位回归估计,并证明估计量的渐近偏差、渐近方差和渐近正态性.其次,讨论了带宽的选择和局部线性复合分位回归估计关于局部线性最小二乘估计的渐近相对效,所得到的局部估计较局部线性最小二乘估计更为有效.最后,通过模拟说明了局部线性复合分位回归估计比局部线性最小二乘估计的模拟效果更好.     

Multivariate Locally Weighted Polynomial Fitting and Partial Derivative Estimation

Nonparametric regression estimator based on locally weighted least squares fitting has been studied by Fan and Ruppert and Wand. The latter paper also studies, in the univariate case, nonparametric derivative estimators given by a locally weighted polynomial fitting. Compared with traditional kernel estimators, these estimators are often of simpler form and possess some better properties. In this paper, we develop current work on locally weighted regression and generalize locally weighted polynomial fitting to the estimation of partial derivatives in a multivariate regression context. Specifically, for both the regression and partial derivative estimators we prove joint asymptotic normality and derive explicit asymptotic expansions for their conditional bias and conditional convariance matrix (given observations of predictor variables) in each of the two important cases of local linear fit and local quadratic fit.     

ASYMPTOTIC PROPERTIES OF ESTIMATORS IN PARTIALLY LINEAR SINGLE-INDEX MODEL FOR LONGITUDINAL DATA

In this article, a partially linear single-index model /or longitudinal data is investigated. The generalized penalized spline least squares estimates of the unknown parameters are suggested. All parameters can be estimated simultaneously by the proposed method while the feature of longitudinal data is considered. The existence, strong consistency and asymptotic normality of the estimators are proved under suitable conditions. A simulation study is conducted to investigate the finite sample performance of the proposed method. Our approach can also be used to study the pure single-index model for longitudinal data.     

Trajectory fitting estimators for SPDEs driven by additive noise

In this paper we study the problem of estimating the drift/viscosity coefficient for a large class of linear, parabolic stochastic partial differential equations (SPDEs) driven by an additive space-time noise. We propose a new class of estimators, called trajectory fitting estimators (TFEs). The estimators are constructed by fitting the observed trajectory with an artificial one, and can be viewed as an analog to the classical least squares estimators from the time-series analysis. As in the existing literature on statistical inference for SPDEs, we take a spectral approach, and assume that we observe the first N Fourier modes of the solution, and we study the consistency and the asymptotic normality of the TFE, as \(N\rightarrow \infty \).     

缺失数据下部分非线性变系数EV模型的统计推断

该文研究了响应变量缺失下半参数部分非线性变系数EV模型的统计推断问题,利用逆概率加权局部纠偏profile最小二乘法构造了模型中非参数分量和参数分量的估计,证明了估计量的渐近正态性.通过数值模拟和实际数据分析,验证了所提出的估计方法是有效的.     

Robust estimation for varying index coefficient models

Varying index coefficient models (VICMs) proposed by Ma and Song (J Am Stat Assoc, 2014. doi: 10.1080/01621459.2014.903185) are a new class of semiparametric models, which encompass most of the existing semiparametric models. So far, only the profile least squares method and local linear fitting were developed for the VICM, which are very sensitive to the outliers and will lose efficiency for the heavy tailed error distributions. In this paper, we propose an efficient and robust estimation procedure for the VICM based on modal regression which depends on a bandwidth. We establish the consistency and asymptotic normality of proposed estimators for index coefficients by utilizing profile spline modal regression method. The oracle property of estimators for the nonparametric functions is also established by utilizing a two-step spline backfitted local linear modal regression approach. In addition, we discuss the bandwidth selection for achieving better robustness and efficiency and propose a modified expectation–maximization-type algorithm for the proposed estimation procedure. Finally, simulation studies and a real data analysis are carried out to assess the finite sample performance of the proposed method.     

A Two-Step Smoothing Method for Varying-Coefficient Models with Repeated Measurements

Datasets involving repeated measurements over time are common in medical trials and epidemiological cohort studies. The outcomes and covariates are usually observed from randomly selected subjects, each at a set of possibly unequally spaced time design points. One useful approach for evaluating the effects of covariates is to consider linear models at a specific time, but the coefficients are smooth curves over time. We show that kernel estimators of the coefficients that are based on ordinary local least squares may be subject to large biases when the covariates are time-dependent. As a modification, we propose a two-step kernel method that first centers the covariates and then estimates the curves based on some local least squares criteria and the centered covariates. The practical superiority of the two-step kernel method over the ordinary least squares kernel method is shown through a fetal growth study and simulations. Theoretical properties of both the two-step and ordinary least squares kernel estimators are developed through their large sample mean squared risks.     

Bias-corrected statistical inference for partially linear varying coefficient errors-in-variables models with restricted condition

In this paper, we consider the statistical inference for the partially liner varying coefficient model with measurement error in the nonparametric part when some prior information about the parametric part is available. The prior information is expressed in the form of exact linear restrictions. Two types of local bias-corrected restricted profile least squares estimators of the parametric component and nonparametric component are conducted, and their asymptotic properties are also studied under some regularity conditions. Moreover, we compare the efficiency of the two kinds of parameter estimators under the criterion of Lo?ner ordering. Finally, we develop a linear hypothesis test for the parametric component. Some simulation studies are conducted to examine the finite sample performance for the proposed method. A real dataset is analyzed for illustration.     

Robust Frequency Estimation Using Elemental Sets

Abstract

The extraction of sinusoidal signals from time-series data is a classic problem of ongoing interest in the statistics and signal processing literatures. Obtaining least squares estimates is difficult because the sum of squares has local minima O(1/n) apart in the frequencies. In practice the frequencies are often estimated using ad hoc and inefficient methods. Problems of data quality have received little attention. An elemental set is a subset of the data containing the minimum number of points such that the unknown parameters in the model can be identified. This article shows that, using a variant of the classical method of Prony, parameter estimates for a sum of sinusoids can be obtained algebraically from an elemental set. Elemental set methods are used to construct finite algorithm estimators that approximately minimize the least squares, least trimmed sum of squares, or least median of squares criteria. The elemental set estimators prove able in simulations to resolve the frequencies to the correct local minima of the objective functions. When used as the first stage of an MM estimator, the constructed estimators based on the trimmed sum of squares and least median of squares criteria produce final estimators which have high breakdown properties and which are simultaneously efficient when no outliers are present. The approach can also be applied to sums of exponentials, and sums of damped sinusoids. The article includes simulations with one and two sinusoids and two data examples.