元回归模型中最大值点的BRPA估计的收敛速度

BRPA估计是Changchien (1990)提出的一种具有良好性质的回归函数最大值点的估计, Chen, Huang and Huang (1996), Bai and Huang (1999), 吴and王(2000)和Bai, Chen and Wu (2003)分别讨论了BRPA的极限性质\bd 本篇文章中, 我们在很一般的条件下研究了$x$为多维向量时BRPA估计的收敛速度, 推广了Bai, Chen and Wu (2003)的结果     

On the distribution of penalized maximum likelihood estimators: The LASSO, SCAD, and thresholding

We study the distributions of the LASSO, SCAD, and thresholding estimators, in finite samples and in the large-sample limit. The asymptotic distributions are derived for both the case where the estimators are tuned to perform consistent model selection and for the case where the estimators are tuned to perform conservative model selection. Our findings complement those of Knight and Fu [K. Knight, W. Fu, Asymptotics for lasso-type estimators, Annals of Statistics 28 (2000) 1356–1378] and Fan and Li [J. Fan, R. Li, Variable selection via non-concave penalized likelihood and its oracle properties, Journal of the American Statistical Association 96 (2001) 1348–1360]. We show that the distributions are typically highly non-normal regardless of how the estimator is tuned, and that this property persists in large samples. The uniform convergence rate of these estimators is also obtained, and is shown to be slower than n^−1/2 in case the estimator is tuned to perform consistent model selection. An impossibility result regarding estimation of the estimators’ distribution function is also provided.     

Rate optimal estimation with the integration method in the presence of many covariates

For multivariate regressors, integrating the Nadaraya–Watson regression smoother produces estimators of the lower-dimensional marginal components that are asymptotically normally distributed, at the optimal rate of convergence. Some heuristics, based on consistency of the pilot estimator, suggested that the estimator would not converge at the optimal rate of convergence in the presence of more than four covariates. This paper shows first that marginal integration with its internally normalized counterpart leads to rate-optimal estimators of the marginal components. We introduce the necessary modifications and give central limit theorems. Then, it is shown that the method apply also to more general models, in particular we discuss feasible estimation of partial linear models. The proofs reveal that the pilot estimator shall over-smooth the variables to be integrated, and, that the resulting estimator is itself a lower-dimensional regression smoother. Hence, finite sample properties of the estimator are comparable to those of low-dimensional nonparametric regression. Further advantages when starting with the internally normalized pilot estimator are its computational attractiveness and better performance (compared to its classical counterpart) when the covatiates are correlated and nonuniformly distributed. Simulation studies underline the excellent performance in comparison with so far known methods.     

A stochastic restricted ridge regression estimator

Groß [J. Groß, Restricted ridge estimation, Statistics & Probability Letters 65 (2003) 57–64] proposed a restricted ridge regression estimator when exact restrictions are assumed to hold. When there are stochastic linear restrictions on the parameter vector, we introduce a new estimator by combining ideas underlying the mixed and the ridge regression estimators under the assumption that the errors are not independent and identically distributed. Apart from [J. Groß, Restricted ridge estimation, Statistics & Probability Letters 65 (2003) 57–64], we call this new estimator as the stochastic restricted ridge regression (SRRR) estimator. The performance of the SRRR estimator over the mixed estimator in respect of the variance and the mean square error matrices is examined. We also illustrate our findings with a numerical example. The shrinkage generalized least squares (GLS) and the stochastic restricted shrinkage GLS estimators are proposed.     

On the estimation of entropy

Motivated by recent work of Joe (1989,Ann. Inst. Statist. Math.,41, 683–697), we introduce estimators of entropy and describe their properties. We study the effects of tail behaviour, distribution smoothness and dimensionality on convergence properties. In particular, we argue that root-n consistency of entropy estimation requires appropriate assumptions about each of these three features. Our estimators are different from Joe's, and may be computed without numerical integration, but it can be shown that the same interaction of tail behaviour, smoothness and dimensionality also determines the convergence rate of Joe's estimator. We study both histogram and kernel estimators of entropy, and in each case suggest empirical methods for choosing the smoothing parameter.     

Adaptive Semiparametric Estimation of the Memory Parameter

In Giraitis, Robinson, and Samarov (1997), we have shown that the optimal rate for memory parameter estimators in semiparametric long memory models with degree of “local smoothness” β is n^−r(β), r(β)=β/(2β+1), and that a log-periodogram regression estimator (a modified Geweke and Porter-Hudak (1983) estimator) with maximum frequency m=m(β)n^2r(β) is rate optimal. The question which we address in this paper is what is the best obtainable rate when β is unknown, so that estimators cannot depend on β. We obtain a lower bound for the asymptotic quadratic risk of any such adaptive estimator, which turns out to be larger than the optimal nonadaptive rate n^−r(β) by a logarithmic factor. We then consider a modified log-periodogram regression estimator based on tapered data and with a data-dependent maximum frequency m=m(β), which depends on an adaptively chosen estimator β of β, and show, using methods proposed by Lepskii (1990) in another context, that this estimator attains the lower bound up to a logarithmic factor. On one hand, this means that this estimator has nearly optimal rate among all adaptive (free from β) estimators, and, on the other hand, it shows near optimality of our data-dependent choice of the rate of the maximum frequency for the modified log-periodogram regression estimator. The proofs contain results which are also of independent interest: one result shows that data tapering gives a significant improvement in asymptotic properties of covariances of discrete Fourier transforms of long memory time series, while another gives an exponential inequality for the modified log-periodogram regression estimator.     

A sequence of improvements over the James-Stein estimator

In this article, we consider the problem of estimating a p-variate (p ≥ 3) normal mean vector in a decision-theoretic setup. Using a simple property of the noncentral chi-square distribution, we have produced a sequence of smooth estimators dominating the James-Stein estimator and each improved estimator is better than the previous one. It is also shown by using a technique of [5]. J. Multivariate Anal.36 121–126) that our smooth estimators can be dominated by non-smooth estimators.     

Estimation of the ratio of the scale parameters of two exponential distributions with unknown location parameters

We consider the estimation of the ratio of the scale parameters of two independent two-parameter exponential distributions with unknown location parameters. It is shown that the best affine equivariant estimator (BAEE) is inadmissible under any loss function from a large class of bowl-shaped loss functions. Two new classes of improved estimators are obtained. Some values of the risk functions of the BAEE and two improved estimators are evaluated for two particular loss functions. Our results are parallel to those of Zidek (1973, Ann. Statist., 1, 264–278), who derived a class of estimators that dominate the BAEE of the scale parameter of a two-parameter exponential distribution.     

纵向数据下半参数回归模型估计的收敛速度

考虑纵向数据下半参数回归模型:yij=x′ijβ+g(tij)+eij,i=1,…,n,j=1,…,mi.基于最小二乘法和一般的非参数权函数方法给出了模型中参数β和回归函数g(·)的估计,并在适当条件下证明了参数分量β的估计量的强收敛速度和未知函数g(·)的估计量的一致强收敛速度.     

On Adaptive Combination of Regression Estimators

Consider the problem of choosing between two estimators of the regression function, where one estimator is based on stronger assumptions than the other and thus the rates of convergence are different. We propose a linear combination of the estimators where the weights are estimated by Mallows' C _L . The adaptive estimator retains the optimal rates of convergence and is an extension of Stein-type estimators considered by Li and Hwang (1984, Ann. Statist., 12, 887-897) and related to an estimator in Burman and Chaudhuri (1999, Ann. Inst. Statist. Math. (to appear)).     

Robust nonparametric estimators of monotone boundaries

This paper revisits some asymptotic properties of the robust nonparametric estimators of order-m and order-α quantile frontiers and proposes isotonized version of these estimators. Previous convergence properties of the order-m frontier are extended (from weak uniform convergence to complete uniform convergence). Complete uniform convergence of the order-m (and of the quantile order-α) nonparametric estimators to the boundary is also established, for an appropriate choice of m (and of α, respectively) as a function of the sample size. The new isotonized estimators share the asymptotic properties of the original ones and a simulated example shows, as expected, that these new versions are even more robust than the original estimators. The procedure is also illustrated through a real data set.     

r-k Class estimation in regression model with concomitant variables

We treat with the r-k class estimation in a regression model, which includes the ordinary least squares estimator, the ordinary ridge regression estimator and the principal component regression estimator as special cases of the r-k class estimator. Many papers compared total mean square error of these estimators. Sarkar (1989, Ann. Inst. Statist. Math., 41, 717–724) asserts that the results of this comparison are still valid in a misspecified linear model. We point out some confusions of Sarkar and show additional conditions under which his assertion holds.     

纵向数据下半参数回归模型估计的渐近性质

本文考虑纵向数据下半参数回归模型: $y_{ij}=x_{ij}'\beta+g(t_{ij})+e_ij},\;i=1,\cdots,m,\;j=1,\cdots,n_i$. 基于最小二乘法和一般的非参数权函数方法给出了模型中参数$\beta$和回归函数$g(\cdot)$的估计, 并在适当条件下证明了$\beta$估计量的渐近正态性和$g(\cdot)$估计量的最优收敛速度\bd 模拟结果表明我们的估计方法在有限样本情形有良好的效果     

Kernel Density and Hazard Rate Estimation for Censored Data under α-Mixing Condition

We derive rates of uniform strong convergence for kernel density estimators and hazard rate estimators in the presence of right censoring. It is assumed that the failure times (survival times) form a stationary -mixing sequence. Moreover, we show that, by an appropriate choice of the bandwidth, both estimators attain the optimal strong convergence rate known from independent complete samples. The results represent an improvement over that of Cai's paper (cf. Cai (1998b, J. Multivariate Anal., 67, 23–34)).     

Estimating and Visualizing Conditional Densities

Abstract

We consider the kernel estimator of conditional density and derive its asymptotic bias, variance, and mean-square error. Optimal bandwidths (with respect to integrated mean-square error) are found and it is shown that the convergence rate of the density estimator is order n ^–2/3. We also note that the conditional mean function obtained from the estimator is equivalent to a kernel smoother. Given the undesirable bias properties of kernel smoothers, we seek a modified conditional density estimator that has mean equivalent to some other nonparametric regression smoother with better bias properties. It is also shown that our modified estimator has smaller mean square error than the standard estimator in some commonly occurring situations. Finally, three graphical methods for visualizing conditional density estimators are discussed and applied to a data set consisting of maximum daily temperatures in Melbourne, Australia.     

Estimation in Linear Models with Random Effects and Errors-in-Variables

The independent variables of linear mixed models are subject to measurement errors in practice. In this paper, we present a unified method for the estimation in linear mixed models with errors-in-variables, based upon the corrected score function of Nakamura (1990, Biometrika, 77, 127–137). Asymptotic normality properties of the estimators are obtained. The estimators are shown to be consistent and convergent at the order of n ^–1/2. The performance of the proposed method is studied via simulation and the analysis of a data set on hedonic housing prices.     

一类纵向数据半参数模型估计的收敛速度

本文研究了一类纵向数据半参数模型参数和回归函数的估计问题.利用最小二乘法和一般的非参数权函数方法,获得了参数估计量的强收敛速度和回归函数估计量的一致收敛速度,推广了文献[4]的相应结果.     

Probability Density Function Estimation Using Gamma Kernels

We consider estimating density functions which have support on [0, ) using some gamma probability densities as kernels to replace the fixed and symmetric kernel used in the standard kernel density estimator. The gamma kernels are non-negative and have naturally varying shape. The gamma kernel estimators are free of boundary bias, non-negative and achieve the optimal rate of convergence for the mean integrated squared error. The variance of the gamma kernel estimators at a distance x away from the origin is O(n ^–4/5 x ^–1/2) indicating a smaller variance as x increases. Finite sample comparisons with other boundary bias free kernel estimators are made via simulation to evaluate the performance of the gamma kernel estimators.     

Asymptotic expansions and higher order properties of semi-parametric estimators in a system of simultaneous equations

Asymptotic expansions are made for the distributions of the Maximum Empirical Likelihood (MEL) estimator and the Estimating Equation (EE) estimator (or the Generalized Method of Moments (GMM) in econometrics) for the coefficients of a single structural equation in a system of linear simultaneous equations, which corresponds to a reduced rank regression model. The expansions in terms of the sample size, when the non-centrality parameters increase proportionally, are carried out to O(n⁻¹). Comparisons of the distributions of the MEL and GMM estimators are made. Also, we relate the asymptotic expansions of the distributions of the MEL and GMM estimators to the corresponding expansions for the Limited Information Maximum Likelihood (LIML) and the Two-Stage Least Squares (TSLS) estimators. We give useful information on the higher order properties of alternative estimators including the semi-parametric inefficiency factor under the homoscedasticity assumption.     

纵向数据下半参数回归模型的统计分析

对于纵向数据下半参数回归模型,基于广义估计方程和一般权函数方法构造了模型中参数分量和非参数分量的估计.在适当的条件下证明了参数估计量具有渐近正态性,并得到了非参数回归函数估计量的最优收敛速度.通过模拟研究说明了所提出的估计量在有限样本下的精确性.