Efficiency of a Liu-type estimator in semiparametric regression models

In this paper we consider the semiparametric regression model, y=Xβ+f+ε. Recently, Hu [11] proposed ridge regression estimator in a semiparametric regression model. We introduce a Liu-type (combined ridge-Stein) estimator (LTE) in a semiparametric regression model. Firstly, Liu-type estimators of both β and f are attained without a restrained design matrix. Secondly, the LTE estimator of β is compared with the two-step estimator in terms of the mean square error. We describe the almost unbiased Liu-type estimator in semiparametric regression models. The almost unbiased Liu-type estimator is compared with the Liu-type estimator in terms of the mean squared error matrix. A numerical example is provided to show the performance of the estimators.     

Nonparametric and semiparametric optimal transformations of markers

The receiver operating characteristic (ROC) curve of a likelihood-ratio function has been shown to be the highest among all transformations of continuous markers. For any sampling scheme with the same likelihoods, the induced conditional probability is derived to have the same ROC curve and is found to be more useful for inference purposes. To compromise the difficult task of high-dimensionality in fully nonparametric models and the risk of model misspecification in fully parametric ones, an appealing single-index model is also adopted in our optimization problem. Based on a nonparametric estimator of the area under the ROC curve (AUC), we develop its related inferences and provide some simple and easily checked conditions for the validity of asymptotic results. Since the optimal marker is estimated by using a semiparametric or nonparametric model, conventional theoretical approaches might be inappropriate to some circumstances. The applicability of our procedures are further demonstrated through extensive numerical experiments and data from the studies of Pima-Indian diabetes and liver disorders.     

Asymptotic normality and Berry-Esseen results for conditional density estimator with censored and dependent data

In this paper we derive the asymptotic normality and a Berry-Esseen type bound for the kernel conditional density estimator proposed in Ould-Saïd and Cai (2005) [26] when the censored observations with multivariate covariates form a stationary α-mixing sequence.     

Difference based ridge and Liu type estimators in semiparametric regression models

We consider a difference based ridge regression estimator and a Liu type estimator of the regression parameters in the partial linear semiparametric regression model, y=Xβ+f+ε. Both estimators are analyzed and compared in the sense of mean-squared error. We consider the case of independent errors with equal variance and give conditions under which the proposed estimators are superior to the unbiased difference based estimation technique. We extend the results to account for heteroscedasticity and autocovariance in the error terms. Finally, we illustrate the performance of these estimators with an application to the determinants of electricity consumption in Germany.     

Rates of convergence for partitioning and nearest neighbor regression estimates with unbounded data

Estimation of regression functions from independent and identically distributed data is considered. The L₂ error with integration with respect to the design measure is used as an error criterion. Usually in the analysis of the rate of convergence of estimates besides smoothness assumptions on the regression function and moment conditions on Y also boundedness assumptions on X are made. In this article we consider partitioning and nearest neighbor estimates and show that by replacing the boundedness assumption on X by a proper moment condition the same rate of convergence can be shown as for bounded data.     

Estimating the support of multivariate densities under measurement error

We consider the problem of estimating the support of a multivariate density based on contaminated data. We introduce an estimator, which achieves consistency under weak conditions on the target density and its support, respecting the assumption of a known error density. Especially, no smoothness or sharpness assumptions are needed for the target density. Furthermore, we derive an iterative and easily computable modification of our estimation and study its rates of convergence in a special case; a numerical simulation is given.     

Asymptotic efficient estimation in semiparametric nonlinear regression models

§１ＩｎｔｒｏｄｕｃｔｉｏｎＣｏｎｓｉｄｅｒｔｈｅｆｉｘｅｄｄｅｓｉｇｎｓｅｍｉｐａｒａｍｅｔｒｉｃｎｏｎｌｉｎｅａｒｒｅｇｒｅｓｓｉｏｎｍｏｄｅｌｓｇｉｖｅｎｂｙｙｉ＝ｆ（ｘｉ,θ）＋λ（ｔｉ）＋εｉ,ｉ＝１,．．．,ｎ,（１）ｗｈｅｒｅｆ（,）ｉ...     

Statistical inference for panel data semiparametric partially linear regression models with heteroscedastic errors

We consider a panel data semiparametric partially linear regression model with an unknown parameter vector for the linear parametric component, an unknown nonparametric function for the nonlinear component, and a one-way error component structure which allows unequal error variances (referred to as heteroscedasticity). We develop procedures to detect heteroscedasticity and one-way error component structure, and propose a weighted semiparametric least squares estimator (WSLSE) of the parametric component in the presence of heteroscedasticity and/or one-way error component structure. This WSLSE is asymptotically more efficient than the usual semiparametric least squares estimator considered in the literature. The asymptotic properties of the WSLSE are derived. The nonparametric component of the model is estimated by the local polynomial method. Some simulations are conducted to demonstrate the finite sample performances of the proposed testing and estimation procedures. An example of application on a set of panel data of medical expenditures in Australia is also illustrated.     

A universal strong law of large numbers for conditional expectations via nearest neighbors

For k_n-nearest neighbor estimates of a regression Y on X (d-dimensional random vector X, integrable real random variable Y) based on observed independent copies of (X,Y), strong universal pointwise consistency is shown, i.e., strong consistency P_X-almost everywhere for general distribution of (X,Y). With tie-breaking by indices, this means validity of a universal strong law of large numbers for conditional expectations E(Y|X=x).     

Limit distribution of the integrated squared error of trigonometric series regression estimator

Limit distribution is studied for the integrated squared error of the projection regression estimator (2) constructed on the basis of independent observations (1). By means of the obtained limit theorems, a test is given for verifying the hypothesis on the regression, and the power of this test is calculated in the case of Pitman alternatives.     

A bivariate histogram density estimator: Consistency and asymptotic normality

This paper presents a nonparametric histogram density estimator based on the spacings of order statistics. This estimator generalizes to the bivariate case the univariate histogram estimator proposed by Van Ryzin (1973). The first of the two theorems in this paper gives conditions under which the estimator is pointwise strongly consistent. The second theorem provides conditions for the asymptotic normality of the estimator for points at which the density function possesses continuous partial derivatives of second order.     

Portfolio value at risk based on independent component analysis

Risk management technology applied to high-dimensional portfolios needs simple and fast methods for calculation of value at risk (VaR). The multivariate normal framework provides a simple off-the-shelf methodology but lacks the heavy-tailed distributional properties that are observed in data. A principle component-based method (tied closely to the elliptical structure of the distribution) is therefore expected to be unsatisfactory. Here, we propose and analyze a technology that is based on independent component analysis (ICA). We study the proposed ICVaR methodology in an extensive simulation study and apply it to a high-dimensional portfolio situation. Our analysis yields very accurate VaRs.     

Boundary kernels for adaptive density estimators on regions with irregular boundaries

In some applications of kernel density estimation the data may have a highly non-uniform distribution and be confined to a compact region. Standard fixed bandwidth density estimates can struggle to cope with the spatially variable smoothing requirements, and will be subject to excessive bias at the boundary of the region. While adaptive kernel estimators can address the first of these issues, the study of boundary kernel methods has been restricted to the fixed bandwidth context. We propose a new linear boundary kernel which reduces the asymptotic order of the bias of an adaptive density estimator at the boundary, and is simple to implement even on an irregular boundary. The properties of this adaptive boundary kernel are examined theoretically. In particular, we demonstrate that the asymptotic performance of the density estimator is maintained when the adaptive bandwidth is defined in terms of a pilot estimate rather than the true underlying density. We examine the performance for finite sample sizes numerically through analysis of simulated and real data sets.     

The multivariate least-trimmed squares estimator

In this paper we introduce the least-trimmed squares estimator for multivariate regression. We give three equivalent formulations of the estimator and obtain its breakdown point. A fast algorithm for its computation is proposed. We prove Fisher-consistency at the multivariate regression model with elliptically symmetric error distribution and derive the influence function. Simulations investigate the finite-sample efficiency and robustness of the estimator. To increase the efficiency of the estimator, we also consider a one-step reweighted estimator.     

Sieve maximum likelihood estimation for doubly semiparametric zero-inflated Poisson models

For nonnegative measurements such as income or sick days, zero counts often have special status. Furthermore, the incidence of zero counts is often greater than expected for the Poisson model. This article considers a doubly semiparametric zero-inflated Poisson model to fit data of this type, which assumes two partially linear link functions in both the mean of the Poisson component and the probability of zero. We study a sieve maximum likelihood estimator for both the regression parameters and the nonparametric functions. We show, under routine conditions, that the estimators are strongly consistent. Moreover, the parameter estimators are asymptotically normal and first order efficient, while the nonparametric components achieve the optimal convergence rates. Simulation studies suggest that the extra flexibility inherent from the doubly semiparametric model is gained with little loss in statistical efficiency. We also illustrate our approach with a dataset from a public health study.     

Scan clustering: A false discovery approach

We present a method that scans a random field for localized clusters while controlling the fraction of false discoveries. We use a kernel density estimator as the test statistic and adjust for the bias in this estimator by a method we introduce in this paper. We also show how to combine information across multiple bandwidths while maintaining false discovery control.     

Nonparametric likelihood based estimation for a multivariate Lipschitz density

We consider a problem of nonparametric density estimation under shape restrictions. We deal with the case where the density belongs to a class of Lipschitz functions. Devroye [L. Devroye, A Course in Density Estimation, in: Progress in Probability and Statistics, vol. 14, Birkhäuser Boston Inc., Boston, MA, 1987] considered these classes of estimates as tailor-made estimates, in contrast in some way to universally consistent estimates. In our framework we get the existence and uniqueness of the maximum likelihood estimate as well as strong consistency. This NPMLE can be easily characterized but it is not easy to compute. Some simpler approximations are also considered.     

A robust and efficient adaptive reweighted estimator of multivariate location and scatter

This article proposes a reweighted estimator of multivariate location and scatter, with weights adaptively computed from the data. Its breakdown point and asymptotic behavior under elliptical distributions are established. This adaptive estimator is able to attain simultaneously the maximum possible breakdown point for affine equivariant estimators and full asymptotic efficiency at the multivariate normal distribution. For the special case of hard-rejection weights and the MCD as initial estimator, it is shown to be more efficient than its non-adaptive counterpart for a broad range of heavy-tailed elliptical distributions. A Monte Carlo study shows that the adaptive estimator is as robust as its non-adaptive relative for several types of bias-inducing contaminations, while it is remarkably more efficient under normality for sample sizes as small as 200.     

On Mardia's and Song's measures of kurtosis in elliptical distributions

The main objective of this paper is the calculation and the comparative study of two general measures of multivariate kurtosis, namely Mardia's measure β_2,p and Song's measure S(f). In this context, general formulas for the said measures are derived for the broad family of the elliptically contoured symmetric distributions and also for specific members of this family, like the multivariate t-distribution, the multivariate Pearson type II, the multivariate Pearson type VII, the multivariate symmetric Kotz type distribution and the uniform distribution in the unit sphere. Analytic expressions for computing Shannon and Rényi entropies are obtained under the elliptic family. The behaviour of Mardia's and Song's measures, their similarities and differences, possible interpretations and uses in practice are investigated by comparing them in specific members of the elliptic family of multivariate distributions. An empirical estimator of Song's measure is moreover proposed and its asymptotic distribution is investigated under the elliptic family of multivariate distributions.