A Partial Empirical Likelihood Based Score Test Under a Semiparametric Finite Mixture Model

We propose a score statistic to test the null hypothesis that the two-component density functions are equal under a semiparametric finite mixture model. The proposed score test is based on a partial empirical likelihood function under an I-sample semiparametric model. The proposed score statistic has an asymptotic chi-squared distribution under the null hypothesis and an asymptotic noncentral chi-squared distribution under local alternatives to the null hypothesis. Moreover, we show that the proposed score test is asymptotically equivalent to a partial empirical likelihood ratio test and a Wald test. We present some results on a simulation study.     

A bartlett-type adjustment for the likelihood ratio statistic with an ordered alternative

For testing the equality of normal variances with an increasing alternative, under the null hypothesis the likelihood ratio test statistic is asymptotically distributed as a mixture of chi-squared distributions. In this paper a Bartlett-type adjustment is proposed to improve the approximation of the null distribution of the likelihood ratio test statistic with an ordered alternative.     

A novel trace test for the mean parameters in a multivariate growth curve model

A trace test for the mean parameters of the growth curve model is proposed. It is constructed using the restricted maximum likelihood followed by an estimated likelihood ratio approach. The statistic reduces to the Lawley-Hotelling trace test for the Multivariate Analysis of Variance (MANOVA) models. Our test statistic is, therefore, a natural extension of the classical trace test to GMANOVA models. We show that the distribution of the test under the null hypothesis does not depend on the unknown covariance matrix Σ. We also show that the distributions under the null and alternative hypotheses can be represented as sums of weighted central and non-central chi-square random variables, respectively. Under the null hypothesis, the Satterthwaite approximation is used to get an approximate critical point. A novel Satterthwaite type approximation is proposed to obtain an approximate power. A simulation study is performed to evaluate the performance of our proposed test and numerical examples are provided as illustrations.     

Testing for no effect via splines

A spline-based test statistic for a constant mean function is proposed based on the penalized residual sum-of-squares difference between the null model and a B-spline model in which the regression function is approximated with P-splines approach. When the number of knots is fixed, the limiting null distribution of the test statistic is shown to be the distribution of a linear combination of independent chi-squared random variables, each with one degree of freedom. A smoothing parameter is selected by setting a specified value equal to the expected value of the test statistic under the null hypothesis. Simulation experiments are conducted to study the proposed spline-based test statistic’s finite-sample properties.     

The likelihood ratio tests for the dimensionality of regression coefficients

In this paper we give a unified derivation of the likelihood ratio (LR) statistics for testing the hypothesis on the dimensionality of regression coefficients under a usual MANOVA model. We also derive the LR statistics under a general MANOVA model and study their asymptotic null and nonnull distributions. Further it is shown that the test statistic used by Bartlett [4] for testing the hypothesis that the last p?k canonical correlations are all zero is the LR statistic.     

Two step-down tests for equality of covariance matrices

The classical problem of testing the equality of the covariance matrices from k ? 2 p-dimensional normal populations is reexamined. The likelihood ratio (LR) statistic, also called Bartlett’s statistic, can be decomposed in two ways, corresponding to two distinct component-wise decompositions of the null hypothesis in terms of the covariance matrices or precision matrices, respectively. The factors of the LR statistic that appear in these two decompositions can be interpreted as conditional and unconditional LR statistics for the component-wise null hypotheses, and their mutual independence under the null hypothesis allows the determination of the overall significance level.     

Test-Based Variable Selection via Cross-Validation

Abstract

Test-based variable selection algorithms in regression often are based on sequential comparison of test statistics to cutoff values. A predetermined a level typically is used to determine the cutoffs based on an assumed probability distribution for the test statistic. For example, backward elimination or forward stepwise involve comparisons of test statistics to prespecified t or F cutoffs in Gaussian linear regression, while a likelihood ratio. Wald, or score statistic, is typically used with standard normal or chi square cutoffs in nonlinear settings. Although such algorithms enjoy widespread use, their statistical properties are not well understood, either theoretically or empirically. Two inherent problems with these methods are that (1) as in classical hypothesis testing, the value of α is arbitrary, while (2) unlike hypothesis testing, there is no simple analog of type I error rate corresponding to application of the entire algorithm to a data set. In this article we propose a new method, backward elimination via cross-validation (BECV), for test-based variable selection in regression. It is implemented by first finding the empirical p value α*, which minimizes a cross-validation estimate of squared prediction error, then selecting the model by running backward elimination on the entire data set using α* as the nominal p value for each test. We present results of an extensive computer simulation to evaluate BECV and compare its performance to standard backward elimination and forward stepwise selection.     

Hypothesis of multisample sphericity

The hypothesis of multisample sphericity appears in different areas such as repeated measurement designs, checking the validity of F ratios in the analysis of variance problems, and testing circularity. This article deals with the modified likelihood ratio test for testing multisample sphericity, null and nonnull moments, as well as the null and nonnull distributions of the test statistic. Some approximations are also considered.Published in Zapiski Nauchnykh Seminarov Leningradskogo Otdeleniya Matematicheskogo Instituta im. V. A. Steklova AN SSSR, Vol. 136, pp. 153–161, 1984.     

Asymptotics of the goodness-of-fit test for a partial linear model with randomly censored data

In this paper, we discuss the problem of testing the hypothesis that the underlying regression is a partial linear model. A test statistic, which is based on the quadratic form of a cusum process of residuals, is proposed. The asymptotic distributions of the test statistic under null hypothesis and the local alternative hypothesis are given. The number simulation shows that the test is available.     

A test for elliptical symmetry

This paper presents a statistic for testing the hypothesis of elliptical symmetry. The statistic also provides a specialized test of multivariate normality. We obtain the asymptotic distribution of this statistic under the null hypothesis of multivariate normality, and give a bootstrapping procedure for approximating the null distribution of the statistic under an arbitrary elliptically symmetric distribution. We present simulation results to examine the accuracy of the asymptotic distribution and the performance of the bootstrapping procedure. Finally, for selected alternatives, we compare the power of our test statistic with that of recently proposed tests for elliptical symmetry given by Manzotti et al. [A statistic for testing the null hypothesis of elliptical symmetry, J. Multivariate Anal. 81 (2002) 274-285] and Schott [Testing for elliptical symmetry in covariance-matrix-based analyses, Statist. Probab. Lett. 60 (2002) 395-404], and with that of the well known tests for multivariate normality of Mardia [Measures of multivariate skewness and kurtosis with applications, Biometrika 57 (1970) 519-530] and Baringhaus and Henze [A consistent test for multivariate normality based on the empirical characteristic function, Metrika 35 (1988) 339-348].     

Asymptotic tests of composite hypotheses for non-ergodic type stochastic processes

Limiting distributions of a score statistic and the likelihood ratio statistic for testing a composite hypothesis involving several parameters in non-ergodic type stochastic processes are obtained. It is shown that, unlike in the usual theory (ergodic type processes), the limiting distributions of these statistics are different both under the null and a contiguous sequence of alternative hypotheses. The results are applied to a regression model with explosive autoregressive Gaussian errors. In the discussion of this example a modified score statistic is suggested where the limiting null and non-null distributions are the same as those of the likelihood ratio statistic.     

Inference for earthquake models: A self-correcting model

Questions of asymptotic inference are discussed for a point process model in which the conditional intensity function increases monotonically between events and drops by determined (nonrandom) amounts after each event. Parameter estimates are shown to be consistent and, except under the null hypothesis of a Poisson process, normally distributed. Under the null hypothesis, however, the Hessian matrix is not asymptotically constant, and the limiting distribution of the likelihood ratio statistics is not χ², but has a form related to that of the Cramer-von Mises ω² statistic for the test of goodness of fit.     

A test for the presence of stochastic ordering under censoring: the k-sample case

In this paper, we develop an empirical likelihood-based test for the presence of stochastic ordering under censoring in the k-sample case. The proposed test statistic is formed by taking the supremum of localized empirical likelihood ratio test statistics. Its asymptotic null distribution has a simple representation in terms of a standard Brownian motion process. Through simulations, we show that it outperforms in terms of power existing methods for the same problem at all the distributions that we consider. A real-life example is used to illustrate the applicability of this new test.

     

Testing covariates in high-dimensional regression

In a high-dimensional linear regression model, we propose a new procedure for testing statistical significance of a subset of regression coefficients. Specifically, we employ the partial covariances between the response variable and the tested covariates to obtain a test statistic. The resulting test is applicable even if the predictor dimension is much larger than the sample size. Under the null hypothesis, together with boundedness and moment conditions on the predictors, we show that the proposed test statistic is asymptotically standard normal, which is further supported by Monte Carlo experiments. A similar test can be extended to generalized linear models. The practical usefulness of the test is illustrated via an empirical example on paid search advertising.     

The local power of the gradient test

The asymptotic expansion of the distribution of the gradient test statistic is derived for a composite hypothesis under a sequence of Pitman alternative hypotheses converging to the null hypothesis at rate n ^−1/2, n being the sample size. Comparisons of the local powers of the gradient, likelihood ratio, Wald and score tests reveal no uniform superiority property. The power performance of all four criteria in one-parameter exponential family is examined.     

ARCH模型的多变点检验

研究自回归条件异方差(ARCH)模型的多变点检验问题.提出一种拟似然比检验统计量,并在原假设下给出统计量的极限分布.在假设检验过程中得到变点个数的一致估计.数值模拟与实例分析说明了方法的合理性.     

Testing for the change of the mean-reverting parameter of an autoregressive model with stationary Gaussian noise

The likelihood ratio test for a change in the mean-reverting parameter of a first order autoregressive model with stationary Gaussian noise is considered. The test statistic converges in distribution to the Gumbel extreme value distribution under the null hypothesis of no change-point for a large class of covariance structures including long-memory processes as the fractional Gaussian noise.

     

基于因变量抽样设计下线性回归模型的假设检验问题

在许多大型队列研究中,采用节约成本并能提高效率的抽样机制至关重要,基于因变量的抽样设计正是这样一种有偏抽样机制.这种方法最大的优点在于:能够将资源集中在那些包含有更多的协变量与因变量关系信息的研究群体上.本文研究基于因变量抽样设计下的线性模型中回归方程显著性检验以及回归系数显著性检验问题.基于一种半参数经验轮廓似然的方法,我们分别为回归方程检验与回归系数检验提出了相应的检验统计量,获得了所提出检验统计量的渐近性质.通过模拟研究评估了所提出的检验方法在有限样本下的表现,并应用提出的方法分析了一个孕妇分娩的实际数据.     

线性模型中自相关的经验似然比检验

研究线性回归模型中的自相关检验问题,用经验似然的方法构造检验统计量,得到了零假设下检验统计量的渐近分布,我们的检验方法不但可以检验一阶自相关,也可以检验高阶自相关,数值模拟表明检验方法具有良好的检验功效.     

Likelihood ratio tests for goodness-of-fit of a nonlinear regression model

We propose likelihood and restricted likelihood ratio tests for goodness-of-fit of nonlinear regression. The first-order Taylor approximation around the MLE of the regression parameters is used to approximate the null hypothesis and the alternative is modeled nonparametrically using penalized splines. The exact finite sample distribution of the test statistics is obtained for the linear model approximation and can be easily simulated. We recommend using the restricted likelihood instead of the likelihood ratio test because restricted maximum-likelihood estimates are not as severely biased as the maximum-likelihood estimates in the penalized splines framework.