A locally directionally maximin test for a multidimensional parameter with order-restricted alternatives

In this paper we propose a locally directionally maximin test which is a generalization of the locally most powerful test for the case of a multidimensional parameter. We show that for the two-dimensional Gaussian distribution the locally directionally maximin test is better than the likelihood ratio test in the sense of the local power. For locally asymptotically normal experiments we construct an asymptotic locally directionally maximin test.     

平衡增加的经验欧氏似然

经验(欧氏)似然方法是近年来非常流行的一种非参数统计方法.针对经验(欧氏)似然的凸包限制和计算复杂问题,本文借助Emerson和Owen (2009)所提出的平衡增加思想对经验欧氏似然进行修正,得到了平衡增加的经验欧氏似然.随后论文从理论和模拟两个方面进行了研究.理论上给出了该方法与经验欧氏似然检验函数之间的联系,即在固定的样本量n下随着添加点位置的连续变化,检验方法可以从简单的均值增加经验欧氏似然变化到经验欧氏似然检验;模拟结果显示,适当选取调整因子,平衡增加的经验欧氏似然相对于(调整)经验欧氏似然而言,在大多数情况下,其分布更接近于对应的极限分布.     

A modified power series distribution

Summary A modification of the usual power series distribution is proposed and a statistical treatment of data generated by this probability model is indicated. It is shown that this modified power series distribution belongs to a multiparameter discrete exponential family and standard theory is then applied to obtain complete sufficient statistics of the parameters, sampling distribution of these statistics, maximum likelihood and minimum variance unbiased estimators, uniformly most powerful unbiased tests, uniformly most accurate confidence intervals and expected cover tolerance regions. CSIRO, Division of Mathematical Statistics     

Empirical bayesian test of the smoothness

In the context of adaptive nonparametric curve estimation a common assumption is that a function (signal) to estimate belongs to a nested family of functional classes. These classes are often parametrized by a quantity representing the smoothness of the signal. It has already been realized by many that the problem of estimating the smoothness is not sensible. What can then be inferred about the smoothness? The paper attempts to answer this question. We consider implications of our results to hypothesis testing about the smoothness and smoothness classification problem. The test statistic is based on the empirical Bayes approach, i.e., it is the marginalized maximum likelihood estimator of the smoothness parameter for an appropriate prior distribution on the unknown signal.     

Method of Moments Using Monte Carlo Simulation

Abstract

We present a computational approach to the method of moments using Monte Carlo simulation. Simple algebraic identities are used so that all computations can be performed directly using simulation draws and computation of the derivative of the log-likelihood. We present a simple implementation using the Newton-Raphson algorithm with the understanding that other optimization methods may be used in more complicated problems. The method can be applied to families of distributions with unknown normalizing constants and can be extended to least squares fitting in the case that the number of moments observed exceeds the number of parameters in the model. The method can be further generalized to allow “moments” that are any function of data and parameters, including as a special case maximum likelihood for models with unknown normalizing constants or missing data. In addition to being used for estimation, our method may be useful for setting the parameters of a Bayes prior distribution by specifying moments of a distribution using prior information. We present two examples—specification of a multivariate prior distribution in a constrained-parameter family and estimation of parameters in an image model. The former example, used for an application in pharmacokinetics, motivated this work. This work is similar to Ruppert's method in stochastic approximation, combines Monte Carlo simulation and the Newton-Raphson algorithm as in Penttinen, uses computational ideas and importance sampling identities of Gelfand and Carlin, Geyer, and Geyer and Thompson developed for Monte Carlo maximum likelihood, and has some similarities to the maximum likelihood methods of Wei and Tanner.     

多项分布总体的相等对增凸序问题的多样本检验

概率分布间随机序在实践中已经得到了广泛的应用,而且似然比检验是用以检验涉及随机序问题的最普遍的检验方法．但是,关于多个多项式总体间的增凸序约束的统计推断问题并没有得到充分发展．多样本的增凸序对无约束的检验问题已被研究．然而,多总体的相等性对增凸序的假设检验问题似乎更有研究意义．并且分布的相等对随机序的假设检验问题往往是统计学家最为普遍地考虑．对多样本的情况,本文考虑了分布的相等对增凸序的假设检验问题,并且获得似然比检验统计量的零渐近分布,它是一组x~2分布随机变量的加权和,即■~2分布．     

指数族下参数双边检验的p-值

在单参数指数族下,对参数的双侧检验问题给出了一致最优检验或一致最优无偏检验的p-值;在多参数指数族下,对单个参数双侧检验问题给出了一致最优无偏检验的p-值.在正态总体下,给出了几个计算上述p-值的例子.     

加权先验下的Bayes方差估计

针对具有多阶段试验信息的参数估计问题,考虑到历史数据和现场数据的不可等同性,给基于历史数据的似然函数加一个权参数a0(0≤a0≤1)的方案,结合动态修正Bayes估计方法,建构并推导出正态分布方差的加权先验Bayes估计模型.     

Empirical likelihood based goodness-of-fit testing for generalized linear mixed models

In this paper, we propose a bias-corrected empirical likelihood （BCEL） ratio to construct a goodness- of-fit test for generalized linear mixed models. BCEL test maintains the advantage of empirical likelihood that is self scale invariant and then does not involve estimating limiting variance of the test statistic to avoid deteri- orating power of test. Furthermore, the bias correction makes the limit to be a process in which every variable is standard chi-squared. This simple structure of the process enables us to construct a Monte Carlo test proce- dure to approximate the null distribution. Thus, it overcomes a problem we encounter when classical empirical likelihood test is used, as it is asymptotically a functional of Gaussian process plus a normal shift function. The complicated covariance function makes it difficult to employ any approximation for the null distribution. The test is omnibus and power study shows that the test can detect local alternatives approaching the null at parametric rate. Simulations are carried out for illustration and for a comparison with existing method.     

Empirical likelihood method for linear transformation models

Empirical likelihood inferential procedure is proposed for right censored survival data under linear transformation models, which include the commonly used proportional hazards model as a special case. A log-empirical likelihood ratio test statistic for the regression coefficients is developed. We show that the proposed log-empirical likelihood ratio test statistic converges to a standard chi-squared distribution. The result can be used to make inference about the entire regression coefficients vector as well as any subset of it. The method is illustrated by extensive simulation studies and a real example.     

Reliability inference with extended sequential order statistics

In this article, we will address the complexity of non-identical components in multi-component systems. Most technical systems can be described as such since either component types or component functions within the system vary amongst components. While most reliability related work resorts to the assumption of homogeneous components, we aim to address the often more realistic assumption of heterogeneous components extending the model of Extended Sequential Order Statistics by two inferential methods. Firstly, the derivation of Maximum Likelihood Estimates including a simulation study demonstrating their good performance for large enough sample size. Secondly, we introduce a likelihood ratio test to test whether components can be assumed identical accompanied by a power study. Both methods are powerful tools in reliability contexts. The former increases our understanding of component behaviour, especially upon failure of other components. This knowledge empowers system operators to make better decisions regarding maintenance schedules and failure time prediction. The latter supports operators in their quest of identifying component equivalence. Therefore, both methods can be used to achieve meaningful results in real life applications.     

长寿命产品在小子样缺失数据下的Bayes可靠性增长分析

在长寿命产品的可靠性增长试验过程中,由于人员、观测设备或其他方面的原因,可能会造成某些试验数据丢失或未观测到的现象。对这类小子样变总体缺失数据情形,提出了Bayes可靠性增长分析方法。首先利用Box-Tiao技术构造先验分布,然后利用非齐次Poisson过程原理和缺失数据的产生机制,得到可靠性增长缺失数据的似然函数,再用Bayes统计推断方法得到产品各研制阶段结束时的可靠性水平,同时给出了缺失数据下增长模型的拟合优度检验方法。最后通过一个示例说明了该方法在工程上的应用。     

商业银行操作风险计量模型的Bayes估计

对于商业银行来讲,一个很重要的问题是损失数据缺乏,而损失数据缺乏会影响模型参数的估计,用Bayes估计解决了这一问题.Bayes估计的方法利用商业银行专家提供的意见确定先验分布,能够有效地解决损失数据缺乏的问题.实证分析的结果表明,Bayes估计与极大似然估计的结果.不考虑存在着一定的差距.不考虑各部分风险之间的相关性,基于Bayes估计与极大似然估计时VaR与ES的大部分结果相差不大.     

The EM algorithm for ML Estimators under nonlinear inequalities restrictions on the parameters

One of the most powerful algorithms for obtaining maximum likelihood estimates for many incomplete-data problems is the EM algorithm. However, when the parameters satisfy a set of nonlinear restrictions, It is difficult to apply the EM algorithm directly. In this paper,we propose an asymptotic maximum likelihood estimation procedure under a set of nonlinear inequalities restrictions on the parameters, in which the EM algorithm can be used. Essentially this kind of estimation problem is a stochastic optimization problem in the M-step. We make use of methods in stochastic optimization to overcome the difficulty caused by nonlinearity in the given constraints.     

Optimal Robust Design of Step Stress Accelerated Life Test Scheme under Weibull Distribution

The traditional accelerated life test scheme is necessary to give the rough values of some model parameters in advance, but the influence of fluctuation on the stability of test scheme is irregulared. Based on the prior life test information, this paper aims to minimize the mean and variance of asymptotic variance of $p$-quantile life estimate under normal test stress level, using maximum likelihood estimation theory and Nelson cumulative failure principle, the optimal robust design mathematical model of step stress accelerated life test scheme with uncertainty parameters under Weibull distribution is established. The results of optimal robust design of step stress accelerated life test scheme for electrical connectors show that: comparing with the optimal design of step stress test scheme in the literature, the optimal robust design scheme is not sensitive to the uncertainty of model parameters when the asymptotic variance of median life estimate is basically the same; Comparing with the optimal design of constant accelerated life test scheme, when the statistical accuracy of test data is basically the same, the number of samples required can be reduced by 1/5, and the test time can be reduced by about 1/4.     

Comparing k-independent and right censored samples based on the likelihood ratio

Powerful k-sample tests to compare the equality of the underlying distributions of right censored data based on the likelihood ratio are proposed. Their statistical power is studied and compared with that of commonly used tests by Monte Carlo simulations. A real data analysis is also considered. It is observed that the new likelihood ratio based tests are clearly more powerful than the traditional ones when there not exists uniform dominance among the involved distributions. Besides, the new tests turn out to be as powerful as the best classical test otherwise.     

Likelihood ratio tests for goodness-of-fit of a nonlinear regression model

We propose likelihood and restricted likelihood ratio tests for goodness-of-fit of nonlinear regression. The first-order Taylor approximation around the MLE of the regression parameters is used to approximate the null hypothesis and the alternative is modeled nonparametrically using penalized splines. The exact finite sample distribution of the test statistics is obtained for the linear model approximation and can be easily simulated. We recommend using the restricted likelihood instead of the likelihood ratio test because restricted maximum-likelihood estimates are not as severely biased as the maximum-likelihood estimates in the penalized splines framework.     

Diagnostic checking for multivariate regression models

Diagnostic checking for multivariate parametric models is investigated in this article. A nonparametric Monte Carlo Test (NMCT) procedure is proposed. This Monte Carlo approximation is easy to implement and can automatically make any test procedure scale-invariant even when the test statistic is not scale-invariant. With it we do not need plug-in estimation of the asymptotic covariance matrix that is used to normalize test statistic and then the power performance can be enhanced. The consistency of NMCT approximation is proved. For comparison, we also extend the score type test to one-dimensional cases. NMCT can also be applied to diverse problems such as a classical problem for which we test whether or not certain covariables in linear model has significant impact for response. Although the Wilks lambda, a likelihood ratio test, is a proven powerful test, NMCT outperforms it especially in non-normal cases. Simulations are carried out and an application to a real data set is illustrated.     

Nonparametric likelihood ratio goodness-of-fit tests for survival data

Berk and Jones (Z. Wahrsch. Verw. Gebiete 47 (1979) 47) described a nonparametric likelihood test of uniformity that is more efficient, in Bahadur's sense, than any weighted Kolmogorov-Smirnov test at any alternative. This article shows how to obtain a nonparametric likelihood test of a general parametric family for incomplete survival data. A nonparametric likelihood ratio test process is employed to measure the discrepancy between a parametric family and the observed data. Large sample properties of the likelihood ratio test process are studied under both the null and alternative hypotheses. A Monte Carlo simulation method is proposed to estimate its null distribution. We show how to produce a likelihood ratio graphical check as well as a formal test of a parametric family based on the developed theory. Our method is developed for the right-censorship model, but can be easily extended to some other survival models. Illustrations are given using both real and simulated data.     

Parameter estimation for a two-parameter bathtub-shaped lifetime distribution

A two-parameter distribution was revisited by Chen (2000) [7]. This distribution can have a bathtub-shaped or increasing failure rate function which enables it to fit real lifetime data sets. Maximum likelihood and Bayes estimates of the two unknown parameters are discussed in this paper. It is assumed in the Bayes case that the unknown parameters have gamma priors. Explicit forms of Bayes estimators cannot be obtained. Different approximations are used to establish point estimates and two sided Bayesian probability intervals for the parameters. Monte Carlo simulations are applied to the comparison between the maximum likelihood estimates and the approximate Bayes estimates obtained under non-informative prior assumptions. Analysis of a real data set is also been presented for illustrative purposes.