关于两总体均值差的一种半参数假设检验方法

近年来, 已有一些在半参数密度函数比模型下建立半参数统计分析方法的报道, 这些方法往往比参数方法稳健, 比非参数方法有效. 在本文里, 我们提出一种半参数的假设检验方法用于对两总体均值差进行假设检验. 该方法主要建立在对两总体均值差进行半参数估计的基础上. 我们报告了一些理论和统计模拟的结果, 得出该方法在数据符合正态性假设时, 比常用的参数和非参数方法略好; 而在数据不符合正态性假设时, 它的优势就非常明显. 我们还将提出的方法用到了两组真实数据的分析上.     

Robust and efficient variable selection for semiparametric partially linear varying coefficient model based on modal regression

Semiparametric partially linear varying coefficient models (SPLVCM) are frequently used in statistical modeling. With high-dimensional covariates both in parametric and nonparametric part for SPLVCM, sparse modeling is often considered in practice. In this paper, we propose a new estimation and variable selection procedure based on modal regression, where the nonparametric functions are approximated by $B$ -spline basis. The outstanding merit of the proposed variable selection procedure is that it can achieve both robustness and efficiency by introducing an additional tuning parameter (i.e., bandwidth $h$ ). Its oracle property is also established for both the parametric and nonparametric part. Moreover, we give the data-driven bandwidth selection method and propose an EM-type algorithm for the proposed method. Monte Carlo simulation study and real data example are conducted to examine the finite sample performance of the proposed method. Both the simulation results and real data analysis confirm that the newly proposed method works very well.     

基于中国地震的损失模型(英文)

对损失分布的估计一直是保险公司的重要问题. 有多种参数方法以及非参数方法拟合损失分布. 本文作者提出了结合参数和非参数的方法来解决损失分布拟合问题. 首先通过超额均值图确定大小损失之间的阈限,再利用广义Pareto分布拟合阈值以上损失, 转换后的核密度估计拟合阈值以下损失. 最后, 通过实证分析将该方法和其他方法进行了误差分析比较, 取得了理想的结果.     

Direction selection in stochastic directional distance functions

Researchers rely on the distance function to model multiple product production using multiple inputs. A stochastic directional distance function (SDDF) allows for noise in potentially all input and output variables. Yet, when estimated, the direction selected will affect the functional estimates because deviations from the estimated function are minimized in the specified direction. Specifically, the parameters of the parametric SDDF are point identified when the direction is specified; we show that the parameters of the parametric SDDF are set identified when multiple directions are considered. Further, the set of identified parameters can be narrowed via data-driven approaches to restrict the directions considered. We demonstrate a similar narrowing of the identified parameter set for a shape constrained nonparametric method, where the shape constraints impose standard features of a cost function such as monotonicity and convexity.Our Monte Carlo simulation studies reveal significant improvements, as measured by out of sample radial mean squared error, in functional estimates when we use a directional distance function with an appropriately selected direction and the errors are uncorrelated across variables. We show that these benefits increase as the correlation in error terms across variables increase. This correlation is a type of endogeneity that is common in production settings. From our Monte Carlo simulations we conclude that selecting a direction that is approximately orthogonal to the estimated function in the central region of the data gives significantly better estimates relative to the directions commonly used in the literature. For practitioners, our results imply that selecting a direction vector that has non-zero components for all variables that may have measurement error provides a significant improvement in the estimator’s performance. We illustrate these results using cost and production data from samples of approximately 500 US hospitals per year operating in 2007, 2008, and 2009, respectively, and find that the shape constrained nonparametric methods provide a significant increase in flexibility over second order local approximation parametric methods.     

�����滥������

本文讨论了信用衍生产品之一的总收益互换的定价问题. 其中涉及到利率风险和违约风险, 本文利用HJM利率模型来刻画利率风险, 并利用强度模型和混合模型对违约风险进行建模. 分别考虑了违约时间与利率无关时总收益互换合约的定价问题, 以及违约时间与利率相关时总收益互换合约的定价问题, 给出了相应的定价模型, 并用蒙特卡罗模拟方法得到定价问题的数值解.     

Nonparametric likelihood ratio goodness-of-fit tests for survival data

Berk and Jones (Z. Wahrsch. Verw. Gebiete 47 (1979) 47) described a nonparametric likelihood test of uniformity that is more efficient, in Bahadur's sense, than any weighted Kolmogorov-Smirnov test at any alternative. This article shows how to obtain a nonparametric likelihood test of a general parametric family for incomplete survival data. A nonparametric likelihood ratio test process is employed to measure the discrepancy between a parametric family and the observed data. Large sample properties of the likelihood ratio test process are studied under both the null and alternative hypotheses. A Monte Carlo simulation method is proposed to estimate its null distribution. We show how to produce a likelihood ratio graphical check as well as a formal test of a parametric family based on the developed theory. Our method is developed for the right-censorship model, but can be easily extended to some other survival models. Illustrations are given using both real and simulated data.     

A Frisch-Newton Algorithm for Sparse Quantile Regression

Recent experience has shown that interior-point methods using a log barrier approach are far superior to classical simplex methods for computing solutions to large parametric quantile regression problems. In many large empirical applications, the design matrix has a very sparse structure. A typical example is the classical fixed-effect model for panel data where the parametric dimension of the model can be quite large, but the number of non-zero elements is quite small. Adopting recent developments in sparse linear algebra we introduce a modified version of the Prisch-Newton algorithm for quantile regression described in Portnoy and Koenker~([28]). The new algorithm substantially reduces the storage (memory) requirements and increases computational speed. The modified algorithm also facilitates the development of nonparametric quantile regression methods. The pseudo design matrices employed in nonparametric quantile regression smoothing are inherently sparse in both the fidelity and roughness penalty components. Exploiting the sparse structure of these problems opens up a whole range of new possibilities for multivariate smoothing on large data sets via ANOVA-type decomposition and partial linear models.     

A Bayesian nonparametric model and its application in insurance loss prediction

Predicting insurance losses is an eternal focus of actuarial science in the insurance sector. Due to the existence of complicated features such as skewness, heavy tail, and multi-modality, traditional parametric models are often inadequate to describe the distribution of losses, calling for a mature application of Bayesian methods. In this study we explore a Gaussian mixture model based on Dirichlet process priors. Using three automobile insurance datasets, we employ the probit stick-breaking method to incorporate the effect of covariates into the weight of the mixture component, improve its hierarchical structure, and propose a Bayesian nonparametric model that can identify the unique regression pattern of different samples. Moreover, an advanced updating algorithm of slice sampling is integrated to apply an improved approximation to the infinite mixture model. We compare our framework with four common regression techniques: three generalized linear models and a dependent Dirichlet process ANOVA model. The empirical results show that the proposed framework flexibly characterizes the actual loss distribution in the insurance datasets and demonstrates superior performance in the accuracy of data fitting and extrapolating predictions, thus greatly extending the application of Bayesian methods in the insurance sector.     

Bayesian estimation of bandwidth in semiparametric kernel estimation of unknown probability mass and regression functions of count data

This work takes advantage of semiparametric modelling which improves significantly in many situations the estimation accuracy of the purely nonparametric approach. Herein for semiparametric estimations of probability mass function (pmf) of count data, and an unknown count regression function (crf), the kernel used is a binomial one and the bandiwdth selection is investigated by developing Bayesian approaches. About the latter, Bayes local and global bandwidth approaches are used to establish data-driven selection procedures in semiparametric framework. From conjugate beta prior distributions of the smoothing parameter and under the squared errors loss function, Bayes estimate for pmf is obtained in closed form. This is not available for the crf which is computed by the Markov Chain Monte Carlo technique. Simulation studies demonstrate that both proposed methods perform better than the classical cross-validation procedures, in particular the smoothing quality and execution times are optimized. All applications are made on real data sets.     

Nonlinear parametric models from volterra kernels measurements

Methods for nonlinear system identification are often classified, based on the employed model form, into parametric (nonlinear differential or difference equations) and nonparametric (functional expansions). These methods exhibit distinct sets of advantages and disadvantages that have motivated comparative studies and point to potential benefits from combined use. Fundamental to these studies are the mathematical relations between nonlinear differential (or difference, in discrete time) equations (NDE) and Volterra functional expansions (VFE) of the class of nonlinear systems for which both model forms exist, in continuous or discrete time. Considerable work has been done in obtaining the VFE's of a broad class of NDE's, which can be used to make the transition from nonparametric models (obtained from experimental input-output data) to more compact parametric models. This paper presents a methodology by which this transition can be made in discrete time. Specifically, a method is proposed for obtaining a parametric NARMAX (Nonlinear Auto-Regressive Moving-Average with exogenous input) model from Volterra kernels estimated by use of input-output data.     

Condition-based maintenance optimization considering improving prediction accuracy

Condition-based maintenance (CBM) aims to reduce maintenance cost and improve equipment reliability by effectively utilizing condition monitoring and prediction information. It is observed that the prediction accuracy often improves with the increase of the age of the component. In this research, we develop a method to quantify the remaining life prediction uncertainty considering the prediction accuracy improvement, and an effective CBM optimization approach to optimize the maintenance schedule. Any type of prognostics methods can be used, including data-driven methods, model-based methods and integrated methods, as long as the prediction method can produce the predicted failure time distribution at any given inspection point. Furthermore, we develop a numerical method to accurately and efficiently evaluate the cost of the CBM policy. The proposed approach is demonstrated using vibration monitoring data collected from pump bearings in the field as well as simulated degradation data. The proposed policy is compared with two benchmark maintenance policies and is found to be more effective.     

A machine learning approach for individual claims reserving in insurance

Accurate loss reserves are an important item in the financial statement of an insurance company and are mostly evaluated by macrolevel models with aggregate data in run‐off triangles. In recent years, a new set of literature has considered individual claims data and proposed parametric reserving models based on claim history profiles. In this paper, we present a nonparametric and flexible approach for estimating outstanding liabilities using all the covariates associated to the policy, its policyholder, and all the information received by the insurance company on the individual claims since its reporting date. We develop a machine learning–based method and explain how to build specific subsets of data for the machine learning algorithms to be trained and assessed on. The choice for a nonparametric model leads to new issues since the target variables (claim occurrence and claim severity) are right‐censored most of the time. The performance of our approach is evaluated by comparing the predictive values of the reserve estimates with their true values on simulated data. We compare our individual approach with the most used aggregate data method, namely, chain ladder, with respect to the bias and the variance of the estimates. We also provide a short real case study based on a Dutch loan insurance portfolio.     

Implicit–explicit Runge–Kutta methods for financial derivatives pricing models

Implicit–explicit Runge–Kutta methods are investigated for application to financial derivatives pricing models in the partial differential equations approach. The methods are showed to be an alternative to other existing procedures for the numerical valuation of American type contracts. We follow the method of lines in order to have a numerical method that can be used with a variety of state variable discretizations including finite elements, finite differences and finite volume methods. Some numerical experiments are presented.     

Statistical inference in partially-varying-coefficient single-index model

Consider a varying-coefficient single-index model which consists of two parts: the linear part with varying coefficients and the nonlinear part with a single-index structure, and are hence termed as varying-coefficient single-index models. This model includes many important regression models such as single-index models, partially linear single-index models, varying-coefficient model and varying-coefficient partially linear models as special examples. In this paper, we mainly study estimating problems of the varying-coefficient vector, the nonparametric link function and the unknown parametric vector describing the single-index in the model. A stepwise approach is developed to obtain asymptotic normality estimators of the varying-coefficient vector and the parametric vector, and estimators of the nonparametric link function with a convergence rate. The consistent estimator of the structural error variance is also obtained. In addition, asymptotic pointwise confidence intervals and confidence regions are constructed for the varying coefficients and the parametric vector. The bandwidth selection problem is also considered. A simulation study is conducted to evaluate the proposed methods, and real data analysis is also used to illustrate our methods.     

Accounting for Time Series Errors in Partially Linear Model With Single- or Multiple-Runs

This article concerns statistical estimation of the partially linear model (PLM) for time course measurements, which are temporally correlated and allow multiple-runs for repeated measurements to enhance experimental accuracy without extending the number of time points within each trial. Such features arise naturally from biomedical data, for example, in brain fMRI, and call for special treatment beyond classical methods in either a purely nonparametric regression model or a PLM with independent errors. We develop a stepwise procedure for estimating the parametric and nonparametric components of the multiple-run PLM and making inference for parameters of interest, adaptive to either single- or multiple-run, in the presence of error temporal dependence. Simulation study and real fMRI data applications illustrate the computational simplicity and effectiveness of the proposed methods. Supplementary material for this article is available online.     

GAM在汽车保险定价中的应用研究

汽车保险定价的基础在于风险分析,车辆、驾驶人以及行车环境等因素构成汽车保险定价所倚赖的一个风险系统.本文引入广义加法模型(GAM).将非参数平滑方法应用于到GAM中,结合贝叶斯理论(Bayes)和马尔可夫蒙特卡罗(MCMC)方法得到参数估计,构建汽车保险定价模型,并以国外某保险数据为样本进行实证分析,得到了较好的效果.     

Stochastic non-convex envelopment of data: Applying isotonic regression to frontier estimation

Isotonic nonparametric least squares (INLS) is a regression method for estimating a monotonic function by fitting a step function to data. In the literature of frontier estimation, the free disposal hull (FDH) method is similarly based on the minimal assumption of monotonicity. In this paper, we link these two separately developed nonparametric methods by showing that FDH is a sign-constrained variant of INLS. We also discuss the connections to related methods such as data envelopment analysis (DEA) and convex nonparametric least squares (CNLS). Further, we examine alternative ways of applying isotonic regression to frontier estimation, analogous to corrected and modified ordinary least squares (COLS/MOLS) methods known in the parametric stream of frontier literature. We find that INLS is a useful extension to the toolbox of frontier estimation both in the deterministic and stochastic settings. In the absence of noise, the corrected INLS (CINLS) has a higher discriminating power than FDH. In the case of noisy data, we propose to apply the method of non-convex stochastic envelopment of data (non-convex StoNED), which disentangles inefficiency from noise based on the skewness of the INLS residuals. The proposed methods are illustrated by means of simulated examples.     

Bayesian semiparametric customer base segmentation of mobile phone users based on longitudinal traffic data

Customer segmentation is one of the most important purposes of customer base analysis for telecommunication companies. Because companies accumulate very large amounts of data on customer behavior, segmentation is typically achieved by profiling and clustering traffic behavior jointly with demographic data and contracts characteristics. Unfortunately, most algorithms and models used for segmentation do not take into account the longitudinal characteristics of data. In particular, in telecommunication traffic analysis, the importance of decreasing patterns of traffic in customers' lives is well known, and it is relevant to aggregate all clients with such a pattern, while other unknown clusters may be of interest for the marketing manager. Our approach to address this problem is based on specifying the distribution of functions as a mixture of a parametric hierarchical model describing the decreasing pattern segment and a nonparametric contamination that allows unanticipated curve shapes in subjects' traffic. The parametric component is chosen based on prior knowledge, while the contamination is characterized as a functional Dirichlet process. Copyright © 2014 John Wiley & Sons, Ltd.     

Detecting change points in the stress‐strength reliability P(X < Y)

We address the statistical problem of detecting change points in the stress‐strength reliability R=P(X<Y) in a sequence of paired variables (X,Y). Without specifying their underlying distributions, we embed this nonparametric problem into a parametric framework and apply the maximum likelihood method via a dynamic programming approach to determine the locations of the change points in R. Under some mild conditions, we show the consistency and asymptotic properties of the procedure to locate the change points. Simulation experiments reveal that, in comparison with existing parametric and nonparametric change‐point detection methods, our proposed method performs well in detecting both single and multiple change points in R in terms of the accuracy of the location estimation and the computation time. Applications to real data demonstrate the usefulness of our proposed methodology for detecting the change points in the stress‐strength reliability R. Supplementary materials are available online.     

�������ݷDz���ģ�͵Ĺ⻬��������

??In the last few decades, longitudinal data was deeply research in statistics science and widely used in many field, such as finance, medical science, agriculture and so on. The characteristic of longitudinal data is that the values are independent from different samples but they are correlate from one sample. Many nonparametric estimation methods were applied into longitudinal data models with development of computer technology. Using Cholesky decomposition and Profile least squares estimation, we will propose a effective spline estimation method pointing at nonparametric model of longitudinal data with covariance matrix unknown in this paper. Finally, we point that the new proposed method is more superior than Naive spline estimation in the covariance matrix is unknown case by comparing the simulated results of one example.