Bootstrapping Likelihood for Model Selection with Small Samples |
| |
Authors: | Wei Pan |
| |
Institution: | Division of Biostatistics , School of Public Health, University of Minnesota , A460 Mayo Building, Box 303, Minneapolis , MN , 55455 , USA |
| |
Abstract: | Abstract Akaike's information criterion (AIC), derived from asymptotics of the maximum likelihood estimator, is widely used in model selection. However, it has a finite-sample bias that produces overfitting in linear regression. To deal with this problem, Ishiguro, Sakamoto, and Kitagawa proposed a bootstrap-based extension to AIC which they called EIC. This article compares model-selection performance of AIC, EIC, a bootstrap-smoothed likelihood cross-validation (BCV) and its modification (632CV) in small-sample linear regression, logistic regression, and Cox regression. Simulation results show that EIC largely overcomes AIC's overfitting problem and that BCV may be better than EIC. Hence, the three methods based on bootstrapping the likelihood establish themselves as important alternatives to AIC in model selection with small samples. |
| |
Keywords: | AIC Cox regression Cross-validation EIC Linear regression Logistic regression Maximum likelihood |
|
|