Minimum divergence estimators,maximum likelihood and exponential families

The dual representation formula of the divergence between two distributions in a parametric model is presented. Resulting estimators do not make use of any grouping or smoothing. For smooth divergences they all coincide with the MLE on any regular exponential family.     

Large deviations for M-estimators

We study the large deviation principle for M-estimators (and maximum likelihood estimators in particular). We obtain the rate function of the large deviation principle for M-estimators. For exponential families, this rate function agrees with the Kullback–Leibler information number. However, for location or scale families this rate function is smaller than the Kullback–Leibler information number. We apply our results to obtain confidence regions of minimum size whose coverage probability converges to one exponentially. In the case of full exponential families, the constructed confidence regions agree with the ones obtained by inverting the likelihood ratio test with a simple null hypothesis.