Generalization bounds of ERM algorithm with Markov chain samples |
| |
Authors: | Bin Zou Zong-ben Xu Jie Xu |
| |
Institution: | 1. Faculty of Mathematics and Computer Science, Hubei University, Wuhan, 430062, China 2. Institute for Information and System Science, School of Mathematics and Statistics, Xi’an Jiaotong University, Xi’an, 710049, China
|
| |
Abstract: | One of the main goals of machine learning is to study the generalization performance of learning algorithms. The previous main results describing the generalization ability of learning algorithms are usually based on independent and identically distributed (i.i.d.) samples. However, independence is a very restrictive concept for both theory and real-world applications. In this paper we go far beyond this classical framework by establishing the bounds on the rate of relative uniform convergence for the Empirical Risk Minimization (ERM) algorithm with uniformly ergodic Markov chain samples. We not only obtain generalization bounds of ERM algorithm, but also show that the ERM algorithm with uniformly ergodic Markov chain samples is consistent. The established theory underlies application of ERM type of learning algorithms. |
| |
Keywords: | generalization bounds ERM algorithm relative uniform convergence uniformly ergodic Markovchain learning theory |
本文献已被 CNKI 维普 SpringerLink 等数据库收录! |
|