Formation and evolution of X-ray binaries

We review recent progress in theoretical understanding of X-ray binaries, which has largely been driven by new observations. We select several topics including formation of compact low-mass X-ray binaries, the evolutionary connection between low-mass X-ray binaries and binary and millisecond radio pulsars, and ultraluminous X-ray sources, to illustrate the interplay between theories and observations.