Optimal control for linear discrete-time systems with Markov perturbations in Hilbert spaces

Email: vio{at}utgjiu.ro Received on September 12, 2007; Accepted on December 26, 2008 In this article, we discuss a quadratic control problem forlinear discrete-time systems with Markov perturbations in Hilbertspaces, which is linked to a discrete-time Riccati equationdefined on certain infinite-dimensional ordered Banach space.We prove that under stabilizability and stochastic uniform observabilityconditions, the Riccati equation has a unique, uniformly positive,bounded on N and stabilizing solution. Based on this result,we solve the proposed optimal control problem. An example illustratesthe theory.