Control limits for two-state partially observable Markov decision processes

A production process can be in either a GOOD or a BAD state. The true state is unknown and can only be inferred from observations. If the state is good during one period it may deteriorate and become bad during the next period. Two actions are available: CONTINUE or REPLACE (for a fixed cost). The objective is to maximize the expected discounted value of the total future profits.