Embedding a state space model into a Markov decision process

Embedding a state space model into a Markov decision process