MDPs are Markov Games

Bellman Equations

MDPs are POMDPs