Dynamic programming
Markov processes
Stochastic control
Markov models
Probability
Markov decision process
Markov chain
PP
Probabilistic CTL
Model checking