<--- Back to Details
First PageDocument Content
Markov models / Probability theory / Markov processes / Probability / Mathematical analysis / Stochastic processes / Graph theory / Markov chain / Stochastic matrix / Markov property / Markov decision process / Entropy rate
Date: 2015-09-21 15:09:08
Markov models
Probability theory
Markov processes
Probability
Mathematical analysis
Stochastic processes
Graph theory
Markov chain
Stochastic matrix
Markov property
Markov decision process
Entropy rate

Stochastic Processes, Markov Chains, and Markov Models Finite-State

Add to Reading List

Source URL: cl.indiana.edu

Download Document from Source Website

File Size: 459,89 KB

Share Document on Facebook

Similar Documents

Mathematics / Mathematical analysis / Mathematical logic / Boolean algebra / Experiment / Measure theory / Sigma-algebra / Symbol / Lie algebras / Moschovakis coding lemma / Generalised Whitehead product

Reachability in Recursive Markov Decision Processes? Tom´ aˇs Br´ azdil, V´ aclav Broˇzek, Vojtˇech Forejt, and Anton´ın Kuˇcera

DocID: 1xW2m - View Document

Mathematics / Mathematical analysis / Dynamic programming / Markov processes / Stochastic control / Probability / Markov decision process / Sigma-algebra / P versus NP problem / Reinforcement learning

Solvency Markov Decision Processes with Interest Tomáš Brázdil∗1 , Taolue Chen2 , Vojtěch Forejt†3 , Petr Novotný1 , and Aistis Simaitis3 1 2 3

DocID: 1xVLS - View Document

Logic / 120-cell / Linear temporal logic / Substitution / Markov decision process / Symbol / Theoretical computer science / Mathematical logic

Specification Revision for Markov Decision Processes with Optimal Trade-off M. Lahijanian and M. Kwiatkowska Abstract— Optimal control policy synthesis for probabilistic systems from high-level specifications is increa

DocID: 1xVDa - View Document

Mathematics / Linear temporal logic / Temporal logic / Mathematical logic / Symbol / Structure / Model theory / Distribution / operator

Strategy Synthesis for Markov Decision Processes and Branching-Time Logics Tom´asˇ Br´azdil⋆ and Vojtˇech Forejt⋆⋆ Faculty of Informatics, Masaryk University, Botanick´a 68a, 60200 Brno, Czech Republic.

DocID: 1xVy7 - View Document

Theoretical computer science / Markov models / Formal methods / Graph theory / Markov chain / Process calculus / Semantics / Stochastic process / Mathematics

Process algebra and Markov processes The nature of synchronisation Equivalence relations Case study: active badges Summary From Markov to Milner and back: Stochastic process algebras Jane Hillston School of Informatics

DocID: 1xVg5 - View Document