DTHMC

Discrete Time Homogeneous Markov Chain


Observations:

Demonstrations for 1. and 2. are the same of the Continuous Time, the 3. is trivial.