Chapman Kolmogorov Equation in Discrete Time

In Matrix Form:

In General:


Observation


Demonstration: