Limit Probability:

Let:

Where:

If the limit exists, is called limit probability of state . If the limit probabilities exist for all states ,then the row vector

Is called limit state probability vector.

Properties of the Limit State Probability Vector:

) Existence

) Uniqueness

  • There exist only one such that:

) Consistency

Which are given by this Theorem.


~Example: