Transient or Recurrent State:

Consider the following problem: The system is in state , and a transition to another state occurs.

Will the system surely return to state in the future?

  • Consider the “future” as infinity time from the state change.

If the answer is yes, the state is said Recurrent Otherwise, it is said Transient


~Example:

State is Recurrent. State is Recurrent. State is Transient.


~Example:

State is Transient. State is Transient. State is Transient. State is Recurrent. State is Recurrent. State is Recurrent.