Transient State

From GM-RKB
Jump to navigation Jump to search

A Transient State is a state that has a non-zero probability of never return to it.

See: Markov Process State, Graph Path, Markov Chain, Accessible State, Recurrent State, Absorbing State.



References

2011

  • http://en.wikipedia.org/wiki/Markov_chain#Recurrence
    • QUOTE: A state i is said to be transient if, given that we start in state i, there is a non-zero probability that we will never return to i. Formally, let the random variable Ti be the first return time to state i (the "hitting time"): [math]\displaystyle{ T_i = \inf \{ n\ge1: X_n = i | X_0 = i\}. }[/math] The number [math]\displaystyle{ f_{ii}^{(n)} = \Pr(T_i = n) }[/math] is the probability that we return to state i for the first time after n steps. Therefore, state i is transient if [math]\displaystyle{ \Pr(T_i \lt {\infty}) = \sum_{n=1}^{\infty} f_{ii}^{(n)} \lt 1. }[/math]

      State i is recurrent (or persistent) if it is not transient. Recurrent states have finite hitting time with probability 1.

2010