Markov chain

“A markov chain is a stochastic process with the markov property. Having the markov property means, given the present state, future states are independent of the past states.

In this talk we will define markov chain and identify its dependence to time. Then we will review its basic properties for example: stationary state, transition probabilities.

We will also introduce researchable state, absorbing state, transient and recurrent state. Finally we present some applications of it in different fields.”