A stochastic model describing a sequence of possible events where the probability of moving to the next state depends solely on the current state and not on previous history.

Transition Matrix

It uses a transition matrix to determine probabilities of moving between states.