Markov chains - notes

The notes introduce the concept of Markov chains and mention:

• state (outcome)
• state matrix (state vector)
• transition matrix
• power of transition matrix
• long term probabilities
• steady state matrix (stable state matrix).