Introduces Hidden Markov Models, explaining the basic problems and algorithms like Forward-Backward, Viterbi, and Baum-Welch, with a focus on Expectation-Maximization.
Explores convergence results for periodic case reversibility in Markov chains, covering irreducible chains, positive recurrence, reversible processes, and random walks on finite graphs.