Explores the convergence of adjacency matrix powers and consensus theorem for primitive and stochastic matrices, emphasizing spectral properties and networked control systems.
Explores the concept of stationary distribution in Markov chains, discussing its properties and implications, as well as the conditions for positive-recurrence.
Explores convergence results for periodic case reversibility in Markov chains, covering irreducible chains, positive recurrence, reversible processes, and random walks on finite graphs.
Covers the theory of Markov Chain Monte Carlo (MCMC) sampling and discusses convergence conditions, transition matrix choice, and target distribution evolution.
Delves into Markov chains by analyzing a scenario with two fleas moving in opposite directions, exploring transition matrices and probabilities over time.