Mediaspace scheduled maintenance: Aug 25, 2026 07:00 - 12:00 AM. During this time, videos will be temporarily unavailable. Check status updates.

Home

Lecture

Markov Chains: States Classification

About
Privacy
Disclaimer

Graph Chatbot

Related lectures (43)

Stochastic Models: Absorbing Markov Chains Examples Log in to Mediaspace to watch this video

Covers examples of absorbing Markov chains in discrete time.

Bonus Malus System: Transition Probabilities Log in to Mediaspace to watch this video

Explores the Bonus Malus system for insurance premiums and Markov chain transition probabilities.

Markov Chains: Recurrence and Transience Log in to Mediaspace to watch this video

Explores first passage times, strong Markov property, and state recurrence/transience in Markov chains.

Markov Chain Games Log in to Mediaspace to watch this video

Explores Markov chain games, hitting probabilities, and expected hitting times in a target set.

Markov Chains: Ergodic Chains Examples Log in to Mediaspace to watch this video

Covers stochastic models for communications, focusing on discrete-time Markov chains.

Markov Chains: Transition Densities Log in to Mediaspace to watch this video

Covers Markov processes, transition densities, and distribution conditional on information, discussing classification of states and stationary distributions.

Stochastic Models for Communications: Discrete-Time Markov Chains - First Passage Time Log in to Mediaspace to watch this video

Explores discrete-time Markov chains, emphasizing first passage time probabilities and minimal solutions.

Markov Chains: Definitions and State Probabilities Log in to Mediaspace to watch this video

Covers the definitions and state probabilities of discrete-time Markov chains.

Markov Chains: Absorbing Classes Log in to Mediaspace to watch this video

Explores Markov chains with absorbing classes through exercises on transition matrices and expected values.

Markov Chains: Properties and Expectations Log in to Mediaspace to watch this video

Explores Markov chains' properties, expectations, and recurrence in Poisson processes.

Biased Monte Carlo Markov Chain Log in to Mediaspace to watch this video

Explores Biased Monte Carlo Markov Chain, including Bayes-optimal estimation and Metropolis-Hastings algorithm.

Finite Element Method: Weak Formulation and Galerkin Method Log in to Mediaspace to watch this video

Explores the weak formulation and Galerkin method in Finite Element Method applications, including boundary conditions and linear systems of equations.

Linear First Order Differential Equations Log in to Mediaspace to watch this video

Covers linear first order differential equations, separation of variables, particular solutions, uniqueness, and coefficients application.

Linear Differential Equations II Log in to Mediaspace to watch this video

Delves into advanced linear differential equations, exploring solutions, characteristic equations, and methods for finding particular solutions.

Finite Element Method: Local Approach Log in to Mediaspace to watch this video

Explores the local approach in the finite element method, covering nodal shape functions and assembly.

Perturbed Boundary Conditions Log in to Mediaspace to watch this video

Covers perturbed boundary conditions in fluid mechanics and linearization of dynamic systems.

Introduction to Mechanics Log in to Mediaspace to watch this video

Introduces General Physics I, focusing on Newtonian mechanics and the course format with pre-recorded lectures and live quizzes.

Mechanics of a helix under gravity Log in to Mediaspace to watch this video

Delves into the equilibrium shapes of helical thin rods under weak gravity conditions, focusing on Kirchhoff's rod theory and ordinary differential equations.

Linear Partial Differential Equations Log in to Mediaspace to watch this video

Explores linear partial differential equations, elliptic PDEs, Laplace equation, boundary conditions, and classical solutions.

Capacitor Charging and Network Analysis Log in to Mediaspace to watch this video

Explores capacitor charging, time constants, differential equations, and network analysis in circuits with lamps and batteries.

Page 2 of 3