Mediaspace scheduled maintenance: Aug 25, 2026 07:00 - 12:00 AM. During this time, videos will be temporarily unavailable. Check status updates.

Home

Lecture

Markov chains

About
Privacy
Disclaimer

Graph Chatbot

Related lectures (57)

Markov Chain Monte Carlo: Rejection Sampling Log in to Mediaspace to watch this video

Explores rejection sampling for generating sample values from a target distribution, along with Bayesian inference using MCMC.

Markov Chains: Theory and Applications Log in to Mediaspace to watch this video

Covers the theory and applications of Markov chains in modeling random phenomena and decision-making under uncertainty.

Markov Chains: Theory and Applications Log in to Mediaspace to watch this video

Covers the theory and applications of Markov chains, focusing on key concepts and properties.

Modeling Neurobiological Signals: Markov Chains Log in to Mediaspace to watch this video

Explores modeling neurobiological signals with Markov Chains, focusing on parameter estimation and data classification.

Data Analysis Techniques: Amplitude Shift Keying and Graphical Methods Log in to Mediaspace to watch this video

Covers amplitude shift keying and various data analysis techniques using Jupyter Notebooks.

Invariant Distributions: Markov Chains Log in to Mediaspace to watch this video

Explores invariant distributions, recurrent states, and convergence in Markov chains, including practical applications like PageRank in Google.

Probability Distributions: Central Limit Theorem and Applications Log in to Mediaspace to watch this video

Discusses probability distributions and the Central Limit Theorem, emphasizing their importance in data science and statistical analysis.

Monte Carlo Method: Surface Radiative Exchange Log in to Mediaspace to watch this video

Explores the Monte Carlo method for surface radiative exchange and its applications in emission, absorption, and reflection.

Markov Chain Monte Carlo: Sampling High-Dimensional Distributions Log in to Mediaspace to watch this video

Covers Markov Chain Monte Carlo for sampling high-dimensional distributions, discussing challenges, advantages, and applications like the Knapsack Problem and cryptography.

Markov Chains: Definitions and State Probabilities Log in to Mediaspace to watch this video

Covers the definitions and state probabilities of discrete-time Markov chains.

Precipitation and Hydrologic Design Log in to Mediaspace to watch this video

Covers methods to define the design storm, empirical distribution of rainfall maxima, Gumbel distribution, and intensity-duration-frequency relationships.

Transformations of Variables Log in to Mediaspace to watch this video

Covers the calculation of cumulative distribution functions and probability density functions for transformed random variables.

Stochastic Simulation: Introduction and G/G/1 Queueing Model Log in to Mediaspace to watch this video

Covers the stochastic simulations course, G/G/1 queueing model, computational finance, statistics, physics, and Bayesian inference.

Statistical Theory: Fundamentals Log in to Mediaspace to watch this video

Covers the basics of statistical theory, including probability models, random variables, and sampling distributions.

Martingales and Brownian Motion: Reflection Principle Log in to Mediaspace to watch this video

Explores the reflection principle in martingales and Brownian motion, simplifying probability calculations.

Stochastic Models for Communications: Discrete-Time Markov Chains - First Passage Time Log in to Mediaspace to watch this video

Explores discrete-time Markov chains, emphasizing first passage time probabilities and minimal solutions.

Document Analysis: Topic Modeling Log in to Mediaspace to watch this video

Explores document analysis, topic modeling, and generative models for data generation in machine learning.

Interactive Lecture: Reinforcement Learning Log in to Mediaspace to watch this video

Explores advanced reinforcement learning topics, including policies, value functions, Bellman recursion, and on-policy TD control.

Applied Probability & Stochastic Processes Log in to Mediaspace to watch this video

Covers applied probability, Markov chains, and stochastic processes, including transition matrices, eigenvalues, and communication classes.

Stochastic Models for Communications Log in to Mediaspace to watch this video

Covers the fundamentals of stochastic models for communications, focusing on Markov chains and Poisson processes.

Page 2 of 3