Mediaspace scheduled maintenance: Aug 25, 2026 07:00 - 12:00 AM. During this time, videos will be temporarily unavailable. Check status updates.

Concept

Andrey Markov

Related lectures (31)

Markov Chains: Theory and Applications Log in to Mediaspace to watch this video

Covers the theory and applications of Markov chains in modeling random phenomena and decision-making under uncertainty.

Dependability Evaluation in Industrial Automation Log in to Mediaspace to watch this video

Explores dependability evaluation, preventive maintenance, reliability, Markov models, FMEA, FTA, and software safety integrity in industrial automation.

Replica and Symmetry Breaking Log in to Mediaspace to watch this video

Explores the Nobel Prize-winning discovery of replica and cavity methods in complex systems, focusing on the random energy model and the application of probability theory.

Optimal Marketing Strategy Log in to Mediaspace to watch this video

Covers decision-making in marketing based on customer behavior for optimal strategies.

Infinite-Horizon Problems: Formulation & Complexity Log in to Mediaspace to watch this video

Covers infinite-horizon problems in Applied Probability and Stochastic Processes.

Stochastic Modeling of Inertial Sensors Log in to Mediaspace to watch this video

Explores stochastic modeling of inertial sensors for optimal fusion with other devices, emphasizing precise sensor stochastics for improved navigation solutions.

Reinforcement Learning Concepts Log in to Mediaspace to watch this video

Covers key concepts in reinforcement learning, neural networks, clustering, and unsupervised learning, emphasizing their applications and challenges.

Reinforcement Learning for Pacman Log in to Mediaspace to watch this video

Covers the application of reinforcement learning to teach Pacman to play autonomously by trial and error.

Reinforcement Learning: Basics and Applications Log in to Mediaspace to watch this video

Covers the basics of reinforcement learning, including Markov Decision Processes and policy gradient methods, and explores real-world applications and recent advances.

Markov Chains: Ergodic Chains Examples Log in to Mediaspace to watch this video

Covers stochastic models for communications, focusing on discrete-time Markov chains.

Markov Chains: Ergodic Chains Examples Log in to Mediaspace to watch this video

Covers stochastic models for communications, focusing on discrete-time Markov chains.