Mediaspace scheduled maintenance: Aug 25, 2026 07:00 - 12:00 AM. During this time, videos will be temporarily unavailable. Check status updates.

Home

Lecture

Dynamic Programming: Optimal Control

About
Privacy
Disclaimer

Graph Chatbot

Related lectures (49)

Asset Selling: Optimal Revenue Policy Log in to Mediaspace to watch this video

Explores asset selling dynamics, optimal revenue policy, acceptance thresholds, and commodity price impact.

Stability of ODE Log in to Mediaspace to watch this video

Explores the stability of Ordinary Differential Equations, focusing on solution dependence, critical data, linearization, and control of nonlinear systems.

Asset Selling Problem Log in to Mediaspace to watch this video

Explores the Asset Selling Problem to maximize long-term reward without a deadline.

Dynamic Programming: Optimal Decision Making Log in to Mediaspace to watch this video

Explores dynamic programming for optimizing decision-making processes over time, using real-world examples like oil extraction and stock trading.

Optimal Marketing Strategy Log in to Mediaspace to watch this video

Covers decision-making in marketing based on customer behavior for optimal strategies.

Controlled Stochastic Processes Log in to Mediaspace to watch this video

Explores controlled stochastic processes, focusing on analysis, behavior, and optimization, using dynamic programming to solve real-world problems.

Asset Selling Problems Log in to Mediaspace to watch this video

Discusses asset selling problems and optimal selling policies based on market conditions and termination states.

Infinite-Horizon Problems: Formulation & Complexity Log in to Mediaspace to watch this video

Covers infinite-horizon problems in Applied Probability and Stochastic Processes.

Optimal Betting Strategy Log in to Mediaspace to watch this video

Explores the optimal betting strategy in a dynamic programming gambling problem, emphasizing risk preference impact.

Optimal Control: NMPC Log in to Mediaspace to watch this video

Covers Nonlinear Model Predictive Control (NMPC) principles, including setpoint stabilization and Pontryagin's Maximum Principle.

Stochastic Processes: Time Reversal Log in to Mediaspace to watch this video

Explores time reversal in stationary Markov chains and the concept of detailed balance conditions.

Stochastic Models for Communications: Discrete-Time Markov Chains - First Passage Time Log in to Mediaspace to watch this video

Explores discrete-time Markov chains, emphasizing the concept of first passage time in communication systems.

Continuous-Time Markov Chains: Asymptotic Behavior Log in to Mediaspace to watch this video

Explores the asymptotic behavior of continuous-time Markov chains and their convergence properties.

Discrete Dynamical Systems Log in to Mediaspace to watch this video

Explores eigenvalues, determinants, traces, and stochastic matrices in discrete dynamical systems.

Generation of Markov Processes Log in to Mediaspace to watch this video

Covers the generation of Markov processes and Markov chains, including transition matrices and stochastic matrices.

Neurobiological Signal Processing Log in to Mediaspace to watch this video

Explores neurobiological signal processing, covering spike modeling, signal classification, and data characterization using principal component analysis.

Stochastic Models for Communications: Introduction Log in to Mediaspace to watch this video

Introduces mathematical tools for communication systems and data science, focusing on stochastic processes and preparing students for advanced courses.

Markov Chain Convergence Log in to Mediaspace to watch this video

Explores Markov chain convergence, emphasizing invariant distribution, Law of Large Numbers, and mean rewards computation.

Discrete-Time Markov Chains: Reversible Chains Log in to Mediaspace to watch this video

Covers reversible discrete-time Markov chains in communication models.

Optimal Stopping Problems: Theory and Applications Log in to Mediaspace to watch this video

Covers optimal stopping problems in applied probability and stochastic processes, focusing on theory and practical applications.

Page 2 of 3