Mediaspace scheduled maintenance: Aug 25, 2026 07:00 - 12:00 AM. During this time, videos will be temporarily unavailable. Check status updates.

Home

Lecture

Memory-Efficient Adaptive Optimization

About
Privacy
Disclaimer

Graph Chatbot

Related lectures (52)

Policy Gradient Methods: Convergence and Optimization Log in to Mediaspace to watch this video

Covers the convergence of policy gradient methods and their optimization in reinforcement learning.

Convex Optimization Log in to Mediaspace to watch this video

Introduces convex optimization, focusing on the importance of convexity in algorithms and optimization problems.

Convex Optimization: Gradient Algorithms Log in to Mediaspace to watch this video

Covers convex optimization problems and gradient-based algorithms to find the global minimum.

Deep Learning for NLP Log in to Mediaspace to watch this video

Introduces deep learning concepts for NLP, covering word embeddings, RNNs, and Transformers, emphasizing self-attention and multi-headed attention.

Convex Optimization: Gradient Descent Log in to Mediaspace to watch this video

Explores VC dimension, gradient descent, convex sets, and Lipschitz functions in convex optimization.

Linear Programming Techniques in Reinforcement Learning Log in to Mediaspace to watch this video

Covers the linear programming approach to reinforcement learning, focusing on its applications and advantages in solving Markov decision processes.

Faster Gradient Descent: Projected Optimization Techniques Log in to Mediaspace to watch this video

Covers faster gradient descent methods and projected gradient descent for constrained optimization in machine learning.

Automating Scanning Probe Microscopy: Techniques and Applications Log in to Mediaspace to watch this video

Covers the integration of machine learning with scanning probe microscopy for enhanced automation and efficiency in scientific workflows.

Convex Optimization Log in to Mediaspace to watch this video

Introduces the fundamentals of convex optimization, emphasizing the significance of convex functions in simplifying the minimization process.

Polynomial Regression and Gradient Descent Log in to Mediaspace to watch this video

Covers polynomial regression, gradient descent, overfitting, underfitting, regularization, and feature scaling in optimization algorithms.

Convex Sets: Mathematical Optimization Log in to Mediaspace to watch this video

Introduces convex optimization, covering convex sets, solution concepts, and efficient numerical methods in mathematical optimization.

Stochastic Gradient Descent Log in to Mediaspace to watch this video

Explores stochastic gradient descent optimization and the Mean-Field Method in neural networks.

Convex Optimization Tutorial: KKT Conditions Log in to Mediaspace to watch this video

Explores KKT conditions in convex optimization, covering dual problems, logarithmic constraints, least squares, matrix functions, and suboptimality of covering ellipsoids.

Convex Optimization: Examples of Convex Functions Log in to Mediaspace to watch this video

Explores convex optimization, convex functions, and their properties, including strict convexity and strong convexity, as well as different types of convex functions like linear affine functions and norms.

Edge Detection: Deep Learning Insights Log in to Mediaspace to watch this video

Explores the evolution of edge detection techniques, from Canny to deep learning insights.

Convex Optimization: Farkas' Lemma Log in to Mediaspace to watch this video

Covers Farkas' lemma, exploring the relationship between linear programs and the conditions for its validity.

Convex Optimization: Elementary Results Log in to Mediaspace to watch this video

Explores elementary results in convex optimization, including affine, convex, and conic hulls, proper cones, and convex functions.

Deep Learning: Generalization and Optimization Log in to Mediaspace to watch this video

Delves into the challenges and benefits of deep learning, highlighting the transition to convolutional neural networks and the impact of network width on the loss landscape.

Image Denoising and Reconstruction Log in to Mediaspace to watch this video

Covers denoising and reconstructing images using total variation minimization and discusses the visual effects of different regularization strengths.

Optimal Transport: Rockafellar Theorem Log in to Mediaspace to watch this video

Explores the Rockafellar Theorem in optimal transport, focusing on c-cyclical monotonicity and convex functions.

Page 2 of 3