Optimization Techniques: Stochastic Gradient Descent and Beyond

About
Privacy
Disclaimer

Graph Chatbot

Related lectures (32)

Convex Optimization: Gradient Descent Log in to Mediaspace to watch this video

Explores VC dimension, gradient descent, convex sets, and Lipschitz functions in convex optimization.

Non-Convex Optimization: Techniques and Applications Log in to Mediaspace to watch this video

Covers non-convex optimization techniques and their applications in machine learning.

Optimization Basics: Unconstrained Optimization and Gradient Descent Log in to Mediaspace to watch this video

Covers optimization basics, including unconstrained optimization and gradient descent methods for finding optimal solutions.

Distributed Computing Execution Models Log in to Mediaspace to watch this video

Explores challenges in minimizing job completion time in distributed computing, focusing on data skew impact and efficient processing.

Ford-Fulkerson: a worked example Log in to Mediaspace to watch this video

Demonstrates the Ford-Fulkerson algorithm through a step-by-step worked example.

(Un)Bumping Cars Log in to Mediaspace to watch this video

Explores turning bumper cars into unbumping ones through collision avoidance algorithms and the challenges faced when implementing ellipsoid barrier functions.

Convex Optimization: Conjugate Duality Log in to Mediaspace to watch this video

Explores envelope representations, subgradients, conjugate functions, duality gap, and strong duality in convex optimization.

Shortest Path in Directed Graphs Log in to Mediaspace to watch this video

Covers finding the shortest path in directed graphs efficiently using algorithmic approaches and discussing related NP-complete problems.

Optimal Transport: Gradient Flows in Rd Log in to Mediaspace to watch this video

Explores optimal transport and gradient flows in Rd, emphasizing convergence and the role of Lipschitz and Picard-Lindelöf theorems.

Hamilton-Jacobi Equation: Exact Fields Log in to Mediaspace to watch this video

Explores the Hamilton-Jacobi equation, optimal control, and Bellman principle in exact fields.

Linear Regression: Ozone Data Analysis Log in to Mediaspace to watch this video

Explores linear regression analysis of ozone data using statistical models.

Decision Trees and Boosting Log in to Mediaspace to watch this video

Introduces decision trees as a method for machine learning and explains boosting techniques for combining predictors.

Page 2 of 2