Mediaspace scheduled maintenance: Aug 25, 2026 07:00 - 12:00 AM. During this time, videos will be temporarily unavailable. Check status updates.

Concept

Stochastic gradient descent

Related lectures (28)

Perception: Data-Driven Approaches

Explores perception in deep learning for autonomous vehicles, covering image classification, optimization methods, and the role of representation in machine learning.

Neural Networks: Training and Optimization Log in to Mediaspace to watch this video

Explores neural network training, optimization, and environmental considerations, with insights into PCA and K-means clustering.

Optimization Techniques: Stochastic Gradient Descent and Beyond Log in to Mediaspace to watch this video

Discusses optimization techniques in machine learning, focusing on stochastic gradient descent and its applications in constrained and non-convex problems.

Neural Networks: Training and Optimization Log in to Mediaspace to watch this video

Explores the training and optimization of neural networks, addressing challenges like non-convex loss functions and local minima.

Coordinate Descent: Optimization Strategies Log in to Mediaspace to watch this video

Explores coordinate descent optimization strategies, emphasizing simplicity in optimization through one-coordinate updates and discussing the implications of different approaches.

Gradient Descent: Optimization Techniques Log in to Mediaspace to watch this video

Explores gradient descent, loss functions, and optimization techniques in neural network training.

Gradient Descent: Linear Regression Log in to Mediaspace to watch this video

Covers the concept of gradient descent for linear regression, explaining the iterative process of updating parameters.

Neural Networks: Random Features and Kernel Regression Log in to Mediaspace to watch this video

Explores random features in neural networks and kernel regression using stochastic gradient descent.