Mediaspace scheduled maintenance: Aug 25, 2026 07:00 - 12:00 AM. During this time, videos will be temporarily unavailable. Check status updates.

Concept

Gradient descent

Related lectures (29)

Neural Networks: Training and Optimization Log in to Mediaspace to watch this video

Explores the training and optimization of neural networks, addressing challenges like non-convex loss functions and local minima.

Optimization Techniques: Stochastic Gradient Descent and Beyond Log in to Mediaspace to watch this video

Discusses optimization techniques in machine learning, focusing on stochastic gradient descent and its applications in constrained and non-convex problems.

Deep Learning: Data Representations and Neural Networks Log in to Mediaspace to watch this video

Covers data representations, Bag of Words, histograms, data pre-processing, and neural networks.

Deep Learning: Multilayer Perceptron and Training Log in to Mediaspace to watch this video

Covers deep learning fundamentals, focusing on multilayer perceptrons and their training processes.

Newton's Method: Optimization & Indefiniteness Log in to Mediaspace to watch this video

Covers Newton's Method for optimization and discusses the caveats of indefiniteness in optimization problems.

Feed-forward Networks Log in to Mediaspace to watch this video

Introduces feed-forward networks, covering neural network structure, training, activation functions, and optimization, with applications in forecasting and finance.

Deep Learning: Convolutional Networks Log in to Mediaspace to watch this video

Explores convolutional neural networks, backpropagation, and stochastic gradient descent in deep learning.

Richardson Method: Preconditioned Iterative Solvers Log in to Mediaspace to watch this video

Covers the Richardson method for solving linear systems with preconditioned iterative solvers and introduces the gradient method.

Proximal Gradient Descent: Optimization Techniques in Machine Learning Log in to Mediaspace to watch this video

Discusses proximal gradient descent and its applications in optimizing machine learning algorithms.