Mediaspace scheduled maintenance: Aug 25, 2026 07:00 - 12:00 AM. During this time, videos will be temporarily unavailable. Check status updates.

Home

Lecture

Gradient Descent

About
Privacy
Disclaimer

Graph Chatbot

Related lectures (46)

Optimization Techniques: Stochastic Gradient Descent and Beyond Log in to Mediaspace to watch this video

Discusses optimization techniques in machine learning, focusing on stochastic gradient descent and its applications in constrained and non-convex problems.

Deep Learning: Designing Neural Network Models Log in to Mediaspace to watch this video

Covers the design and optimization of neural network models in deep learning.

Gradient Descent: Optimization Techniques Log in to Mediaspace to watch this video

Explores gradient descent, loss functions, and optimization techniques in neural network training.

Gradient Descent: Linear Regression Log in to Mediaspace to watch this video

Covers the concept of gradient descent for linear regression, explaining the iterative process of updating parameters.

Non-Convex Optimization: Techniques and Applications Log in to Mediaspace to watch this video

Covers non-convex optimization techniques and their applications in machine learning.

Proximal Gradient Descent: Optimization Techniques in Machine Learning Log in to Mediaspace to watch this video

Discusses proximal gradient descent and its applications in optimizing machine learning algorithms.

Gradient Descent on Two-Layer ReLU Neural Networks Log in to Mediaspace to watch this video

Analyzes gradient descent on two-layer ReLU neural networks, exploring global convergence, regularization, implicit bias, and statistical efficiency.

Linear Models for Classification: Logistic Regression and SVM Log in to Mediaspace to watch this video

Covers linear models for classification, focusing on logistic regression and support vector machines.

Regularization in Machine Learning Log in to Mediaspace to watch this video

Introduces regularization techniques to prevent overfitting in machine learning models.

Deep and Convolutional Networks: Generalization and Optimization Log in to Mediaspace to watch this video

Explores deep and convolutional networks, covering generalization, optimization, and practical applications in machine learning.

RTR practical aspects + tCG Log in to Mediaspace to watch this video

Explores practical aspects of Riemannian trust-region optimization and introduces the truncated conjugate gradient method.

Machine Learning Fundamentals: Overfitting and Regularization Log in to Mediaspace to watch this video

Covers overfitting, regularization, and cross-validation in machine learning, exploring polynomial curve fitting, feature expansion, kernel functions, and model selection.

Newton's Method: Optimization Techniques Log in to Mediaspace to watch this video

Explores optimization techniques like gradient descent, line search, and Newton's method for efficient problem-solving.

Connect Four: Alpha-Beta Pruning and Monte-Carlo Tree Search Log in to Mediaspace to watch this video

Explores solving Connect Four using game theory algorithms and compares their performance.

Supervised Learning Essentials Log in to Mediaspace to watch this video

Introduces the basics of supervised learning, focusing on logistic regression, linear classification, and likelihood maximization.

The Hessian and Newton's method Log in to Mediaspace to watch this video

Covers the Hessian and Newton's method for optimization using iterative processes.

Introduction to Optimization Log in to Mediaspace to watch this video

Covers the basics of optimization, including historical perspectives, mathematical formulations, and practical applications in decision-making problems.

Estimating R: Maximum Likelihood Method Log in to Mediaspace to watch this video

Explores estimating parameters in statistical models using the maximum likelihood method and the method of moments.

State Space Models: Expressivity and Transformers Log in to Mediaspace to watch this video

Covers state space models and their expressivity compared to transformers, focusing on attention mechanisms and computational efficiency.

Gradient Descent Method Log in to Mediaspace to watch this video

Covers the Gradient Descent method, smoothness in functions, and proofs related to convexity.

Page 2 of 3