Mediaspace scheduled maintenance: Aug 25, 2026 07:00 - 12:00 AM. During this time, videos will be temporarily unavailable. Check status updates.

Home

Lecture

Gradient Descent: Optimization and Regularization

About
Privacy
Disclaimer

Graph Chatbot

Related lectures (51)

Optimization algorithms Log in to Mediaspace to watch this video

Covers optimization algorithms, focusing on Proximal Gradient Descent and its variations.

Optimization Techniques: Stochastic Gradient Descent and Beyond Log in to Mediaspace to watch this video

Discusses optimization techniques in machine learning, focusing on stochastic gradient descent and its applications in constrained and non-convex problems.

Matrix Factorization: Optimization and Evaluation Log in to Mediaspace to watch this video

Explores matrix factorization optimization, evaluation methods, and challenges in recommendation systems.

Simplex Algorithm: Basics Log in to Mediaspace to watch this video

Introduces the Simplex algorithm for solving flow problems and handling negative cost cycles.

RTR practical aspects + tCG Log in to Mediaspace to watch this video

Explores practical aspects of Riemannian trust-region optimization and introduces the truncated conjugate gradient method.

Polynomial Regression and Gradient Descent Log in to Mediaspace to watch this video

Covers polynomial regression, gradient descent, overfitting, underfitting, regularization, and feature scaling in optimization algorithms.

Gradient Descent: Optimization and Constraints Log in to Mediaspace to watch this video

Discusses gradient descent for optimization with equality constraints and iterative convergence criteria.

Gradient Descent: Lipschitz Continuity Log in to Mediaspace to watch this video

Explores Lipschitz continuity in gradient descent optimization and its implications on function optimization.

Optimization in Large Search Spaces: GPU-Accelerated Join Order Log in to Mediaspace to watch this video

Explores GPU-accelerated join order optimization in large search spaces, leveraging graph topology to reduce computational overheads.

Proof of Strong Duality Log in to Mediaspace to watch this video

Covers the proof of strong duality in optimization problems and provides examples of Rayleigh quotient optimization.

Quantile Regression: Linear Optimization Log in to Mediaspace to watch this video

Covers quantile regression, focusing on linear optimization for predicting outputs and discussing sensitivity to outliers, problem formulation, and practical implementation.

Word Embeddings: Modeling Word Context and Similarity Log in to Mediaspace to watch this video

Covers word embeddings, modeling word context and similarity in a low-dimensional space.

Stochastic Gradient Descent Log in to Mediaspace to watch this video

Explores stochastic gradient descent optimization and the Mean-Field Method in neural networks.

Convergence Criteria: Necessary Conditions Log in to Mediaspace to watch this video

Explains necessary conditions for convergence in optimization problems.

Self-Concordant Functions Log in to Mediaspace to watch this video

Explores self-concordant functions, their properties, definitions, and optimization in mathematical problems.

Inference of Effects: Models and Interactions Log in to Mediaspace to watch this video

Discusses constant and random coefficient models, factors optimization, and interactions estimation in performance analysis.

Robust Optimization in Radiation Therapy Log in to Mediaspace to watch this video

Explores robust optimization in radiation therapy, emphasizing dose optimization and trade-offs between nominal and robust solutions.

Word Embedding Models: Optimization and Applications Log in to Mediaspace to watch this video

Explores optimizing word embedding models, including loss function minimization and gradient descent, and introduces techniques like Fasttext and Byte Pair Encoding.

Optimization Methods: Lagrange Multipliers Log in to Mediaspace to watch this video

Covers advanced optimization methods using Lagrange multipliers to find extrema of functions subject to constraints.

Euler-Lagrange Equations Log in to Mediaspace to watch this video

Covers the derivation and application of Euler-Lagrange equations for optimization problems in mathematical analysis.

Page 2 of 3