Mediaspace scheduled maintenance: Aug 25, 2026 07:00 - 12:00 AM. During this time, videos will be temporarily unavailable. Check status updates.

Home

Lecture

Optimization Basics: Norms, Convexity, Differentiability

About
Privacy
Disclaimer

Graph Chatbot

Related lectures (41)

Convexity: Functions and Global Minima Log in to Mediaspace to watch this video

Explores convex functions, global minima, and their relationship with differentiability.

Faster Gradient Descent: Projected Optimization Techniques Log in to Mediaspace to watch this video

Covers faster gradient descent methods and projected gradient descent for constrained optimization in machine learning.

KKT and Convex Optimization Log in to Mediaspace to watch this video

Covers the KKT conditions and convex optimization, discussing constraint qualifications and tangent cones of convex sets.

Convex Optimization Log in to Mediaspace to watch this video

Introduces convex optimization, focusing on the importance of convexity in algorithms and optimization problems.

Linear Models: Continued Log in to Mediaspace to watch this video

Explores linear models, regression, multi-output prediction, classification, non-linearity, and gradient-based optimization.

Convex Optimization: Elementary Results Log in to Mediaspace to watch this video

Explores elementary results in convex optimization, including affine, convex, and conic hulls, proper cones, and convex functions.

Calculating with Taylor, Convexity Log in to Mediaspace to watch this video

Covers calculating with Taylor series and convexity concepts, including sin(x) and cos(x) approximations.

Derivability and Composition of Functions Log in to Mediaspace to watch this video

Explores derivability and function composition with examples.

Introduction to Mathematics for Engineers Log in to Mediaspace to watch this video

Introduces the purpose of mastering mathematics and calculation tools for engineers, emphasizing the need to think methodically and rigorously.

Convex Optimization: Introduction and Sets Log in to Mediaspace to watch this video

Covers the fundamentals of convex optimization, including mathematical problems, minimizers, and solution concepts, with an emphasis on efficient methods and practical applications.

Level Curves and Graphs of Functions Log in to Mediaspace to watch this video

Covers level curves and graphs of functions in two and three dimensions.

Lipschitz Gradient Theorem Log in to Mediaspace to watch this video

Covers the Lipschitz gradient theorem and its applications in function optimization.

Taylor Series and Secant Method: Numerical Analysis Techniques Log in to Mediaspace to watch this video

Discusses the Taylor series and secant method, focusing on their applications in numerical analysis and root-finding techniques.

SGD and Mean Field Analysis Log in to Mediaspace to watch this video

Explores Stochastic Gradient Descent and Mean Field Analysis in two-layer neural networks, emphasizing their iterative processes and mathematical foundations.

Differentiable Functions in R² Log in to Mediaspace to watch this video

Covers the representation of differentiable functions in R² and the concept of changes of coordinates through bijections.

Neural Networks: Training and Optimization Log in to Mediaspace to watch this video

Explores the training and optimization of neural networks, addressing challenges like non-convex loss functions and local minima.

Natural Cubic Splines: Optimization and Penalization Log in to Mediaspace to watch this video

Explores the optimization and penalization of natural cubic splines, including roughness penalties and Bayesian inference.

TR global convergence (end) + CG Log in to Mediaspace to watch this video

Covers the trust-region method and introduces the truncated conjugate gradients method.

Optimization of Functions: Maximum and Minimum Log in to Mediaspace to watch this video

Covers the optimization of functions, focusing on finding the maximum and minimum values.

Geometric Surfaces: Paraboloids and Hyperboloids in Architecture Log in to Mediaspace to watch this video

Explores the geometric properties of paraboloids and hyperboloids in architecture, emphasizing their design implications and practical applications.

Page 2 of 3