Mediaspace scheduled maintenance: Aug 25, 2026 07:00 - 12:00 AM. During this time, videos will be temporarily unavailable. Check status updates.

Lecture

Adaptive Gradient Methods: Theory and Applications

Related lectures (40)

Adaptive Optimization Methods: Theory and Applications

Explores adaptive optimization methods that adapt locally and converge without knowing the smoothness constant.

Neural Networks Optimization

Explores neural networks optimization, including backpropagation, batch normalization, weight initialization, and hyperparameter search strategies.

Structures in Non-Convex Optimization

Covers non-convex optimization, deep learning training problems, stochastic gradient descent, adaptive methods, and neural network architectures.

Generalization in Deep Learning

Delves into the trade-off between model complexity and risk, generalization bounds, and the dangers of overfitting complex function classes.

The Hidden Convex Optimization Landscape of Deep Neural Networks

Explores the hidden convex optimization landscape of deep neural networks, showcasing the transition from non-convex to convex models.

Generalization in Deep Learning

Explores generalization in deep learning, covering model complexity, implicit bias, and the double descent phenomenon.

Neural Networks: Regularization & Optimization

Explores neural network regularization, optimization, and practical implementation tips.

Neural Networks: Training and Activation

Explores neural networks, activation functions, backpropagation, and PyTorch implementation.

Crash course on Deep Learning

Covers a crash course on deep learning, including the Mark I Perceptron, neural networks, optimization algorithms, and practical training aspects.

Double Descent Curves: Overparametrization

Explores double descent curves and overparametrization in machine learning models, highlighting the risks and benefits.

Multilayer Neural Networks: Deep Learning

Covers the fundamentals of multilayer neural networks and deep learning.

Deep Learning Paradigm

Explores the deep learning paradigm, including challenges, neural networks, robustness, fairness, interpretability, and energy efficiency.

Deep Neural Networks: Training and Optimization

Explores deep neural network training, optimization, preventing overfitting, and different network architectures.

Multilayer Perceptron: Training and Optimization

Explores the multilayer perceptron model, training, optimization, data preprocessing, activation functions, backpropagation, and regularization.

Deep Learning: Theory and Applications

Explores the mathematics of deep learning, neural networks, and their applications in computer vision tasks, addressing challenges and the need for robustness.

Deep Learning: Convolutional Neural Networks

Introduces Convolutional Neural Networks, explaining their architecture, training process, and applications in semantic segmentation tasks.

Deep Learning: Convolutional Neural Networks

Covers Convolutional Neural Networks, standard architectures, training techniques, and adversarial examples in deep learning.

No Free Lunch Theorem: Deep Learning

Explores the No Free Lunch Theorem and how deep networks match real-world problem structures.

Neural Networks: Multilayer Perceptrons

Covers Multilayer Perceptrons, artificial neurons, activation functions, matrix notation, flexibility, regularization, regression, and classification tasks.

Neural Network Training

Covers the training process of a neural network, including feedforward, cost function, gradient checking, and visualization of hidden layers.