Lecture

Adaptive Optimization Methods: Theory and Applications

Graph Chat

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

Related lectures (64)

Improving Models of the Ventral Visual Pathway

Explores computational models of the ventral visual system, focusing on optimizing networks for real-world tasks and comparing to brain data.

Neural Networks: Training and Activation

Explores neural networks, activation functions, backpropagation, and PyTorch implementation.

Gradient Descent Methods

Covers gradient descent methods for convex and nonconvex problems, including smooth unconstrained convex minimization, maximum likelihood estimation, and examples like ridge regression and image classification.

Deep Learning: Theory and Applications

Explores the mathematics of deep learning, neural networks, and their applications in computer vision tasks, addressing challenges and the need for robustness.

Algorithms for Composite Optimization

Explores algorithms for composite optimization, including proximal operators and gradient methods, with examples and theoretical bounds.

Deep Learning Fundamentals

Introduces deep learning, from logistic regression to neural networks, emphasizing the need for handling non-linearly separable data.

Reinforcement Learning: Policy Gradient and Actor-Critic Methods

Provides an overview of reinforcement learning, focusing on policy gradient and actor-critic methods for deep artificial neural networks.

Convolutional Neural Networks

Covers Convolutional Neural Networks, including layers, training strategies, standard architectures, tasks like semantic segmentation, and deep learning tricks.

Adversarial Machine Learning

Explores adversarial machine learning, generative adversarial networks, and the challenges of adversarial examples in data optimization.

Pavement Distress Detection

Covers the importance of preventive maintenance for pavement distress detection and introduces machine learning concepts for engineers.

Automatic Differentiation: BackProp revisited

Discusses automatic differentiation, emphasizing reverse mode differentiation for optimizing convolutional layer filters by gradient descent.

No Free Lunch Theorem: Deep Learning

Explores the No Free Lunch Theorem and how deep networks match real-world problem structures.

Quantum Many-body Dynamics with Artificial Neural Networks

Explores quantum many-body dynamics using artificial neural networks, focusing on experimental simulations and theoretical challenges.

Deep Learning Building Blocks

Covers tensors, loss functions, autograd, and convolutional layers in deep learning.

Non-Conceptual Knowledge Systems

Delves into the impact of deep learning on non-conceptual knowledge systems and the advancements in transformers and generative adversarial networks.

Variance Reduction in Deep Learning

Explores variance reduction techniques in deep learning, covering gradient descent, stochastic gradient descent, SVRG method, and performance comparison of algorithms.

Score-Based Generative Models

Delves into score-based generative models, exploring learning natural distributions and the impact of neural network architecture on robustness.

Deep Learning: Convolutional Networks

Explores convolutional neural networks, backpropagation, and stochastic gradient descent in deep learning.

Improving Density Predictions in Machine Learning

Explores enhancing machine learning predictions by refining error metrics and applying constraints for improved accuracy in electron density predictions.

Deep and Convolutional Networks: Generalization and Optimization

Explores deep and convolutional networks, covering generalization, optimization, and practical applications in machine learning.