Lecture

Gradient-Based Algorithms in High-Dimensional Learning

Graph Chat

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

Related lectures (64)

Deep Learning: Convolutional Neural Networks

Introduces Convolutional Neural Networks, explaining their architecture, training process, and applications in semantic segmentation tasks.

Supervised Learning Overview

Covers CNNs, RNNs, SVMs, and supervised learning methods, emphasizing the importance of tuning regularization and making informed decisions in machine learning.

Convolutional Neural Networks

Covers Convolutional Neural Networks, including layers, training strategies, standard architectures, tasks like semantic segmentation, and deep learning tricks.

Multilayer Neural Networks: Deep Learning

Covers the fundamentals of multilayer neural networks and deep learning.

Structured Learning: Chau-Lieu Algorithm

Explores structured learning with the Chau-Lieu algorithm and delves into the basics of deep learning and neural networks.

Image Representation Insights

Explores the evolution of image representation, challenges in supervised learning, benefits of self-supervised learning, and recent advancements in SSL.

Data-Driven Modeling of Haemodynamics in Vascular Flows

Explores data-driven modeling of haemodynamics in vascular flows, focusing on computational challenges, reduced order modeling, FSI problems, and neural network applications.

Dynamics of Linear Neural Networks

Explores the learning dynamics of deep neural networks using linear networks for analysis, covering two-layer and multi-layer networks, self-supervised learning, and benefits of decoupled initialization.

Improving Models of the Ventral Visual Pathway

Explores computational models of the ventral visual system, focusing on optimizing networks for real-world tasks and comparing to brain data.

Neural Networks: Training and Optimization

Explores the training and optimization of neural networks, addressing challenges like non-convex loss functions and local minima.

Neural Networks Optimization

Explores neural networks optimization, including backpropagation, batch normalization, weight initialization, and hyperparameter search strategies.

Deep Learning: Fundamentals

Covers the fundamentals of deep learning, from artificial neurons to modern networks.

Optimization in Machine Learning: Gradient Descent

Covers optimization in machine learning, focusing on gradient descent for linear and logistic regression, stochastic gradient descent, and practical considerations.

Splines and Machine Learning

Explores supervised learning as an ill-posed problem and the integration of sparse adaptive splines into neural architectures.

The Hidden Convex Optimization Landscape of Deep Neural Networks

Explores the hidden convex optimization landscape of deep neural networks, showcasing the transition from non-convex to convex models.

Gradient Descent Methods for Artificial Neural Networks

Explores gradient descent methods for training artificial neural networks, covering supervised learning, single-layer networks, and modern gradient descent rules.

Statistical Learning Theory: Conclusions on Deep Learning

Covers the conclusions on deep learning and an introduction to statistical learning theory.

Learning Sparse Features: Overfitting in Neural Networks

Discusses how learning sparse features can lead to overfitting in neural networks despite empirical evidence of generalization.

Neural Networks: Training and Activation

Explores neural networks, activation functions, backpropagation, and PyTorch implementation.

Non conceptual knowledge systems

Explores the impact of Deep learning on Digital Humanities, focusing on non conceptual knowledge systems and recent advancements in AI.