Lecture

Gradient Descent on Two-Layer ReLU Neural Networks

Graph Chat

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

Related lectures (64)

Nonlinear Supervised Learning

Explores the inductive bias of different nonlinear supervised learning methods and the challenges of hyper-parameter tuning.

Applied Machine Learning

Introduces applied machine learning concepts such as data collection, feature engineering, model selection, and performance evaluation metrics.

Structured Learning: Chau-Lieu Algorithm

Explores structured learning with the Chau-Lieu algorithm and delves into the basics of deep learning and neural networks.

Introduction: Foundations of Data Science

Covers distribution estimation, property testing, and multi-arm bandits in data science.

Deep Learning Fundamentals

Introduces deep learning fundamentals, covering data representations, neural networks, and convolutional neural networks.

Introduction to Reinforcement Learning: Key Concepts and Applications

Introduces reinforcement learning, covering its definitions, applications, and theoretical foundations, while outlining the course structure and objectives.

Deep Learning: Data Representations and Neural Networks

Covers data representations, Bag of Words, histograms, data pre-processing, and neural networks.

Deep Neural Networks: Optimization and Approximation

Explores optimization and approximation in deep neural networks, including optimal control and numerical experiments.

Deep Learning: Convolutional Networks

Explores convolutional neural networks, backpropagation, and stochastic gradient descent in deep learning.

Adaptive Gradient Methods: Part 1

Explores adaptive gradient methods and their impact on optimization scenarios, including AdaGrad, ADAM, and RMSprop.

Optimization in Machine Learning: Gradient Descent

Covers optimization in machine learning, focusing on gradient descent for linear and logistic regression, stochastic gradient descent, and practical considerations.

Convolutional Neural Networks

Covers convolutional neural networks, filter operations, and their applications in signal processing and image analysis.

Neural Networks: Multilayer Learning

Covers the fundamentals of multilayer neural networks and deep learning, including back-propagation and network architectures like LeNet, AlexNet, and VGG-16.

Support Vector Machines: Maximizing Margin

Explores Support Vector Machines, maximizing margin for robust classification and the transition to soft SVM for non-linearly separable data.

Reinforcement Learning Concepts

Covers key concepts in reinforcement learning, neural networks, clustering, and unsupervised learning, emphasizing their applications and challenges.

Deep Knowledge Tracing

Explores Deep Knowledge Tracing and its application in predicting student learning outcomes using neural networks and loss functions.

Deep Learning

Covers the fundamentals of deep learning, including data representations, bag of words, data pre-processing, artificial neural networks, and convolutional neural networks.

Deep Reinforcement Learning: Mini-Batches and Policy Methods

Discusses deep reinforcement learning methods, focusing on mini-batches and the implications of on-policy and off-policy training techniques.

Deep and Convolutional Networks: Generalization and Optimization

Explores deep and convolutional networks, covering generalization, optimization, and practical applications in machine learning.

Machine Learning and Privacy

Explores the intersection of machine learning and privacy, discussing confidentiality, attacks, differential privacy, and trade-offs in federated learning.