Lecture

Deep Learning: Data Representation and Neural Networks

Graph Chat

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

Related lectures (64)

Deep Learning Building Blocks: Linear Layers

Explains the fundamental building blocks of deep learning, focusing on linear layers and activation functions.

Neural Networks: Perceptron

Covers the main concepts of neural networks, including the Perceptron model and training algorithms.

Tricks of the Trade in Deep Learning: Aims

Covers practical questions and aims in deep learning, including neuron types, network architecture, optimization, and weight initialization.

Batch Normalization: Why It Works

Explores the aim and process of batch normalization in deep neural networks, emphasizing its importance in stabilizing mean input and solving the vanishing gradient problem.

Splines and Imaging: From Compressed Sensing to Deep Neural Nets

Explores the optimality of splines for imaging and deep neural networks, demonstrating sparsity and global optimality with spline activations.

Deep and Robust Reinforcement Learning Techniques

Discusses advanced reinforcement learning techniques, focusing on deep and robust methods, including actor-critic frameworks and adversarial learning strategies.

Machine Learning for Solving PDEs: Random Feature Method

Explores the Random Feature Method for solving PDEs using machine learning algorithms to approximate high-dimensional functions efficiently.

Learning with Deep Neural Networks

Explores the success and challenges of deep learning, including overfitting, generalization, and the impact on various domains.

Neural Networks

Explores neural networks, hidden layers, weight adjustments, activation functions, and the universal approximation theorem.

Building Physical Neural Networks

Discusses challenges in building physical neural networks, focusing on depth, connections, and trainability.

Neural Networks: Multi-layers

Explains the learning process in multi-layer neural networks, including back-propagation, activation functions, weights update, and error backpropagation.

Deep Learning: Data Representation and Multilayer Perceptron

Covers data representation, MLP training, activation functions, and gradient-based learning in deep neural networks.

Foundations of Deep Learning: Transformer Architecture Overview

Covers the foundational concepts of deep learning and the Transformer architecture, focusing on neural networks, attention mechanisms, and their applications in sequence modeling tasks.

Neural Networks: Basics and History

Covers the history and fundamental concepts of neural networks, including the mathematical model of a neuron, gradient descent, and the multilayer perceptron.

Neural Networks: Training and Optimization

Explores the training and optimization of neural networks, addressing challenges like non-convex loss functions and local minima.

Multilayer Networks: First Steps

Covers the preparation for deriving the Backprop algorithm in layered networks using multi-layer perceptrons and gradient descent.

Convolutional Neural Networks

Introduces Convolutional Neural Networks (CNNs) for autonomous vehicles, covering architecture, applications, and regularization techniques.

Multilayer Perceptron: Training and Optimization

Explores the multilayer perceptron model, training, optimization, data preprocessing, activation functions, backpropagation, and regularization.

Convolutional Neural Networks

Covers Convolutional Neural Networks, including layers, training strategies, standard architectures, tasks like semantic segmentation, and deep learning tricks.

State Space Models: Expressivity of Transformers

Covers state space models and the expressivity of transformers in sequence copying tasks.