Concept

Activation function

Related lectures (32)

Explores supervised learning as an ill-posed problem and the integration of sparse adaptive splines into neural architectures.

Multilayer Neural Networks: Deep Learning

Covers the fundamentals of multilayer neural networks and deep learning.

Neural Networks

Explores neural networks, hidden layers, weight adjustments, activation functions, and the universal approximation theorem.

Deep Neural Networks: Optimization and Approximation

Explores optimization and approximation in deep neural networks, including optimal control and numerical experiments.

Neural Networks: Multi-layers

Explains the learning process in multi-layer neural networks, including back-propagation, activation functions, weights update, and error backpropagation.

Deep Generative Models: Part 2

Explores deep generative models, including mixtures of multinomials, PCA, deep autoencoders, convolutional autoencoders, and GANs.

Neural Networks: Multilayer Learning

Covers the fundamentals of multilayer neural networks and deep learning, including back-propagation and network architectures like LeNet, AlexNet, and VGG-16.

Neural Networks: Deep Neural Networks

Explores the basics of neural networks, with a focus on deep neural networks and their architecture and training.

Advanced Triangulation: Gradient Maximization

Covers advanced triangulation problems related to gradient maximization.

Adversarial Training: Optimization and Applications

Explores adversarial training optimization, practical implementation, interpretability, fairness, Wasserstein distance, and Wasserstein GANs.

Deep Learning: Edge Detection and Neural Networks

Discusses edge detection techniques and the evolution of deep learning in neural networks.

Deep Learning Building Blocks

Covers tensors, loss functions, autograd, and convolutional layers in deep learning.

Neural Networks: Multilayer Perceptron

Explores the history, models, training, convergence, and limitations of neural networks, including the backpropagation algorithm and universal approximation.

Deep Learning: Multilayer Perceptron and Training

Covers deep learning fundamentals, focusing on multilayer perceptrons and their training processes.

Word Embeddings: Context and Representation

Explores word embeddings, emphasizing word-context relationships and low-dimensional representations.

Photonic Extreme Learning Machines: Reservoir Computing Techniques

Covers photonic extreme learning machines and reservoir computing, focusing on their architectures, programming techniques, and applications in optical computing.

Neural Networks: Multilayer Perceptrons

Covers Multilayer Perceptrons, artificial neurons, activation functions, matrix notation, flexibility, regularization, regression, and classification tasks.

Optimal Errors and Phase Transitions

Explores optimal errors and phase transitions in high dimensional models.

Neural Networks: Two Layers Neural Network

Covers the basics of neural networks, focusing on the development from two layers neural networks to deep neural networks.

Neural Network: Random Features and Kernel Regression

Covers random features in neural networks and kernel regression equivalence.

Graph Chat

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.