Lecture

Deep Splines: Unifying Framework for Deep Neural Networks

Graph Chat

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

Related lectures (64)

The Hidden Convex Optimization Landscape of Deep Neural Networks

Explores the hidden convex optimization landscape of deep neural networks, showcasing the transition from non-convex to convex models.

Deep Neural Networks and Splines

Covers the fundamentals of deep neural networks and splines, exploring their properties, implications, and applications in modern machine learning.

Neural Networks: Multilayer Perceptrons

Covers Multilayer Perceptrons, artificial neurons, activation functions, matrix notation, flexibility, regularization, regression, and classification tasks.

Dynamics of Linear Neural Networks

Explores the learning dynamics of deep neural networks using linear networks for analysis, covering two-layer and multi-layer networks, self-supervised learning, and benefits of decoupled initialization.

Deep Learning: Multilayer Perceptron and Training

Covers deep learning fundamentals, focusing on multilayer perceptrons and their training processes.

Neural Networks: Multilayer Learning

Covers the fundamentals of multilayer neural networks and deep learning, including back-propagation and network architectures like LeNet, AlexNet, and VGG-16.

Statistical Learning Theory: Conclusions on Deep Learning

Covers the conclusions on deep learning and an introduction to statistical learning theory.

Deep Neural Networks: Optimization and Approximation

Explores optimization and approximation in deep neural networks, including optimal control and numerical experiments.

Foundations of Deep Learning: Transformer Architecture Overview

Covers the foundational concepts of deep learning and the Transformer architecture, focusing on neural networks, attention mechanisms, and their applications in sequence modeling tasks.

Deep Learning: Data Representations and Neural Networks

Explores data representations, histograms, neural networks, and deep learning concepts.

Neural Networks: Multi-layers

Explains the learning process in multi-layer neural networks, including back-propagation, activation functions, weights update, and error backpropagation.

Non conceptual knowledge systems

Explores the impact of Deep learning on Digital Humanities, focusing on non conceptual knowledge systems and recent advancements in AI.

Tricks of the Trade in Deep Learning: Aims

Covers practical questions and aims in deep learning, including neuron types, network architecture, optimization, and weight initialization.

Gradient-Based Algorithms in High-Dimensional Learning

Provides insights on gradient-based algorithms, deep learning mysteries, and the challenges of non-convex problems.

Convolutional Neural Networks: Fundamentals

Covers the basics of Convolutional Neural Networks, including training optimization, layer structure, and potential pitfalls of summary statistics.

Introduction to Machine Learning

Provides an overview of Machine Learning, including historical context, key tasks, and real-world applications.

Neural Networks Recap: Activation Functions

Covers the basics of neural networks, activation functions, training, image processing, CNNs, regularization, and dimensionality reduction methods.

Building Physical Neural Networks

Discusses challenges in building physical neural networks, focusing on depth, connections, and trainability.

Statistical Physics in Machine Learning: Understanding Deep Learning

Explores the application of statistical physics in understanding deep learning with a focus on neural networks and machine learning challenges.

Statistical Physics of Learning

Offers insights into the statistical physics of learning, exploring the relationship between neural network structure and disordered systems.