Lecture

Generative Models: Self-Attention and Transformers

Graph Chat

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

Related lectures (64)

Document Analysis: Topic Modeling

Explores document analysis, topic modeling, and generative models for data generation in machine learning.

Generative Models: Boltzmann Machine

Covers generative models, focusing on Boltzmann machines and constrained maximization using Lagrange multipliers.

Linear Models: Part 1

Covers linear models, including regression, derivatives, gradients, hyperplanes, and classification transition, with a focus on minimizing risk and evaluation metrics.

Machine Learning Fundamentals

Introduces fundamental machine learning concepts, covering regression, classification, dimensionality reduction, and deep generative models.

Deep Generative Models

Covers deep generative models, including variational autoencoders, GANs, and deep convolutional GANs.

Machine Learning Review

Covers a review of machine learning concepts, including supervised learning, classification vs regression, linear models, kernel functions, support vector machines, dimensionality reduction, deep generative models, and cross-validation.

Understanding Data Attributes

Covers the analysis of various data attributes and linear regression models.

Introduction to Machine Learning: Linear Models

Introduces linear models for supervised learning, covering overfitting, regularization, and kernels, with applications in machine learning tasks.

Supervised Learning: Linear Regression

Covers supervised learning with a focus on linear regression, including topics like digit classification, spam detection, and wind speed prediction.

Linear Regression: Basics

Covers the basics of linear regression, binary and multi-class classification, and evaluation metrics.

Introduction to Machine Learning

Covers the basics of machine learning, including supervised and unsupervised learning, linear regression, and classification.

Introduction to Machine Learning: Course Overview and Basics

Introduces the course structure and fundamental concepts of machine learning, including supervised learning and linear regression.

Explicit Stabilised Methods: Applications to Bayesian Inverse Problems

Explores explicit stabilised Runge-Kutta methods and their application to Bayesian inverse problems, covering optimization, sampling, and numerical experiments.

Deep Generative Models: Part 2

Explores deep generative models, including mixtures of multinomials, PCA, deep autoencoders, convolutional autoencoders, and GANs.

Machine Learning Basics

Introduces the basics of machine learning, covering supervised and unsupervised learning, linear regression, and data understanding.

Machine learning: Basics of data-driven materials modeling

Covers dimensionality reduction and linear regression in data-driven materials modeling.

Linear Regression Basics

Covers the basics of linear regression in machine learning, including model training, loss functions, and evaluation metrics.

Linear Models: Continued

Explores linear models, logistic regression, gradient descent, and multi-class logistic regression with practical applications and examples.

Linear Regression: Statistical Inference and Regularization

Covers the probabilistic model for linear regression and the importance of regularization techniques.

Deep Generative Models

Covers deep generative models, including LDA, autoencoders, GANs, and DCGANs.