Lecture

Neural Networks for NLP

Graph Chat

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

Related lectures (64)

Transformers: Pretraining and Decoding Techniques

Covers advanced transformer concepts, focusing on pretraining and decoding techniques in NLP.

Mathematics of Data: Deep Learning Introduction

Covers a mathematical introduction to deep learning, including challenges, power of linear classifiers, model scaling, and theoretical aspects.

Deep Learning: Multilayer Perceptron and Training

Covers deep learning fundamentals, focusing on multilayer perceptrons and their training processes.

Modern NLP: A Simple Neural Classifier

Introduces the basics of modern NLP, covering word embeddings, neural models, and tasks like sequence labeling and text generation.

The Hidden Convex Optimization Landscape of Deep Neural Networks

Explores the hidden convex optimization landscape of deep neural networks, showcasing the transition from non-convex to convex models.

Provable and Generalizable Robustness in Deep Learning

Explores adversarial examples, defenses, and certifiable robustness in deep learning, including Gaussian smoothing and perceptual attacks.

Perception: Data-Driven Approaches

Explores perception in deep learning for autonomous vehicles, covering image classification, optimization methods, and the role of representation in machine learning.

Deep Knowledge Tracing

Explores Deep Knowledge Tracing and its application in predicting student learning outcomes using neural networks and loss functions.

Neural Networks: Multilayer Perceptrons

Covers Multilayer Perceptrons, artificial neurons, activation functions, matrix notation, flexibility, regularization, regression, and classification tasks.

Batch Normalization: Why It Works

Explores the aim and process of batch normalization in deep neural networks, emphasizing its importance in stabilizing mean input and solving the vanishing gradient problem.

Foundations of Deep Learning: Transformer Architecture Overview

Covers the foundational concepts of deep learning and the Transformer architecture, focusing on neural networks, attention mechanisms, and their applications in sequence modeling tasks.

Medical Image Reconstruction: From Model-Based to Data-Driven

Explores the evolution of medical image reconstruction techniques, from classical methods to data-driven approaches using deep neural networks.

Contextual Representations: ELMO and BERT Overview

Covers contextual representations in NLP, focusing on ELMO and BERT architectures and their applications in various tasks.

Deep and Robust Reinforcement Learning Techniques

Discusses advanced reinforcement learning techniques, focusing on deep and robust methods, including actor-critic frameworks and adversarial learning strategies.

Deep Generative Models: Part 2

Explores deep generative models, including mixtures of multinomials, PCA, deep autoencoders, convolutional autoencoders, and GANs.

Recurrent Neural Networks: LSTMs & GRUs

Explores LSTM and GRU variants in recurrent neural networks, addressing challenges and advantages.

Word Embeddings: Introduction and Applications

Introduces word embeddings, explaining how they capture word meanings based on context and their applications in natural language processing tasks.

Structures in Non-Convex Optimization

Covers non-convex optimization, deep learning training problems, stochastic gradient descent, adaptive methods, and neural network architectures.

Non-Conceptual Knowledge Systems

Delves into the impact of deep learning on non-conceptual knowledge systems and the advancements in transformers and generative adversarial networks.

Diffusion Models in Generative Modeling

Explores diffusion models in generative modeling, covering probability estimation, data generation, and model evaluation.