Mediaspace scheduled maintenance: Aug 25, 2026 07:00 - 12:00 AM. During this time, videos will be temporarily unavailable. Check status updates.

Home

Lecture

Pretraining Sequence-to-Sequence Models: BART and T5

About
Privacy
Disclaimer

Graph Chatbot

Related lectures (50)

Transformer: Pre-Training Log in to Mediaspace to watch this video

Explores the Transformer model, from recurrent models to attention-based NLP, highlighting its key components and significant results in machine translation and document generation.

Modern NLP and Ethics in NLP Log in to Mediaspace to watch this video

Delves into advancements and challenges in NLP, along with ethical considerations and potential harms.

BERT: Pretraining and Applications Log in to Mediaspace to watch this video

Delves into BERT pretraining for transformers, discussing its applications in NLP tasks.

Neural Networks for NLP Log in to Mediaspace to watch this video

Covers modern Neural Network approaches to NLP, focusing on word embeddings, Neural Networks for NLP tasks, and future Transfer Learning techniques.

Coreference Resolution Log in to Mediaspace to watch this video

Covers coreference resolution, models, applications, challenges, and advancements in natural language processing.

Natural Language Processing: A Primer Log in to Mediaspace to watch this video

Introduces Natural Language Processing (NLP) and its applications, covering tokenization, machine learning, sentiment analysis, and Swiss NLP applications.

Ethics in NLP Log in to Mediaspace to watch this video

Discusses the ethical implications of NLP systems, focusing on biases, toxicity, and privacy concerns in language models.

Chemical Reaction Prediction: Molecular Transformer Log in to Mediaspace to watch this video

Explores chemical reaction prediction using generative models and molecular transformers, emphasizing the importance of molecular language processing and stereochemistry.

Machine Learning: Supervised and Unsupervised Learning Techniques Log in to Mediaspace to watch this video

Covers supervised and unsupervised learning techniques in machine learning, highlighting their applications in finance and environmental analysis.

Deep Learning for NLP Log in to Mediaspace to watch this video

Explores deep learning for NLP, covering word embeddings, context representations, learning techniques, and challenges like vanishing gradients and ethical considerations.

Transformer Architecture: Subquadratic Attention Mechanisms Log in to Mediaspace to watch this video

Covers transformer architecture, focusing on encoder-decoder models and subquadratic attention mechanisms for efficient processing of input sequences.

Question Answering: Deep Learning Insights Log in to Mediaspace to watch this video

Explores question answering systems, reading comprehension models, and the challenges in achieving accurate responses.

Coreference Resolution: Models and Evaluation Log in to Mediaspace to watch this video

Explores coreference resolution models, challenges in scoring spans, graph refinement techniques, state-of-the-art results, and the impact of pretrained Transformers.

Machine Learning at the Atomic Scale Log in to Mediaspace to watch this video

Explores simple models, electronic structure evaluation, and machine learning at the atomic scale.

Foundations of Deep Learning: Transformer Architecture Overview Log in to Mediaspace to watch this video

Covers the foundational concepts of deep learning and the Transformer architecture, focusing on neural networks, attention mechanisms, and their applications in sequence modeling tasks.

Deep Learning: Dimensionality and Data Representation Log in to Mediaspace to watch this video

Delves into deep learning's dimensionality, data representation, and performance in classifying large-dimensional data, exploring the curse of dimensionality and the neural tangent kernel.

Document Analysis: Topic Modeling Log in to Mediaspace to watch this video

Explores document analysis, topic modeling, and generative models for data generation in machine learning.

Boltzmann Machine: RBM Log in to Mediaspace to watch this video

Explores the Restricted Boltzmann Machine, a more expressive version of the Boltzmann Machine with hidden units.

Machine Learning and Modern AI: SWOT Analysis Log in to Mediaspace to watch this video

Covers a SWOT analysis of Machine Learning and Artificial Intelligence, exploring strengths, weaknesses, opportunities, and threats in the field.

Reinforcement Learning Concepts Log in to Mediaspace to watch this video

Covers key concepts in reinforcement learning, neural networks, clustering, and unsupervised learning, emphasizing their applications and challenges.

Page 2 of 3