Mediaspace scheduled maintenance: Aug 25, 2026 07:00 - 12:00 AM. During this time, videos will be temporarily unavailable. Check status updates.

Home

Lecture

Pretraining: Transformers & Models

About
Privacy
Disclaimer

Graph Chatbot

Related lectures (49)

Deep Learning for NLP Log in to Mediaspace to watch this video

Introduces deep learning concepts for NLP, covering word embeddings, RNNs, and Transformers, emphasizing self-attention and multi-headed attention.

Neural Networks for NLP Log in to Mediaspace to watch this video

Covers modern Neural Network approaches to NLP, focusing on word embeddings, Neural Networks for NLP tasks, and future Transfer Learning techniques.

Natural Language Processing: Understanding Transformers and Tokenization Log in to Mediaspace to watch this video

Provides an overview of Natural Language Processing, focusing on transformers, tokenization, and self-attention mechanisms for effective language analysis and synthesis.

Deep Learning for NLP Log in to Mediaspace to watch this video

Delves into Deep Learning for Natural Language Processing, exploring Neural Word Embeddings, Recurrent Neural Networks, and Attentive Neural Modeling with Transformers.

Transformers: Pre-Training Log in to Mediaspace to watch this video

Discusses challenges and advancements in Transformers, pretraining models, and subword tokenization in NLP.

Transformer: Pre-Training Log in to Mediaspace to watch this video

Explores the Transformer model, from recurrent models to attention-based NLP, highlighting its key components and significant results in machine translation and document generation.

Chemical Reactions: Transformer Architecture Log in to Mediaspace to watch this video

Explores atom mapping in chemical reactions and the transition to reaction grammar using the transformer architecture.

Deep Generative Models: Part 2 Log in to Mediaspace to watch this video

Explores deep generative models, including mixtures of multinomials, PCA, deep autoencoders, convolutional autoencoders, and GANs.

Untitled Log in to Mediaspace to watch this video

Coreference Resolution: Models and Evaluation Log in to Mediaspace to watch this video

Explores coreference resolution models, challenges in scoring spans, graph refinement techniques, state-of-the-art results, and the impact of pretrained Transformers.

Transformer Architecture: Subquadratic Attention Mechanisms Log in to Mediaspace to watch this video

Covers transformer architecture, focusing on encoder-decoder models and subquadratic attention mechanisms for efficient processing of input sequences.

Foundations of Deep Learning: Transformer Architecture Overview Log in to Mediaspace to watch this video

Covers the foundational concepts of deep learning and the Transformer architecture, focusing on neural networks, attention mechanisms, and their applications in sequence modeling tasks.

Question Answering: Deep Learning Insights Log in to Mediaspace to watch this video

Explores question answering systems, reading comprehension models, and the challenges in achieving accurate responses.

Document Analysis: Topic Modeling Log in to Mediaspace to watch this video

Explores document analysis, topic modeling, and generative models for data generation in machine learning.

Machine Learning at the Atomic Scale Log in to Mediaspace to watch this video

Explores simple models, electronic structure evaluation, and machine learning at the atomic scale.

Molecular Synthesis Planning: Transformer Models and Atom Mapping Log in to Mediaspace to watch this video

Explores Molecular Transformer models, atom mapping, AI synthesis planning, and the transformative role of Transformers in chemistry.

Reinforcement Learning Concepts Log in to Mediaspace to watch this video

Covers key concepts in reinforcement learning, neural networks, clustering, and unsupervised learning, emphasizing their applications and challenges.

Coreference Resolution Log in to Mediaspace to watch this video

Covers coreference resolution, models, applications, challenges, and advancements in natural language processing.

Graphical Models: Probability Distributions and Factor Graphs Log in to Mediaspace to watch this video

Covers graphical models for probability distributions and factor graphs representation.

Untitled Log in to Mediaspace to watch this video

Page 2 of 3