Mediaspace scheduled maintenance: Aug 25, 2026 07:00 - 12:00 AM. During this time, videos will be temporarily unavailable. Check status updates.

Home

Lecture

Transformers: Pretraining and Decoding Techniques

About
Privacy
Disclaimer

Graph Chatbot

Related lectures (41)

Neural Networks for NLP Log in to Mediaspace to watch this video

Covers modern Neural Network approaches to NLP, focusing on word embeddings, Neural Networks for NLP tasks, and future Transfer Learning techniques.

Deep Learning for NLP Log in to Mediaspace to watch this video

Explores deep learning for NLP, covering word embeddings, context representations, learning techniques, and challenges like vanishing gradients and ethical considerations.

Machine Translation: Attention Mechanism Log in to Mediaspace to watch this video

Explores the attention mechanism in machine translation, addressing the bottleneck problem and improving NMT performance significantly.

Transformers: Unifying Machine Learning Communities Log in to Mediaspace to watch this video

Covers the role of Transformers in unifying various machine learning fields.

Foundations of Deep Learning: Transformer Architecture Overview Log in to Mediaspace to watch this video

Covers the foundational concepts of deep learning and the Transformer architecture, focusing on neural networks, attention mechanisms, and their applications in sequence modeling tasks.

Pre-Training: BiLSTM and Transformer Log in to Mediaspace to watch this video

Delves into pre-training BiLSTM and Transformer models for NLP tasks, showcasing their effectiveness and applications.

Deep Learning for NLP Log in to Mediaspace to watch this video

Delves into Deep Learning for Natural Language Processing, exploring Neural Word Embeddings, Recurrent Neural Networks, and Attentive Neural Modeling with Transformers.

Coreference Resolution Log in to Mediaspace to watch this video

Covers coreference resolution, models, applications, challenges, and advancements in natural language processing.

Transformers in Vision: Applications and Architectures Log in to Mediaspace to watch this video

Covers the impact of transformers in computer vision, discussing their architecture, applications, and advancements in various tasks.

Deep Generative Models: Part 2 Log in to Mediaspace to watch this video

Explores deep generative models, including mixtures of multinomials, PCA, deep autoencoders, convolutional autoencoders, and GANs.

Transformer: Pre-Training Log in to Mediaspace to watch this video

Explores the Transformer model, from recurrent models to attention-based NLP, highlighting its key components and significant results in machine translation and document generation.

Model Analysis Log in to Mediaspace to watch this video

Explores neural model analysis in NLP, covering evaluation, probing, and ablation studies to understand model behavior and interpretability.

Neuro-symbolic Representations: Commonsense Knowledge & Reasoning Log in to Mediaspace to watch this video

Explores neuro-symbolic representations for understanding commonsense knowledge and reasoning, emphasizing the challenges and limitations of deep learning in natural language processing.

Manipulating Objects with Robots: Vision-Language Integration Log in to Mediaspace to watch this video

Discusses how robots manipulate objects using natural language instructions and integrates vision-language models for enhanced performance.

Untitled Log in to Mediaspace to watch this video

Integrative Benchmarking: Advancing System Models of Human Intelligence Log in to Mediaspace to watch this video

Explores advancing system models of human intelligence through integrative benchmarking and the importance of Brain-Score for fair model comparisons.

Predicting Reaction Yields with Deep Learning Log in to Mediaspace to watch this video

Explores predicting reaction yields with deep learning models and the importance of high-quality data sets in chemistry.

Feature Maps Log in to Mediaspace to watch this video

Explores the visualization of feature maps in neural networks and the features learned by deep models.

Machine Learning Models for Neuroscience Log in to Mediaspace to watch this video

Explores machine learning models for neuroscience, focusing on understanding brain function and core object recognition through convolutional neural networks.

Adaptive Signal Processing: Filtering & Neural Networks Log in to Mediaspace to watch this video

Explores adaptive signal processing, gradient descent, and the LMS algorithm for efficient filtering and neural network training.

Page 2 of 3