Mediaspace scheduled maintenance: Aug 25, 2026 07:00 - 12:00 AM. During this time, videos will be temporarily unavailable. Check status updates.

Home

Lecture

Transformer: Pre-Training

About
Privacy
Disclaimer

Graph Chatbot

Related lectures (31)

Chemical Reaction Prediction: Molecular Transformer Log in to Mediaspace to watch this video

Explores chemical reaction prediction using generative models and molecular transformers, emphasizing the importance of molecular language processing and stereochemistry.

Neural Machine Translation Log in to Mediaspace to watch this video

Explores the evolution and challenges of Neural Machine Translation systems and the evaluation metrics used in this field.

Deep Learning for NLP Log in to Mediaspace to watch this video

Explores deep learning for NLP, covering word embeddings, context representations, learning techniques, and challenges like vanishing gradients and ethical considerations.

Pre-Training: BiLSTM and Transformer Log in to Mediaspace to watch this video

Delves into pre-training BiLSTM and Transformer models for NLP tasks, showcasing their effectiveness and applications.

BERT: Pretraining and Applications Log in to Mediaspace to watch this video

Delves into BERT pretraining for transformers, discussing its applications in NLP tasks.

Transformers in Vision: Applications and Architectures Log in to Mediaspace to watch this video

Covers the impact of transformers in computer vision, discussing their architecture, applications, and advancements in various tasks.

Modern NLP and Ethics in NLP Log in to Mediaspace to watch this video

Delves into advancements and challenges in NLP, along with ethical considerations and potential harms.

Deep Learning for NLP Log in to Mediaspace to watch this video

Delves into Deep Learning for Natural Language Processing, exploring Neural Word Embeddings, Recurrent Neural Networks, and Attentive Neural Modeling with Transformers.

Transformers: Unifying Machine Learning Communities Log in to Mediaspace to watch this video

Covers the role of Transformers in unifying various machine learning fields.

Coreference Resolution Log in to Mediaspace to watch this video

Covers coreference resolution, models, applications, challenges, and advancements in natural language processing.

Foundations of Deep Learning: Transformer Architecture Overview Log in to Mediaspace to watch this video

Covers the foundational concepts of deep learning and the Transformer architecture, focusing on neural networks, attention mechanisms, and their applications in sequence modeling tasks.

Page 2 of 2