Mediaspace scheduled maintenance: Aug 25, 2026 07:00 - 12:00 AM. During this time, videos will be temporarily unavailable. Check status updates.

Concept

Generative pre-trained transformer

Related lectures (31)

Coreference Resolution: Models and Evaluation Log in to Mediaspace to watch this video

Explores coreference resolution models, challenges in scoring spans, graph refinement techniques, state-of-the-art results, and the impact of pretrained Transformers.

BERT: Pretraining and Applications Log in to Mediaspace to watch this video

Delves into BERT pretraining for transformers, discussing its applications in NLP tasks.

Chemical Reaction Prediction: Molecular Transformer Log in to Mediaspace to watch this video

Explores chemical reaction prediction using generative models and molecular transformers, emphasizing the importance of molecular language processing and stereochemistry.

Chemical Reactions: Transformer Architecture Log in to Mediaspace to watch this video

Explores atom mapping in chemical reactions and the transition to reaction grammar using the transformer architecture.

Model Analysis Log in to Mediaspace to watch this video

Explores neural model analysis in NLP, covering evaluation, probing, and ablation studies to understand model behavior and interpretability.

Transformer: Pre-Training Log in to Mediaspace to watch this video

Explores the Transformer model, from recurrent models to attention-based NLP, highlighting its key components and significant results in machine translation and document generation.

Deep Learning for NLP Log in to Mediaspace to watch this video

Explores deep learning for NLP, covering word embeddings, context representations, learning techniques, and challenges like vanishing gradients and ethical considerations.

SRAM: Peripherals and Noise Margin Log in to Mediaspace to watch this video

Covers the operation of SRAM, focusing on peripherals and noise margin.

Modern NLP and Ethics in NLP Log in to Mediaspace to watch this video

Delves into advancements and challenges in NLP, along with ethical considerations and potential harms.

Distributed Machine Learning: Algorithms and Challenges Log in to Mediaspace to watch this video

Explores distributed machine learning algorithms, adaptive methods for attention models, collaborative learning, and open problems in the field.

Cognitive Maps in Rats and Men Log in to Mediaspace to watch this video

Explores cognitive maps, reward systems, latent learning, attention mechanisms, and transformers in visual intelligence and machine learning.