Mediaspace scheduled maintenance: Aug 25, 2026 07:00 - 12:00 AM. During this time, videos will be temporarily unavailable. Check status updates.

Home

Lecture

Transformers: Self-Attention and MLP

About
Privacy
Disclaimer

Graph Chatbot

Related lectures (37)

Financial Time Series Analysis Log in to Mediaspace to watch this video

Covers stylized facts of asset returns, summary statistics, testing for normality, Q-Q plots, and efficient market hypothesis.

Feed-forward Networks Log in to Mediaspace to watch this video

Introduces feed-forward networks, covering neural network structure, training, activation functions, and optimization, with applications in forecasting and finance.

Deep Learning Fundamentals Log in to Mediaspace to watch this video

Introduces deep learning fundamentals, covering data representations, neural networks, and convolutional neural networks.

Neural Networks: Regression and Classification Log in to Mediaspace to watch this video

Explores neural networks for regression and classification tasks, covering training, regularization, and practical examples.

Deep Learning: Multilayer Perceptron and Training Log in to Mediaspace to watch this video

Covers deep learning fundamentals, focusing on multilayer perceptrons and their training processes.

Neural Networks: Basics and Applications Log in to Mediaspace to watch this video

Explores neural networks basics, XOR problem, classification, and practical applications like weather data prediction.

Deep Learning: Data Representations and Neural Networks Log in to Mediaspace to watch this video

Covers data representations, Bag of Words, histograms, data pre-processing, and neural networks.

Multi-layered Perceptron: History and Training Algorithm Log in to Mediaspace to watch this video

Explores the historical development and training of multi-layered perceptrons, emphasizing the backpropagation algorithm and feature design.

Chemical Reactions: Transformer Architecture Log in to Mediaspace to watch this video

Explores atom mapping in chemical reactions and the transition to reaction grammar using the transformer architecture.

Deep Learning Fundamentals Log in to Mediaspace to watch this video

Introduces deep learning, from logistic regression to neural networks, emphasizing the need for handling non-linearly separable data.

Reinforcement Learning Concepts Log in to Mediaspace to watch this video

Covers key concepts in reinforcement learning, neural networks, clustering, and unsupervised learning, emphasizing their applications and challenges.

Brain Intelligence: Continual Learning of Representational Models Log in to Mediaspace to watch this video

Delves into the continual learning of representational models in brain intelligence, emphasizing rapid adaptation to unstructured environments.

Convolutional Neural Networks: Semantic Segmentation Log in to Mediaspace to watch this video

Explores Convolutional Neural Networks for semantic segmentation, discussing models for pixel classification, learned decoding, and the importance of skip connections.

Introduction to Natural Language Processing Log in to Mediaspace to watch this video

Covers the basics of Natural Language Processing, from traditional to modern approaches, highlighting the challenges and importance of studying both methods.

Convolutional Neural Networks: Training Tricks Log in to Mediaspace to watch this video

Explores convolutional neural networks for image classification, focusing on weight challenges, overfitting prevention strategies, and fine-tuning pre-trained models.

Transformers: Pre-Training Log in to Mediaspace to watch this video

Discusses challenges and advancements in Transformers, pretraining models, and subword tokenization in NLP.

Dimensionality Reduction: PCA and LDA Log in to Mediaspace to watch this video

Covers dimensionality reduction techniques like PCA and LDA, clustering methods, density estimation, and data representation.

Page 2 of 2