Mediaspace scheduled maintenance: Aug 25, 2026 07:00 - 12:00 AM. During this time, videos will be temporarily unavailable. Check status updates.

Home

Lecture

Transformer Architectures: Subquadratic Attention Mechanisms

About
Privacy
Disclaimer

Graph Chatbot

Related lectures (48)

Linear Applications and Matrix Calculus Log in to Mediaspace to watch this video

Explores linear applications, matrices, injectivity, unique solutions, and matrix operations.

Matrix Operations: Product and Inverse Log in to Mediaspace to watch this video

Covers matrix operations, focusing on the product and inverse of matrices.

State Space Models: Expressivity and Transformers Log in to Mediaspace to watch this video

Covers state space models and their expressivity compared to transformers, focusing on attention mechanisms and computational efficiency.

State Space Models: Expressivity of Transformers Log in to Mediaspace to watch this video

Covers state space models and the expressivity of transformers in sequence copying tasks.

Matrix Multiplication: Basics and Properties Log in to Mediaspace to watch this video

Covers the basics of matrix multiplication, including properties and examples.

Linear Systems: Diagonal and Triangular Matrices, LU Factorization Log in to Mediaspace to watch this video

Covers linear systems, diagonal and triangular matrices, and LU factorization.

Matrix Inversion: Basics and Properties Log in to Mediaspace to watch this video

Covers the basics of matrix inversion, properties of matrix multiplication, and the uniqueness of matrix inverses.

Matrix Operations and Vector Spaces Log in to Mediaspace to watch this video

Covers elementary matrix operations and vector spaces, including properties and conditions for invertibility.

Matrix Multiplication: Applications and Properties Log in to Mediaspace to watch this video

Covers matrix multiplication, properties, and inverses in linear algebra.

Algorithmic Complexity: Visualization and Analysis Log in to Mediaspace to watch this video

Explores algorithmic complexity, visualization of functions, and algorithm efficiency analysis using Python.

Support Vector Machines: Formulation and Complexity Log in to Mediaspace to watch this video

Explores the formulation and complexity of Support Vector Machines, including primal and dual forms, geometric interpretation, and algorithmic implications.

Eigenvalues of Matrices: Properties and Relations Log in to Mediaspace to watch this video

Explores properties and relations of eigenvalues of square matrices and their products.

Matrix Operations: Partitions and Blocks Log in to Mediaspace to watch this video

Covers matrix operations, including partitioning and block multiplication.

Needleman-Wunsch Algorithm: Sequence Alignment Log in to Mediaspace to watch this video

Covers the Needleman-Wunsch algorithm for optimal protein sequence alignment using dynamic programming and scoring methods.

Diagonalization: Theory and Examples Log in to Mediaspace to watch this video

Explores diagonalization of matrices through eigenvalues and eigenvectors, emphasizing distinct eigenvalues and their role in the diagonalization process.

Matrix Arithmetic: Properties and Operations Log in to Mediaspace to watch this video

Explores matrix arithmetic, including properties, products, and dimensions, with a focus on matrix multiplication and commutativity.

Kernel Regression: Basics and Applications Log in to Mediaspace to watch this video

Explores kernel regression, the curse of dimensionality, and random features in neural networks.

Eigenstate Thermalization Hypothesis Log in to Mediaspace to watch this video

Explores the Eigenstate Thermalization Hypothesis in quantum systems, emphasizing the random matrix theory and the behavior of observables in thermal equilibrium.

Algorithms: Efficiency Analysis Log in to Mediaspace to watch this video

Covers the analysis of algorithm efficiency and optimizing code for faster execution.

Matrix Inverses: Properties and Calculations Log in to Mediaspace to watch this video

Explores matrix inverses, their properties, calculations, and determinants of invertibility.

Page 2 of 3