Mediaspace scheduled maintenance: Aug 25, 2026 07:00 - 12:00 AM. During this time, videos will be temporarily unavailable. Check status updates.

Home

Lecture

State Space Models: Expressivity of Transformers

About
Privacy
Disclaimer

Graph Chatbot

Related lectures (40)

Subquadratic Attention Mechanisms: State Space Models Overview Log in to Mediaspace to watch this video

Covers subquadratic attention mechanisms and state space models, focusing on their theoretical foundations and practical implementations in machine learning.

Lexicons, n-grams and Language Models Log in to Mediaspace to watch this video

Explores lexicons, n-grams, and language models, emphasizing their importance in recognizing words and the effectiveness of n-grams for various tasks.

Probability and Statistics Log in to Mediaspace to watch this video

Introduces key concepts in probability and statistics, such as events, Venn diagrams, and conditional probability.

Elements of Statistics: Probability and Random Variables Log in to Mediaspace to watch this video

Introduces key concepts in probability and random variables, covering statistics, distributions, and covariance.

Central Limit Theorem: Properties and Applications Log in to Mediaspace to watch this video

Explores the Central Limit Theorem, covariance, correlation, joint random variables, quantiles, and the law of large numbers.

Conditional Density and Expectation Log in to Mediaspace to watch this video

Explores conditional density, expectations, and independence of random variables with practical examples.

Partial Differential Equations: Reflow and Light Propagation Log in to Mediaspace to watch this video

Explores PDEs through reflow of polymer film and light propagation in optical fibers.

Continuous Random Variables: Distributions and Examples Log in to Mediaspace to watch this video

Explores continuous random variables, density functions, and distribution laws with practical examples.

Statistical Vision Problems Log in to Mediaspace to watch this video

Explores statistical vision problems, evaluating algorithms for hidden signal estimation and the challenges of phase transitions.

Discussion of Complexity Log in to Mediaspace to watch this video

Explores worst-case complexity in computer science and the importance of real-life complexity in algorithm selection.

Dimensionality Reduction Log in to Mediaspace to watch this video

Introduces artificial neural networks and explores various dimensionality reduction techniques like PCA, LDA, Kernel PCA, and t-SNE.

Martingales and Conditional Expectations Log in to Mediaspace to watch this video

Explores Brun's Sieve, Martingales, and Conditional Expectations in probability theory.

Gaussian Process Regression: Kernels and Comparisons Log in to Mediaspace to watch this video

Explores Gaussian Process Regression kernels, computational costs, and comparisons with Ridge Regression and other non-linear regression techniques.

Deep Generative Models: Variational Autoencoders & GANs Log in to Mediaspace to watch this video

Explores Variational Autoencoders and Generative Adversarial Networks for deep generative modeling.

Reinforcement Learning: Basics and Applications Log in to Mediaspace to watch this video

Covers the basics of reinforcement learning, including trial-and-error learning, Q-learning, deep RL, and applications in gaming and planning.

Hypothesis Testing: Statistical Disproof and Probability Calculation Log in to Mediaspace to watch this video

Explores hypothesis testing through statistical disproof and probability calculation, emphasizing the significance level and error handling in statistical statements.

Data Representations & Processing Log in to Mediaspace to watch this video

Explores data representations, overfitting, model selection, cross-validation, and imbalanced data challenges.

Understanding Phase Transitions in Computational Problems Log in to Mediaspace to watch this video

Explores the connection between phase transitions in physics and computational problems, showcasing how insights from physics can inform algorithm design.

Nonparametric Regression: Kernel-Based Estimation Log in to Mediaspace to watch this video

Covers nonparametric regression using kernel-based estimation techniques to model complex relationships between variables.

Pointers in C: Practical Usage and Concepts Log in to Mediaspace to watch this video

Explains the fundamental concepts and practical usage of pointers in C programming.

Page 2 of 2