Mediaspace scheduled maintenance: Aug 25, 2026 07:00 - 12:00 AM. During this time, videos will be temporarily unavailable. Check status updates.

Concept

Algorithmic information theory

Related lectures (31)

Data Compression and Entropy Definition

Explores the concept of entropy as the average number of questions needed to guess a randomly chosen letter in a sequence, emphasizing its enduring relevance in information theory.

Data Compression and Shannon-Fano Algorithm

Explores the Shannon-Fano algorithm for data compression and its efficiency in creating unique binary codes for letters.

Introduction to Digital Humanities

Covers information, memory, glyphs, writing systems, digital images, physical and morphological connections, 3D shapes, and the challenges of computational processing.

Entropy and Mutual Information

On entropy and mutual information explores quantifying information in data science through probability distributions.

Machine Learning Theory: High-Dimensional Perspectives Log in to Mediaspace to watch this video

Explores high-dimensional perspectives in machine learning theory, shedding light on new insights and challenges.

Advanced Information Theory: Random Binning Log in to Mediaspace to watch this video

Explores random binning in advanced information theory, focusing on assigning labels based on typicality and achieving negligible error rates in source coding.

Scientific Machine Learning: Optimal Errors Log in to Mediaspace to watch this video

Explores optimal errors in high-dimensional models, comparing algorithms and shedding light on the interplay between model architecture and performance.

Maximal Correlation: Information Measures Log in to Mediaspace to watch this video

Explores maximal correlation in information theory, mutual information properties, Renyi's measures, and mathematical foundations of information theory.

Advanced Information Theory: F-Divergences and Generalization Error Log in to Mediaspace to watch this video

Covers f-divergences and generalization error in advanced information theory.

Online Matching in Evolving Environments Log in to Mediaspace to watch this video

Explores online matching in evolving environments, addressing challenges and solutions for adapting algorithms to changing data.

State Space Models: Expressivity of Transformers Log in to Mediaspace to watch this video

Covers state space models and the expressivity of transformers in sequence copying tasks.