Mediaspace scheduled maintenance: Aug 25, 2026 07:00 - 12:00 AM. During this time, videos will be temporarily unavailable. Check status updates.

Home

Lecture

Information Measures

About
Privacy
Disclaimer

Graph Chatbot

Related lectures (39)

Random Variables and Information Theory Concepts

Introduces random variables and their significance in information theory, covering concepts like expected value and Shannon's entropy.

Second Principle: Entropy

Explores the second principle of thermodynamics, emphasizing entropy's role in system evolution and equilibrium.

Information Measures: Part 1

Covers information measures, tail bounds, subgaussions, subpossion, independence proof, and conditional expectation.

Building a Decision Tree

Covers building decision trees to classify mushrooms as poisonous or not.

Information Theory and Coding

Covers source coding, Kraft's inequality, mutual information, Huffman procedure, and properties of tropical sequences.

Nonparametric GLMs & High Level Picture

Explores nonparametric relationships in GLMs and the importance of understanding variability through probability and models.

Information Theory: Basics and Applications

Covers the basics of information theory and its applications in various fields.

Thermodynamics: Entropy and Ideal Gases Log in to Mediaspace to watch this video

Explores entropy, ideal gases, and TDS equations in thermodynamics, emphasizing the importance of the Clausius inequality and the Carnot cycle.

Decision Trees: Classification Log in to Mediaspace to watch this video

Explores decision trees for classification, entropy, information gain, one-hot encoding, hyperparameter optimization, and random forests.

Achievable Rate & Capacity Log in to Mediaspace to watch this video

Explores achievable rate, channel capacity, spectral efficiency, and fading channels in wireless communication systems.

Entropy and the Second Law of Thermodynamics Log in to Mediaspace to watch this video

Covers entropy, its definition, and its implications in thermodynamics.

Random Vectors and Stochastic Models for Communications Log in to Mediaspace to watch this video

Covers random vectors, joint probability, and conditional probability in communication stochastic models.

Quantization of Probability Distributions Log in to Mediaspace to watch this video

Covers quantization of probability distributions, statistical k-means clustering, mean estimation, robust clustering methods, and open research questions.

Dimensionality Reduction: PCA and LDA Log in to Mediaspace to watch this video

Covers dimensionality reduction techniques like PCA and LDA, clustering methods, density estimation, and data representation.

Carnot Cycle: Efficiency and Reversibility Log in to Mediaspace to watch this video

Explores the Carnot Cycle's efficiency, reversibility, and entropy in thermodynamics.

Introduction to Information, Computation, and Communication Log in to Mediaspace to watch this video

Introduces the fundamental principles of Information, Computation, and Communication theory, covering genomics, medical imaging, and assistive technology.

Markov Chains: Transition Densities Log in to Mediaspace to watch this video

Covers Markov processes, transition densities, and distribution conditional on information, discussing classification of states and stationary distributions.

Multivariate Gaussian Laws Log in to Mediaspace to watch this video

Explores multivariate Gaussian laws, covering probabilities, correlations, and conditional distributions in bivariate cases.

Bivariate Maxima: Parametric Models and Distributions Log in to Mediaspace to watch this video

Explores bivariate maxima, parametric models, distributions, and dependence functions in statistics.

Page 2 of 2