Skip to main content
Graph
Search
fr
en
Login
Search
All
Categories
Concepts
Courses
Lectures
MOOCs
People
Quizes
Exercises
Publications
Startups
Units
Show all results for
Home
Lecture
Mutual Information and Entropy
Graph Chatbot
Related lectures (51)
Mutual Information: Understanding Random Variables
Explores mutual information, quantifying relationships between random variables and measuring information gain and statistical dependence.
Conditional Entropy and Information Theory Concepts
Discusses conditional entropy and its role in information theory and data compression.
Information Measures
Covers information measures like entropy, Kullback-Leibler divergence, and data processing inequality, along with probability kernels and mutual information.
Information Theory: Entropy and Capacity
Covers concepts of entropy, Gaussian distributions, and channel capacity with constraints.
Entropy Bounds: Conditional Entropy Theorems
Explores entropy bounds, conditional entropy theorems, and the chain rule for entropies, illustrating their application through examples.
Quantifying Statistical Dependence: Covariance and Correlation
Explores covariance, correlation, and mutual information in quantifying statistical dependence between random variables.
Information Theory: Channel Capacity and Convex Functions
Explores channel capacity and convex functions in information theory, emphasizing the importance of convexity.
Lecture: Shannon
Covers the basics of information theory, focusing on Shannon's setting and channel transmission.
Random Variables and Information Theory Concepts
Introduces random variables and their significance in information theory, covering concepts like expected value and Shannon's entropy.
Entropy and Mutual Information
On entropy and mutual information explores quantifying information in data science through probability distributions.
Source Coding Theorems: Entropy and Source Models
Covers source coding theorems, entropy, and various source models in information theory.
Information Theory Basics
Introduces information theory basics, including entropy, independence, and binary entropy function.
Mutual Information in Biological Data
Explores mutual information in biological data, emphasizing its role in quantifying statistical dependence and analyzing protein sequences.
Information Theory and Coding
Covers source coding, Kraft's inequality, mutual information, Huffman procedure, and properties of tropical sequences.
Information Measures
Covers information measures like entropy and Kullback-Leibler divergence.
Probability Distribution and Entropy
Explains probability distribution, entropy, and Gibbs free entropy, along with the Weiss model.
Information Measures: Part 2
Covers information measures like entropy, joint entropy, and mutual information in information theory and data processing.
Information Measures: Estimation & Detection
Covers information measures, entropy, mutual information, and data processing inequality in signal representation.
Entropy and Information Theory
Log in to Mediaspace to watch this video
Explores entropy, uncertainty, coding theory, and data compression applications.
Conditional Entropy and Data Compression Techniques
Log in to Mediaspace to watch this video
Discusses conditional entropy and its role in data compression techniques.
Previous
Page 1 of 3
Next
