Skip to main content
Graph
Search
fr
en
Login
Search
All
Categories
Concepts
Courses
Lectures
MOOCs
People
Quizes
Exercises
Publications
Startups
Units
Show all results for
Home
Lecture
Information Theory Basics
Graph Chatbot
Related lectures (38)
Source Coding Theorem
Explores the Source Coding Theorem, entropy, Huffman coding, and conditioning's impact on entropy reduction.
Source Coding Theorem: Fundamentals and Models
Covers the Source Coding Theorem, source models, entropy, regular sources, and examples.
Information Measures
Covers information measures like entropy, Kullback-Leibler divergence, and data processing inequality, along with probability kernels and mutual information.
Information Theory: Quantifying Messages and Source Entropy
Covers quantifying information in messages, source entropy, common information, and communication channel capacity.
Information Measures
Covers information measures like entropy and Kullback-Leibler divergence.
Information in Networked Systems: Functional Representation and Data Compression
Explores traditional information theory, data compression, data transmission, and functional representation lemmas in networked systems.
Conditional Entropy and Data Compression Techniques
Log in to Mediaspace to watch this video
Discusses conditional entropy and its role in data compression techniques.
Entropy and Information Theory
Log in to Mediaspace to watch this video
Explores entropy, uncertainty, coding theory, and data compression applications.
Constructing Real Numbers: Decimal Expansion
Log in to Mediaspace to watch this video
Covers constructing real numbers through decimal expansion and the concept of discrete and continuous random variables.
Second Moment Method
Log in to Mediaspace to watch this video
Explores the Second Moment Method and variance of random variables, including covariance and independence.
Decision Trees: Classification
Log in to Mediaspace to watch this video
Explores decision trees for classification, entropy, information gain, one-hot encoding, hyperparameter optimization, and random forests.
Random Variables and Probability Densities
Log in to Mediaspace to watch this video
Explores random variables, probability densities, Gaussian distribution, and conditional probabilities in measurement systems.
Probability Theory: Basics and Applications
Log in to Mediaspace to watch this video
Covers the fundamental concepts of probability theory and random variables.
Variance of Random Variables
Log in to Mediaspace to watch this video
Covers the concept of variance for random variables and introduces calculation rules.
Stochastic Calculus: Lecture 1
Log in to Mediaspace to watch this video
Covers the essentials of probability, algebras, and conditional probability, including the Borel o-algebra and Poisson processes.
Entropy and Thermodynamics: Microstates and Macrostates
Log in to Mediaspace to watch this video
Covers the concepts of microstates and macrostates in thermodynamics, focusing on entropy and its implications for isolated systems.
Phase Diagrams: Understanding State Transitions
Log in to Mediaspace to watch this video
Explains phase diagrams, critical points, and phase transitions, illustrating state determination and property tables.
Measurement Principles: Calibration and Sensitivity Examples
Log in to Mediaspace to watch this video
Discusses measurement principles through examples of calibration, sensitivity, and optical measurement techniques.
Previous
Page 2 of 2
Next
