Mediaspace scheduled maintenance: Aug 25, 2026 07:00 - 12:00 AM. During this time, videos will be temporarily unavailable. Check status updates.

Lecture

High probability learning guarantees

Related lectures (37)

Generalization Error

Explores tail bounds, information bounds, and maximal leakage in the context of generalization error.

Chernoff Bounds

Explains Chernoff bounds, extractors, and their theorems with proofs.

Convergence in Law: Theorem and Proof

Explores convergence in law for random variables, including Kolmogorov's theorem and proofs based on probability lemmas.

Probability Convergence

Explores probability convergence, discussing conditions for random variable sequences to converge and the uniqueness of convergence.

Concentration Inequalities

Covers concentration inequalities and sampling methods for estimating unknown distributions, with a focus on population infection rates.

Conditional Expectation: Grouping Lemma

Explores conditional expectation, the grouping lemma, and the law of large numbers.

McDiarmid's Inequality: Proof and Applications

Covers McDiarmid's inequality, providing concentration bounds for functions of independent random variables.

Coupling of Markov Chains: Ergodic Theorem

Explores the coupling of Markov chains and the proof of the ergodic theorem, emphasizing distribution convergence and chain properties.

Variational Formulation: Information Measures

Explores variational formulation for measuring information content and divergence between probability distributions.

Hoeffding's Inequality: Binomial Distribution

Explores Hoeffding's inequality and the binomial distribution, focusing on error minimization and generalization gaps in predictor selection.

Hoeffding's Inequality

Explores Hoeffding's inequality and its applications in probability theory and statistical analysis.

Uniform Integrability and Convergence

Explores uniform integrability, convergence theorems, and the importance of bounded sequences in understanding the convergence of random variables.

Generalization Error

Explores generalization error in machine learning, focusing on data distribution and hypothesis impact.

Multivariate Statistics: Wishart and Hotelling T²

Explores the Wishart distribution, properties of Wishart matrices, and the Hotelling T² distribution, including the two-sample Hotelling T² statistic.

Probability Theory: Integration and Convergence

Covers topics in probability theory, focusing on uniform integrability and convergence theorems.

Information Measures: Entropy and Information Theory

Explains how entropy measures uncertainty in a system based on possible outcomes.

Concentration Inequalities: Hoeffding's Inequality

Covers Hoeffding's inequality and concentration inequalities with a focus on sequences of random variables.

Multi-arm Bandits: Exploration vs Exploitation

Explores the balance between exploration and exploitation in multi-arm bandit algorithms.

Martingale Convergence Theorems

Explores the convergence of martingales under specific conditions and previews upcoming topics on martingale theorems and inequalities.

Entropy and Algorithms: Applications in Sorting and Weighing

Covers the application of entropy in algorithms, focusing on sorting and decision-making strategies.