Lectures related to Exponential Family Distributions

Exponential Family: Maximum Entropy Distributions

Covers exponential families and maximum entropy distributions under moment constraints.

Covers statistical estimation methods, including maximum likelihood and Bayesian estimation.

Generalized Linear Regression: Classification

Explores Generalized Linear Regression, Classification, confusion matrices, ROC curves, and noise in data.

Delves into probability, statistics, paradoxes, and random variables, showcasing their real-world applications and properties.

Advanced Probabilities: Random Variables & Expected Values

Explores advanced probabilities, random variables, and expected values, with practical examples and quizzes to reinforce learning.

Generalised Linear Models: Regression with Exponential Family Responses

Covers regression with exponential family responses using Generalised Linear Models.

Probability and Statistics

Covers p-quantile, normal approximation, joint distributions, and exponential families in probability and statistics.

Random Variables: Expected Value

Covers advanced probability concepts, including random variables and expected value calculation.

Exponential Family: Maximum Entropy Distribution

Covers exponential families, maximum entropy, and Moxwell-Boltzmann distribution properties.

Random Variables and Expected Value

Introduces random variables, probability distributions, and expected values through practical examples.

Probability Distributions

Covers various probability distributions and their applications in real-world scenarios.

Sufficient Statistics: Understanding Data Compression

Explores sufficient statistics, data compression, and their role in statistical inference, with examples like Bernoulli Trials and exponential families.

Logistic Regression: Probability Modeling and Optimization

Explores logistic regression for binary classification, covering probability modeling, optimization methods, and regularization techniques.

Maximum Likelihood Estimation: Theory and Examples

Covers maximum likelihood estimation, including the Rao-Blackwell Theorem proof and practical examples of deriving estimators.

Exponential Family: Definition and Properties

Covers the Exponential Family, including its definition, sufficient statistics, and distribution properties.

Common Distributions: Moment Generating Functions

Explores common probability distributions, special distributions, and entropy concepts.

Probability Models: Fundamentals

Introduces the basics of probability models, covering random variables, distributions, and statistical estimation.

Fundamental Limits of Gradient-Based Learning

Delves into the fundamental limits of gradient-based learning on neural networks, covering topics such as binomial theorem, exponential series, and moment-generating functions.

Sampling Theory: Statistics for Mathematicians

Covers the theory of sampling, focusing on statistics for mathematicians.

Statistical Justification of Least Squares

Explores the statistical justification of Least Squares and Generalized Linear Models.