Mediaspace scheduled maintenance: Aug 25, 2026 07:00 - 12:00 AM. During this time, videos will be temporarily unavailable. Check status updates.

Lecture

Special Families of Models

In course

MATH-442: Statistical theory

This course gives a mostly rigourous treatment of some statistical methods outside the context of standard likelihood theory. ...

Description

This lecture covers the concepts of completeness, minimal sufficiency, and special families of models in statistical theory. The instructor explains the Lehmann-Scheffé theorem, Basu's theorem, and the properties of exponential families of distributions. Emphasis is placed on the importance of exponential families and the transformation families in modeling data, as well as the invariance and equivariance properties of statistics in different parametric models.

This video is available exclusively on Mediaspace for a restricted audience. Please log in to MediaSpace to access it if you have the necessary permissions.

Watch on Mediaspace

Instructor

Yoav Zemel

Official source

Ontological neighbourhood

Statistics

Statistical inference: Mathematical statistics

Related concepts (32)

Statistical model

A statistical model is a mathematical model that embodies a set of statistical assumptions concerning the generation of sample data (and similar data from a larger population). A statistical model represents, often in considerably idealized form, the data-generating process. When referring specifically to probabilities, the corresponding term is probabilistic model. A statistical model is usually specified as a mathematical relationship between one or more random variables and other non-random variables.

Statistical inference

Statistical inference is the process of using data analysis to infer properties of an underlying distribution of probability. Inferential statistical analysis infers properties of a population, for example by testing hypotheses and deriving estimates. It is assumed that the observed data set is sampled from a larger population. Inferential statistics can be contrasted with descriptive statistics. Descriptive statistics is solely concerned with properties of the observed data, and it does not rest on the assumption that the data come from a larger population.

Exponential family

In probability and statistics, an exponential family is a parametric set of probability distributions of a certain form, specified below. This special form is chosen for mathematical convenience, including the enabling of the user to calculate expectations, covariances using differentiation based on some useful algebraic properties, as well as for generality, as exponential families are in a sense very natural sets of distributions to consider. The term exponential class is sometimes used in place of "exponential family", or the older term Koopman–Darmois family.

Exponential distribution

In probability theory and statistics, the exponential distribution or negative exponential distribution is the probability distribution of the time between events in a Poisson point process, i.e., a process in which events occur continuously and independently at a constant average rate. It is a particular case of the gamma distribution. It is the continuous analogue of the geometric distribution, and it has the key property of being memoryless. In addition to being used for the analysis of Poisson point processes it is found in various other contexts.

Natural exponential family

In probability and statistics, a natural exponential family (NEF) is a class of probability distributions that is a special case of an exponential family (EF). The natural exponential families (NEF) are a subset of the exponential families. A NEF is an exponential family in which the natural parameter η and the natural statistic T(x) are both the identity. A distribution in an exponential family with parameter θ can be written with probability density function (PDF) where and are known functions.

Related lectures (56)

Exponential Family: Maximum Entropy Distributions

Covers exponential families and maximum entropy distributions under moment constraints.

Statistical Models: Basics & Applications

Covers statistical concepts like probability, estimation, hypothesis testing, and confidence intervals for mathematicians.

Generalised Linear Models: Regression with Exponential Family Responses

Covers regression with exponential family responses using Generalised Linear Models.

Generalized Linear Models

Covers probability, random variables, expectation, GLMs, hypothesis testing, and Bayesian statistics with practical examples.

Sufficient Statistics: Understanding Data Compression