Lecture

Sampling Distributions: Understanding Ancillary Statistics

Graph Chat

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

Description

This lecture by the instructor covers the concept of ancillary statistics in sampling distributions. The lecture explains how ancillary statistics do not depend on the parameter of interest and carry no information about it. It delves into examples of exponential families and how certain statistics provide more information than others. The lecture also discusses the sufficiency of statistics and the Fisher-Neyman factorization theorem. It explores how sufficient statistics compress data without losing information and introduces the concept of minimally sufficient statistics. The lecture concludes with the proof of the Fisher-Neyman factorization theorem and the implications of minimal sufficiency in parameter estimation.

Official source

Ontological neighbourhood

Statistics

Statistical inference: Mathematical statistics

Related concepts (32)

Sufficient statistic

In statistics, a statistic is sufficient with respect to a statistical model and its associated unknown parameter if "no other statistic that can be calculated from the same sample provides any additional information as to the value of the parameter". In particular, a statistic is sufficient for a family of probability distributions if the sample from which it is calculated gives no additional information than the statistic, as to which of those probability distributions is the sampling distribution.

Ancillary statistic

An ancillary statistic is a measure of a sample whose distribution (or whose pmf or pdf) does not depend on the parameters of the model. An ancillary statistic is a pivotal quantity that is also a statistic. Ancillary statistics can be used to construct prediction intervals. They are also used in connection with Basu's theorem to prove independence between statistics. This concept was first introduced by Ronald Fisher in the 1920s, but its formal definition was only provided in 1964 by Debabrata Basu.

Sampling distribution

In statistics, a sampling distribution or finite-sample distribution is the probability distribution of a given random-sample-based statistic. If an arbitrarily large number of samples, each involving multiple observations (data points), were separately used in order to compute one value of a statistic (such as, for example, the sample mean or sample variance) for each sample, then the sampling distribution is the probability distribution of the values that the statistic takes on.

Statistics

Statistics (from German: Statistik, () "description of a state, a country") is the discipline that concerns the collection, organization, analysis, interpretation, and presentation of data. In applying statistics to a scientific, industrial, or social problem, it is conventional to begin with a statistical population or a statistical model to be studied. Populations can be diverse groups of people or objects such as "all people living in a country" or "every atom composing a crystal".

Estimation theory

Estimation theory is a branch of statistics that deals with estimating the values of parameters based on measured empirical data that has a random component. The parameters describe an underlying physical setting in such a way that their value affects the distribution of the measured data. An estimator attempts to approximate the unknown parameters using the measurements.

Related lectures (64)

Sampling Theory: Statistics and Inference

Covers sampling theory, statistics, and inference, focusing on the sampling distribution of statistics.

Entropy and Sampling Theory

Explores entropy, exponential family, sampling theory, and statistical inference from samples.

Generalised Linear Models: Regression with Exponential Family Responses

Covers regression with exponential family responses using Generalised Linear Models.

Sampling Theory: Statistics for Mathematicians

Covers the theory of sampling, focusing on statistics for mathematicians.

Statistical Models and Parameter Estimation

Explores statistical models, parameter estimation, and sampling distributions in probability and statistics.

Related concepts (32)

Sufficient statistic

Ancillary statistic

Sampling distribution

Statistics

Estimation theory