Lecture

Statistical Theory: Inference and Optimality

Graph Chat

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

In course

MATH-442: Statistical theory

This course gives a mostly rigourous treatment of some statistical methods outside the context of standard likelihood theory. ...

Description

This lecture covers topics such as constructing confidence regions from confidence intervals, inverting hypothesis tests, and the pivotal method. It also discusses the relationship between confidence intervals and hypothesis tests, the Bonferroni method, multiple testing, and confidence intervals based on maximum likelihood estimation asymptotics. The instructor emphasizes the importance of likelihood methods in statistical inference, asymptotic results, and the efficiency of statistical approaches. The lecture concludes with insights on misspecification, computational aspects, and the limitations of optimality in statistical methods.

Instructor

Yoav Zemel

Official source

Related concepts (32)

Statistical inference

Statistical inference is the process of using data analysis to infer properties of an underlying distribution of probability. Inferential statistical analysis infers properties of a population, for example by testing hypotheses and deriving estimates. It is assumed that the observed data set is sampled from a larger population. Inferential statistics can be contrasted with descriptive statistics. Descriptive statistics is solely concerned with properties of the observed data, and it does not rest on the assumption that the data come from a larger population.

Statistical theory

The theory of statistics provides a basis for the whole range of techniques, in both study design and data analysis, that are used within applications of statistics. The theory covers approaches to statistical-decision problems and to statistical inference, and the actions and deductions that satisfy the basic principles stated for these different approaches. Within a given approach, statistical theory gives ways of comparing statistical procedures; it can find a best possible procedure within a given context for given statistical problems, or can provide guidance on the choice between alternative procedures.

Multiple comparisons problem

In statistics, the multiple comparisons, multiplicity or multiple testing problem occurs when one considers a set of statistical inferences simultaneously or infers a subset of parameters selected based on the observed values. The more inferences are made, the more likely erroneous inferences become. Several statistical techniques have been developed to address that problem, typically by requiring a stricter significance threshold for individual comparisons, so as to compensate for the number of inferences being made.

Statistical model

A statistical model is a mathematical model that embodies a set of statistical assumptions concerning the generation of sample data (and similar data from a larger population). A statistical model represents, often in considerably idealized form, the data-generating process. When referring specifically to probabilities, the corresponding term is probabilistic model. A statistical model is usually specified as a mathematical relationship between one or more random variables and other non-random variables.

Estimation theory

Estimation theory is a branch of statistics that deals with estimating the values of parameters based on measured empirical data that has a random component. The parameters describe an underlying physical setting in such a way that their value affects the distribution of the measured data. An estimator attempts to approximate the unknown parameters using the measurements.

Related lectures (33)

Likelihood Ratio Tests: Optimality and Extensions

Covers Likelihood Ratio Tests, their optimality, and extensions in hypothesis testing, including Wilks' Theorem and the relationship with Confidence Intervals.

Probability and Statistics

Covers moments, variance, and expected values in probability and statistics, including the distribution of tokens in a product.

Hypothesis Testing: Wilks' Theorem

Explores hypothesis testing using Wilks' Theorem, likelihood ratio statistics, p-values, interval estimation, and confidence regions.

Maximum Likelihood Estimation: Multivariate Statistics

Explores maximum likelihood estimation and multivariate hypothesis testing, including challenges and strategies for testing multiple hypotheses.

Statistical Theory: Maximum Likelihood Estimation