Lecture

Optimal Tests for Simple Hypotheses

Graph Chat

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

In course

MATH-232: Probability and statistics (for IC)

Cours d'introduction à la théorie des probabilités et aux statistiques. ...

Description

This lecture covers the concept of optimal tests for simple hypotheses, focusing on the Neyman-Pearson lemma and the comparison of simple hypotheses. It discusses the power and distance between models, emphasizing the significance of standardized distance in hypothesis testing.

Instructors (2)

Emmanuel Abbé

Teaching & PhD PhD Students Denys Pushkin, Ortal Yona Senouf, Vladyslav Shashkov Past EPFL PhD Students Elisabetta Cornacchia, Aryo Lotfi Courses Reasoning in artificial intelligence MATH-700 Large language models have raised the potential of artificial intelligence in various applications, including science and mathematics, but their reasoning capabilities remain under investigations. This class focuses on defining, measuring and improving the reasoning capabilities of such AI models. Awa

Raphaël Jean Berthier

Official source

Ontological neighbourhood

Statistics

Statistical inference: Statistical hypothesis testing

Related concepts (32)

Statistical significance

In statistical hypothesis testing, a result has statistical significance when a result at least as "extreme" would be very infrequent if the null hypothesis were true. More precisely, a study's defined significance level, denoted by , is the probability of the study rejecting the null hypothesis, given that the null hypothesis is true; and the p-value of a result, , is the probability of obtaining a result at least as extreme, given that the null hypothesis is true. The result is statistically significant, by the standards of the study, when .

Statistical hypothesis testing

A statistical hypothesis test is a method of statistical inference used to decide whether the data at hand sufficiently support a particular hypothesis. Hypothesis testing allows us to make probabilistic statements about population parameters. While hypothesis testing was popularized early in the 20th century, early forms were used in the 1700s. The first use is credited to John Arbuthnot (1710), followed by Pierre-Simon Laplace (1770s), in analyzing the human sex ratio at birth; see .

Statistical inference

Statistical inference is the process of using data analysis to infer properties of an underlying distribution of probability. Inferential statistical analysis infers properties of a population, for example by testing hypotheses and deriving estimates. It is assumed that the observed data set is sampled from a larger population. Inferential statistics can be contrasted with descriptive statistics. Descriptive statistics is solely concerned with properties of the observed data, and it does not rest on the assumption that the data come from a larger population.

Multiple comparisons problem

In statistics, the multiple comparisons, multiplicity or multiple testing problem occurs when one considers a set of statistical inferences simultaneously or infers a subset of parameters selected based on the observed values. The more inferences are made, the more likely erroneous inferences become. Several statistical techniques have been developed to address that problem, typically by requiring a stricter significance threshold for individual comparisons, so as to compensate for the number of inferences being made.

Test statistic

A test statistic is a statistic (a quantity derived from the sample) used in statistical hypothesis testing. A hypothesis test is typically specified in terms of a test statistic, considered as a numerical summary of a data-set that reduces the data to one value that can be used to perform the hypothesis test. In general, a test statistic is selected or defined in such a way as to quantify, within observed data, behaviours that would distinguish the null from the alternative hypothesis, where such an alternative is prescribed, or that would characterize the null hypothesis if there is no explicitly stated alternative hypothesis.

Related lectures (64)

Statistical Hypothesis Testing: Unilateral and Bilateral Pairs

Explores unilateral and bilateral pairs in statistical hypothesis testing, covering critical values, test statistics, and p-values.

Hypothesis Testing: State of Nature

Explores hypothesis testing, emphasizing the state of nature and the importance of choosing the most powerful test.

Confidence Intervals and Hypothesis Testing

Explores confidence intervals, hypothesis testing, and decision-making using test statistics and p-values.

Hypothesis Testing in Statistics

Explores hypothesis testing, significance levels, errors, GWAS, optimal testing, and point estimation in statistics.

Probability and Statistics: Basics and Applications