Mediaspace scheduled maintenance: Aug 25, 2026 07:00 - 12:00 AM. During this time, videos will be temporarily unavailable. Check status updates.

Lecture

Hypothesis Testing: Neyman-Pearson Framework

In course

EE-209: Elements of statistics for data science

Théorie de l'estimation: estimateurs du maximum de vraisemblance, information de Fisher, inégalité de Cramer-Rao, intervalles de confiance. Tests d'hypothèses: cadre de Neyman-Pearson: test du rapport de vraisemblance, tests paramétriques et non-parmétriq ...

Description

This lecture covers the concept of hypothesis testing, distinguishing between two hypotheses based on observations or samples, types of errors, the Neyman-Pearson framework, one-sided Gaussian tests, and simple vs composite hypotheses. It also discusses the asymmetry of errors and the importance of privileging one hypothesis by default.

Instructor

Florent Gérard Krzakala

Official source

Related concepts (25)

Statistical hypothesis testing

A statistical hypothesis test is a method of statistical inference used to decide whether the data at hand sufficiently support a particular hypothesis. Hypothesis testing allows us to make probabilistic statements about population parameters. While hypothesis testing was popularized early in the 20th century, early forms were used in the 1700s. The first use is credited to John Arbuthnot (1710), followed by Pierre-Simon Laplace (1770s), in analyzing the human sex ratio at birth; see .

Null hypothesis

In scientific research, the null hypothesis (often denoted H0) is the claim that no relationship exists between two sets of data or variables being analyzed. The null hypothesis is that any experimentally observed difference is due to chance alone, and an underlying causative relationship does not exist, hence the term "null". In addition to the null hypothesis, an alternative hypothesis is also developed, which claims that a relationship does exist between two variables.

Alternative hypothesis

In statistical hypothesis testing, the alternative hypothesis is one of the proposed proposition in the hypothesis test. In general the goal of hypothesis test is to demonstrate that in the given condition, there is sufficient evidence supporting the credibility of alternative hypothesis instead of the exclusive proposition in the test (null hypothesis). It is usually consistent with the research hypothesis because it is constructed from literature review, previous studies, etc.

Test statistic

A test statistic is a statistic (a quantity derived from the sample) used in statistical hypothesis testing. A hypothesis test is typically specified in terms of a test statistic, considered as a numerical summary of a data-set that reduces the data to one value that can be used to perform the hypothesis test. In general, a test statistic is selected or defined in such a way as to quantify, within observed data, behaviours that would distinguish the null from the alternative hypothesis, where such an alternative is prescribed, or that would characterize the null hypothesis if there is no explicitly stated alternative hypothesis.

Normal distribution

In statistics, a normal distribution or Gaussian distribution is a type of continuous probability distribution for a real-valued random variable. The general form of its probability density function is The parameter is the mean or expectation of the distribution (and also its median and mode), while the parameter is its standard deviation. The variance of the distribution is . A random variable with a Gaussian distribution is said to be normally distributed, and is called a normal deviate.

Related lectures (53)

Confidence Intervals and Hypothesis Tests

Covers confidence intervals, hypothesis tests, standard errors, statistical models, likelihood, Bayesian inference, ROC curve, Pearson statistic, goodness of fit tests, and power of tests.

Maximum Likelihood Estimation: Multivariate Statistics

Explores maximum likelihood estimation and multivariate hypothesis testing, including challenges and strategies for testing multiple hypotheses.

Describing Data: Statistics and Hypothesis Testing

Covers descriptive statistics, hypothesis testing, and correlation analysis with various probability distributions and robust statistics.

Confidence Intervals and Hypothesis Testing

Explores confidence intervals, hypothesis testing, and ROC curves in statistical analysis.

Probabilities and Statistics