Mediaspace scheduled maintenance: Aug 25, 2026 07:00 - 12:00 AM. During this time, videos will be temporarily unavailable. Check status updates.

Lecture

Hypothesis Testing: Statistics Overview

Description

This lecture covers hypothesis testing, focusing on test statistics, critical regions, one-sided and two-sided tests, p-values, Wald test, power functions, and multiple testing methods like Bonferroni and False Discovery Rate control. It also delves into non-parametric statistics, empirical distribution functions, Glivenko-Cantelli theorem, and confidence intervals for distribution functions.

Official source

Ontological neighbourhood

Statistics

Statistical inference: Statistical hypothesis testing, Mathematical statistics

Related concepts (32)

Statistical hypothesis testing

A statistical hypothesis test is a method of statistical inference used to decide whether the data at hand sufficiently support a particular hypothesis. Hypothesis testing allows us to make probabilistic statements about population parameters. While hypothesis testing was popularized early in the 20th century, early forms were used in the 1700s. The first use is credited to John Arbuthnot (1710), followed by Pierre-Simon Laplace (1770s), in analyzing the human sex ratio at birth; see .

Empirical distribution function

In statistics, an empirical distribution function (commonly also called an empirical cumulative distribution function, eCDF) is the distribution function associated with the empirical measure of a sample. This cumulative distribution function is a step function that jumps up by 1/n at each of the n data points. Its value at any specified value of the measured variable is the fraction of observations of the measured variable that are less than or equal to the specified value.

Multiple comparisons problem

In statistics, the multiple comparisons, multiplicity or multiple testing problem occurs when one considers a set of statistical inferences simultaneously or infers a subset of parameters selected based on the observed values. The more inferences are made, the more likely erroneous inferences become. Several statistical techniques have been developed to address that problem, typically by requiring a stricter significance threshold for individual comparisons, so as to compensate for the number of inferences being made.

Test statistic

A test statistic is a statistic (a quantity derived from the sample) used in statistical hypothesis testing. A hypothesis test is typically specified in terms of a test statistic, considered as a numerical summary of a data-set that reduces the data to one value that can be used to perform the hypothesis test. In general, a test statistic is selected or defined in such a way as to quantify, within observed data, behaviours that would distinguish the null from the alternative hypothesis, where such an alternative is prescribed, or that would characterize the null hypothesis if there is no explicitly stated alternative hypothesis.

Nonparametric statistics

Nonparametric statistics is the type of statistics that is not restricted by assumptions concerning the nature of the population from which a sample is drawn. This is opposed to parametric statistics, for which a problem is restricted a priori by assumptions concerning the specific distribution of the population (such as the normal distribution) and parameters (such the mean or variance).

Related lectures (60)

Hypothesis Testing in Statistics

Delves into hypothesis testing, covering test statistics, critical regions, power functions, p-values, multiple testing, and non-parametric statistics.

Understanding Statistics & Experimental Design

Explores t-tests, confidence intervals, ANOVA, and hypothesis testing in statistics, emphasizing the importance of avoiding false discoveries and understanding the logic behind statistical tests.

Descriptive Statistics: Hypothesis Testing

Introduces descriptive statistics, hypothesis testing, p-values, and confidence intervals, emphasizing their importance in data analysis.

Describing Data: Statistics & Uncertainty

Introduces descriptive statistics, uncertainty quantification, and variable relationships, emphasizing the importance of statistical interpretation and critical analysis.

Describing Data: Statistics and Hypothesis Testing