Mediaspace scheduled maintenance: Aug 25, 2026 07:00 - 12:00 AM. During this time, videos will be temporarily unavailable. Check status updates.

Lecture

Hypothesis Testing in Statistics

Description

This lecture covers hypothesis testing in statistics, focusing on test statistics, critical regions, simple and composite hypotheses, one-sided and two-sided tests, power functions, Wald tests, p-values, multiple testing, Bonferroni method, False Discovery Rate, and non-parametric statistics. The instructor explains the importance of controlling the Type I error rate and introduces practical methods for conducting and interpreting hypothesis tests.

Official source

Ontological neighbourhood

Statistics

Statistical inference: Statistical hypothesis testing

Related concepts (32)

Multiple comparisons problem

In statistics, the multiple comparisons, multiplicity or multiple testing problem occurs when one considers a set of statistical inferences simultaneously or infers a subset of parameters selected based on the observed values. The more inferences are made, the more likely erroneous inferences become. Several statistical techniques have been developed to address that problem, typically by requiring a stricter significance threshold for individual comparisons, so as to compensate for the number of inferences being made.

False discovery rate

In statistics, the false discovery rate (FDR) is a method of conceptualizing the rate of type I errors in null hypothesis testing when conducting multiple comparisons. FDR-controlling procedures are designed to control the FDR, which is the expected proportion of "discoveries" (rejected null hypotheses) that are false (incorrect rejections of the null). Equivalently, the FDR is the expected ratio of the number of false positive classifications (false discoveries) to the total number of positive classifications (rejections of the null).

Family-wise error rate

In statistics, family-wise error rate (FWER) is the probability of making one or more false discoveries, or type I errors when performing multiple hypotheses tests. John Tukey developed in 1953 the concept of a familywise error rate as the probability of making a Type I error among a specified group, or "family," of tests. Ryan (1959) proposed the related concept of an experimentwise error rate, which is the probability of making a Type I error in a given experiment.

False coverage rate

In statistics, a false coverage rate (FCR) is the average rate of false coverage, i.e. not covering the true parameters, among the selected intervals. The FCR gives a simultaneous coverage at a (1 − α)×100% level for all of the parameters considered in the problem. The FCR has a strong connection to the false discovery rate (FDR). Both methods address the problem of multiple comparisons, FCR from confidence intervals (CIs) and FDR from P-value's point of view. FCR was needed because of dangers caused by selective inference.

Test statistic

A test statistic is a statistic (a quantity derived from the sample) used in statistical hypothesis testing. A hypothesis test is typically specified in terms of a test statistic, considered as a numerical summary of a data-set that reduces the data to one value that can be used to perform the hypothesis test. In general, a test statistic is selected or defined in such a way as to quantify, within observed data, behaviours that would distinguish the null from the alternative hypothesis, where such an alternative is prescribed, or that would characterize the null hypothesis if there is no explicitly stated alternative hypothesis.

Related lectures (36)

Hypothesis Testing: Statistics Overview

Provides an overview of hypothesis testing, p-values, Wald test, and non-parametric statistics.

Understanding Statistics & Experimental Design

Explores t-tests, confidence intervals, ANOVA, and hypothesis testing in statistics, emphasizing the importance of avoiding false discoveries and understanding the logic behind statistical tests.

Hypothesis Testing: State of Nature

Explores hypothesis testing, emphasizing the state of nature and the importance of choosing the most powerful test.

Multiple Testing Problem

Explores the challenges of multiple testing in genomic data analysis, covering error rate control, adjusted p-values, permutation tests, and pitfalls in hypothesis testing.

Maximum Likelihood Estimation: Multivariate Statistics