Mediaspace scheduled maintenance: Aug 25, 2026 07:00 - 12:00 AM. During this time, videos will be temporarily unavailable. Check status updates.

Lecture

Randomization tests: Understanding Experimental Results

In course

MICRO-110: Probability & statistics for engineers

Description

This lecture introduces randomization tests as an alternative to t-tests when the normal, independent, and identically distributed assumption is violated. By creating fake random data, researchers can test for significance without external reference data. The process involves mixing up labels and analyzing variations to determine if the null hypothesis holds. The lecture also covers paired experiments, where before and after data or correlated samples can be used for randomization. Through examples like a tomato fertilizer experiment, students learn how to apply randomization tests to assess the effectiveness of treatments.

This video is available exclusively on Mediaspace for a restricted audience. Please log in to MediaSpace to access it if you have the necessary permissions.

Watch on Mediaspace

Instructor

Vivek Subramanian

Official source

Related concepts (22)

Statistical hypothesis testing

A statistical hypothesis test is a method of statistical inference used to decide whether the data at hand sufficiently support a particular hypothesis. Hypothesis testing allows us to make probabilistic statements about population parameters. While hypothesis testing was popularized early in the 20th century, early forms were used in the 1700s. The first use is credited to John Arbuthnot (1710), followed by Pierre-Simon Laplace (1770s), in analyzing the human sex ratio at birth; see .

Student's t-test

A t-test is a type of statistical analysis used to compare the averages of two groups and determine if the differences between them are more likely to arise from random chance. It is any statistical hypothesis test in which the test statistic follows a Student's t-distribution under the null hypothesis. It is most commonly applied when the test statistic would follow a normal distribution if the value of a scaling term in the test statistic were known (typically, the scaling term is unknown and therefore a nuisance parameter).

Design of experiments

The design of experiments (DOE or DOX), also known as experiment design or experimental design, is the design of any task that aims to describe and explain the variation of information under conditions that are hypothesized to reflect the variation. The term is generally associated with experiments in which the design introduces conditions that directly affect the variation, but may also refer to the design of quasi-experiments, in which natural conditions that influence the variation are selected for observation.

Null hypothesis

In scientific research, the null hypothesis (often denoted H0) is the claim that no relationship exists between two sets of data or variables being analyzed. The null hypothesis is that any experimentally observed difference is due to chance alone, and an underlying causative relationship does not exist, hence the term "null". In addition to the null hypothesis, an alternative hypothesis is also developed, which claims that a relationship does exist between two variables.

Randomization

Randomization is the process of making something random. Randomization is not haphazard; instead, a random process is a sequence of random variables describing a process whose outcomes do not follow a deterministic pattern, but follow an evolution described by probability distributions. For example, a random sample of individuals from a population refers to a sample where every individual has a known probability of being sampled. This would be contrasted with nonprobability sampling where arbitrary individuals are selected.

Related lectures (30)

Statistics & Experimental Design

Explores conditional probability, Framingham studies, effect size, t-test, and sampling error in statistics.

Understanding Statistics & Experimental Design

Explores t-tests, confidence intervals, ANOVA, and hypothesis testing in statistics, emphasizing the importance of avoiding false discoveries and understanding the logic behind statistical tests.

Understanding Statistics & Experimental Design

Provides an overview of basic probability theory, ANOVA, t-tests, central limit theorem, metrics, confidence intervals, and non-parametric tests.

Statistics Essentials: The t-test

Introduces the t-test for assessing categorical effects on quantitative outcomes, covering hypothesis testing, assumptions, and alternative tests.

Hypothesis Testing and Confidence Intervals: An Overview