Lecture

Randomization tests: Understanding Experimental Results

Graph Chat

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

In course

MICRO-110: Probability & statistics for engineers

This course covers the basics of probability and statistical techniques for engineers, including major probability concepts, data analysis, and statistical inference.

Description

This lecture introduces randomization tests as an alternative to t-tests when the normal, independent, and identically distributed assumption is violated. By creating fake random data, researchers can test for significance without external reference data. The process involves mixing up labels and analyzing variations to determine if the null hypothesis holds. The lecture also covers paired experiments, where before and after data or correlated samples can be used for randomization. Through examples like a tomato fertilizer experiment, students learn how to apply randomization tests to assess the effectiveness of treatments.

This video is available exclusively on Mediaspace for a restricted audience. Please log in to MediaSpace to access it if you have the necessary permissions.

Watch on Mediaspace

Instructor

Vivek Subramanian

Teaching & PhD PhD Students Giovanni Ruffolo, Giada Romano, Sanjay Manoharan, Kyle Haas, Claude Dahan, Biruktait Ayele Lemecho, Yagmur Ceren Alatas, Tugçe Delipinar Past EPFL PhD Students Amin Hodaei, Mustafa Mohieldin Fadlelmula Fadlelseed Past EPFL PhD Students as codirector Mohammad Jafarpour Courses Organic and printed electronics MICRO-505 This course addresses the implementation of organic and printed electronics technologies using large area manufacturing techniques. It will provide

Official source

Related concepts (22)

Statistical hypothesis testing

A statistical hypothesis test is a method of statistical inference used to decide whether the data at hand sufficiently support a particular hypothesis. Hypothesis testing allows us to make probabilistic statements about population parameters. While hypothesis testing was popularized early in the 20th century, early forms were used in the 1700s. The first use is credited to John Arbuthnot (1710), followed by Pierre-Simon Laplace (1770s), in analyzing the human sex ratio at birth; see .

Student's t-test

A t-test is a type of statistical analysis used to compare the averages of two groups and determine if the differences between them are more likely to arise from random chance. It is any statistical hypothesis test in which the test statistic follows a Student's t-distribution under the null hypothesis. It is most commonly applied when the test statistic would follow a normal distribution if the value of a scaling term in the test statistic were known (typically, the scaling term is unknown and therefore a nuisance parameter).

Design of experiments

The design of experiments (DOE or DOX), also known as experiment design or experimental design, is the design of any task that aims to describe and explain the variation of information under conditions that are hypothesized to reflect the variation. The term is generally associated with experiments in which the design introduces conditions that directly affect the variation, but may also refer to the design of quasi-experiments, in which natural conditions that influence the variation are selected for observation.

Null hypothesis

In scientific research, the null hypothesis (often denoted H0) is the claim that no relationship exists between two sets of data or variables being analyzed. The null hypothesis is that any experimentally observed difference is due to chance alone, and an underlying causative relationship does not exist, hence the term "null". In addition to the null hypothesis, an alternative hypothesis is also developed, which claims that a relationship does exist between two variables.

Randomization

Randomization is the process of making something random. Randomization is not haphazard; instead, a random process is a sequence of random variables describing a process whose outcomes do not follow a deterministic pattern, but follow an evolution described by probability distributions. For example, a random sample of individuals from a population refers to a sample where every individual has a known probability of being sampled. This would be contrasted with nonprobability sampling where arbitrary individuals are selected.

Related lectures (44)

Statistics & Experimental Design

Explores conditional probability, Framingham studies, effect size, t-test, and sampling error in statistics.

Understanding Statistics & Experimental Design

Explores t-tests, confidence intervals, ANOVA, and hypothesis testing in statistics, emphasizing the importance of avoiding false discoveries and understanding the logic behind statistical tests.

Probability Distributions in Environmental Studies

Explores probability distributions for random variables in air pollution and climate change studies, covering descriptive and inferential statistics.