Mediaspace scheduled maintenance: Aug 25, 2026 07:00 - 12:00 AM. During this time, videos will be temporarily unavailable. Check status updates.

Lecture

Simpson's Paradox: Understanding and Randomized Trials

In course

EE-209: Elements of statistics for data science

Théorie de l'estimation: estimateurs du maximum de vraisemblance, information de Fisher, inégalité de Cramer-Rao, intervalles de confiance. Tests d'hypothèses: cadre de Neyman-Pearson: test du rapport de vraisemblance, tests paramétriques et non-parmétriq ...

Description

This lecture delves into the Simpson's Paradox using the kidney stone recovery example, highlighting how the paradox arises from the interaction of variables and the importance of randomized trials in avoiding confounding factors.

Instructor

Florent Gérard Krzakala

Official source

Ontological neighbourhood

Statistics

Data collection: Experiment

Related concepts (28)

Clinical trial

Clinical trials are prospective biomedical or behavioral research studies on human participants designed to answer specific questions about biomedical or behavioral interventions, including new treatments (such as novel vaccines, drugs, dietary choices, dietary supplements, and medical devices) and known interventions that warrant further study and comparison. Clinical trials generate data on dosage, safety and efficacy. They are conducted only after they have received health authority/ethics committee approval in the country where approval of the therapy is sought.

Randomized controlled trial

A randomized controlled trial (or randomized control trial; RCT) is a form of scientific experiment used to control factors not under direct experimental control. Examples of RCTs are clinical trials that compare the effects of drugs, surgical techniques, medical devices, diagnostic procedures or other medical treatments. Participants who enroll in RCTs differ from one another in known and unknown ways that can influence study outcomes, and yet cannot be directly controlled.

Randomized experiment

In science, randomized experiments are the experiments that allow the greatest reliability and validity of statistical estimates of treatment effects. Randomization-based inference is especially important in experimental design and in survey sampling. In the statistical theory of design of experiments, randomization involves randomly allocating the experimental units across the treatment groups. For example, if an experiment compares a new drug against a standard drug, then the patients should be allocated to either the new drug or to the standard drug control using randomization.

Confounding

In causal inference, a confounder (also confounding variable, confounding factor, extraneous determinant or lurking variable) is a variable that influences both the dependent variable and independent variable, causing a spurious association. Confounding is a causal concept, and as such, cannot be described in terms of correlations or associations. The existence of confounders is an important quantitative explanation why correlation does not imply causation.

Placebo-controlled study

Placebo-controlled studies are a way of testing a medical therapy in which, in addition to a group of subjects that receives the treatment to be evaluated, a separate control group receives a sham "placebo" treatment which is specifically designed to have no real effect. Placebos are most commonly used in blinded trials, where subjects do not know whether they are receiving real or placebo treatment. Often, there is also a further "natural history" group that does not receive any treatment at all.

Related lectures (30)

Causal Analysis of Observational Data

Covers causal analysis of observational data, pitfalls, tools for valid conclusions, and addressing confounding variables.

Randomized Trials and Simpson's Paradox

Covers randomized clinical trials, confounding variables, ethical challenges, and Simpson's paradox in data analysis.

Assessing Market Regulation

Explores the assessment of market regulation, focusing on high-frequency trading and the impact of regulatory changes on liquidity and market quality.

Implementation Research: Strategies and Results

Explores implementation research strategies, outcomes, and scaling-up challenges in real-world settings.

Observational Studies: Pitfalls and Valid Conclusions