Mediaspace scheduled maintenance: Aug 25, 2026 07:00 - 12:00 AM. During this time, videos will be temporarily unavailable. Check status updates.

Lecture

Causality and Invariant Machine Learning

Description

This lecture covers the concepts of causality, correlation, and spurious correlations in machine learning, emphasizing the importance of distinguishing between them. It discusses the problems that arise when machine learning models ignore causation and the biases that can result from spurious correlations. The goal is to remove these spurious correlations through bias mitigation techniques and causal inference. Additionally, the lecture explores the idea of invariance across environments and the development of invariant models to improve robustness, reduce bias, and enhance generalization in machine learning applications.

Official source

Related concepts (25)

Correlation

In statistics, correlation or dependence is any statistical relationship, whether causal or not, between two random variables or bivariate data. Although in the broadest sense, "correlation" may indicate any type of association, in statistics it usually refers to the degree to which a pair of variables are linearly related. Familiar examples of dependent phenomena include the correlation between the height of parents and their offspring, and the correlation between the price of a good and the quantity the consumers are willing to purchase, as it is depicted in the so-called demand curve.

Correlation does not imply causation

The phrase "correlation does not imply causation" refers to the inability to legitimately deduce a cause-and-effect relationship between two events or variables solely on the basis of an observed association or correlation between them. The idea that "correlation implies causation" is an example of a questionable-cause logical fallacy, in which two events occurring together are taken to have established a cause-and-effect relationship. This fallacy is also known by the Latin phrase cum hoc ergo propter hoc ('with this, therefore because of this').

Pearson correlation coefficient

In statistics, the Pearson correlation coefficient (PCC) is a correlation coefficient that measures linear correlation between two sets of data. It is the ratio between the covariance of two variables and the product of their standard deviations; thus, it is essentially a normalized measurement of the covariance, such that the result always has a value between −1 and 1. As with covariance itself, the measure can only reflect a linear correlation of variables, and ignores many other types of relationships or correlations.

Spurious relationship

In statistics, a spurious relationship or spurious correlation is a mathematical relationship in which two or more events or variables are associated but not causally related, due to either coincidence or the presence of a certain third, unseen factor (referred to as a "common response variable", "confounding factor", or "lurking variable"). An example of a spurious relationship can be found in the time-series literature, where a spurious regression is a one that provides misleading statistical evidence of a linear relationship between independent non-stationary variables.

Causal inference

Causal inference is the process of determining the independent, actual effect of a particular phenomenon that is a component of a larger system. The main difference between causal inference and inference of association is that causal inference analyzes the response of an effect variable when a cause of the effect variable is changed. The science of why things occur is called etiology, and can be described using the language of scientific causal notation. Causal inference is said to provide the evidence of causality theorized by causal reasoning.

Related lectures (31)

Describing Data: Statistics and Hypothesis Testing

Covers descriptive statistics, hypothesis testing, and correlation analysis with various probability distributions and robust statistics.

Dependence Concepts and Copulas

Explores dependence concepts, copulas, correlation fallacies, and rank correlations in statistics.

Red bus/Blue bus paradox

Explores the Red bus/Blue bus paradox, nested logit models, and multivariate extreme value models in transportation.

Complex Systems: Epidemics

Delves into complex systems, strange attractors, and epidemics, emphasizing the influence of psychological factors and the role of contagion.

Quantifying Statistical Dependence: Covariance and Correlation