Mediaspace scheduled maintenance: Aug 25, 2026 07:00 - 12:00 AM. During this time, videos will be temporarily unavailable. Check status updates.

Lecture

Understanding Statistics & Experimental Design

In course

BIO-449: Understanding statistics and experimental design

This course is neither an introduction to the mathematics of statistics nor an introduction to a statistics program such as R. The aim of the course is to understand statistics from its experimental design and to avoid common pitfalls of statistical reason ...

Description

This lecture covers basic probability theory, signal detection theory, statistics in a nutshell, multiple testing, ANOVA, experimental design, correlations, PCA, meta-statistics, statistical power analysis, conventions about statistical power, retrospective power analysis, t-tests, central limit theorem, metrics, confidence intervals, non-parametric tests, hypothesis testing procedures, popular non-parametric tests, advantages and disadvantages of non-parametric tests, and good and bad practices in statistical analysis.

Instructor

Michael Herzog

Official source

Ontological neighbourhood

Statistics

Statistical inference: Statistical hypothesis testing, Mathematical statistics

Related concepts (32)

Statistics

Statistics (from German: Statistik, () "description of a state, a country") is the discipline that concerns the collection, organization, analysis, interpretation, and presentation of data. In applying statistics to a scientific, industrial, or social problem, it is conventional to begin with a statistical population or a statistical model to be studied. Populations can be diverse groups of people or objects such as "all people living in a country" or "every atom composing a crystal".

Statistical hypothesis testing

A statistical hypothesis test is a method of statistical inference used to decide whether the data at hand sufficiently support a particular hypothesis. Hypothesis testing allows us to make probabilistic statements about population parameters. While hypothesis testing was popularized early in the 20th century, early forms were used in the 1700s. The first use is credited to John Arbuthnot (1710), followed by Pierre-Simon Laplace (1770s), in analyzing the human sex ratio at birth; see .

Power of a test

In statistics, the power of a binary hypothesis test is the probability that the test correctly rejects the null hypothesis () when a specific alternative hypothesis () is true. It is commonly denoted by , and represents the chances of a true positive detection conditional on the actual existence of an effect to detect. Statistical power ranges from 0 to 1, and as the power of a test increases, the probability of making a type II error by wrongly failing to reject the null hypothesis decreases.

Student's t-test

A t-test is a type of statistical analysis used to compare the averages of two groups and determine if the differences between them are more likely to arise from random chance. It is any statistical hypothesis test in which the test statistic follows a Student's t-distribution under the null hypothesis. It is most commonly applied when the test statistic would follow a normal distribution if the value of a scaling term in the test statistic were known (typically, the scaling term is unknown and therefore a nuisance parameter).

Statistical significance

In statistical hypothesis testing, a result has statistical significance when a result at least as "extreme" would be very infrequent if the null hypothesis were true. More precisely, a study's defined significance level, denoted by , is the probability of the study rejecting the null hypothesis, given that the null hypothesis is true; and the p-value of a result, , is the probability of obtaining a result at least as extreme, given that the null hypothesis is true. The result is statistically significant, by the standards of the study, when .

Related lectures (35)

Understanding Statistics & Experimental Design

Explores t-tests, confidence intervals, ANOVA, and hypothesis testing in statistics, emphasizing the importance of avoiding false discoveries and understanding the logic behind statistical tests.

Hypothesis Testing and Confidence Intervals: Key Concepts

Provides an overview of hypothesis testing and confidence intervals in statistics, including practical examples and key concepts.

Hypothesis Testing and Confidence Intervals: An Overview

Covers hypothesis testing, confidence intervals, and their applications in statistics.

Statistics: Hypothesis Testing & Confidence Intervals

Covers hypothesis testing, confidence intervals, data distributions, and statistical significance in data analysis.

Statistical Hypothesis Testing

Covers statistical hypothesis testing, confidence intervals, p-values, and significance levels in hypothesis testing.

Related concepts (32)

Statistics

Statistical hypothesis testing

Power of a test

Student's t-test

Statistical significance