Mediaspace scheduled maintenance: Aug 25, 2026 07:00 - 12:00 AM. During this time, videos will be temporarily unavailable. Check status updates.

Lecture

Bayesian Statistics: Hypothesis Testing and Estimation

In course

EE-209: Elements of statistics for data science

Théorie de l'estimation: estimateurs du maximum de vraisemblance, information de Fisher, inégalité de Cramer-Rao, intervalles de confiance. Tests d'hypothèses: cadre de Neyman-Pearson: test du rapport de vraisemblance, tests paramétriques et non-parmétriq ...

Description

This lecture covers hypothesis testing, including one-sided Gaussian tests, p-values, and significance levels. It also introduces Bayesian statistics, explaining Bayesian estimation for single observations and samples, likelihood, and prior and posterior distributions.

Instructor

Florent Gérard Krzakala

Official source

Ontological neighbourhood

Statistics

Statistical inference: Statistical hypothesis testing, Mathematical statistics

Related concepts (32)

P-value

In null-hypothesis significance testing, the p-value is the probability of obtaining test results at least as extreme as the result actually observed, under the assumption that the null hypothesis is correct. A very small p-value means that such an extreme observed outcome would be very unlikely under the null hypothesis. Even though reporting p-values of statistical tests is common practice in academic publications of many quantitative fields, misinterpretation and misuse of p-values is widespread and has been a major topic in mathematics and metascience.

One- and two-tailed tests

In statistical significance testing, a one-tailed test and a two-tailed test are alternative ways of computing the statistical significance of a parameter inferred from a data set, in terms of a test statistic. A two-tailed test is appropriate if the estimated value is greater or less than a certain range of values, for example, whether a test taker may score above or below a specific range of scores. This method is used for null hypothesis testing and if the estimated value exists in the critical areas, the alternative hypothesis is accepted over the null hypothesis.

Likelihood-ratio test

In statistics, the likelihood-ratio test assesses the goodness of fit of two competing statistical models, specifically one found by maximization over the entire parameter space and another found after imposing some constraint, based on the ratio of their likelihoods. If the constraint (i.e., the null hypothesis) is supported by the observed data, the two likelihoods should not differ by more than sampling error. Thus the likelihood-ratio test tests whether this ratio is significantly different from one, or equivalently whether its natural logarithm is significantly different from zero.

Likelihood function

In statistical inference, the likelihood function quantifies the plausibility of parameter values characterizing a statistical model in light of observed data. Its most typical usage is to compare possible parameter values (under a fixed set of observations and a particular model), where higher values of likelihood are preferred because they correspond to more probable parameter values.

Statistical hypothesis testing

A statistical hypothesis test is a method of statistical inference used to decide whether the data at hand sufficiently support a particular hypothesis. Hypothesis testing allows us to make probabilistic statements about population parameters. While hypothesis testing was popularized early in the 20th century, early forms were used in the 1700s. The first use is credited to John Arbuthnot (1710), followed by Pierre-Simon Laplace (1770s), in analyzing the human sex ratio at birth; see .

Related lectures (56)

Bayesian Estimation: Overview and Examples

Introduces Bayesian estimation, covering classical versus Bayesian inference, conjugate priors, MCMC methods, and practical examples like temperature estimation and choice modeling.

Confidence Intervals and Hypothesis Tests

Covers confidence intervals, hypothesis tests, standard errors, statistical models, likelihood, Bayesian inference, ROC curve, Pearson statistic, goodness of fit tests, and power of tests.

Statistical Hypothesis Testing

Covers statistical hypothesis testing, confidence intervals, p-values, and significance levels in hypothesis testing.

Bayesian Inference: Beta-Bernoulli Model

Explores the Beta distribution, Bayesian inference, and posterior calculation in the Beta-Bernoulli model.

Hypothesis Testing: State of Nature