Mediaspace scheduled maintenance: Aug 25, 2026 07:00 - 12:00 AM. During this time, videos will be temporarily unavailable. Check status updates.

Lecture

Bayesian Inference: Precision in Gaussian Model

In course

EE-209: Elements of statistics for data science

Théorie de l'estimation: estimateurs du maximum de vraisemblance, information de Fisher, inégalité de Cramer-Rao, intervalles de confiance. Tests d'hypothèses: cadre de Neyman-Pearson: test du rapport de vraisemblance, tests paramétriques et non-parmétriq ...

Description

This lecture covers Bayesian inference for precision in the Gaussian model when the mean is known, using a Gamma prior. It discusses improper priors, subjective vs objective priors, and the difference between frequentist and Bayesian probabilities. The lecture also explores the concept of consistency in Bayesian statistics.

Instructor

Florent Gérard Krzakala

Official source

Ontological neighbourhood

Statistics

Statistical inference: Statistical hypothesis testing

Related concepts (32)

Bayesian probability

Bayesian probability (ˈbeɪziən or ˈbeɪʒən ) is an interpretation of the concept of probability, in which, instead of frequency or propensity of some phenomenon, probability is interpreted as reasonable expectation representing a state of knowledge or as quantification of a personal belief. The Bayesian interpretation of probability can be seen as an extension of propositional logic that enables reasoning with hypotheses; that is, with propositions whose truth or falsity is unknown.

Prior probability

A prior probability distribution of an uncertain quantity, often simply called the prior, is its assumed probability distribution before some evidence is taken into account. For example, the prior could be the probability distribution representing the relative proportions of voters who will vote for a particular politician in a future election. The unknown quantity may be a parameter of the model or a latent variable rather than an observable variable.

Conjugate prior

In Bayesian probability theory, if the posterior distribution is in the same probability distribution family as the prior probability distribution , the prior and posterior are then called conjugate distributions, and the prior is called a conjugate prior for the likelihood function . A conjugate prior is an algebraic convenience, giving a closed-form expression for the posterior; otherwise, numerical integration may be necessary. Further, conjugate priors may give intuition by more transparently showing how a likelihood function updates a prior distribution.

Bayesian inference

Bayesian inference (ˈbeɪziən or ˈbeɪʒən ) is a method of statistical inference in which Bayes' theorem is used to update the probability for a hypothesis as more evidence or information becomes available. Bayesian inference is an important technique in statistics, and especially in mathematical statistics. Bayesian updating is particularly important in the dynamic analysis of a sequence of data. Bayesian inference has found application in a wide range of activities, including science, engineering, philosophy, medicine, sport, and law.

Bayesian statistics

Bayesian statistics (ˈbeɪziən or ˈbeɪʒən ) is a theory in the field of statistics based on the Bayesian interpretation of probability where probability expresses a degree of belief in an event. The degree of belief may be based on prior knowledge about the event, such as the results of previous experiments, or on personal beliefs about the event. This differs from a number of other interpretations of probability, such as the frequentist interpretation that views probability as the limit of the relative frequency of an event after many trials.

Related lectures (39)

Inference Problems & Spin Glass Game

Covers inference problems related to the Spin Glass Game and the challenges of making mistakes with preb P.

Probability and Statistics

Introduces probability, statistics, distributions, inference, likelihood, and combinatorics for studying random events and network modeling.

Bayesian Inference: Estimation & Demystification

Covers the concepts of Demystification, Estimation, and Bayesian Inference in the context of Bayesian statistics.

Estimation & Bayesian Inference

Covers demousing, estimation, Bayesian inference, likelihood, AWGN, and more.

Bayesian Estimation: Overview and Examples