Mediaspace scheduled maintenance: Aug 25, 2026 07:00 - 12:00 AM. During this time, videos will be temporarily unavailable. Check status updates.

Lecture

Statistical Theory: Maximum Likelihood Estimation

In course

MATH-442: Statistical theory

This course gives a mostly rigourous treatment of some statistical methods outside the context of standard likelihood theory. ...

Description

This lecture delves into the consistency of the Maximum Likelihood Estimator (MLE) and its asymptotic properties. It explores the relationship between the MLE and the Kullback-Leibler Divergence, highlighting the challenges in proving the MLE's consistency. The lecture discusses deterministic examples to illustrate the complexities of the MLE's behavior. It also covers the construction of asymptotically MLE-like estimators and the Newton-Raphson algorithm. The lecture concludes with a discussion on misspecified models and likelihood, emphasizing the importance of model approximation and the behavior of estimators in such scenarios.

This video is available exclusively on Mediaspace for a restricted audience. Please log in to MediaSpace to access it if you have the necessary permissions.

Watch on Mediaspace

Instructor

Yoav Zemel

Official source

Ontological neighbourhood

Statistics

Statistical inference: Mathematical statistics

Related concepts (32)

Maximum likelihood estimation

In statistics, maximum likelihood estimation (MLE) is a method of estimating the parameters of an assumed probability distribution, given some observed data. This is achieved by maximizing a likelihood function so that, under the assumed statistical model, the observed data is most probable. The point in the parameter space that maximizes the likelihood function is called the maximum likelihood estimate. The logic of maximum likelihood is both intuitive and flexible, and as such the method has become a dominant means of statistical inference.

Estimation theory

Estimation theory is a branch of statistics that deals with estimating the values of parameters based on measured empirical data that has a random component. The parameters describe an underlying physical setting in such a way that their value affects the distribution of the measured data. An estimator attempts to approximate the unknown parameters using the measurements.

Estimator

In statistics, an estimator is a rule for calculating an estimate of a given quantity based on observed data: thus the rule (the estimator), the quantity of interest (the estimand) and its result (the estimate) are distinguished. For example, the sample mean is a commonly used estimator of the population mean. There are point and interval estimators. The point estimators yield single-valued results. This is in contrast to an interval estimator, where the result would be a range of plausible values.

Likelihood function

In statistical inference, the likelihood function quantifies the plausibility of parameter values characterizing a statistical model in light of observed data. Its most typical usage is to compare possible parameter values (under a fixed set of observations and a particular model), where higher values of likelihood are preferred because they correspond to more probable parameter values.

Invariant estimator

In statistics, the concept of being an invariant estimator is a criterion that can be used to compare the properties of different estimators for the same quantity. It is a way of formalising the idea that an estimator should have certain intuitively appealing qualities. Strictly speaking, "invariant" would mean that the estimates themselves are unchanged when both the measurements and the parameters are transformed in a compatible way, but the meaning has been extended to allow the estimates to change in appropriate ways with such transformations.

Related lectures (52)

Statistics for Data Science: Introduction to Statistical Methods

Covers the fundamental concepts of statistics and their application in data science.

Estimation Methods in Probability and Statistics

Discusses estimation methods in probability and statistics, focusing on maximum likelihood estimation and confidence intervals.

Maximum Likelihood Estimation

Covers maximum likelihood estimation to estimate parameters by maximizing prediction accuracy, demonstrating through a simple example and discussing validity through hypothesis testing.

Likelihood Ratio Test: Hypothesis Testing

Covers the Likelihood Ratio Test and hypothesis testing methods using Maximum Likelihood Estimators.

Maximum Likelihood Estimation MOOC: Introduction to Discrete Choice Models