Mediaspace scheduled maintenance: Aug 25, 2026 07:00 - 12:00 AM. During this time, videos will be temporarily unavailable. Check status updates.

Lecture

Likelihood Ratio Test: Hypothesis Testing

Description

This lecture covers the Likelihood Ratio Test for hypothesis testing, focusing on comparing unrestricted and restricted Maximum Likelihood Estimators (MLEs). It discusses the Score Test and Wald's Test, emphasizing large deviations as evidence against the null hypothesis. The instructor explains the importance of regularity conditions and asymptotic normality in approximating distributions for large sample sizes.

Official source

Ontological neighbourhood

Statistics

Statistical inference: Mathematical statistics, Statistical hypothesis testing

Related concepts (32)

Likelihood function

In statistical inference, the likelihood function quantifies the plausibility of parameter values characterizing a statistical model in light of observed data. Its most typical usage is to compare possible parameter values (under a fixed set of observations and a particular model), where higher values of likelihood are preferred because they correspond to more probable parameter values.

Score test

In statistics, the score test assesses constraints on statistical parameters based on the gradient of the likelihood function—known as the score—evaluated at the hypothesized parameter value under the null hypothesis. Intuitively, if the restricted estimator is near the maximum of the likelihood function, the score should not differ from zero by more than sampling error. While the finite sample distributions of score tests are generally unknown, they have an asymptotic χ2-distribution under the null hypothesis as first proved by C.

Wald test

In statistics, the Wald test (named after Abraham Wald) assesses constraints on statistical parameters based on the weighted distance between the unrestricted estimate and its hypothesized value under the null hypothesis, where the weight is the precision of the estimate. Intuitively, the larger this weighted distance, the less likely it is that the constraint is true. While the finite sample distributions of Wald tests are generally unknown, it has an asymptotic χ2-distribution under the null hypothesis, a fact that can be used to determine statistical significance.

Likelihood-ratio test

In statistics, the likelihood-ratio test assesses the goodness of fit of two competing statistical models, specifically one found by maximization over the entire parameter space and another found after imposing some constraint, based on the ratio of their likelihoods. If the constraint (i.e., the null hypothesis) is supported by the observed data, the two likelihoods should not differ by more than sampling error. Thus the likelihood-ratio test tests whether this ratio is significantly different from one, or equivalently whether its natural logarithm is significantly different from zero.

Maximum likelihood estimation

In statistics, maximum likelihood estimation (MLE) is a method of estimating the parameters of an assumed probability distribution, given some observed data. This is achieved by maximizing a likelihood function so that, under the assumed statistical model, the observed data is most probable. The point in the parameter space that maximizes the likelihood function is called the maximum likelihood estimate. The logic of maximum likelihood is both intuitive and flexible, and as such the method has become a dominant means of statistical inference.

Related lectures (59)

Maximum Likelihood Estimation: Multivariate Statistics

Explores maximum likelihood estimation and multivariate hypothesis testing, including challenges and strategies for testing multiple hypotheses.

Maximum Likelihood Estimation

Covers maximum likelihood estimation to estimate parameters by maximizing prediction accuracy, demonstrating through a simple example and discussing validity through hypothesis testing.

Fisher Information, Cramér-Rao Inequality, MLE

Explains Fisher information, Cramér-Rao inequality, and MLE properties, including invariance and asymptotics.

Hypothesis Testing: Wilks' Theorem

Explores hypothesis testing using Wilks' Theorem, likelihood ratio statistics, p-values, interval estimation, and confidence regions.

Maximum Likelihood Estimation MOOC: Introduction to Discrete Choice Models