Lecture

Testing: Likelihood Ratio Test

Graph Chat

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

Description

This lecture introduces the likelihood ratio test in the context of choice models, comparing unrestricted and restricted models with equal probability and alternative specific constants. It revisits benchmarking, discussing log likelihood statistics and classical output of estimation software. The instructor explains tests for generic attributes, taste variations, and nonlinear specifications, including power series and linear models. The lecture concludes with a caution against overfitting and the use of other nonlinear specifications like piecewise linear and Box-Cox transformations.

Official source

Related concepts (32)

Likelihood function

In statistical inference, the likelihood function quantifies the plausibility of parameter values characterizing a statistical model in light of observed data. Its most typical usage is to compare possible parameter values (under a fixed set of observations and a particular model), where higher values of likelihood are preferred because they correspond to more probable parameter values.

Likelihood-ratio test

In statistics, the likelihood-ratio test assesses the goodness of fit of two competing statistical models, specifically one found by maximization over the entire parameter space and another found after imposing some constraint, based on the ratio of their likelihoods. If the constraint (i.e., the null hypothesis) is supported by the observed data, the two likelihoods should not differ by more than sampling error. Thus the likelihood-ratio test tests whether this ratio is significantly different from one, or equivalently whether its natural logarithm is significantly different from zero.

Relative likelihood

In statistics, when selecting a statistical model for given data, the relative likelihood compares the relative plausibilities of different candidate models or of different values of a parameter of a single model. Assume that we are given some data x for which we have a statistical model with parameter θ. Suppose that the maximum likelihood estimate for θ is . Relative plausibilities of other θ values may be found by comparing the likelihoods of those other values with the likelihood of .

Linear model

In statistics, the term linear model is used in different ways according to the context. The most common occurrence is in connection with regression models and the term is often taken as synonymous with linear regression model. However, the term is also used in time series analysis with a different meaning. In each case, the designation "linear" is used to identify a subclass of models for which substantial reduction in the complexity of the related statistical theory is possible.

Likelihood principle

In statistics, the likelihood principle is the proposition that, given a statistical model, all the evidence in a sample relevant to model parameters is contained in the likelihood function. A likelihood function arises from a probability density function considered as a function of its distributional parameterization argument.

Related lectures (64)

Maximum Likelihood Estimation: Multivariate Statistics

Explores maximum likelihood estimation and multivariate hypothesis testing, including challenges and strategies for testing multiple hypotheses.

Model Selection Criteria: AIC, BIC, Cp

Explores model selection criteria like AIC, BIC, and Cp in statistics for data science.

Likelihood Ratio Test: Detection & Estimation

Covers the likelihood ratio test for detection and estimation in statistical analysis.

Likelihood Ratio Test: Hypothesis Testing

Covers the Likelihood Ratio Test and hypothesis testing methods using Maximum Likelihood Estimators.

Logistic Regression: Statistical Inference and Machine Learning