Mediaspace scheduled maintenance: Aug 25, 2026 07:00 - 12:00 AM. During this time, videos will be temporarily unavailable. Check status updates.

Lecture

Regression Diagnostics

In course

MATH-341: Linear models

Regression modelling is a fundamental tool of statistics, because it describes how the law of a random variable of interest may depend on other variables. This course aims to familiarize students with linear models and some of their extensions, which lie a ...

Description

This lecture by the instructor covers the essential regression diagnostics for linear models. It explains the assumptions to check for, including linearity, homoskedasticity, Gaussian distribution, and independent errors. The lecture details how to check these assumptions using residuals, standardised residuals, and various plots. It emphasizes the importance of identifying outliers, influential observations, and covariates left out of the model. Additionally, it discusses how to assess linearity, homoskedasticity, normality, and independence through graphical methods. The lecture concludes with a summary of diagnostic plots commonly used in regression analysis.

Instructors (2)

Victor Panaretos

Tomas Masák

Official source

Ontological neighbourhood

Statistics

Data analysis: Regression analysis

Statistical inference: Mathematical statistics

Related concepts (32)

Linear regression

In statistics, linear regression is a linear approach for modelling the relationship between a scalar response and one or more explanatory variables (also known as dependent and independent variables). The case of one explanatory variable is called simple linear regression; for more than one, the process is called multiple linear regression. This term is distinct from multivariate linear regression, where multiple correlated dependent variables are predicted, rather than a single scalar variable.

Linear model

In statistics, the term linear model is used in different ways according to the context. The most common occurrence is in connection with regression models and the term is often taken as synonymous with linear regression model. However, the term is also used in time series analysis with a different meaning. In each case, the designation "linear" is used to identify a subclass of models for which substantial reduction in the complexity of the related statistical theory is possible.

Generalized linear model

In statistics, a generalized linear model (GLM) is a flexible generalization of ordinary linear regression. The GLM generalizes linear regression by allowing the linear model to be related to the response variable via a link function and by allowing the magnitude of the variance of each measurement to be a function of its predicted value. Generalized linear models were formulated by John Nelder and Robert Wedderburn as a way of unifying various other statistical models, including linear regression, logistic regression and Poisson regression.

Linear probability model

In statistics, a linear probability model (LPM) is a special case of a binary regression model. Here the dependent variable for each observation takes values which are either 0 or 1. The probability of observing a 0 or 1 in any one case is treated as depending on one or more explanatory variables. For the "linear probability model", this relationship is a particularly simple one, and allows the model to be fitted by linear regression.

Generalized linear mixed model

In statistics, a generalized linear mixed model (GLMM) is an extension to the generalized linear model (GLM) in which the linear predictor contains random effects in addition to the usual fixed effects. They also inherit from GLMs the idea of extending linear mixed models to non-normal data. GLMMs provide a broad range of models for the analysis of grouped data, since the differences between groups can be modelled as a random effect. These models are useful in the analysis of many kinds of data, including longitudinal data.

Related lectures (36)

Gaussian Linear Regression: Assumptions and Residuals

Explores the assumptions and checking methods for Gaussian linear regression models using residuals and graphical plots.

Linear Models: Introduction

Introduces linear models, regression, Gaussian distribution, linearity, and model generalization.

Linear Models: Least Squares

Explores linear models, least squares, Gaussian vectors, and model selection methods.

Multicollinearity: Dangers and Remedies

Explores the dangers of multicollinearity in linear models and discusses diagnostic methods and remedies.

Regression: Linear Models