Mediaspace scheduled maintenance: Aug 25, 2026 07:00 - 12:00 AM. During this time, videos will be temporarily unavailable. Check status updates.

Lecture

Linear Regression Testing

Description

This lecture covers the concept of least squares in linear regression, focusing on testing in the linear regression setting. Topics include non-central chi-squared distribution, orthogonal matrices, idempotent matrices, hypothesis testing, and diagnostics for linear regression models. The lecture also delves into outliers, influential observations, and the assumptions underlying Gaussian linear regression models.

Official source

Ontological neighbourhood

Statistics

Data analysis: Regression analysis

Statistical inference: Mathematical statistics

Mathematics

Algebra: Linear algebra

Related concepts (32)

Linear least squares

Linear least squares (LLS) is the least squares approximation of linear functions to data. It is a set of formulations for solving statistical problems involved in linear regression, including variants for ordinary (unweighted), weighted, and generalized (correlated) residuals. Numerical methods for linear least squares include inverting the matrix of the normal equations and orthogonal decomposition methods. The three main linear least squares formulations are: Ordinary least squares (OLS) is the most common estimator.

Linear regression

In statistics, linear regression is a linear approach for modelling the relationship between a scalar response and one or more explanatory variables (also known as dependent and independent variables). The case of one explanatory variable is called simple linear regression; for more than one, the process is called multiple linear regression. This term is distinct from multivariate linear regression, where multiple correlated dependent variables are predicted, rather than a single scalar variable.

Least squares

The method of least squares is a standard approach in regression analysis to approximate the solution of overdetermined systems (sets of equations in which there are more equations than unknowns) by minimizing the sum of the squares of the residuals (a residual being the difference between an observed value and the fitted value provided by a model) made in the results of each individual equation. The most important application is in data fitting.

Non-linear least squares

Non-linear least squares is the form of least squares analysis used to fit a set of m observations with a model that is non-linear in n unknown parameters (m ≥ n). It is used in some forms of nonlinear regression. The basis of the method is to approximate the model by a linear one and to refine the parameters by successive iterations. There are many similarities to linear least squares, but also some significant differences.

Regression analysis

In statistical modeling, regression analysis is a set of statistical processes for estimating the relationships between a dependent variable (often called the 'outcome' or 'response' variable, or a 'label' in machine learning parlance) and one or more independent variables (often called 'predictors', 'covariates', 'explanatory variables' or 'features'). The most common form of regression analysis is linear regression, in which one finds the line (or a more complex linear combination) that most closely fits the data according to a specific mathematical criterion.

Related lectures (53)

Linear Regression: Maximum Likelihood Approach

Covers linear regression topics including confidence intervals, variance, and maximum likelihood approach.

Regression II

Delves into regression analysis, emphasizing distributional checks, weighted least squares, and hypothesis testing.

Linear Regression: Estimation and Testing

Explores linear regression estimation, hypothesis testing, and practical applications in statistics.

Linear Regression: Absence or Presence of Covariates

Explores linear regression with and without covariates, covering models captured by independent distributions and tools like subspaces and orthogonal projections.

Regression: Linear Models