Lecture

Linear Models: Introduction

Graph Chat

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

In course

MATH-341: Linear models

Regression modelling is a fundamental tool of statistics, because it describes how the law of a random variable of interest may depend on other variables. This course aims to familiarize students with linear models and some of their extensions, which lie a ...

Description

This lecture introduces linear models, focusing on regression models and the statistical problem of estimating the relationship between random variable Y and non-random variable x. It covers the general formulation of Y ~ Distribution{g(x)}, the concept of data compression, and examples like Honolulu tide and gas mileage. The lecture also discusses normal linear regression, the importance of Gaussian distribution and linearity, and the gradual generalization of the normal linear model to linear Gaussian regression, nonlinear Gaussian regression, and nonparametric Gaussian regression.

Instructors (2)

Victor Panaretos

Curriculum vitae Background & EducationPublications & PreprintsHonours & AwardsEditorial ActivitiesInvited Talks & Seminars Teaching & PhD PhD Students Ulysse Naepels, Nikitas Georgakis, Ho Yun Past EPFL PhD Students Andrea Kraus, Shahin Tavakoli, Mikael Kuusela, Yoav Zemel, Marie-Hélène Descary, Valentina Masarotto, Tomas Rubin, Tomas Masák, Laya Ghodrati, Kartik Waghmare, Leonardo Santoro Past EPFL PhD Students as codirector Matthieu Simeoni, Ophelia Miralles, Sonia Alouini, Timmy Rong Tian Tse, Krali M

Tomas Masák

Official source

Ontological neighbourhood

Statistics

Data analysis: Regression analysis

Related concepts (32)

Regression analysis

In statistical modeling, regression analysis is a set of statistical processes for estimating the relationships between a dependent variable (often called the 'outcome' or 'response' variable, or a 'label' in machine learning parlance) and one or more independent variables (often called 'predictors', 'covariates', 'explanatory variables' or 'features'). The most common form of regression analysis is linear regression, in which one finds the line (or a more complex linear combination) that most closely fits the data according to a specific mathematical criterion.

Generalized linear model

In statistics, a generalized linear model (GLM) is a flexible generalization of ordinary linear regression. The GLM generalizes linear regression by allowing the linear model to be related to the response variable via a link function and by allowing the magnitude of the variance of each measurement to be a function of its predicted value. Generalized linear models were formulated by John Nelder and Robert Wedderburn as a way of unifying various other statistical models, including linear regression, logistic regression and Poisson regression.

General linear model

The general linear model or general multivariate regression model is a compact way of simultaneously writing several multiple linear regression models. In that sense it is not a separate statistical linear model. The various multiple linear regression models may be compactly written as where Y is a matrix with series of multivariate measurements (each column being a set of measurements on one of the dependent variables), X is a matrix of observations on independent variables that might be a design matrix (each column being a set of observations on one of the independent variables), B is a matrix containing parameters that are usually to be estimated and U is a matrix containing errors (noise).

Bayesian linear regression

Bayesian linear regression is a type of conditional modeling in which the mean of one variable is described by a linear combination of other variables, with the goal of obtaining the posterior probability of the regression coefficients (as well as other parameters describing the distribution of the regressand) and ultimately allowing the out-of-sample prediction of the regressand (often labelled ) conditional on observed values of the regressors (usually ).

Segmented regression

Segmented regression, also known as piecewise regression or broken-stick regression, is a method in regression analysis in which the independent variable is partitioned into intervals and a separate line segment is fit to each interval. Segmented regression analysis can also be performed on multivariate data by partitioning the various independent variables. Segmented regression is useful when the independent variables, clustered into different groups, exhibit different relationships between the variables in these regions.

Related lectures (64)

Likelihood Estimation and Least Squares

Introduces simple and multiple normal linear regression, and maximum likelihood estimation with practical examples.

Linear Regression: Ozone Data Analysis

Explores linear regression analysis of ozone data using statistical models.

Probabilistic Linear Regression

Explores probabilistic linear regression, covering joint and conditional probability, ridge regression, and overfitting mitigation.

Linear Regression: Estimation and Inference

Explores linear regression estimation, linearity assumptions, and statistical tests in the context of model comparison.

Generalized Linear Models