Lecture

Linear Regression: Basics and Applications

Graph Chat

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

In course

MICRO-110: Probability & statistics for engineers

This course covers the basics of probability and statistical techniques for engineers, including major probability concepts, data analysis, and statistical inference.

Description

This lecture covers the concept of the least-squares regression line, how to find it using correlation coefficients and standard deviations, and the coefficient of determination. It also explains the interpretation of r and r2, the impact of outliers and influential points, and how to calculate and interpret residuals in a regression model.

This video is available exclusively on Mediaspace for a restricted audience. Please log in to MediaSpace to access it if you have the necessary permissions.

Watch on Mediaspace

Instructor

Vivek Subramanian

Teaching & PhD PhD Students Giovanni Ruffolo, Giada Romano, Sanjay Manoharan, Kyle Haas, Claude Dahan, Biruktait Ayele Lemecho, Yagmur Ceren Alatas, Tugçe Delipinar Past EPFL PhD Students Amin Hodaei, Mustafa Mohieldin Fadlelmula Fadlelseed Past EPFL PhD Students as codirector Mohammad Jafarpour Courses Organic and printed electronics MICRO-505 This course addresses the implementation of organic and printed electronics technologies using large area manufacturing techniques. It will provide

Official source

Ontological neighbourhood

Statistics

Data analysis: Regression analysis

Related concepts (32)

Linear least squares

Linear least squares (LLS) is the least squares approximation of linear functions to data. It is a set of formulations for solving statistical problems involved in linear regression, including variants for ordinary (unweighted), weighted, and generalized (correlated) residuals. Numerical methods for linear least squares include inverting the matrix of the normal equations and orthogonal decomposition methods. The three main linear least squares formulations are: Ordinary least squares (OLS) is the most common estimator.

Linear regression

In statistics, linear regression is a linear approach for modelling the relationship between a scalar response and one or more explanatory variables (also known as dependent and independent variables). The case of one explanatory variable is called simple linear regression; for more than one, the process is called multiple linear regression. This term is distinct from multivariate linear regression, where multiple correlated dependent variables are predicted, rather than a single scalar variable.

Pearson correlation coefficient

In statistics, the Pearson correlation coefficient (PCC) is a correlation coefficient that measures linear correlation between two sets of data. It is the ratio between the covariance of two variables and the product of their standard deviations; thus, it is essentially a normalized measurement of the covariance, such that the result always has a value between −1 and 1. As with covariance itself, the measure can only reflect a linear correlation of variables, and ignores many other types of relationships or correlations.

Coefficient of determination

In statistics, the coefficient of determination, denoted R2 or r2 and pronounced "R squared", is the proportion of the variation in the dependent variable that is predictable from the independent variable(s). It is a statistic used in the context of statistical models whose main purpose is either the prediction of future outcomes or the testing of hypotheses, on the basis of other related information. It provides a measure of how well observed outcomes are replicated by the model, based on the proportion of total variation of outcomes explained by the model.

Regression analysis

In statistical modeling, regression analysis is a set of statistical processes for estimating the relationships between a dependent variable (often called the 'outcome' or 'response' variable, or a 'label' in machine learning parlance) and one or more independent variables (often called 'predictors', 'covariates', 'explanatory variables' or 'features'). The most common form of regression analysis is linear regression, in which one finds the line (or a more complex linear combination) that most closely fits the data according to a specific mathematical criterion.

Related lectures (54)

Linear and Ridge Regression

Covers linear and ridge regression, overfitting, hyperparameters, and test sets.

Linear Regression: Simple

Introduces simple linear regression, properties of residuals, variance decomposition, and the coefficient of determination in the context of Okun's law.

The Information Criteria of Takeuchi and Akaike

Covers the estimation of optimism for predictors via statistical models and the application of AIC to linear regression.

Linear Regression: Estimation and Inference

Explores linear regression estimation, linearity assumptions, and statistical tests in the context of model comparison.

Regularization: Tikhonov and Ridge