Lecture

Linear Regression and Least Squares Method

Graph Chat

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

Related lectures (64)

Gaussian Conditional Model and Properties

Explores the Gaussian conditional model for linear regression and the properties of Gaussian data, illustrated with the example of kidney stone treatment comparison.

Linear Regression: Basics and Geometric Interpretation

Explores Gaussian linear regression, design matrix, least squares estimation, and geometric interpretation in linear regression analysis.

Parametric Models: Regression Estimators and Optimization

Covers parametric models, regression estimators, and optimization in statistical modeling.

Linear MM SE Estimation

Covers the principles of linear MM SE estimation and the minimization of errors in linear regression.

Linear Regression: Simple

Introduces simple linear regression, properties of residuals, variance decomposition, and the coefficient of determination in the context of Okun's law.

Cross-Validation: Techniques and Applications

Explores cross-validation, overfitting, regularization, and regression techniques in machine learning.

Linear Regression: Parametric Models and Optimization

Covers linear regression, parametric models, optimization, and predictive modeling using labeled examples.

Introduction to Machine Learning: Regression Fundamentals

Introduces the fundamentals of regression in machine learning, covering course logistics, key concepts, and the importance of loss functions in model evaluation.

Bayesian Inference: Part 2

Explores Bayesian inference, multiclass classification, logistic regression, and linear regression inference.

Nonlinear ML Algorithms

Introduces nonlinear ML algorithms, covering nearest neighbor, k-NN, polynomial curve fitting, model complexity, overfitting, and regularization.

Linear Regression Basics

Covers the basics of linear regression in machine learning, including model training, loss functions, and evaluation metrics.

Linear Regression and Gradient Descent

Covers linear regression, gradient descent, overfitting, and ridge regression among other concepts.

Overfitting in Supervised Learning: Case Studies and Techniques

Addresses overfitting in supervised learning through polynomial regression case studies and model selection techniques.

Linear Regression Analysis

Introduces linear regression analysis, covering model building, predictors, coefficients, and outcome interpretation.

Regression: Interactive Lecture

Covers linear regression, weighted regression, locally weighted regression, support vector regression, noise handling, and eye mapping using SVR.

Regression and Kinetics Modeling

Explores regression analysis, kinetics modeling, parameter estimation, and atmospheric ozone concentration modeling using linear relationships and scatterplots.

Linear Regression: Least Squares Method I

Covers linear regression and the least squares method to find the best-fit line for given data points.

Optimization Techniques: Gradient Method Overview

Discusses the gradient method for optimization, focusing on its application in machine learning and the conditions for convergence.

Nonlinear Machine Learning: k-Nearest Neighbors and Feature Expansion

Covers the transition from linear to nonlinear models, focusing on k-NN and feature expansion techniques.

Modern Regression: Spring Barley Data

Covers iterative weighted least squares, Poisson regression, and Bayesian analysis of spring barley data using mixed models.