Lecture

Quadratic Best Approximation

Graph Chat

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

Description

This lecture covers the concept of the best quadratic approximation in a finite-dimensional vector space with a scalar product, i.e., an Euclidean space. It explains how to find the closest vector in a subspace to a given vector, defining the best approximation as the one minimizing the squared distance. The proof involves applying the Pythagorean theorem to show the optimality of the projection. The lecture emphasizes the importance of this concept in the context of least squares approximation. The instructor illustrates the theory with mathematical propositions and remarks, providing a deep understanding of the topic.

In MOOC

Linear Algebra (Part 3)

Would you like to learn linear algebra, a valuable tool to complement the knowledge you've acquired during your studies in economics, engineering, physics or statistics? Or simply for the beauty of it? Then this course is for you! In addition to its role as a tool in the various branches mentioned above (enabling the solution of concrete problems), linear algebra, which captures the essence of mathematics - namely, algebra and geometry - will introduce you to the more abstract world of mathematics. Offered

Official source

Ontological neighbourhood

Mathematics

Algebra: Linear algebra

Related concepts (32)

Euclidean space

Euclidean space is the fundamental space of geometry, intended to represent physical space. Originally, that is, in Euclid's Elements, it was the three-dimensional space of Euclidean geometry, but in modern mathematics there are Euclidean spaces of any positive integer dimension n, which are called Euclidean n-spaces when one wants to specify their dimension. For n equal to one or two, they are commonly called respectively Euclidean lines and Euclidean planes.

Least squares

The method of least squares is a standard approach in regression analysis to approximate the solution of overdetermined systems (sets of equations in which there are more equations than unknowns) by minimizing the sum of the squares of the residuals (a residual being the difference between an observed value and the fitted value provided by a model) made in the results of each individual equation. The most important application is in data fitting.

Linear least squares

Linear least squares (LLS) is the least squares approximation of linear functions to data. It is a set of formulations for solving statistical problems involved in linear regression, including variants for ordinary (unweighted), weighted, and generalized (correlated) residuals. Numerical methods for linear least squares include inverting the matrix of the normal equations and orthogonal decomposition methods. The three main linear least squares formulations are: Ordinary least squares (OLS) is the most common estimator.

Pythagorean theorem

In mathematics, the Pythagorean theorem or Pythagoras' theorem is a fundamental relation in Euclidean geometry between the three sides of a right triangle. It states that the area of the square whose side is the hypotenuse (the side opposite the right angle) is equal to the sum of the areas of the squares on the other two sides. The theorem can be written as an equation relating the lengths of the sides a, b and the hypotenuse c, sometimes called the Pythagorean equation: The theorem is named for the Greek philosopher Pythagoras, born around 570 BC.

Euclidean distance

In mathematics, the Euclidean distance between two points in Euclidean space is the length of a line segment between the two points. It can be calculated from the Cartesian coordinates of the points using the Pythagorean theorem, therefore occasionally being called the Pythagorean distance. These names come from the ancient Greek mathematicians Euclid and Pythagoras, although Euclid did not represent distances as numbers, and the connection from the Pythagorean theorem to distance calculation was not made until the 18th century.

Related lectures (64)

Orthogonality and Least Squares Method

Covers orthogonal vectors, unit vectors, and the Pythagorean theorem in R^m.

Orthogonality and Least Squares

Introduces orthogonality between vectors, angles, and orthogonal complement properties in vector spaces.

Orthogonal Projection: Euclidean Space

Explores orthogonal projection in Euclidean space, emphasizing uniqueness and calculation methods.

Diagonalization of Matrices and Least Squares

Covers diagonalization of matrices, eigenvectors, linear maps, and least squares method.

Orthogonality and Scalar Product