Mediaspace scheduled maintenance: Aug 25, 2026 07:00 - 12:00 AM. During this time, videos will be temporarily unavailable. Check status updates.

Lecture

Singular Values and Norms: Understanding Linear Maps with SVD

In course

MATH-329: Continuous optimization

This course introduces students to continuous, nonlinear optimization. We study the theory of optimization with continuous variables (with full proofs), and we analyze and implement important algorithms to solve constrained and unconstrained problems. ...

Description

This lecture delves into the concept of singular value decomposition (SVD) of a matrix A, explaining how it always exists and its significance in linear algebra. Through the SVD, the instructor demonstrates how applying a linear map to a vector affects its norm, showcasing the properties of orthogonal matrices and their impact on vector norms. By analyzing the relationship between singular values and vector norms, the lecture concludes with a fundamental result in linear algebra, illustrating the essential role of SVD in understanding linear maps.

This video is available exclusively on Mediaspace for a restricted audience. Please log in to MediaSpace to access it if you have the necessary permissions.

Watch on Mediaspace

Instructor

Nicolas Boumal

Official source

Ontological neighbourhood

Mathematics

Algebra: Linear algebra

Related concepts (31)

Linear map

In mathematics, and more specifically in linear algebra, a linear map (also called a linear mapping, linear transformation, vector space homomorphism, or in some contexts linear function) is a mapping between two vector spaces that preserves the operations of vector addition and scalar multiplication. The same names and the same definition are also used for the more general case of modules over a ring; see Module homomorphism. If a linear map is a bijection then it is called a .

Linear algebra

Linear algebra is the branch of mathematics concerning linear equations such as: linear maps such as: and their representations in vector spaces and through matrices. Linear algebra is central to almost all areas of mathematics. For instance, linear algebra is fundamental in modern presentations of geometry, including for defining basic objects such as lines, planes and rotations. Also, functional analysis, a branch of mathematical analysis, may be viewed as the application of linear algebra to spaces of functions.

Singular value decomposition

In linear algebra, the singular value decomposition (SVD) is a factorization of a real or complex matrix. It generalizes the eigendecomposition of a square normal matrix with an orthonormal eigenbasis to any matrix. It is related to the polar decomposition. Specifically, the singular value decomposition of an complex matrix M is a factorization of the form where U is an complex unitary matrix, is an rectangular diagonal matrix with non-negative real numbers on the diagonal, V is an complex unitary matrix, and is the conjugate transpose of V.

Normed vector space

In mathematics, a normed vector space or normed space is a vector space over the real or complex numbers on which a norm is defined. A norm is a generalization of the intuitive notion of "length" in the physical world. If is a vector space over , where is a field equal to or to , then a norm on is a map , typically denoted by , satisfying the following four axioms: Non-negativity: for every ,. Positive definiteness: for every , if and only if is the zero vector.

Singular value

In mathematics, in particular functional analysis, the singular values, or s-numbers of a compact operator acting between Hilbert spaces and , are the square roots of the (necessarily non-negative) eigenvalues of the self-adjoint operator (where denotes the adjoint of ). The singular values are non-negative real numbers, usually listed in decreasing order (σ1(T), σ2(T), ...). The largest singular value σ1(T) is equal to the operator norm of T (see Min-max theorem).

Related lectures (49)

Singular Value Decomposition

Explores Singular Value Decomposition, low-rank approximation, fundamental subspaces, and matrix norms.

Matrices and Orthogonal Transformations MOOC: Linear Algebra (Part 3)

Explores orthogonal matrices and transformations, emphasizing preservation of norms and angles.

Signal Representations

Covers the norm of a matrix, operator, singular values, and unitary matrices in linear algebra.

Matrix Representations: Linear Maps

Explores matrix representations of linear maps and their invariance, using examples and special cases.

Orthogonal Projection: Vector Decomposition