Mediaspace scheduled maintenance: Aug 25, 2026 07:00 - 12:00 AM. During this time, videos will be temporarily unavailable. Check status updates.

Concept

Conjugate gradient method

Related lectures (32)

Nonlinear Optimization

Covers line search, Newton's method, BFGS, and conjugate gradient in nonlinear optimization.

Conjugate Gradient Method

Covers the Conjugate Gradient method for solving linear systems efficiently.

Optimization without Constraints: Gradient Method

Covers optimization without constraints using the gradient method to find the function's minimum.

Gradient Descent

Covers the concept of gradient descent in scalar cases, focusing on finding the minimum of a function by iteratively moving in the direction of the negative gradient.

Conjugate Gradient Methods: Overview

Provides an overview of conjugate gradient methods, including preconditioning, nonlinear conjugate gradient, and singular value decomposition.

Momentum methods and nonlinear CG

Explores gradient descent with memory, momentum methods, conjugate gradients, and nonlinear CG on manifolds.

Optimization Methods in Machine Learning

Explores optimization methods in machine learning, emphasizing gradients, costs, and computational efforts for efficient model training.

Optimality of Convergence Rates: Accelerated Gradient Descent

Explores the optimality of convergence rates in convex optimization, focusing on accelerated gradient descent and adaptive methods.

Conjugate Gradient Optimization

Explores Conjugate Gradient optimization, covering quadratic and nonlinear cases, Wolfe conditions, BFGS, CG algorithms, and matrix symmetry.

Conjugate Gradient Method

Explores the Conjugate Gradient method for solving linear systems and introduces Quasi-Newton methods and rank 2 updates.

Iterative Methods for Linear Equations

Introduces iterative methods for linear equations, convergence criteria, gradient of quadratic forms, and classical force fields in complex atomistic systems.

Optimization Basics

Introduces optimization basics, covering logistic regression, derivatives, convex functions, gradient descent, and second-order methods.

Gradient Descent with Momentum

Explores the use of momentum in gradient descent to enhance speed and stability.

Regression & Systemed Lineaires

Covers the principles of regression and linear systems, focusing on iterative methods.

Mathematics of Data: Computation Role

Explores the role of computation in data mathematics, focusing on iterative methods, optimization, estimators, and descent principles.

Deep Learning Building Blocks

Covers tensors, loss functions, autograd, and convolutional layers in deep learning.

Quasi-newton optimization

Covers gradient line search methods and optimization techniques with an emphasis on Wolfe conditions and positive definiteness.

Conjugate Gradient Method: Iterative Optimization Log in to Mediaspace to watch this video

Covers the conjugate gradient method, stopping criteria, and convergence properties in iterative optimization.

Richardson Method: Preconditioned Iterative Solvers Log in to Mediaspace to watch this video

Covers the Richardson method for solving linear systems with preconditioned iterative solvers and introduces the gradient method.

Manopt: Optimization on Manifolds Log in to Mediaspace to watch this video

Introduces Manopt, a toolbox for optimization on manifolds, covering gradient and Hessian checks, solver calls, and manual caching.

Related lectures (32)

Nonlinear Optimization

Covers line search, Newton's method, BFGS, and conjugate gradient in nonlinear optimization.

Conjugate Gradient Method

Covers the Conjugate Gradient method for solving linear systems efficiently.

Optimization without Constraints: Gradient Method

Covers optimization without constraints using the gradient method to find the function's minimum.

Gradient Descent

Covers the concept of gradient descent in scalar cases, focusing on finding the minimum of a function by iteratively moving in the direction of the negative gradient.

Conjugate Gradient Methods: Overview

Provides an overview of conjugate gradient methods, including preconditioning, nonlinear conjugate gradient, and singular value decomposition.

Momentum methods and nonlinear CG

Explores gradient descent with memory, momentum methods, conjugate gradients, and nonlinear CG on manifolds.

Optimization Methods in Machine Learning

Explores optimization methods in machine learning, emphasizing gradients, costs, and computational efforts for efficient model training.

Optimality of Convergence Rates: Accelerated Gradient Descent

Explores the optimality of convergence rates in convex optimization, focusing on accelerated gradient descent and adaptive methods.

Conjugate Gradient Optimization

Explores Conjugate Gradient optimization, covering quadratic and nonlinear cases, Wolfe conditions, BFGS, CG algorithms, and matrix symmetry.

Conjugate Gradient Method

Explores the Conjugate Gradient method for solving linear systems and introduces Quasi-Newton methods and rank 2 updates.

Iterative Methods for Linear Equations

Introduces iterative methods for linear equations, convergence criteria, gradient of quadratic forms, and classical force fields in complex atomistic systems.

Optimization Basics

Introduces optimization basics, covering logistic regression, derivatives, convex functions, gradient descent, and second-order methods.

Gradient Descent with Momentum

Explores the use of momentum in gradient descent to enhance speed and stability.

Regression & Systemed Lineaires

Covers the principles of regression and linear systems, focusing on iterative methods.

Mathematics of Data: Computation Role

Explores the role of computation in data mathematics, focusing on iterative methods, optimization, estimators, and descent principles.

Deep Learning Building Blocks

Covers tensors, loss functions, autograd, and convolutional layers in deep learning.

Quasi-newton optimization

Covers gradient line search methods and optimization techniques with an emphasis on Wolfe conditions and positive definiteness.

Conjugate Gradient Method: Iterative Optimization Log in to Mediaspace to watch this video

Covers the conjugate gradient method, stopping criteria, and convergence properties in iterative optimization.

Richardson Method: Preconditioned Iterative Solvers Log in to Mediaspace to watch this video

Covers the Richardson method for solving linear systems with preconditioned iterative solvers and introduces the gradient method.

Manopt: Optimization on Manifolds Log in to Mediaspace to watch this video

Introduces Manopt, a toolbox for optimization on manifolds, covering gradient and Hessian checks, solver calls, and manual caching.