Descent Methods and Newton Method with Line Search

About
Privacy
Disclaimer

Graph Chatbot

Related lectures (28)

Lipschitz continuous Hessian and Newton's method Log in to Mediaspace to watch this video

Explores the convergence of Newton's method and the CG algorithm for solving linear equations.

Coordinate Descent: Optimization Strategies Log in to Mediaspace to watch this video

Explores coordinate descent optimization strategies, emphasizing simplicity in optimization through one-coordinate updates and discussing the implications of different approaches.

Richardson Method: Preconditioned Iterative Solvers Log in to Mediaspace to watch this video

Covers the Richardson method for solving linear systems with preconditioned iterative solvers and introduces the gradient method.

Iterative Methods for Linear Equations Log in to Mediaspace to watch this video

Introduces iterative methods for solving linear equations and discusses the gradient method for minimizing errors.

Convex Optimization: Gradient Algorithms Log in to Mediaspace to watch this video

Covers convex optimization problems and gradient-based algorithms to find the global minimum.

TR global convergence (end) + CG Log in to Mediaspace to watch this video

Covers the trust-region method and introduces the truncated conjugate gradients method.

Proximal Gradient Descent: Optimization Techniques in Machine Learning Log in to Mediaspace to watch this video

Discusses proximal gradient descent and its applications in optimizing machine learning algorithms.

Effect of Rounding Errors in Linear Systems Log in to Mediaspace to watch this video

Explores the effect of rounding errors in solving linear systems using the LU factorization method.

Page 2 of 2