Conjugate Gradient MethodExplores the Conjugate Gradient method for solving linear systems and introduces Quasi-Newton methods and rank 2 updates.
Optimal Control TheoryIntroduces optimal control theory, covering models, discretization, measurements, Lagrangian, KKT conditions, and invertibility.
Conjugate Gradient OptimizationExplores Conjugate Gradient optimization, covering quadratic and nonlinear cases, Wolfe conditions, BFGS, CG algorithms, and matrix symmetry.
Multistep methodsCovers multistep methods for solving differential equations, focusing on stability conditions and examples.
Runge-Kutta MethodsExplains the Runge-Kutta methods, particularly the explicit scheme of order 4 (ERK4), and how to optimize parameters for accuracy.
Equivalent formulationCovers the concept of equivalent formulation in constrained optimization and explores the tangent cone.
Optimization methodsCovers optimization methods, focusing on gradient methods and line search techniques.
Optimal control applicationsCovers the application of optimal control in parameter identification and the trade-off between the model and measurements.
Convergence of the methodCovers the convergence of the method and the importance of adapting time steps for accurate approximations.
Numerical analysisCovers advanced numerical analysis topics including deep neural networks and optimization methods.
Optimization MethodsCovers unconstrained and constrained optimization, optimal control, neural networks, and global optimization methods.
Optimization MethodsCovers optimization methods without constraints, including gradient and line search in the quadratic case.
Quasi-newton optimizationCovers gradient line search methods and optimization techniques with an emphasis on Wolfe conditions and positive definiteness.
Nonlinear OptimizationCovers line search, Newton's method, BFGS, and conjugate gradient in nonlinear optimization.
