Lecture

Convergence Criteria

Graph Chat

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

In courses (2)

MATH-250: Advanced numerical analysis I

Construction and analysis of numerical methods for the solution of problems from linear algebra, integration, approximation, and differentiation. ...

MATH-251(c): Numerical analysis

Le cours présente des méthodes numériques pour la résolution de problèmes mathématiques comme des systèmes d'équations linéaires ou non linéaires, l'approximation de fonctions, l'intégration et la dérivation, et les équations différentielles. ...

Description

This lecture covers different convergence criteria used in optimization algorithms, such as stopping conditions based on the norm of the gradient and the change in the objective function. The instructor explains how these criteria help determine when to stop the optimization process and highlights the importance of paying attention to the criteria when dealing with large values. Various examples are provided to illustrate the application of convergence criteria in practice.

Instructors (3)

Daniel Kressner

Annalisa Buffa

Teaching & PhD PhD Students Gonzalo Bonilla Moreno, Philipp Christoph Weder, Yannis Dirk Voet, Fabio Marcinno, Ferhat Sindy, Francesco Sala, Markus Renoldner, Mohamed Ben Abdelouahab, Davor Dobrota Past EPFL PhD Students Luca Coradello, Ondine Chanon, Riccardo Puppi Courses Numerical approximation of PDEs MATH-451 The course is about the derivation, theoretical analysis and implementation of the finite element method for the numerical approximation of partial differential equations in on

Simone Deparis

Expertise Simone Deparis is a professor at EPFL specializing in applied mathematics, numerical analysis, and the didactics of university-level mathematics. His research spans computational modeling for biomedical applications and innovations in mathematics education, with a focus on equity, self-efficacy, and assessment reform in large STEM cohorts. Mission Our group conducts research at the intersection of applied mathematics and learning sciences. In applied mathematics, we focus on modeling and simulatio

Official source

Related concepts (18)

Multi-objective optimization

Multi-objective optimization or Pareto optimization (also known as multi-objective programming, vector optimization, multicriteria optimization, or multiattribute optimization) is an area of multiple-criteria decision making that is concerned with mathematical optimization problems involving more than one objective function to be optimized simultaneously. Multi-objective is a type of vector optimization that has been applied in many fields of science, including engineering, economics and logistics where optimal decisions need to be taken in the presence of trade-offs between two or more conflicting objectives.

Program optimization

In computer science, program optimization, code optimization, or software optimization, is the process of modifying a software system to make some aspect of it work more efficiently or use fewer resources. In general, a computer program may be optimized so that it executes more rapidly, or to make it capable of operating with less memory storage or other resources, or draw less power. Although the word "optimization" shares the same root as "optimal", it is rare for the process of optimization to produce a truly optimal system.

Mathematical optimization

Mathematical optimization (alternatively spelled optimisation) or mathematical programming is the selection of a best element, with regard to some criterion, from some set of available alternatives. It is generally divided into two subfields: discrete optimization and continuous optimization. Optimization problems arise in all quantitative disciplines from computer science and engineering to operations research and economics, and the development of solution methods has been of interest in mathematics for centuries.

Ant colony optimization algorithms

In computer science and operations research, the ant colony optimization algorithm (ACO) is a probabilistic technique for solving computational problems which can be reduced to finding good paths through graphs. Artificial ants stand for multi-agent methods inspired by the behavior of real ants. The pheromone-based communication of biological ants is often the predominant paradigm used. Combinations of artificial ants and local search algorithms have become a method of choice for numerous optimization tasks involving some sort of graph, e.

Combinatorial optimization

Combinatorial optimization is a subfield of mathematical optimization that consists of finding an optimal object from a finite set of objects, where the set of feasible solutions is discrete or can be reduced to a discrete set. Typical combinatorial optimization problems are the travelling salesman problem ("TSP"), the minimum spanning tree problem ("MST"), and the knapsack problem. In many such problems, such as the ones previously mentioned, exhaustive search is not tractable, and so specialized algorithms that quickly rule out large parts of the search space or approximation algorithms must be resorted to instead.

Related lectures (64)

Optimization Methods: Theory Discussion

Explores optimization methods, including unconstrained problems, linear programming, and heuristic approaches.

Optimisation Strategies: Energy Systems Modelling and Optimization

Explores solving strategies for energy system optimization problems and different types of optimization approaches.

Optimization with Constraints: KKT Conditions

Covers the KKT conditions for optimization with constraints, essential for solving constrained optimization problems efficiently.

Optimization Techniques: Convexity in Machine Learning

Covers optimization techniques in machine learning, focusing on convexity and its implications for efficient problem-solving.

Energy optimization strategies