Lecture

Non-Stochastic Control Problem: Online Gradient Boosting

Graph Chat

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

Description

This lecture covers the non-stochastic control problem, focusing on online gradient boosting for dynamical systems. It discusses the challenges in control, the main results of efficient algorithms, and the ingredients for successful control. The instructor presents the concept of policy regret minimization, the use of weak predictors in boosting, and the removal of state via stability. The lecture also includes experiments demonstrating the effectiveness of the proposed methods in various scenarios, such as dealing with correlated noise and controlling an inverted pendulum.

Official source

Related concepts (32)

Dynamical system

In mathematics, a dynamical system is a system in which a function describes the time dependence of a point in an ambient space, such as in a parametric curve. Examples include the mathematical models that describe the swinging of a clock pendulum, the flow of water in a pipe, the random motion of particles in the air, and the number of fish each springtime in a lake. The most general definition unifies several concepts in mathematics such as ordinary differential equations and ergodic theory by allowing different choices of the space and how time is measured.

Dynamical systems theory

Dynamical systems theory is an area of mathematics used to describe the behavior of complex dynamical systems, usually by employing differential equations or difference equations. When differential equations are employed, the theory is called continuous dynamical systems. From a physical point of view, continuous dynamical systems is a generalization of classical mechanics, a generalization where the equations of motion are postulated directly and are not constrained to be Euler–Lagrange equations of a least action principle.

Stability theory

In mathematics, stability theory addresses the stability of solutions of differential equations and of trajectories of dynamical systems under small perturbations of initial conditions. The heat equation, for example, is a stable partial differential equation because small perturbations of initial data lead to small variations in temperature at a later time as a result of the maximum principle. In partial differential equations one may measure the distances between functions using Lp norms or the sup norm, while in differential geometry one may measure the distance between spaces using the Gromov–Hausdorff distance.

Noise (electronics)

In electronics, noise is an unwanted disturbance in an electrical signal. Noise generated by electronic devices varies greatly as it is produced by several different effects. In particular, noise is inherent in physics and central to thermodynamics. Any conductor with electrical resistance will generate thermal noise inherently. The final elimination of thermal noise in electronics can only be achieved cryogenically, and even then quantum noise would remain inherent. Electronic noise is a common component of noise in signal processing.

Sorting algorithm

In computer science, a sorting algorithm is an algorithm that puts elements of a list into an order. The most frequently used orders are numerical order and lexicographical order, and either ascending or descending. Efficient sorting is important for optimizing the efficiency of other algorithms (such as search and merge algorithms) that require input data to be in sorted lists. Sorting is also often useful for canonicalizing data and for producing human-readable output.

Related lectures (64)

Dynamical Systems: Equilibrium Points and Stability

Covers dynamical systems, equilibrium points, stability analysis, and phase plots using examples like the pendulum system.

Introduction to Dynamical System

Introduces dynamical systems, equilibrium points, stability, vector fields, phase plots, and Lyapunov stability.

Learning and Adaptive Control for Robots: Extensions to DS

Explores coupled and uncoupled dynamical systems, stability, hand-arm coupling, and adaptation in robotics.

Dynamical Systems: Maps and Stability

Explores one-dimensional maps, periodic solutions, and bifurcations in dynamical systems.

Learning Modulation for DS