A Continuized View on Nesterov Acceleration

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

In algorithms for solving optimization problems constrained to a smooth manifold, retractions are a well-established tool to ensure that the iterates stay on the manifold. More recently, it has been demonstrated that retractions are a useful concept for ot ...

Predicting the evolution of systems with spatio-temporal dynamics in response to external stimuli is essential for scientific progress. Traditional equations-based approaches leverage first principles through the numerical approximation of differential equ ...

In this work, we analyze space-time reduced basis methods for the efficient numerical simulation of haemodynamics in arteries. The classical formulation of the reduced basis (RB) method features dimensionality reduction in space, while finite difference sc ...

Despite the widespread empirical success of ResNet, the generalization properties of deep ResNet are rarely explored beyond the lazy training regime. In this work, we investigate scaled ResNet in the limit of infinitely deep and wide neural networks, of wh ...

The thesis is dedicated to the study of two main partial differential equations (PDEs) in fluid dynamics: the Navier-Stokes equations, which describe the motion of incompressible fluids, and the transport equation with divergence-free velocity fields, whic ...

We establish shape holomorphy results for general weakly- and hyper-singular boundary integral operators arising from second-order partial differential equations in unbounded two-dimensional domains with multiple finite-length open arcs. After recasting th ...

Molecular quantum dynamics simulations are essential for understanding many fundamental phenomena in physics and chemistry. They often require solving the time-dependent Schrödinger equation for molecular nuclei, which is challenging even for medium-sized ...

This paper presents the new 2D electrostatic particle -in -cell code FENNECS developed to study the formation of magnetized non -neutral plasmas in geometries with azimuthal symmetry. This code has been developed in the domain of gyrotron electron gun desi ...

We propose a local, non -intrusive model order reduction technique to accurately approximate the solution of coupled multi -component parametrized systems governed by partial differential equations. Our approach is based on the approximation of the boundar ...

In this work, we investigate the effect of momentum on the optimisation trajectory of gradient descent. We leverage a continuous-time approach in the analysis of momentum gradient descent with step size

\gamma

and momentum parameter

\beta

that allows u ...

We present a combination technique based on mixed differences of both spatial approximations and quadrature formulae for the stochastic variables to solve efficiently a class of optimal control problems (OCPs) constrained by random partial differential equ ...

In computational hydraulics models, predicting bed topography and bedload transport with sufficient accuracy remains a significant challenge. An accurate assessment of a river's sediment transport rate necessitates a prior understanding of its bed topograp ...

We prove global in time well-posedness for perturbations of the 2D stochastic Navier-Stokes equations partial derivative( t)u + u center dot del u = Delta u - del p + sigma + xi, u(0, center dot ) = u(0),div (u) = 0, driven by additive space-time white noi ...

This work is concerned with the computation of the action of a matrix function f(A), such as the matrix exponential or the matrix square root, on a vector b. For a general matrix A, this can be done by computing the compression of A onto a suitable Krylov ...

Deep Neural Networks (DNNs) training can be difficult due to vanishing and exploding gradients during weight optimization through backpropagation. To address this problem, we propose a general class of Hamiltonian DNNs (H-DNNs) that stem from the discretiz ...

Using a variational method, we prove the existence of heteroclinic solutions for a 6-dimensional system of ordinary differential equations. We derive this system from the classical Benard-Rayleigh problem near the convective instability threshold. The cons ...

Electric vehicle charging facilities offer their capacity constrained electric charge and parking to users for a fee. As electric vehicle adoption grows, so too does the potential for excessive resource utilization. In this paper, we study how prices set b ...

Isogeometric analysis is a powerful paradigm which exploits the high smoothness of splines for the numerical solution of high order partial differential equations. However, the tensor-product structure of standard multivariate B-spline models is not well s ...

We introduce the elliptical Ornstein-Uhlenbeck (OU) process, which is a generalisation of the well-known univariate OU process to bivariate time series. This process maps out elliptical stochastic oscillations over time in the complex plane, which are obse ...

The goal of this thesis is the development and the analysis of numerical methods for problems where the unknown is a curve on a smooth manifold. In particular, the thesis is structured around the three following problems: homotopy continuation, curve inter ...

A Continuized View on Nesterov Acceleration

Chat with Graph Search

From low-rank retractions to dynamical low-rank approximation and back

Learning the intrinsic dynamics of spatio-temporal processes through Latent Dynamics Networks

SPACE-TIME REDUCED BASIS METHODS FOR PARAMETRIZED UNSTEADY STOKES EQUATIONS

Generalization of Scaled Deep ResNets in the Mean-Field Regime

Anomalous dissipation and other non-smooth phenomena in fluids

Shape Holomorphy of Boundary Integral Operators on Multiple Open Arcs

High-order geometric integrators for the variational Gaussian wavepacket dynamics and application to vibronic spectra at finite temperature

FENNECS: a novel particle-in-cell code for simulating the formation of magnetized non-neutral plasmas trapped by electrodes of complex geometries

Model reduction of coupled systems based on non-intrusive approximations of the boundary response maps

Leveraging Continuous Time to Understand Momentum When Training Diagonal Linear Networks

A Combination Technique for Optimal Control Problems Constrained by Random PDEs

Stochastic Simulations and Machine Learning Modeling to Predict Bedload Transport and Bed Topography

Global existence for perturbations of the 2D stochastic Navier-Stokes equations with space-time white noise

SPEEDING UP KRYLOV SUBSPACE METHODS FOR COMPUTING f(A)b VIA RANDOMIZATION

Hamiltonian Deep Neural Networks Guaranteeing Non-Vanishing Gradients by Design

Heteroclinic orbits for a system of amplitude equations for orthogonal domain walls

Resource aware pricing for electric vehicle charging

Adaptive isogeometric methods with C-1 (truncated) hierarchical splines on planar multi-patch domains

The elliptical Ornstein-Uhlenbeck process

Retraction-based numerical methods for continuation, interpolation and time integration on manifolds