Publications related to A New Convergence Proof For The Higher-Order Power Method And Generalizations

Related publications (29)

Residual-based attention in physics-informed neural networks

Nikolaos Stergiopoulos, Sokratis Anagnostopoulos

Driven by the need for more efficient and seamless integration of physical models and data, physics -informed neural networks (PINNs) have seen a surge of interest in recent years. However, ensuring the reliability of their convergence and accuracy remains ...

Elsevier Science Sa2024

Generalization of Scaled Deep ResNets in the Mean-Field Regime

Volkan Cevher, Grigorios Chrysos, Fanghui Liu

Despite the widespread empirical success of ResNet, the generalization properties of deep ResNet are rarely explored beyond the lazy training regime. In this work, we investigate scaled ResNet in the limit of infinitely deep and wide neural networks, of wh ...

2024

Optimization Algorithms for Decentralized, Distributed and Collaborative Machine Learning

Anastasiia Koloskova

Distributed learning is the key for enabling training of modern large-scale machine learning models, through parallelising the learning process. Collaborative learning is essential for learning from privacy-sensitive data that is distributed across various ...

EPFL2024

LDP and CLT for SPDEs with transport noise

Lucio Galeati

In this work we consider solutions to stochastic partial differential equations with transport noise, which are known to converge, in a suitable scaling limit, to solution of the corresponding deterministic PDE with an additional viscosity term. Large devi ...

SPRINGER2023

One- and two-step semi-Lagrangian integrators for arbitrary Lagrangian-Eulerian-finite element two-phase flow simulations

John Richard Thome, Gustavo Rabello Dos Anjos

Semi-Lagrangian (SL) schemes are of utmost relevance to simulate two-phase flows where advection dominates. The combination of SL schemes with the finite element (FE) method and arbitrary Lagrangian-Eulerian (ALE) dynamic meshes yields a strong ingredient ...

WILEY2022

Mixed-precision explicit stabilized Runge-Kutta methods for single- and multi-scale differential equations

Giacomo Rosilho De Souza

Mixed-precision algorithms combine low-and high-precision computations in order to benefit from the performance gains of reduced-precision without sacrificing accuracy. In this work, we design mixed-precision Runge-Kutta-Chebyshev (RKC) methods, where high ...

ACADEMIC PRESS INC ELSEVIER SCIENCE2022

Spectral Coarse Spaces for the Substructured Parallel Schwarz Method

Tommaso Vanzan

The parallel Schwarz method (PSM) is an overlapping domain decomposition (DD) method to solve partial differential equations (PDEs). Similarly to classical nonoverlapping DD methods, the PSM admits a substructured formulation, that is, it can be formulated ...

2022

Last iterate convergence of SGD for Least-Squares in the Interpolation regime

Aditya Vardhan Varre, Nicolas Henri Bernard Flammarion, Loucas Pillaud-Vivien

Motivated by the recent successes of neural networks that have the ability to fit the data perfectly \emph{and} generalize well, we study the noiseless model in the fundamental least-squares setup. We assume that an optimum predictor fits perfectly inputs ...

Advances in Neural Information Processing Systems 20212021

Data-Driven Convergence Prediction of Astrobots Swarms

Denis Gillet, Jean-Paul Richard Kneib, Matin Macktoobian

Astrobots are robotic artifacts whose swarms are used in astrophysical studies to generate the map of the observable universe. These swarms have to be coordinated with respect to various desired observations. Such coordination\footnote{\z{A coordination sa ...

2022

On the Almost Sure Convergence of Stochastic Gradient Descent in Non-Convex Problems

Volkan Cevher, Ali Kavis, Shaul Nadav Hallak

This paper analyzes the trajectories of stochastic gradient descent (SGD) to help understand the algorithm’s convergence properties in non-convex problems. We first show that the sequence of iterates generated by SGD remains bounded and converges with prob ...

2020

Strong convergence of multivariate maxima

Simone Padoan, Stefano Rizzelli

It is well known and readily seen that the maximum of n independent and uniformly on [0, 1] distributed random variables, suitably standardised, converges in total variation distance, as n increases, to the standard negative exponential distribution. We ex ...

CAMBRIDGE UNIV PRESS2020

Convergent momentum-space OPE and bootstrap equations in conformal field theory

Marc Gillioz

General principles of quantum field theory imply that there exists an operator product expansion (OPE) for Wightman functions in Minkowski momentum space that converges for arbitrary kinematics. This convergence is guaranteed to hold in the sense of a dist ...

Springer Nature2020

Novel corrector problems with exponential decay of the resonance error for numerical homogenization

Edoardo Paganoni

Multiscale problems, such as modelling flows through porous media or predicting the mechanical properties of composite materials, are of great interest in many scientific areas. Analytical models describing these phenomena are rarely available, and one mus ...

EPFL2020

Random time step probabilistic methods for uncertainty quantification in chaotic and geometric numerical integration

Assyr Abdulle, Giacomo Garegnani

A novel probabilistic numerical method for quantifying the uncertainty induced by the time integration of ordinary differential equations (ODEs) is introduced. Departing from the classical strategy to randomize ODE solvers by adding a random forcing term, ...

2020

Complex Dynamics in Simple Neural Networks: Understanding Gradient Flow in Phase Retrieval

Lenka Zdeborová, Florent Gérard Krzakala

Despite the widespread use of gradient-based algorithms for optimizing high-dimensional non-convex functions, understanding their ability of finding good minima instead of being trapped in spurious ones remains to a large extent an open problem. Here we fo ...

Curran Associates, Inc.2020

Coordinate parameterisation and spectral method optimisation for Beltrami field solver in stellarator geometry

David Pfefferlé, Aravind Kumar Chandiran, Antoine Baillod

The numerical solution of the stepped pressure equilibrium (Hudson et al 2012 Phys. Plasmas 19 112502) requires a fast and robust solver to obtain the Beltrami field in three-dimensional geometry such as stellarators. The spectral method implemented in the ...

2020

Penalization and Bayesian numerical methods for multiscale inverse problems

Andrea Di Blasio

In this thesis we consider inverse problems involving multiscale elliptic partial differential equations. The name multiscale indicates that these models are characterized by the presence of parameters which vary on different spatial scales (macroscopic, m ...

EPFL2019

Numerical Homogenization And Model Order Reduction For Multiscale Inverse Problems

Assyr Abdulle, Andrea Di Blasio

A new numerical method based on numerical homogenization and model order reduction is introduced for the solution of multiscale inverse problems. We consider a class of elliptic problems with highly oscillatory tensors that varies on a microscopic scale. W ...

SIAM PUBLICATIONS2019

A local discontinuous Galerkin gradient discretization method for linear and quasilinear elliptic equations

Assyr Abdulle, Giacomo Rosilho De Souza

A local weighted discontinuous Galerkin gradient discretization method for solving elliptic equations is introduced. The local scheme is based on a coarse grid and successively improves the solution solving a sequence of local elliptic problems in high gra ...

EDP SCIENCES S A2019

Ising Model: Local Spin Correlations and Conformal Invariance

Clément Hongler, Sung Chul Park

We study the 2-dimensional Ising model at critical temperature on a simply connected subset of the square grid Z2. The scaling limit of the critical Ising model is conjectured to be described by Conformal Field Theory; in particular, there is expected to b ...

Springer2019