Publication

Optimal Rates for Spectral Algorithms with Least-Squares Regression over Hilbert Spaces

Publications associées (31)

(S)GD over Diagonal Linear Networks: Implicit Regularisation, Large Stepsizes and Edge of Stability

Scott William Pesme, Nicolas Henri Bernard Flammarion, Mathieu Even

In this paper, we investigate the impact of stochasticity and large stepsizes on the implicit regularisation of gradient descent (GD) and stochastic gradient descent (SGD) over diagonal linear networks. We prove the convergence of GD and SGD with macroscop ...

2023

Near-Minimax Optimal Estimation With Shallow ReLU Neural Networks

Rahul Parhi

We study the problem of estimating an unknown function from noisy data using shallow ReLU neural networks. The estimators we study minimize the sum of squared data-fitting errors plus a regularization term proportional to the squared Euclidean norm of the ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2023

Gaia Focused Product Release: Asteroid orbital solution: Properties and assessment

Stephan Morgenthaler, Shuangqing Liao

Context. We report the exploitation of a sample of Solar System observations based on data from the third Gaia Data Release (Gaia DR3) of nearly 157 000 asteroids. It extends the epoch astrometric solution over the time coverage planned for the Gaia DR4, w ...

Edp Sciences S A2023

Linear Recursive State Estimation of Hybrid and Unbalanced AC/DC Micro-Grids using Synchronized Measurements

Mario Paolone, Willem Lambrichts

In this paper, we present an exact (i. e. non-approximated) and linear measurement model for hybrid AC/DC microgrids for recursive state estimation (SE). More specifically, an exact linear model of a voltage source converter (VSC) is proposed. It relies on ...

New York2023

Adequacy of stationary measurements as proxies for residential personal exposure to gaseous and particle air pollutants

Dusan Licina, Maria Viviana Gonzalez Serrano

People are exposed to myriad of airborne pollutants in their homes. Owing to diverse potential sources of air pollution and human activity patterns, accurate assessment of residential exposures is complex. In this study, we explored the relationship betwee ...

ACADEMIC PRESS INC ELSEVIER SCIENCE2023

Saddle-to-Saddle Dynamics in Diagonal Linear Networks

Scott William Pesme, Nicolas Henri Bernard Flammarion

In this paper we fully describe the trajectory of gradient flow over diagonal linear networks in the limit of vanishing initialisation. We show that the limiting flow successively jumps from a saddle of the training loss to another until reaching the minim ...

2023

Quantum circuits for solving local fermion-to-qubit map- pings

Giuseppe Carleo, Jannes Willy E. Nys

Local Hamiltonians of fermionic systems on a lattice can be mapped onto local qubit Hamiltonians. Maintaining the lo-cality of the operators comes at the ex-pense of increasing the Hilbert space with auxiliary degrees of freedom. In order to retrieve the l ...

VEREIN FORDERUNG OPEN ACCESS PUBLIZIERENS QUANTENWISSENSCHAF2023

Stable parameterization of continuous and piecewise-linear functions

Michaël Unser, Joaquim Gonçalves Garcia Barreto Campos, Alexis Marie Frederic Goujon

Rectified-linear-unit (ReLU) neural networks, which play a prominent role in deep learning, generate continuous and piecewise-linear (CPWL) functions. While they provide a powerful parametric representation, the mapping between the parameter and function s ...

2023

Diverse parameters of ambulatory knee moments differ with medial knee osteoarthritis severity and are combinable into a severity index

Julien Favre, Brigitte Jolles-Haeberli

Objective: To characterize ambulatory knee moments with respect to medial knee osteoarthritis (OA) severity comprehensively and to assess the possibility of developing a severity index combining knee moment parameters. ...

FRONTIERS MEDIA SA2023

Regularization Techniques for Low-Resource Machine Translation

Alejandro Ramírez Atrio

Neural machine translation (MT) and text generation have recently reached very high levels of quality. However, both areas share a problem: in order to reach these levels, they require massive amounts of data. When this is not present, they lack generaliza ...

EPFL2023

Reliable uncertainties: Error correlation, rotated error bars, and linear regressions in three-isotope plots and beyond

Reto Georg Trappitsch

Correlated errors of experimental data are a common but often neglected problem in physical sciences. Various tools are provided here for thorough propagation of uncertainties in cases of correlated errors. Discussed are techniques especially applicable to ...

ELSEVIER2023