Publication

Robust Generalization via f−Mutual Information

Related publications (31)

Beyond the ultradeep frontier fields and legacy observations (BUFFALO): a high-resolution strong plus weak-lensing view of Abell 370

The HST treasury programme BUFFALO provides extended wide-field imaging of the six Hubble Frontier Fields galaxy clusters. Here we present the combined strong and weak-lensing analysis of Abell 370, a massive cluster at z = 0.375. From the reconstructed to ...

OXFORD UNIV PRESS2023

Euclid preparation: XXVIII. Forecasts for ten different higher-order weak lensing statistics

Frédéric Courbin, Fabio Finelli, Richard Massey, Maurizio Martinelli, Jean-Luc Starck, Gianluca Castignani, Marcello Farina, Austin Chandler Peel, Yi Wang

Recent cosmic shear studies have shown that higher-order statistics (HOS) developed by independent teams now outperform standard two-point estimators in terms of statistical precision thanks to their sensitivity to the non-Gaussian features of large-scale ...

EDP SCIENCES S A2023

Personalized Privacy-Preserving Distributed Learning on Heterogeneous Data

Michael Christoph Gastpar, Aditya Pradeep

One major challenge in distributed learning is to efficiently learn for each client when the data across clients is heterogeneous or non iid (not independent or identically distributed). This provides a significant challenge as the data of the other client ...

2023

Polynomial-time universality and limitations of deep learning

Emmanuel Abbé

The goal of this paper is to characterize function distributions that general neural networks trained by descent algorithms (GD/SGD), can or cannot learn in polytime. The results are: (1) The paradigm of general neural networks trained by SGD is poly-time ...

WILEY2023

Motor-Unit Ordering of Blindly-Separated Surface-EMG Signals for Gesture Recognition

Elisa Donati, Pasquale Davide Schiavone

Hand gestures are one of the most natural and expressive way for humans to convey information, and thus hand gesture recognition has become a research hotspot in the human-machine interface (HMI) field. In particular, biological signals such as surface ele ...

SPRINGER INTERNATIONAL PUBLISHING AG2023

Engineering random spin models with atoms in a high-finesse cavity

Jean-Philippe Brantut, Nick Jacob Sauerwein, Tigrane Arthur Cantat Moltrecht

Random spin models play a key role in our understanding of disorder and complex many-body systems. Two all-to-all interacting, disordered models have now been realized using a cavity quantum electrodynamics platform. ...

NATURE PORTFOLIO2023

Fundamental Limits in Statistical Learning Problems: Block Models and Neural Networks

Elisabetta Cornacchia

This thesis focuses on two selected learning problems: 1) statistical inference on graphs models, and, 2) gradient descent on neural networks, with the common objective of defining and analysing the measures that characterize the fundamental limits. In th ...

EPFL2023

A multigrid method for PDE-constrained optimization with uncertain inputs

Fabio Nobile, Tommaso Vanzan

In this manuscript, we present a collective multigrid algorithm to solve efficiently the large saddle-point systems of equations that typically arise in PDE-constrained optimization under uncertainty, and develop a novel convergence analysis of collective ...

Springer Science and Business Media LLC2024

Time vs. Truth: Age-Distortion Tradeoffs and Strategies for Distributed Inference

Yunus Inan

In 1948, Claude Shannon laid the foundations of information theory, which grew out of a study to find the ultimate limits of source compression, and of reliable communication. Since then, information theory has proved itself not only as a quest to find the ...

EPFL2023

A Theory of Finite-Width Neural Networks: Generalization, Scaling Laws, and the Loss Landscape

Berfin Simsek

Deep learning has achieved remarkable success in various challenging tasks such as generating images from natural language or engaging in lengthy conversations with humans. The success in practice stems from the ability to successfully train massive neural ...

EPFL2023

Impact of phylogeny on structural contact inference from protein sequence data

Nicola Dietler, Umberto Lupo, Anne-Florence Raphaëlle Bitbol

Local and global inference methods have been developed to infer structural contacts from multiple sequence alignments of homologous proteins. They rely on correlations in amino acid usage at contacting sites. Because homologous proteins share a common ance ...

ROYAL SOC2023