Publications associées à On Vacuous and Non-Vacuous Generalization Bounds for Deep Neural Networks

Publications associées (60)

Integer Linear Programming for Unsupervised Training Set Selection in Molecular Machine Learning

Anne-Clémence Corminboeuf, Friedrich Eisenbrand, Rubén Laplaza Solanas, Puck Elisabeth van Gerwen, Ksenia Briling, Jan Weinreich, Matthieu Nicolas Haeberle

Integer linear programming (ILP) is an elegant approach to solve linear optimization problems, naturally described using integer decision variables. Within the context of physics-inspired machine learning (ML) applied to chemistry, we demonstrate the relev ...

IOP Publishing Ltd2025

Generalization of Scaled Deep ResNets in the Mean-Field Regime

Volkan Cevher, Grigorios Chrysos, Fanghui Liu

Despite the widespread empirical success of ResNet, the generalization properties of deep ResNet are rarely explored beyond the lazy training regime. In this work, we investigate scaled ResNet in the limit of infinitely deep and wide neural networks, of wh ...

2024

Machine learning-enabled estimation of cardiac output from peripheral waveforms is independent of blood pressure measurement location in an in silico population

Ramin Mohammadi, Nikolaos Stergiopoulos, Georgios Rovas, Lydia Aslanidou, Sokratis Anagnostopoulos

Monitoring of cardiac output (CO) is a mainstay of hemodynamic management in the acutely or critically ill patient. Invasive determination of CO using thermodilution, albeit regarded as the gold standard, is cumbersome and bears risks inherent to catheteri ...

2025

Random matrix methods for high-dimensional machine learning models

Antoine Philippe Michel Bodin

In the rapidly evolving landscape of machine learning research, neural networks stand out with their ever-expanding number of parameters and reliance on increasingly large datasets. The financial cost and computational resources required for the training p ...

EPFL2024

On the added value of sequential deep learning for the upscaling of evapotranspiration

Devis Tuia

Estimating ecosystem-atmosphere fluxes such as evapotranspiration (ET) in a robust manner and at a global scale remains a challenge. Methods based on machine learning (ML) have shown promising results in achieving such upscaling, providing a complementary ...

2025

Statistical Inference for Inverse Problems: From Sparsity-Based Methods to Neural Networks

Pakshal Narendra Bohra

In inverse problems, the task is to reconstruct an unknown signal from its possibly noise-corrupted measurements. Penalized-likelihood-based estimation and Bayesian estimation are two powerful statistical paradigms for the resolution of such problems. They ...

EPFL2024

Edge-Cloud Collaborated Object Detection via Bandwidth Adaptive Difficult-Case Discriminator

Yung-Cheng Chiang

Object detection, a fundamental task in computer vision, is crucial for various intelligent edge computing applications. However, object detection algorithms are usually heavy in computation, hindering their deployments on resource-constrained edge devices ...

2025

Robust machine learning for neuroscientific inference

Steffen Schneider

Modern neuroscience research is generating increasingly large datasets, from recording thousands of neurons over long timescales to behavioral recordings of animals spanning weeks, months, or even years. Despite a great variety in recording setups and expe ...

EPFL2024

Combining physics-based and data-driven models: advancing the frontiers of research with scientific machine learning

Alfio Quarteroni

Scientific Machine Learning (SciML) is a recently emerged research field which combines physics-based and data-driven models for the numerical approximation of differential problems. Physics-based models rely on the physical understanding of the problem at ...

2025

Infusing structured knowledge priors in neural models for sample-efficient symbolic reasoning

Mattia Atzeni

The ability to reason, plan and solve highly abstract problems is a hallmark of human intelligence. Recent advancements in artificial intelligence, propelled by deep neural networks, have revolutionized disciplines like computer vision and natural language ...

EPFL2024

Task-driven neural network models predict neural dynamics of proprioception: Experimental data, activations and predictions of neural network models

Alexander Mathis, Alberto Silvio Chiappa, Alessandro Marin Vargas, Axel Bisi

Here we provide the neural data, activation and predictions for the best models and result dataframes of our article "Task-driven neural network models predict neural dynamics of proprioception". It contains the behavioral and neural experimental data (cu ...

EPFL Infoscience2024

Machine Learning Applications to Conditional Asset Pricing: Attention, CNNs, and Neural Tangent Kernels

Boris Kuznetsov

The first two chapters develop ML-based models that generate conditional SDF estimates efficiently using conditioning information sets, resulting in minimal pricing errors and superior Sharpe ratios compared to traditional conditional asset pricing models. ...

EPFL2025

TimEHR: Image-based Time Series Generation for Electronic Health Records

David Atienza Alonso, Anisoara Ionescu, Hojjat Karami

Time series in Electronic Health Records (EHRs) present unique challenges for generative models, such as irregular sampling, missing values, and high dimensionality. In this paper, we propose a novel generative adversarial network (GAN) model, TimEHR, to g ...

Institute of Electrical and Electronics Engineers (IEEE)2025

Deep learning approach for identification of H II regions during reionization in 21-cm observations - II. Foreground contamination

Jean-Paul Richard Kneib, Emma Elizabeth Tolley, Michele Bianco, Tianyue Chen

The upcoming Square Kilometre Array Observatory will produce images of neutral hydrogen distribution during the epoch of reionization by observing the corresponding 21-cm signal. However, the 21-cm signal will be subject to instrumental limitations such as ...

Oxford Univ Press2024

t-PiNet: A thermodynamics-informed hierarchical learning for discovering constitutive relations of geomaterials

Konstantinos Karapiperis

More attention has been paid to integrating existing knowledge with data to understand the complex mechanical behaviour of geomaterials, but it incurs scepticism and criticism on its generalizability and robustness. Moreover, a common mistake in current da ...

2025

Reduced Training Data for Laser Ultrasound Signal Interpretation by Neural Networks

Romain Christophe Rémy Fleury, Janez Rus

The performance of machine learning algorithms is conditioned by the availability of training datasets, which is especially true for the field of nondestructive evaluation. Here we propose one reconfigurable specimen instead of numerous reference specimens ...

2024

Retrieval of Surface Solar Radiation through Implicit Albedo Recovery from Temporal Context

Michael Lehning, Devis Tuia, Yael Frischholz

To retrieve Surface Solar Radiation (SSR) from satellite images, a baseline reflectance of the observed ground in clear-sky conditions, also called background reflectance, is necessary to distinguish atmospheric absorption and scattering effects from surfa ...

2025

Machine Learning for Modeling Stock Returns

Teng Andrea Xu

Throughout history, the pace of knowledge and information sharing has evolved into an unthinkable speed and media. At the end of the XVII century, in Europe, the ideas that would shape the "Age of Enlightenment" were slowly being developed in coffeehouses, ...

EPFL2024

Diffusion Stochastic Optimization for Min-Max Problems

Ali H. Sayed, Haoyuan Cai

The optimistic gradient method is useful in addressing minimax optimization problems. Motivated by the observation that the conventional stochastic version suffers from the need for a large batch size on the order of O(ϵ-2) to achieve an ϵ-stationary solut ...

2025

Safe Deep Neural Networks

Kyle Michael Matoba

The capabilities of deep learning systems have advanced much faster than our ability to understand them. Whilst the gains from deep neural networks (DNNs) are significant, they are accompanied by a growing risk and gravity of a bad outcome. This is troubli ...

EPFL2024