Publications associées à Optimal Convergence for Distributed Learning with Stochastic Gradient Methods and Spectral Algorithms

Publications associées (55)

Preliminary Sensitivity Analysis of Time-Dependent Code Outputs in Fuel Performance Models Using OFFBEAT for Future Calibration

Mathieu Hursin, Alessandro Scolaro, Edoardo Luciano Brunetto, Sara Maccario

Fuel performance codes are essential for predicting fuel rod behavior in nuclear reactors. These codes comprise a complex system of models with empirical constants that require calibration against experimental data. To support this calibration, this study ...

American Nuclear Society2025

Quantifying the Unknown: Data-Driven Approaches and Applications in Energy Systems

Paul Scharnhorst

In light of the challenges posed by climate change and the goals of the Paris Agreement, electricity generation is shifting to a more renewable and decentralized pattern, while the operation of systems like buildings is increasingly electrified. This calls ...

EPFL2024

Diffusion Stochastic Optimization for Min-Max Problems

Ali H. Sayed, Haoyuan Cai

The optimistic gradient method is useful in addressing minimax optimization problems. Motivated by the observation that the conventional stochastic version suffers from the need for a large batch size on the order of O(ϵ-2) to achieve an ϵ-stationary solut ...

2025

Random matrix methods for high-dimensional machine learning models

Antoine Philippe Michel Bodin

In the rapidly evolving landscape of machine learning research, neural networks stand out with their ever-expanding number of parameters and reliance on increasingly large datasets. The financial cost and computational resources required for the training p ...

EPFL2024

First and Zeroth-Order Implementations of the Regularized Newton Method with Lazy Approximated Hessians

Nikita Doikov

In this work, we develop first-order (Hessian-free) and zeroth-order (derivative-free) implementations of the Cubically Regularized Newton Method for solving general non-convex optimization problems. For that, we employ finite difference approximations of ...

SPRINGER/PLENUM PUBLISHERS2025

Understanding generalization and robustness in modern deep learning

Maksym Andriushchenko

In this thesis, we study two closely related directions: robustness and generalization in modern deep learning. Deep learning models based on empirical risk minimization are known to be often non-robust to small, worst-case perturbations known as adversari ...

EPFL2024

A Stochastic Approach to Contact-rich Manipulation

Julius Maximilian Jankowski

For robots to operate in unstructured environments, they are required to interact with objects through contact. Those contacts may be used to push objects to the side, deform objects, or manipulate objects in-hand. This thesis addresses the problem of cont ...

EPFL2025

Graph generative deep learning models with an application to circuit topologies

Igor Krawczuk

Modern integrated circuits are tiny yet incredibly complex technological artifacts, composed of millions and billions of individual structures working in unison. Managing their complexity and facilitating their design drove part of the co-evolution of mode ...

EPFL2024

GLoFool: Global Enhancements and Local Perturbations to Craft Adversarial Images

Andrea Cavallaro

Adversarial examples crafted in black-box scenarios are affected by unrealistic colors or spatial artifacts. To prevent these shortcomings, we propose a novel strategy that generates adversarial images with low detectability and high transferability. The p ...

Springer Science and Business Media Deutschland GmbH2025

Robust machine learning for neuroscientific inference

Steffen Schneider

Modern neuroscience research is generating increasingly large datasets, from recording thousands of neurons over long timescales to behavioral recordings of animals spanning weeks, months, or even years. Despite a great variety in recording setups and expe ...

EPFL2024

Integer Linear Programming for Unsupervised Training Set Selection in Molecular Machine Learning

Anne-Clémence Corminboeuf, Friedrich Eisenbrand, Rubén Laplaza Solanas, Puck Elisabeth van Gerwen, Ksenia Briling, Jan Weinreich, Matthieu Nicolas Haeberle

Integer linear programming (ILP) is an elegant approach to solve linear optimization problems, naturally described using integer decision variables. Within the context of physics-inspired machine learning (ML) applied to chemistry, we demonstrate the relev ...

IOP Publishing Ltd2025

On the Generalization of Stochastic Gradient Descent with Momentum

Volkan Cevher, Kimon Antonakopoulos

While momentum-based accelerated variants of stochastic gradient descent (SGD) are widely used when training machine learning models, there is little theoretical understanding on the generalization error of such methods. In this work, we first show that th ...

Microtome Publishing2024

Enabling Deep Learning Models for Seizure Monitoring within Wearables Lifecycle

Alireza Amirshahi

Continuous monitoring of various physiological conditions enables early detection of potential health issues. The monitoring offers real-time insights into patient well-being and rapid medical interventions. As a case study, in epilepsy, a prevalent neurol ...

EPFL2025

Deep learning approach for identification of H II regions during reionization in 21-cm observations - II. Foreground contamination

Jean-Paul Richard Kneib, Emma Elizabeth Tolley, Michele Bianco, Tianyue Chen

The upcoming Square Kilometre Array Observatory will produce images of neutral hydrogen distribution during the epoch of reionization by observing the corresponding 21-cm signal. However, the 21-cm signal will be subject to instrumental limitations such as ...

Oxford Univ Press2024

Edge-Cloud Collaborated Object Detection via Bandwidth Adaptive Difficult-Case Discriminator

Yung-Cheng Chiang

Object detection, a fundamental task in computer vision, is crucial for various intelligent edge computing applications. However, object detection algorithms are usually heavy in computation, hindering their deployments on resource-constrained edge devices ...

2025

Convex Computation of Value-at-risk Bounds for Stochastic Processes

Matteo Raphael Tacchi

This article formulates algorithms to upper-bound the maximum value-at-risk (VaR) of a state function along trajectories of stochastic processes. The VaR is upper bounded by two methods: minimax tail-bounds (Cantelli/Vysochanskij-Petunin) and Expected Shor ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2025

Topics in statistical physics of high-dimensional machine learning

Hugo Chao Cui

In the past few years, Machine Learning (ML) techniques have ushered in a paradigm shift, allowing the harnessing of ever more abundant sources of data to automate complex tasks. The technical workhorse behind these important breakthroughs arguably lies in ...

EPFL2024

Constructing multicomponent cluster expansions with machine-learning and chemical embedding

Yann Lorris Müller, Anirudh Raju Natarajan

Cluster expansions are commonly employed as surrogate models to link the electronic structure of an alloy to its finite-temperature properties. Using cluster expansions to model materials with several alloying elements is challenging due to a rapid increas ...

NATURE PORTFOLIO2025

Machine learning models for prediction of electrochemical properties in supercapacitor electrodes using MXene and graphene nanoplatelets

Mohammad Khaja Nazeeruddin

Herein, machine learning (ML) models using multiple linear regression (MLR), support vector regression (SVR), random forest (RF) and artificial neural network (ANN) are developed and compared to predict the output features viz. specific capacitance (Csp), ...

Elsevier Science Sa2024

Machine learning-enabled estimation of cardiac output from peripheral waveforms is independent of blood pressure measurement location in an in silico population

Ramin Mohammadi, Nikolaos Stergiopoulos, Georgios Rovas, Lydia Aslanidou, Sokratis Anagnostopoulos

Monitoring of cardiac output (CO) is a mainstay of hemodynamic management in the acutely or critically ill patient. Invasive determination of CO using thermodilution, albeit regarded as the gold standard, is cumbersome and bears risks inherent to catheteri ...

2025