Publications associées à Second-Order Guarantees In Federated Learning

Publications associées (41)

X-ray Micro-CT based characterization of rock cuttings with deep learning

Nils Frédérik Heiden Olsen, Alexandre Massoud Alahi, Pascal Turberg

Rock cuttings from destructive boreholes are a common and cheaper source of drilling materials that can be used to determine underground geology compared to rock core samples. Classifying manually the series of cuttings can be a long and tedious process an ...

2025

Comparison of Reservoir Computing topologies using the Recurrent Kernel approach

Jonathan Yuelin Dong

Reservoir Computing (RC) has become popular in recent years thanks to its fast and efficient computational capabilities. Standard RC has been shown to be equivalent in the asymptotic limit to Recurrent Kernels, which helps in analyzing its expressive power ...

2025

Enhancing wearable sensor data analysis for patient health monitoring using allied data disparity technique and multi instance ensemble perceptron learning

Zaffar Ahmed Shaikh

Wearable Sensor (WS)-based monitoring systems detect minute patient movements/ demands and abnormalities through periodic sensing and imaging. Sensor data observed over different intervals is not constant or available based on operating sequences. Due to v ...

Springer Science and Business Media LLC2025

Two New Calibration Techniques of Lumped-Parameter Mathematical Models for the Cardiovascular System

Alfio Quarteroni

Cardiocirculatory mathematical models are valuable tools for investigating both physiological and pathological conditions of the circulatory system. To assess an individual's clinical condition, these models must be tailored through parameter calibration. ...

Wiley2025

A coordinate transformation-based physics-informed neural networks for hyperbolic conservation laws

Jan Sickmann Hesthaven

Hyperbolic conservation laws play a critical role in various fields, including aerodynamics, physics, and oceanography. However, traditional physics-informed neural networks (PINNs), despite their remarkable capabilities in solving partial differential equ ...

2025

Robust semantic learning for precise medical image segmentation

Seyedbehzad Bozorgtabar

Precisely localizing anomalies in medical images remains a significant challenge due to their heterogeneous nature across modalities and organs. While initial efforts excelled in identifying prominent anomalies, detecting minute target lesions posed signif ...

2025

Minimizing Quasi-self-concordant Functions by Gradient Regularization of Newton Method

Nikita Doikov

We study the composite convex optimization problems with a quasi-self-concordant smooth component. This problem class naturally interpolates between classic self-concordant functions and functions with Lipschitz continuous Hessian. Previously, the best com ...

SPRINGER HEIDELBERG2025

Galerkin neural network-POD for acoustic and electromagnetic wave propagation in parametric domains

Jan Sickmann Hesthaven, Mariella Kast, Philipp Christoph Weder

We investigate reduced order models for acoustic and electromagnetic wave problems in parametrically defined domains. The parameter-to-solution maps are approximated following the so-called Galerkin POD-NN method, which combines the construction of a reduc ...

2025

Understanding generalization and robustness in modern deep learning

Maksym Andriushchenko

In this thesis, we study two closely related directions: robustness and generalization in modern deep learning. Deep learning models based on empirical risk minimization are known to be often non-robust to small, worst-case perturbations known as adversari ...

EPFL2024

Optimization Algorithms for Decentralized, Distributed and Collaborative Machine Learning

Anastasiia Koloskova

Distributed learning is the key for enabling training of modern large-scale machine learning models, through parallelising the learning process. Collaborative learning is essential for learning from privacy-sensitive data that is distributed across various ...

EPFL2024

On the Generalization of Stochastic Gradient Descent with Momentum

Volkan Cevher, Kimon Antonakopoulos

While momentum-based accelerated variants of stochastic gradient descent (SGD) are widely used when training machine learning models, there is little theoretical understanding on the generalization error of such methods. In this work, we first show that th ...

Microtome Publishing2024

Predicting the long-term collective behaviour of fish pairs with deep learning

Francesco Mondada, Alexandre Massoud Alahi, Vaios Papaspyros

Modern computing has enhanced our understanding of how social interactions shape collective behaviour in animal societies. Although analytical models dominate in studying collective behaviour, this study introduces a deep learning model to assess social in ...

2024

IM-Context: In-Context Learning for Imbalanced Regression Tasks

Olga Fink, Ismail Nejjar

Regression models often fail to generalize effectively in regions characterized by highly imbalanced label distributions. Previous methods for deep imbalanced regression rely on gradient-based weight updates, which tend to overfit in underrepresented regio ...

Neural information processing systems foundation2024

Scalable constrained optimization

Maria-Luiza Vladarean

Modern optimization is tasked with handling applications of increasingly large scale, chiefly due to the massive amounts of widely available data and the ever-growing reach of Machine Learning. Consequently, this area of research is under steady pressure t ...

EPFL2024

Robust machine learning for neuroscientific inference

Steffen Schneider

Modern neuroscience research is generating increasingly large datasets, from recording thousands of neurons over long timescales to behavioral recordings of animals spanning weeks, months, or even years. Despite a great variety in recording setups and expe ...

EPFL2024

Resource-Efficient Continual Learning for Personalized Online Seizure Detection

Amirhossein Shahbazinia, David Atienza Alonso, Giovanni Ansaloni, Flavio Ponzina, José Angel Miranda Calero, Jonathan Dan

Epilepsy, a major neurological disease, requires careful diagnosis and treatment. However, the detection of epileptic seizures remains a significant challenge. Current clinical practice relies on expert analysis of EEG signals, a process that is time-consu ...

IEEE2024

Performing and Detecting Backdoor Attacks on Face Recognition Algorithms

Alexander Carl Unnervik

The field of biometrics, and especially face recognition, has seen a wide-spread adoption the last few years, from access control on personal devices such as phones and laptops, to automated border controls such as in airports. The stakes are increasingly ...

EPFL2024

Les Houches lectures on deep learning at large and infinite width

Vittorio Erba, Christian Keup

These lectures, presented at the 2022 Les Houches Summer School on Statistical Physics and Machine Learning, focus on the infinite-width limit and large-width regime of deep neural networks. Topics covered include the various statistical and dynamical prop ...

2024

Glenohumeral joint force prediction with deep learning

Dominique Pioletti, Alexandre Terrier, Philippe Büchler, Patrick Goetti, Pezhman Eghbalishamsabadi

Deep learning models (DLM) are efficient replacements for computationally intensive optimization techniques. Musculoskeletal models (MSM) typically involve resource-intensive optimization processes for determining joint and muscle forces. Consequently, DLM ...

Elsevier Sci Ltd2024

A KL Divergence-Based Loss for In Vivo Ultrafast Ultrasound Image Enhancement with Deep Learning: Dataset (1/6)

Jean-Philippe Thiran, Roser Vinals Terres

This dataset contains a collection of ultrafast ultrasound acquisitions from nine volunteers and the CIRS 054G phantom. For a comprehensive understanding of the dataset, please refer to the paper: Viñals, R.; Thiran, J.-P. A KL Divergence-Based Loss for In ...

Zenodo2024