Publications associées à Don't Use Large Mini-Batches, Use Local SGD

Publications associées (24)

NAT: Learning to Attack Neurons for Enhanced Adversarial Transferability

Alexandre Massoud Alahi, Krishna Kanth Nakka

The generation of transferable adversarial perturbations typically involves training a generator to maximize embedding separation between clean and adversarial images at a single mid-layer of a source model. In this work, we build on this approach and intr ...

IEEE2025

Intelligent and Self-Driving Microscopy of Protein Aggregation in Neurodegenerative Diseases

Khalid Ashraf Mohie Ibrahim

Neurodegenerative diseases, such as Alzheimer's, Parkinson's, and Huntington's, afflict tens of millions of patients worldwide. They are characterized by protein aggregation and progressive neuronal loss, leading to cognitive and motor impairments, and ult ...

EPFL2025

Graph Neural Networks With Adaptive Structures

Zepeng Zhang

Graph neural networks (GNNs) have made significant progress in various machine learning tasks. Despite their success, many existing GNN models are shown to be vulnerable to adversarial attacks, creating a stringent need to build robust GNN architectures. I ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2025

Adaptive Interface-Pinns (Adai-Pinns) for Transient Diffusion: Applications to Forward and Inverse Problems in Heterogeneous Media

Brice Tanguy Alphonse Lecampion

We model transient diffusion in heterogeneous materials using a novel physics-informed neural networks framework (PINNs) termed Adaptive interface physics-informed neural networks or AdaI-PINNs (Roy et al. arXiv preprint arXiv:2406.04626, 2024). AdaI-PINNs ...

Elsevier BV2025

Robust and Personalized Federated Learning: Handling Data Corruption and Heterogeneity

Ljubomir Rokvic

Federated Learning (FL) has emerged as a transformative paradigm in machine learning, enabling collaborative model training across decentralized devices while preserving data privacy. However, FL's success is highly contingent on the quality and integrity ...

EPFL2025

Learning transferable land cover semantics for open vocabulary interactions with remote sensing images

Devis Tuia, Javiera Francisca Castillo Navarro, Valérie Zermatten

Why should we confine land cover classes to rigid and arbitrary definitions? Land cover mapping is a central task in remote sensing image processing, but the rigorous class definitions can sometimes restrict the transferability of annotations between datas ...

2025

Revealing Brain and Spinal Cord Functional Networks by Block-Structured Graph Laplacian Mixture Models

Pascal Frossard, Dimitri Nestor Alice Van De Ville, Ilaria Ricchi, Ekansh Sareen, William Cappelletti

The Graph Laplacian Mixture Model (GLMM) allows to infer multiple underlying graph structures from multivariate time series data. Given its effectiveness in identifying brain states from brain activity measured by functional magnetic resonance imaging (fMR ...

IEEE2025

Precision non-invasive brain stimulation: an in silico pipeline for personalized control of brain dynamics

Friedhelm Christoph Hummel, Elena Beanato

Objective. Non-invasive brain stimulation (NIBS) offers therapeutic benefits for various brain disorders. Personalization may enhance these benefits by optimizing stimulation parameters for individual subjects. Approach. We present a computational pipeline ...

2025

Bridging Discrete Choice Modeling and Neural Networks: Unifying Statistical Rigor and Predictive Power

Brian Alan Tappy-Sifringer

This thesis explores the innovative integration of Discrete Choice Modeling (DCM) and Machine Learning (ML), specifically Neural Networks (NN), within the transportation sector. DCM, with its highly interpretable and hand-designed models grounded in robust ...

EPFL2024

Neural Distributed Controllers with Port-Hamiltonian Structures

Giancarlo Ferrari Trecate, Muhammad Zakwan

Controlling large-scale cyber-physical systems necessitates optimal distributed policies, relying solely on local real-time data and limited communication with neighboring agents. However, finding optimal controllers remains challenging, even in seemingly ...

Institute of Electrical and Electronics Engineers Inc.2024

Distributed Machine Learning Targeting Embedded Systems for Epilepsy Detection

Saleh Baghersalimi

Epileptic seizure detection and monitoring is critical in healthcare, particularly for individuals requiring continuous oversight. Current methods, primarily based on electroencephalogram (EEG) technologies, face limitations due to their complexity in term ...

EPFL2024

PyTorch 2 Model for the prediction of single-artery segmentations for "AngioPy segmentation: An open-source, user-guided deep learning tool for coronary artery segmentation"

Edward Carlo Giorgio Andò, Thabodhan Mahendiran

These are pytorch model weights for the angiopy-segmentation deep learning model, descriped in a paper published in 2024 in the International Journal of Cardiology: AngioPy segmentation: An open-source, user-guided deep learning tool for coronary artery se ...

Zenodo2024

NoiseNCA: Noisy Seed Improves Spatio-Temporal Continuity of Neural Cellular Automata

Sabine Süsstrunk, Ehsan Pajouheshgar, Yitao Xu

Neural Cellular Automata (NCA) is a class of Cellular Automata where the update rule is parameterized by a neural network that can be trained using gradient descent. In this paper, we focus on NCA models used for texture synthesis, where the update rule is ...

MIT Press2024

Quantum Variational Algorithms: Exploring Applications and Potentials Amid Trainability and Classical Simulability Limitations

Su Yeon Chang

Since its proposal, quantum computing has made significant strides in various domains. Among the different emerging techniques, Variational Quantum Algorithms (VQAs) have become one of the most promising approaches in the current era, where quantum computa ...

EPFL2024

Constrained Zero-Shot Neural Architecture Search on Small Classification Dataset

Liza Carol Andrea Dunbar

The rapid evolution of Deep Learning (DL) has brought about significant transformations across scientific domains, marked by the development of increasingly intricate models demanding powerful GPU platforms. However, edge applications like wearables and mo ...

IEEE2024

Machine learning potential for the Cu-W system

William Curtin

Combining the excellent thermal and electrical properties of Cu with the high abrasion resistance and thermal stability of W, Cu-W nanoparticle-reinforced metal matrix composites and nano-multilayers are finding applications as brazing fillers and shieldin ...

2024

Bootstrapping Autonomous Driving Radars with Self-Supervised Learning

Haitham Al Hassanieh, Junfeng Guan

The perception of autonomous vehicles using radars has attracted increased research interest due its ability to operate in fog and bad weather. However, training radar models is hindered by the cost and difficulty of annotating largescale radar data. To ov ...

IEEE2024

Annotation Cost-Efficient Active Learning for Deep Metric Learning-Driven Remote Sensing Image Retrieval

Gencer Sümbül

Deep metric learning (DML) has shown to be effective for content-based image retrieval (CBIR) in remote sensing (RS). Most of the DML methods for CBIR rely on a high number of annotated images to accurately learn model parameters of deep neural networks (D ...

2024

Integrating symmetry and physical constraints into atomic-scale machine learning

Jigyasa Nigam

Over the past decade, computational atomistic modeling, driven by machine learning (ML), has become indispensable to scientific endeavors, improving our understanding and accelerating the search for compounds with enhanced properties. Traditional atomistic ...

EPFL2024

Facilitated machine learning for image-based fruit quality assessment

Fernando Perez Cruz

Image-based machine learning models can be used to make the sorting and grading of agricultural products more efficient. In many regions, implementing such systems can be difficult due to the lack of centralization and automation of postharvest supply chai ...

2023