D-Cliques: Compensating for Data Heterogeneity with Topology in Decentralized Federated Learning

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

Reduced-order models (ROMs) are widely used in scientific computing to tackle high-dimensional systems. However, traditional ROM methods may only partially capture the intrinsic geometric characteristics of the data. These characteristics encompass the und ...

Approximate multipliers (AppMults) are widely employed in deep neural network (DNN) accelerators to reduce the area, delay, and power consumption. However, the inaccuracies of AppMults degrade DNN accuracy, necessitating a retraining process to recover acc ...

Recent years have been marked with the fast-pace diversification and increasing ubiquity of machine learning (ML) applications. Yet, a firm theoretical understanding of the surprising efficiency of neural networks (NNs) to learn from high-dimensional data ...

The Euclid mission is generating a vast amount of imaging data in four broadband filters at a high angular resolution. This data will allow for the detailed study of mass, metallicity, and stellar populations across galaxies that will constrain their forma ...

Motivated by policy gradient methods in the context of reinforcement learning, we derive the first large deviation rate function for the iterates generated by stochastic gradient descent for possibly non-convex objectives satisfying a Polyak-Łojasiewicz co ...

Machine-learning models based on a point-cloud representation of a physical object are ubiquitous in scientific applications and particularly well-suited to the atomic-scale description of molecules and materials. Among the many different approaches that h ...

This paper presents a comparison of machine learning (ML) methods used for three-dimensional localization of partial discharges (PD) in a power transformer tank. The study examines ML and deep learning (DL) methods, ranging from support vector machines (SV ...

Cross-view geo-localization aims at localizing a ground-level query image by matching it to its corresponding geo-referenced aerial view. In real-world scenarios, the task requires accommodating diverse ground images captured by users with varying orientat ...

In the rapidly evolving landscape of machine learning research, neural networks stand out with their ever-expanding number of parameters and reliance on increasingly large datasets. The financial cost and computational resources required for the training p ...

In the past few years, Machine Learning (ML) techniques have ushered in a paradigm shift, allowing the harnessing of ever more abundant sources of data to automate complex tasks. The technical workhorse behind these important breakthroughs arguably lies in ...

Driven by the need for more efficient and seamless integration of physical models and data, physics -informed neural networks (PINNs) have seen a surge of interest in recent years. However, ensuring the reliability of their convergence and accuracy remains ...

Lipschitz-constrained neural networks have several advantages over unconstrained ones and can be applied to a variety of problems, making them a topic of attention in the deep learning community. Unfortunately, it has been shown both theoretically and empi ...

Digital twins are virtual models of physical objects or systems that enable real-time monitoring and analysis. In the ﬁeld of stone masonry buildings, digital twins can be used to assess damage, predict maintenance needs, and opti- mize building performanc ...

The design and control of winged aircraft and drones is an iterative process aimed at identifying a compromise of mission-specific costs and constraints. When agility is required, shape-shifting (morphing) drones represent an efficient solution. However, m ...

As large, data-driven artificial intelligence models become ubiquitous, guaranteeing high data quality is imperative for constructing models. Crowdsourcing, community sensing, and data filtering have long been the standard approaches to guaranteeing or imp ...

Distributed learning is the key for enabling training of modern large-scale machine learning models, through parallelising the learning process. Collaborative learning is essential for learning from privacy-sensitive data that is distributed across various ...

In this thesis, we study two closely related directions: robustness and generalization in modern deep learning. Deep learning models based on empirical risk minimization are known to be often non-robust to small, worst-case perturbations known as adversari ...

Decentralized learning (DL) has gained prominence for its potential benefits in terms of scalability, privacy, and fault tolerance. It consists of many nodes that coordinate without a central server and exchange millions of parameters in the inherently ite ...

The upcoming Square Kilometre Array Observatory will produce images of neutral hydrogen distribution during the epoch of reionization by observing the corresponding 21-cm signal. However, the 21-cm signal will be subject to instrumental limitations such as ...

In data-parallel optimization of machine learning models, workers collaborate to improve their estimates of the model: more accurate gradients allow them to use larger learning rates and optimize faster. In the decentralized setting, in which workers commu ...

D-Cliques: Compensating for Data Heterogeneity with Topology in Decentralized Federated Learning

Chat with Graph Search

OPTIMAL TRANSPORT-INSPIRED DEEP LEARNING FRAMEWORK FOR SLOW-DECAYING KOLMOGOROV \bfitn-WIDTH PROBLEMS: EXPLOITING SINKHORN LOSS AND WASSERSTEIN KERNEL

Gradient Approximation of Approximate Multipliers for High-Accuracy Deep Neural Network Retraining

High-dimensional learning of narrow neural networks

Euclid preparation: LXVIII. Extracting physical parameters from galaxies with machine learning

A Large Deviations Perspective on Policy Gradient Algorithms

Wigner kernels: Body-ordered equivariant machine learning without a basis

Partial discharge localization in power transformer tanks using machine learning methods

ConGeo: Robust Cross-View Geo-Localization Across Ground View Variations

Random matrix methods for high-dimensional machine learning models

Topics in statistical physics of high-dimensional machine learning

Residual-based attention in physics-informed neural networks

Improving Lipschitz-Constrained Neural Networks by Learning Activation Functions

Digital Twins of Stone Masonry Buildings for Damage Assessment

Co-Design Optimisation of Morphing Topology and Control of Winged Drones

Extensions of Peer Prediction Incentive Mechanisms

Optimization Algorithms for Decentralized, Distributed and Collaborative Machine Learning

Understanding generalization and robustness in modern deep learning

Decentralized learning made easy with DecentralizePy

Deep learning approach for identification of H II regions during reionization in 21-cm observations - II. Foreground contamination

Beyond Spectral Gap: The Role of the Topology in Decentralized Learning