Sparsified SGD with Memory

À propos
Confidentialité
Mentions légales

Graph Chatbot

Publications associées (31)

Phonon Self-Energy Corrections: To Screen, or Not to Screen

Nicola Marzari, Samuel Poncé

First-principles calculations of phonons are often based on the adiabatic approximation and on Brillouinzone samplings that might not always be sufficient to capture the subtleties of Kohn anomalies. These shortcomings can be addressed through corrections ...

American Physical Society2023

Bayesian Optimization for Chemical Reactions

Philippe Schwaller, Bojana Rankovic, Jeff Guo

Reaction optimization is challenging and traditionally delegated to domain experts who iteratively pro-pose increasingly optimal experiments. Problematically, the reaction landscape is complex and often requires hundreds of experiments to reach convergence ...

Swiss Chemical Soc2023

Hypergraph-Based Fast Distributed AC Power Flow Optimization

Colin Neil Jones, Yingzhao Lian, Yuning Jiang, Xinliang Dai

This paper presents a novel distributed approach for solving AC power flow (PF) problems. The optimization problem is reformulated into a distributed form using a communication structure corresponding to a hypergraph, by which complex relationships between ...

IEEE2023

Robust optimization of control parameters for WEC arrays using stochastic methods

Edie Miglio, Tommaso Vanzan

This work presents a new computational optimization framework for the robust control of parks of Wave Energy Converters (WEC) in irregular waves. The power of WEC parks is maximized with respect to the individual control damping and stiffness coefficients ...

Journal of Computational Physics2023

Hamiltonian Deep Neural Networks Guaranteeing Non-Vanishing Gradients by Design

Giancarlo Ferrari Trecate, Clara Lucía Galimberti, Liang Xu, Luca Furieri

Deep Neural Networks (DNNs) training can be difficult due to vanishing and exploding gradients during weight optimization through backpropagation. To address this problem, we propose a general class of Hamiltonian DNNs (H-DNNs) that stem from the discretiz ...

2023

Modeling and Design Optimization of Loosely Coupled PCB Spiral Coils in Inductive Power Transfer Systems

Drazen Dujic, Xiaotong Du

There are various possibilities to realize coil winding designs for an inductive power transfer system. In order to achieve high power transfer efficiency and power density and explore trade-offs between the two, design optimization around the coil link is ...

2023

Deep Learning Generalization with Limited and Noisy Labels

Mahsa Forouzesh

Deep neural networks have become ubiquitous in today's technological landscape, finding their way in a vast array of applications. Deep supervised learning, which relies on large labeled datasets, has been particularly successful in areas such as image cla ...

EPFL2023

Impact of Redundancy on Resilience in Distributed Optimization and Learning

Shuo Liu, Nirupam Gupta

This paper considers the problem of resilient distributed optimization and stochastic learning in a server-based architecture. The system comprises a server and multiple agents, where each agent has its own local cost function. The agents collaborate with ...

Assoc Computing Machinery2023

Robust Design of Herringbone Grooved Journal Bearings using Multi-Objective Optimization with Artificial Neural Networks

Jürg Alexander Schiffmann, Soheyl Massoudi

Herringbone grooved journal bearings (HGJBs) are widely used in micro-turbocompressor applications due to their high load-carrying capacity, low friction, and oil-free solution. However, the performance of these bearings is sensitive to manufacturing devia ...

Amer Soc Mechanical Engineers2023

Robust Design of Herringbone Grooved Journal Bearings using Multi-Objective Optimization with Artificial Neural Networks

Jürg Alexander Schiffmann, Soheyl Massoudi

2023

Robust Collaborative Learning with Linear Gradient Overhead

Rachid Guerraoui, Le Nguyen Hoang, John Stephan, Sadegh Farhadkhani, Nirupam Gupta, Rafaël Benjamin Pinot

Collaborative learning algorithms, such as distributed SGD (or D-SGD), are prone to faulty machines that may deviate from their prescribed algorithm because of software or hardware bugs, poisoned data or malicious behaviors. While many solutions have been ...

PLMR2023

Page 2 sur 2