PowerSGD: Practical Low-Rank Gradient Compression for Distributed Optimization

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

The load tracking performance of combined cooling, heating, and power multi-energy system (CCHP-MES) greatly depends on the equipment capacity configuration. And the frequent fluctuations in the source-load uncertainty puts higher demands on the load track ...

Positron emission tomography is a nuclear imaging technique well known for its use in oncology for cancer diagnosis and staging. A PET scanner is a complex machine which comprises photodetectors placed in a ring configuration that detect gamma photons gen ...

Agent-based simulations have been widely applied in many disciplines, by scientists and engineers alike. Scientists use agent-based simulations to tackle global problems, including alleviating poverty, reducing violence, and predicting the impact of pandem ...

The work presented in this thesis lies at the intersection of Machine Learning (ML) and control theory. The first part is dedicated to the design of Deep Neural Network (DNN) architectures with specific numerical properties, inspired by dynamical systems m ...

The minimization of a data-fidelity term and an additive regularization functional gives rise to a powerful framework for supervised learning. In this paper, we present a unifying regularization functional that depends on an operator L\documentclass[12pt]{ ...

Deep digital twins (DDTs) are deep neural networks that encode the behavior of complex physical systems. DDTs are excellent system representations due to their ability to continuously adapt to operational changes and their capability to capture complex rel ...

Today's continued increase in demand for processing power, despite the slowdown of Moore's law, has led to an increase in processor count, which has resulted in energy consumption and distribution problems. To address this, there is a growing trend toward ...

Reinforcement learning (RL) is inherently rife with non-stationarity since the states and rewards the agent observes during training depend on its changing policy. Therefore, networks in deep RL must be capable of adapting to new observations and fitting n ...

With the emergence of ultra-portable ultrasound systems, the need to reduce cost and complexity of ultrasound systems has intensified. Sparse arrays, employing fewer transducer elements to acquire images, offer a viable solution by effectively minimizing d ...

Dense image-based prediction methods have advanced tremendously in recent years. Their remarkable development has been possible due to the ample availability of real-world imagery. While these methods work well on photographs, their abilities do not genera ...

Purpose The aim of this study was to develop a novel approach for predicting the expression status of Epidermal Growth Factor Receptor (EGFR) and its subtypes in patients with Non-Small Cell Lung Cancer (NSCLC) using a Three-Dimensional Convolutional Neura ...

Codebook-based optimizations are a class of algorithmic-level transformations able to effectively reduce the computing and memory requirements of Convolutional Neural Networks (CNNs). This approach tightly limits the number of unique weights in each layer, ...

PowerSGD: Practical Low-Rank Gradient Compression for Distributed Optimization

Chat with Graph Search

Stochastic-robust planning optimization method based on tracking-economy extreme scenario tradeoff for CCHP multi-energy system

Integrated electronics for time-of-flight positron emission tomography photodetectors

Generalizing Bulk-Synchronous Parallel Processing for Data Science: From Data to Threads and Agent-Based Simulations

Navigating the Loop: From Control Systems to Neural Networks and Back

From Kernel Methods to Neural Networks: A Unifying Variational Formulation

Digital Twin Generalization with Meta and Geometric Deep Learning

Compilation and Design Space Exploration of Dataflow Programs for Heterogeneous CPU-GPU Platforms

No Representation, No Trust: Connecting Representation, Collapse, and Trust Issues in PPO

Sequential CNN-based Enhancement of Ultrafast Ultrasound Imaging for Sparse Arrays

Dense Image-based Predictions for Comics Analysis

Advancing EGFR mutation subtypes prediction in NSCLC by combining 3D pretrained ConvNeXt, radiomics, and clinical features

An Accuracy-Driven Compression Methodology to Derive Efficient Codebook-Based CNNs