PowerSGD: Practical Low-Rank Gradient Compression for Distributed Optimization

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

We propose an image-based elastography method to measure the heterogeneous stiffness inside a cell and its nucleus. It uses a widely accessible setup consisting of plate compression imaged with fluorescence microscopy. Our framework recovers a spatial map ...

In this thesis, we explore techniques for addressing the communication bottleneck in data-parallel distributed training of deep learning models. We investigate algorithms that either reduce the size of the messages that are exchanged between workers, or th ...

Neurons in the human amygdala and hippocampus are classically thought to encode a person’s identity invariant to visual features. However, it remains largely unknown how visual information from higher visual cortical areas is translated into such a semanti ...

In the field of image acquisition, Dynamic Vision Sensors (DVS) present an innovative methodology, capturing only the variations in pixel brightness instead of absolute values and thereby revealing unique features. Given that the primary deployment of DVS ...

Sign Language conveys information through multiple channels composed of manual (handshape, hand movement) and non-manual (facial expression, mouthing, body posture) components. Sign language assessment involves giving granular feedback to a learner, in ter ...

Recent advances in image compression have made it both possible and desirable for image quality to approach the visually lossless range. However, the most commonly used subjective visual quality assessment protocols, e.g. those reported in ITU-T Rec. BT.50 ...

Many empirical studies have provided evidence for the emergence of algorithmic mechanisms (abilities) in the learning of language models, that lead to qualitative improvements in the model capabilities. Yet, a theoretical characterization of how such mecha ...

Neural network approaches to approximate the ground state of quantum hamiltonians require the numerical solution of a highly nonlinear optimization problem. We introduce a statistical learning approach that makes the optimization trivial by using kernel me ...

High-dimensional data must be highly structured to be learnable. Although the compositional and hierarchical nature of data is often put forward to explain learnability, quantitative measurements establishing these properties are scarce. Likewise, accessin ...

The Joint Photographic Experts Group (JPEG) AI learning-based image coding system is an ongoing joint standardization effort between International Organization for Standardization (ISO), International Electrotechnical Commission (IEC), and International Te ...

This paper introduces MNE-RT, a Python package designed for real-time neural feature extraction from magne-toencephalography (MEG) and electroencephalography (EEG) signals in Brain-Computer Interface (BCI) systems. The package incorporates efficient algori ...

Visual data play a crucial role in modern society, and the rate at which images and videos are acquired, stored, and exchanged every day is rapidly increasing. Image compression is the key technology that enables storing and sharing of visual content in an ...

The past decades have witnessed rapid growth in imaging as a major form of communication between individuals. Due to recent advances in capture, storage, delivery and display technologies, consumers demand improved perceptual quality while requiring reduce ...

The Internet of Things (IoT) consists of physical objects and devices embedded with network connectivity, software, and sensors to collect and transmit data. The development of the Internet of Things (IoT) has led to various security and privacy issues, in ...

Dynamic situations and applications are supported by the diverse devices and communication technologies that constitute the Internet of Things concept. Despite this, communication backlogs are common due to rising network demand and insufficient resource a ...

The use of meteorological radars to study snowfall microphysical properties and processes is well established, in particular via a few distinct techniques: the use of radar polarimetry, of multi-frequency radar measurements, and of the radar Doppler spectr ...

Reinterpretable cameras are defined by their post-processing capabilities that exceed traditional imaging. We present "SoDaCam" that provides reinterpretable cameras at the granularity of photons, from photon-cubes acquired by single-photon devices. Photon ...

In 1948, Claude Shannon laid the foundations of information theory, which grew out of a study to find the ultimate limits of source compression, and of reliable communication. Since then, information theory has proved itself not only as a quest to find the ...

The landscape of computing is changing, thanks to the advent of modern networking equipment that allows machines to exchange information in as little as one microsecond. Such advancement has enabled microsecond-scale distributed computing, where entire dis ...

The demise of Moore's Law and Dennard scaling has resulted in diminishing performance gains for general-purpose processors, and so has prompted a surge in academic and commercial interest for hardware accelerators. Specialized hardware has already redefine ...

PowerSGD: Practical Low-Rank Gradient Compression for Distributed Optimization

Chat with Graph Search

PROBING INTRACELLULAR ELASTICITY WITH MINIMAL-HESSIAN REGISTRATION

Communication-efficient distributed training of machine learning models

Feature-based encoding of face identity by single neurons in the human amygdala and hippocampus

Evaluation of the impact of lossy compression on event camera-based computer vision tasks

Posterior-Based Analysis of Spatio-Temporal Features for Sign Language Assessment

On the assessment of high-quality images: advances on the JPEG AIC-3 activity

A phase transition between positional and semantic learning in a solvable model of dot-product attention

Learning ground states of gapped quantum Hamiltonians with Kernel Methods

Probing the latent hierarchical structure of data via diffusion models

The JPEG AI Standard: Providing Efficient Human and Machine Visual Data Consumption

Advances on Real Time M/EEG Neural Feature Extraction

JPEG AIC-3 Dataset: Towards Defining the High Quality to Nearly Visually Lossless Quality Range

On the Performance of Subjective Visual Quality Assessment Protocols for Nearly Visually Lossless Image Compression

GraphFedAI framework for DDoS attack detection in IoT systems using federated learning and graph based artificial intelligence

Enhancing dynamic resource management in decentralized federated learning for collaborative edge Internet of Things

Dual-frequency spectral radar retrieval of snowfall microphysics: a physics-driven deep-learning approach

SoDaCam: Software-defined Cameras via Single-Photon Imaging

Time vs. Truth: Age-Distortion Tradeoffs and Strategies for Distributed Inference

Reliable Microsecond-Scale Distributed Computing

Building Chips Faster: Hardware-Compiler Co-Design for Accelerated RTL Simulation