Publications related to One-Bit Measurements With Adaptive Thresholds

Spectral Estimators for High-Dimensional Matrix Inference

A key challenge across many disciplines is to extract meaningful information from data which is often obscured by noise. These datasets are typically represented as large matrices. Given the current trend of ever-increasing data volumes, with datasets grow ...

EPFL2024

ZigZag: Universal Sampling-free Uncertainty Estimation Through Two-Step Inference

Nikita Durasov, Nik Joel Dorndorf, Minh Hieu Lê

Whereas the ability of deep networks to produce useful predictions on many kinds of data has been amply demonstrated, estimating the reliability of these predictions remains challenging. Sampling approaches such as MC-Dropout and Deep Ensembles have emerge ...

2024

Time vs. Truth: Age-Distortion Tradeoffs and Strategies for Distributed Inference

Yunus Inan

In 1948, Claude Shannon laid the foundations of information theory, which grew out of a study to find the ultimate limits of source compression, and of reliable communication. Since then, information theory has proved itself not only as a quest to find the ...

EPFL2023

Robust Distributed Learning: Tight Error Bounds and Breakdown Point under Data Heterogeneity

Rachid Guerraoui, Nirupam Gupta, Rafaël Benjamin Pinot, Youssef Allouah, Geovani Rizk

The theory underlying robust distributed learning algorithms, designed to resist adversarial machines, matches empirical observations when data is homogeneous. Under data heterogeneity however, which is the norm in practical scenarios, established lower bo ...

2023

Quantization for Decentralized Learning Under Subspace Constraints

Ali H. Sayed, Roula Nassif, Stefan Vlaski, Marco Carpentiero

In this article, we consider decentralized optimization problems where agents have individual cost functions to minimize subject to subspace constraints that require the minimizers across the network to lie in low-dimensional subspaces. This constrained fo ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2023

A Statistical Framework to Investigate the Optimality of Signal-Reconstruction Methods

Michaël Unser, Pakshal Narendra Bohra, Pol del Aguila Pla

We present a statistical framework to benchmark the performance of reconstruction algorithms for linear inverse problems, in particular, neural-network-based methods that require large quantities of training data. We generate synthetic signals as realizati ...

2023

Evaluating the effect of sparse convolutions on point cloud compression

Touradj Ebrahimi, Davi Nachtigall Lazzarotto

The use of point clouds as an imaging modality has been rapidly growing, motivating research on compression methods to enable efficient transmission and storage for many applications. While compression standards relying on conven- tional techniques such as ...

2023

Linear Recursive State Estimation of Hybrid and Unbalanced AC/DC Micro-Grids using Synchronized Measurements

Mario Paolone, Willem Lambrichts

In this paper, we present an exact (i. e. non-approximated) and linear measurement model for hybrid AC/DC microgrids for recursive state estimation (SE). More specifically, an exact linear model of a voltage source converter (VSC) is proposed. It relies on ...

New York2023

Convex Quantization Preserves Logconcavity

Pol del Aguila Pla

A logconcave likelihood is as important to proper statistical inference as a convex cost function is important to variational optimization. Quantization is often disregarded when writing likelihood models, ignoring the limitations of the physical detectors ...

IEEE Institute of Electrical and Electronics Engineers2022

Finite Bit Quantization For Decentralized Learning Under Subspace Constraints

Ali H. Sayed, Roula Nassif, Stefan Vlaski, Marco Carpentiero

In this paper, we consider decentralized optimization problems where agents have individual cost functions to minimize subject to subspace constraints that require the minimizers across the network to lie in low-dimensional subspaces. This constrained form ...

IEEE2022

Statistical limits of dictionary learning: Random matrix theory and the spectral replica method

Nicolas Macris, Jean François Emmanuel Barbier

We consider increasingly complex models of matrix denoising and dictionary learning in the Bayes-optimal setting, in the challenging regime where the matrices to infer have a rank growing linearly with the system size. This is in contrast with most existin ...

AMER PHYSICAL SOC2022

Linear Recursive State Estimation of Hybrid and Unbalanced AC/DC Micro-Grids using Synchronized Measurements

Mario Paolone, Willem Lambrichts

In this paper, we present an exact (i.e. non-approximated) and linear measurement model for hybrid AC/DC micro-grids for recursive state estimation (SE). More specifically, an exact linear model of a voltage source converter (VSC) is proposed. It relies on ...

2022

Statistical limits of high-dimensional inference problems

Clément Dominique Luneau

This thesis focuses on two kinds of statistical inference problems in signal processing and data science. The first problem is the estimation of a structured informative tensor from the observation of a noisy tensor in which it is buried. The structure com ...

EPFL2021

Frequency-Domain Diffusion Adaptation Over Networks

Ali H. Sayed, Ricardo Merched, Shuo Zhang

This paper analyzes the implementation of least-mean-squares (LMS)-based, adaptive diffusion algorithms over networks in the frequency-domain (FD). We focus on a scenario of noisy links and include a moving-average step for denoising after self-learning to ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2021

Last iterate convergence of SGD for Least-Squares in the Interpolation regime

Aditya Vardhan Varre, Nicolas Henri Bernard Flammarion, Loucas Pillaud-Vivien

Motivated by the recent successes of neural networks that have the ability to fit the data perfectly \emph{and} generalize well, we study the noiseless model in the fundamental least-squares setup. We assume that an optimum predictor fits perfectly inputs ...

Advances in Neural Information Processing Systems 20212021

A Real-time Synchrophasor Data Compression Method Using Singular Value Decomposition

Mario Paolone

The proliferation of phasor measurement units (PMUs) presents new challenges in archiving and processing large amounts of synchrophasor data which necessitates advanced data compression methods. This paper proposes a singular value decomposition (SVD)-base ...

2021

Time-Synchronization Attacks against Critical Infrastructures and their Mitigation

Marguerite Marie Nathalie Delcourt

This work focuses on the security of critical infrastructures against time-synchronization attacks (TSA). A TSA can impact any network that relies on the dynamic analysis of data, by altering the time synchronization between its nodes. Such attacked networ ...

EPFL2021

TDOA Source-Localization Technique Robust to Time-Synchronization Attacks

Jean-Yves Le Boudec, Marguerite Marie Nathalie Delcourt

In this paper, we focus on the localization of a passive source from time difference of arrival (TDOA) measurements. TDOA values are computed with respect to pairs of fixed sensors that are required to be accurately time-synchronized. This constitutes a we ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2021

Learning in Volatile Environments With the Bayes Factor Surprise

Wulfram Gerstner, Vasiliki Liakoni, Johanni Michael Brea, Alireza Modirshanechi

Surprise-based learning allows agents to rapidly adapt to nonstationary stochastic environments characterized by sudden changes. We show that exact Bayesian inference in a hierarchical model gives rise to a surprise-modulated trade-off between forgetting o ...

MIT PRESS2021

Sequential Domain Adaptation by Synthesizing Distributionally Robust Experts

Viet Anh Nguyen, Daniel Kuhn, Bahar Taskesen

Least squares estimators, when trained on a few target domain samples, may predict poorly. Supervised domain adaptation aims to improve the predictive accuracy by exploiting additional labeled training samples from a source distribution that is close to th ...

JMLR-JOURNAL MACHINE LEARNING RESEARCH2021