The Gray-Wyner Network and Wyner's Common Information for Gaussian Sources

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

A key challenge across many disciplines is to extract meaningful information from data which is often obscured by noise. These datasets are typically represented as large matrices. Given the current trend of ever-increasing data volumes, with datasets grow ...

Information theory has allowed us to determine the fundamental limit of various communication and algorithmic problems, e.g., the channel coding problem, the compression problem, and the hypothesis testing problem. In this work, we revisit the assumptions ...

We demonstrate the first EDWA-enabled Terabit-class coherent optical communication with 1.6-Tb/s net bit rate per channel and 16 -channel WDM transmission over 81 -km fiber, proving the potential of such on-chip amplification for future coherent applicatio ...

Most modern image-based 6D object pose estimation methods learn to predict 2D-3D correspondences, from which the pose can be obtained using a PnP solver. Because of the non-differentiable nature of common PnP solvers, these methods are supervised via the i ...

Local and global inference methods have been developed to infer structural contacts from multiple sequence alignments of homologous proteins. They rely on correlations in amino acid usage at contacting sites. Because homologous proteins share a common ance ...

What training should engineering students receive to enable them to contribute to reducing bias, discrimination and the persistent lack of diversity in engineering? Collaboration is central to professional engineering work and, consequently, teamwork and g ...

Diffusion models generating images conditionally on text, such as Dall-E 2 [51] and Stable Diffusion[53], have recently made a splash far beyond the computer vision com- munity. Here, we tackle the related problem of generating point clouds, both unconditi ...

We develop techniques to study the phase transition for planar Gaussian percolation models that are not (necessarily) positively correlated. These models lack the property of positive associations (also known as the 'FKG inequality'), and hence many classi ...

Since the birth of Information Theory, researchers have defined and exploited various information measures, as well as endowed them with operational meanings. Some were born as a "solution to a problem", like Shannon's Entropy and Mutual Information. Other ...

Biochemistry, ecology, and neuroscience are examples of prominent fields aiming at describing interacting systems that exhibit nontrivial couplings to complex, ever-changing environments. We have recently shown that linear interactions and a switching envi ...

Measuring conditional dependencies among the variables of a network is of great interest to many disciplines. This paper studies some shortcomings of the existing dependency measures in detecting direct causal influences or their lack of ability for group ...

We consider the problem of parameter estimation in a Bayesian setting and propose a general lower-bound that includes part of the family of f-Divergences. The results are then applied to specific settings of interest and compared to other notable results i ...

High temperature superconducting (HTS) materials are widely utilized in various design proposals for fusion magnets, resulting in enhanced performance of the machines compared to the past. However, a reliable quench detection in HTS conductors remains an o ...

Two-dimensional materials (2DMs) have found potential applications in many areas of electronics, such as sensing, memory systems, optoelectronics, and power. Despite an intense experimental work, the literature is lacking of accurate modeling of nonvolatil ...

In this work, we connect the problem of bounding the expected generalisation error with transportation-cost inequalities. Exposing the underlying pattern behind both approaches we are able to generalise them and go beyond Kullback- Leibler Divergences/Mutu ...

The conditional mean is a fundamental and important quantity whose applications include the theories of estimation and rate-distortion. It is also notoriously difficult to work with. This paper establishes novel bounds on the differential entropy of the co ...

Due to conservative approaches in construction design and practice, infrastructure often has hidden reserve capacity. When quantified, this reserve has potential to improve decisions related to asset management. Field measurements, collected through load t ...

The hydrostatic compaction of composites comprising a closely-packed particle-bed filled by a dense matrix is measured experimentally using a fluid-pressurization apparatus. A highly compliant polymer or pure aluminium are infiltrated into preforms of pack ...

Wyner's common information is a measure that quantifies and assesses the commonality between two random variables. Based on this, we introduce a novel two-step procedure to construct features from data, referred to as Common Information Components Analysis ...

We consider increasingly complex models of matrix denoising and dictionary learning in the Bayes-optimal setting, in the challenging regime where the matrices to infer have a rank growing linearly with the system size. This is in contrast with most existin ...

The Gray-Wyner Network and Wyner's Common Information for Gaussian Sources

Chat with Graph Search

Spectral Estimators for High-Dimensional Matrix Inference

On Speed and Advantage : Results in Information Velocity and Monitoring Problems

First Demonstration of Erbium -Doped Waveguide Amplifier Enabled Multi-Tb/s (16x1.6T) Coherent Transmission

Linear-Covariance Loss for End-to-End Learning of 6D Pose Estimation

Impact of phylogeny on structural contact inference from protein sequence data

Educating Engineering Students to Address Bias and Discrimination Within Their Project Teams

Geometrically-Conditioned Point Diffusion Models

THE PHASE TRANSITION FOR PLANAR GAUSSIAN PERCOLATION MODELS WITHOUT FKG

A Functional Perspective on Information Measures

Mutual information in changing environments: Nonlinear interactions, out-of-equilibrium systems, and continuously varying diffusivities

A Wasserstein-based measure of conditional dependence

Lower-bounds on the Bayesian Risk in Estimation Procedures via f–Divergences

Co-Wound Superconducting Wire for Quench Detection in Fusion Magnets

Impact of Interface Traps in Floating-Gate Memory Based on Monolayer MoS2

From Generalisation Error to Transportation-cost Inequalities and Back

Differential Entropy of the Conditional Expectation Under Additive Gaussian Noise

A Comparison of optimal measurement-system design with engineering judgement for bridge load testing

On the bulk compressibility of close-packed particles and their composites

Common Information Components Analysis

Statistical limits of dictionary learning: Random matrix theory and the spectral replica method