Publications associées à SoDaCam: Software-defined Cameras via Single-Photon Imaging

Exploiting the Signal-Leak Bias in Diffusion Models

Sabine Süsstrunk, Radhakrishna Achanta, Mahmut Sami Arpa, Athanasios Fitsios, Martin Nicolas Everaert

There is a bias in the inference pipeline of most diffusion models. This bias arises from a signal leak whose distribution deviates from the noise distribution, creating a discrepancy between training and inference processes. We demonstrate that this signa ...

2024

Global existence for perturbations of the 2D stochastic Navier-Stokes equations with space-time white noise

Martin Hairer

We prove global in time well-posedness for perturbations of the 2D stochastic Navier-Stokes equations partial derivative( t)u + u center dot del u = Delta u - del p + sigma + xi, u(0, center dot ) = u(0),div (u) = 0, driven by additive space-time white noi ...

Springernature2024

Efficient Temporally-Aware DeepFake Detection using H.264 Motion Vectors

Sabine Süsstrunk, Alessio Verardo, Yufan Ren, Peter Arpad Grönquist, Qingyi He

Video DeepFakes are fake media created with Deep Learning (DL) that manipulate a person’s expression or identity. Most current DeepFake detection methods analyze each frame independently, ignoring inconsistencies and unnatural movements between frames. Som ...

2024

Imaging sensor device using an array of single-photon avalanche diode photodetectors

Edoardo Charbon, Andrei Ardelean

The invention relates to an Imaging sensor device in a stacked arrangement comprising: - a pixel array tier comprising a plurality of pixel segments each having a plurality of pixels for photon detection each providing a digital pixel output; - a processin ...

2024

Exploring High-Performance and Energy-Efficient Architectures for Edge AI-Enabled Applications

Joshua Alexander Harrison Klein

The desire and ability to place AI-enabled applications on the edge has grown significantly in recent years. However, the compute-, area-, and power-constrained nature of edge devices are stressed by the needs of the AI-enabled applications, due to a gener ...

EPFL2024

The Privacy Power of Correlated Noise in Decentralized Learning

Rachid Guerraoui, Martin Jaggi, Anastasiia Koloskova, Youssef Allouah, Aymane El Firdoussi

Decentralized learning is appealing as it enables the scalable usage of large amounts of distributed data and resources (without resorting to any central entity), while promoting privacy since every user minimizes the direct exposure of their data. Yet, wi ...

PMLR2024

Fast and Future: Towards Efficient Forecasting in Video Semantic Segmentation

Evann Pierre Guy Courdier

Deep learning has revolutionized the field of computer vision, a success largely attributable to the growing size of models, datasets, and computational power. Simultaneously, a critical pain point arises as several computer vision applications are deploye ...

EPFL2024

Optimal digital filter selection for remote photoplethysmography (rPPG) signal conditioning

Ata Jedari Golparvar

Remote photoplethysmography (rPPG) using camera-based imaging has shown excellent potential recently in vital signs monitoring due to its contactless nature. However, the optimum filter selection for pre-processing rPPG data in signal conditioning is still ...

IOP Publishing Ltd2023

Practical computational imaging by use of spatiotemporal light modulation: from simulations to applications in biological microscopy

François Thierry M Marelli

Optical microscopy is an essential tool for biologists, who are often faced with the need to overcome the spatial and temporal resolution limitations of their devices to capture finer details. As upgrading imaging hardware is expensive, computational metho ...

EPFL2023

Performance investigation of cameras using HDR sensors for daylight glare evaluations

Jan Wienold, Geraldine Cai Ting Quek, Dong Hyun Kim

This study presents a novel framework for evaluating the luminance measurement capabilities of High Dynamic Range (HDR) sensor cameras in indoor glare conditions. Results indicate that the practical usage range of the CSEM VIP camera is significantly lower ...

International Commission on Illumination2023

How deep convolutional neural networks lose spatial information with training

Matthieu Wyart, Leonardo Petrini, Umberto Maria Tomasini, Francesco Cagnetta

A central question of machine learning is how deep nets manage to learn tasks in high dimensions. An appealing hypothesis is that they achieve this feat by building a representation of the data where information irrelevant to the task is lost. For image da ...

Iop Publishing Ltd2023

Disentangling 1/f noise from confined ion dynamics

Théo Denis Tobias Emmerich

Ion transport through biological and solid-state nanochannels is known to be a highly noisy process. The power spectrum of current fluctuations is empirically known to scale like the inverse of frequency, following the long-standing yet poorly understood H ...

ROYAL SOC CHEMISTRY2023

Distributionally Robust Linear Quadratic Control

Daniel Kuhn, Cagil Kocyigit, Bahar Taskesen

Linear-Quadratic-Gaussian (LQG) control is a fundamental control paradigm that is studied in various fields such as engineering, computer science, economics, and neuroscience. It involves controlling a system with linear dynamics and imperfect observations ...

2023

Optimizing Data Processing for Nanodiamond Based Relaxometry

Mayeul Sylvain Chipaux

The nitrogen-vacancy (NV) center in diamond is a powerful and versatile quantum sensor for diverse quantities. In particular, relaxometry (or T1), can be used to detect magnetic noise at the nanoscale. For experiments with single NV centers the analysis of ...

WILEY2023

Tensor approximation of the self-diffusion matrix of tagged particle processes

Christoph Max Strössner

The objective of this paper is to investigate a new numerical method for the approximation of the self-diffusion matrix of a tagged particle process defined on a grid. While standard numerical methods make use of long-time averages of empirical means of de ...

ACADEMIC PRESS INC ELSEVIER SCIENCE2023

A KL Divergence-Based Loss for In Vivo Ultrafast Ultrasound Image Enhancement with Deep Learning

Jean-Philippe Thiran, Roser Vinals Terres

Ultrafast ultrasound imaging, characterized by high frame rates, generates low-quality images. Convolutional neural networks (CNNs) have demonstrated great potential to enhance image quality without compromising the frame rate. However, CNNs have been most ...

2023

Active Wire Fences for Multitenant FPGAs

Mirjana Stojilovic, Ognjen Glamocanin, Andela Kostic, Stasa Kostic

When spatially shared among multiple tenants, field-programmable gate arrays (FPGAs) are vulnerable to remote power side-channel analysis attacks. Using carefully crafted on-chip voltage sensors, adversaries can extract secrets (e.g., encryption keys or th ...

2023

Multi-agent Learning with Privacy Guarantees

Elsa Rizk

A multi-agent system consists of a collection of decision-making or learning agents subjected to streaming observations from some real-world phenomenon. The goal of the system is to solve some global learning or optimization problem in a distributed or dec ...

EPFL2023

LenslessPiCam: A Hardware and Software Platform for Lensless Computational Imaging with a Raspberry Pi

Martin Vetterli, Sepand Kashani, Matthieu Martin Jean-André Simeoni, Eric Bezzam

This toolkit has everything you need to perform imaging with a lensless camera. We make use of a low-cost implementation of DiffuserCam, namely replacing the lens with a piece of tape and using the Raspberry Pi HQ camera sensor. Similar principles and meth ...

Zenodo2023

Arbitrary Decisions are a Hidden Cost of Differentially Private Training

Bogdan Kulynych, Carmela González Troncoso

Mechanisms used in privacy-preserving machine learning often aim to guarantee differential privacy (DP) during model training. Practical DP-ensuring training methods use randomization when fitting model parameters to privacy-sensitive data (e.g., adding Ga ...

Assoc Computing Machinery2023