Publications associées à Unsupervised Extraction of Audio-Visual Objects

Aggregating Spatial and Photometric Context for Photometric Stereo

Photometric stereo, a computer vision technique for estimating the 3D shape of objects through images captured under varying illumination conditions, has been a topic of research for nearly four decades. In its general formulation, photometric stereo is an ...

EPFL2024

Subsurface fluorescence time-of-flight imaging using a large-format single-photon avalanche diode sensor for tumor depth assessment

Claudio Bruschini, Edoardo Charbon, Arin Can Ülkü, Yichen Feng

Significance: Fluorescence guidance is used clinically by surgeons to visualize anatomical and/or physiological phenomena in the surgical field that are difficult or impossible to detect by the naked eye. Such phenomena include tissue perfusion or molecula ...

SPIE Society of Photo-optical Instrumentation Engineers2024

Test-time adaptation for 6D pose tracking

Andrea Cavallaro

We propose a test -time adaptation for 6D object pose tracking that learns to adapt a pre -trained model to track the 6D pose of novel objects. We consider the problem of 6D object pose tracking as a 3D keypoint detection and matching task and present a mo ...

Elsevier Sci Ltd2024

Practical computational imaging by use of spatiotemporal light modulation: from simulations to applications in biological microscopy

François Thierry M Marelli

Optical microscopy is an essential tool for biologists, who are often faced with the need to overcome the spatial and temporal resolution limitations of their devices to capture finer details. As upgrading imaging hardware is expensive, computational metho ...

EPFL2023

LenslessPiCam: A Hardware and Software Platform for Lensless Computational Imaging with a Raspberry Pi

Martin Vetterli, Sepand Kashani, Matthieu Martin Jean-André Simeoni, Eric Bezzam

This toolkit has everything you need to perform imaging with a lensless camera. We make use of a low-cost implementation of DiffuserCam, namely replacing the lens with a piece of tape and using the Raspberry Pi HQ camera sensor. Similar principles and meth ...

Zenodo2023

Regressive Tomography and Direct Regressive Reconstruction: A Research Note

Henri Weisen

Two related methods for inverting line-integrated measurements are presented in this research paper in the context of the recent deuterium-tritium experiments in the JET tokamak. Unlike traditional methods of tomography, these methods rely on making use of ...

2023

Self-supervised Dense Representation Learning for Live-Cell Microscopy with Time Arrow Prediction

Max Stieber, Martin Weigert, Benjamin Tobias Gallusser

State-of-the-art object detection and segmentation methods for microscopy images rely on supervised machine learning, which requires laborious manual annotation of training data. Here we present a self-supervised method based on time arrow prediction pre-t ...

Springer International Publishing Ag2023

Terahertz waveform synthesis in integrated thin-film lithium niobate platform

Jérôme Faist, Ileana-Cristina Benea-Chelmus, Francesca Fabiana Settembrini

Bridging the "terahertz gap" relies upon synthesizing arbitrary waveforms in the terahertz domain enabling applications that require both narrow band sources for sensing and few-cycle drives for classical and quantum objects. However, realization of custom ...

Nature Portfolio2023

SoDaCam: Software-defined Cameras via Single-Photon Imaging

Claudio Bruschini, Edoardo Charbon, Andrei Ardelean, Mohit Gupta

Reinterpretable cameras are defined by their post-processing capabilities that exceed traditional imaging. We present "SoDaCam" that provides reinterpretable cameras at the granularity of photons, from photon-cubes acquired by single-photon devices. Photon ...

Ieee Computer Soc2023

Resonators with tailored optical path by cascaded-mode conversions

Ileana-Cristina Benea-Chelmus, Marco Piccardo

Optical resonators enable the generation, manipulation, and storage of electromagnetic waves. The physics underlying their operation is determined by the interference of electromagnetic waves, giving rise to the resonance spectrum. This mechanism causes th ...

Nature Portfolio2023

Towards learning-based denoising of light fields

Touradj Ebrahimi, Michela Testolina, Tomás Soares De Carvalho Feith

In recent years, new emerging immersive imaging modalities, e.g. light fields, have been receiving growing attention, becoming increasingly widespread over the years. Light fields are often captured through multi-camera arrays or plenoptic cameras, with th ...

2023

Unsupervised Term Extraction for Highly Technical Domains

Diego Matteo Antognini

Term extraction is an information extraction task at the root of knowledge discovery platforms. Developing term extractors that are able to generalize across very diverse and potentially highly technical domains is challenging, as annotations for domains r ...

2022

Effects of illuminance intensity on the green channel of remote photoplethysmography (rPPG) signals

Ata Jedari Golparvar

Point-of-care remote photoplethysmography (rPPG) devices that utilize low-cost RGB cameras have drawn considerable attention due to their convenience in contactless and non-invasive vital signs monitoring. In rPPG, sufficient lighting conditions are essent ...

SPRINGER2022

Temporal Representation Learning on Monocular Videos for 3D Human Pose Estimation

Pascal Fua, Mathieu Salzmann, Victor Constantin, Helge Jochen Rhodin, Sina Honari

In this paper we propose an unsupervised feature extraction method to capture temporal information on monocular videos, where we detect and encode subject of interest in each frame and leverage contrastive self-supervised (CSS) learning to extract rich lat ...

2022

AI-based telepresence for broadcast applications

Touradj Ebrahimi, Rayan Daod Nathoo, Laurent Deillon, Henrique Piñeiro Monteagudo

In this paper, we introduce a new solution and underlying architecture that allows remote participants to interact with hosts in a broadcast scenario. To achieve this, background extraction is first applied to video received from remote participants to ext ...

SPIE2022

Blind as a Bat: Audible Echolocation on Small Robots

Martin Vetterli, Mihailo Kolundzija, Frederike Dümbgen, Adrien Guillaume Olivier Hoffet, Adam James Scholefield

For safe and efficient operation, mobile robots need to perceive their environment, and in particular, perform tasks such as obstacle detection, localization, and mapping. Although robots are often equipped with microphones and speakers, the audio modality ...

2022

In vitro and in vivo NIR fluorescence lifetime imaging with a time-gated SPAD camera

Claudio Bruschini, Edoardo Charbon, Arin Can Ülkü

Near-infrared (NIR) fluorescence lifetime imaging (FLI) provides a unique contrast mechanism to monitor biological parameters and molecular events in vivo. Single-photon avalanche diode (SPAD) cameras have been recently demonstrated in FLI microscopy (FLIM ...

Optica Publishing Group2022

Using Animal Motion Capture to Learn Neural Representations

Semih Günel

Understanding behavior from neural activity is a fundamental goal in neuroscience. It has practical applications in building robust brain-machine interfaces, human-computer interaction, and assisting patients with neurological disabilities. Despite the eve ...

EPFL2022

Self-supervised Segmentation via Background Inpainting

Pascal Fua, Mathieu Salzmann, Victor Constantin, Isinsu Katircioglu, Helge Jochen Rhodin

While supervised object detection and segmentation methods achieve impressive accuracy, they generalize poorly to images whose appearance significantly differs from the data they have been trained on. To address this when annotating data is prohibitively e ...

2022

Digital twins for post-earthquake damage assessment of free-standing buildings including damage information

Radhakrishna Achanta, Katrin Beyer, Amir Rezaie, Bryan German Pantoja Rosero

We present a pipeline for the automatic generation of digital twins of free-standing buildings for damage assessment. Our method takes multiple view images of the target building as input and processes them to produce a 3D model in levels of detail (LOD) f ...

2022