Publications associées à Unsupervised Extraction of Audio-Visual Objects

Publications associées (33)

Learning Privacy from Visual Entities

Subjective interpretation and content diversity make predicting whether an image is private or public a challenging task. Graph neural networks combined with convolutional neural networks (CNNs), which consist of 14,000 to 500 millions parameters, generate ...

2025

MetaCap: Meta-learning Priors from Multi-view Imagery for Sparse-View Human Performance Capture and Rendering

Pascal Fua

Faithful human performance capture and free-view rendering from sparse RGB observations is a long-standing problem in Vision and Graphics. The main challenges are the lack of observations and the inherent ambiguities of the setting, e.g. occlusions and dep ...

Springer Science and Business Media Deutschland GmbH2025

Aggregating Spatial and Photometric Context for Photometric Stereo

David Honzátko

Photometric stereo, a computer vision technique for estimating the 3D shape of objects through images captured under varying illumination conditions, has been a topic of research for nearly four decades. In its general formulation, photometric stereo is an ...

EPFL2024

Beyond Essentials: Nuanced and Diverse Text-to-video Retrieval

Yuchen Yang

The field of text-to-video retrieval has advanced significantly with the evolution of language models and large-scale pre-training on generated caption-video pairs. Current methods predominantly focus on visual and event-based details, making retrieval lar ...

Institute of Electrical and Electronics Engineers Inc.2024

Subsurface fluorescence time-of-flight imaging using a large-format single-photon avalanche diode sensor for tumor depth assessment

Edoardo Charbon, Claudio Bruschini, Arin Can Ülkü

Significance: Fluorescence guidance is used clinically by surgeons to visualize anatomical and/or physiological phenomena in the surgical field that are difficult or impossible to detect by the naked eye. Such phenomena include tissue perfusion or molecula ...

SPIE Society of Photo-optical Instrumentation Engineers2024

Test-time adaptation for 6D pose tracking

Andrea Cavallaro

We propose a test -time adaptation for 6D object pose tracking that learns to adapt a pre -trained model to track the 6D pose of novel objects. We consider the problem of 6D object pose tracking as a 3D keypoint detection and matching task and present a mo ...

Elsevier Sci Ltd2024

Practical computational imaging by use of spatiotemporal light modulation: from simulations to applications in biological microscopy

François Thierry M Marelli

Optical microscopy is an essential tool for biologists, who are often faced with the need to overcome the spatial and temporal resolution limitations of their devices to capture finer details. As upgrading imaging hardware is expensive, computational metho ...

EPFL2023

LenslessPiCam: A Hardware and Software Platform for Lensless Computational Imaging with a Raspberry Pi

Martin Vetterli, Matthieu Martin Jean-André Simeoni, Eric Bezzam, Sepand Kashani

This toolkit has everything you need to perform imaging with a lensless camera. We make use of a low-cost implementation of DiffuserCam, namely replacing the lens with a piece of tape and using the Raspberry Pi HQ camera sensor. Similar principles and meth ...

Zenodo2023

Regressive Tomography and Direct Regressive Reconstruction: A Research Note

Henri Weisen

Two related methods for inverting line-integrated measurements are presented in this research paper in the context of the recent deuterium-tritium experiments in the JET tokamak. Unlike traditional methods of tomography, these methods rely on making use of ...

2023

Self-supervised Dense Representation Learning for Live-Cell Microscopy with Time Arrow Prediction

Martin Weigert, Benjamin Tobias Gallusser

State-of-the-art object detection and segmentation methods for microscopy images rely on supervised machine learning, which requires laborious manual annotation of training data. Here we present a self-supervised method based on time arrow prediction pre-t ...

Springer International Publishing Ag2023

Terahertz waveform synthesis in integrated thin-film lithium niobate platform

Ileana-Cristina Benea-Chelmus

Bridging the "terahertz gap" relies upon synthesizing arbitrary waveforms in the terahertz domain enabling applications that require both narrow band sources for sensing and few-cycle drives for classical and quantum objects. However, realization of custom ...

Nature Portfolio2023

SoDaCam: Software-defined Cameras via Single-Photon Imaging

Edoardo Charbon, Claudio Bruschini, Andrei Ardelean

Reinterpretable cameras are defined by their post-processing capabilities that exceed traditional imaging. We present "SoDaCam" that provides reinterpretable cameras at the granularity of photons, from photon-cubes acquired by single-photon devices. Photon ...

Ieee Computer Soc2023

Resonators with tailored optical path by cascaded-mode conversions

Ileana-Cristina Benea-Chelmus

Optical resonators enable the generation, manipulation, and storage of electromagnetic waves. The physics underlying their operation is determined by the interference of electromagnetic waves, giving rise to the resonance spectrum. This mechanism causes th ...

Nature Portfolio2023

Towards learning-based denoising of light fields

Touradj Ebrahimi, Michela Testolina

In recent years, new emerging immersive imaging modalities, e.g. light fields, have been receiving growing attention, becoming increasingly widespread over the years. Light fields are often captured through multi-camera arrays or plenoptic cameras, with th ...

2023

Digitization of the inscriptions on the monuments of Armenian cultural heritage in Nagorno-Karabakh region

Hamest Tamrazyan

The Armenian cultural heritage in Artsakh 1 is in danger after explicit threats of irreversible destruction coordinated by Azerbaijan authorities 2. As part of a series of actions coordinated by the École Polytechnique Fédérale de Lausanne, the Digital Hum ...

2023

Unsupervised Term Extraction for Highly Technical Domains

Diego Matteo Antognini

Term extraction is an information extraction task at the root of knowledge discovery platforms. Developing term extractors that are able to generalize across very diverse and potentially highly technical domains is challenging, as annotations for domains r ...

2022

Effects of illuminance intensity on the green channel of remote photoplethysmography (rPPG) signals

Ata Jedari Golparvar

Point-of-care remote photoplethysmography (rPPG) devices that utilize low-cost RGB cameras have drawn considerable attention due to their convenience in contactless and non-invasive vital signs monitoring. In rPPG, sufficient lighting conditions are essent ...

SPRINGER2022

Temporal Representation Learning on Monocular Videos for 3D Human Pose Estimation

Pascal Fua, Mathieu Salzmann, Helge Jochen Rhodin, Sina Honari, Victor Constantin

In this paper we propose an unsupervised feature extraction method to capture temporal information on monocular videos, where we detect and encode subject of interest in each frame and leverage contrastive self-supervised (CSS) learning to extract rich lat ...

2022

AI-based telepresence for broadcast applications

Rayan Daod Nathoo, Changsheng Gao, Laurent Deillon, Henrique Piñeiro Monteagudo, Touradj Ebrahimi

In this paper, we introduce a new solution and underlying architecture that allows remote participants to interact with hosts in a broadcast scenario. To achieve this, background extraction is first applied to video received from remote participants to ext ...

SPIE2022

Blind as a Bat: Audible Echolocation on Small Robots

Martin Vetterli, Adam James Scholefield, Mihailo Kolundzija, Frederike Dümbgen, Adrien Guillaume Olivier Hoffet

For safe and efficient operation, mobile robots need to perceive their environment, and in particular, perform tasks such as obstacle detection, localization, and mapping. Although robots are often equipped with microphones and speakers, the audio modality ...

2022