Publications related to Differentiable inverse rendering based on radiative backpropagation

Related publications (29)

Aggregating Spatial and Photometric Context for Photometric Stereo

Photometric stereo, a computer vision technique for estimating the 3D shape of objects through images captured under varying illumination conditions, has been a topic of research for nearly four decades. In its general formulation, photometric stereo is an ...

EPFL2024

On the assessment of high-quality images: advances on the JPEG AIC-3 activity

Touradj Ebrahimi, Michela Testolina, Evgeniy Upenik

Recent advances in image compression have made it both possible and desirable for image quality to approach the visually lossless range. However, the most commonly used subjective visual quality assessment protocols, e.g. those reported in ITU-T Rec. BT.50 ...

2023

A KL Divergence-Based Loss for In Vivo Ultrafast Ultrasound Image Enhancement with Deep Learning

Jean-Philippe Thiran, Roser Vinals Terres

Ultrafast ultrasound imaging, characterized by high frame rates, generates low-quality images. Convolutional neural networks (CNNs) have demonstrated great potential to enhance image quality without compromising the frame rate. However, CNNs have been most ...

2023

3D reconstruction of curvilinear one-dimensional objects viewed in transmission electron microscopy

Gulnaz Ganeeva

To obtain a more complete understanding of material microstructure at the nanoscale and to gain profound insights into their properties, there is a growing need for more efficient and precise methods that can streamline the process of 3D imaging using a tr ...

EPFL2023

Towards learning-based denoising of light fields

Touradj Ebrahimi, Michela Testolina

In recent years, new emerging immersive imaging modalities, e.g. light fields, have been receiving growing attention, becoming increasingly widespread over the years. Light fields are often captured through multi-camera arrays or plenoptic cameras, with th ...

2023

Burst Vision Using Single-Photon Cameras

Edoardo Charbon, Paul Mos

Single-photon avalanche diodes (SPADs) are novel image sensors that record the arrival of individual photons at extremely high temporal resolution. In the past, they were only available as single pixels or small-format arrays, for various active imaging ap ...

IEEE COMPUTER SOC2023

Self-supervised Dense Representation Learning for Live-Cell Microscopy with Time Arrow Prediction

Martin Weigert, Benjamin Tobias Gallusser

State-of-the-art object detection and segmentation methods for microscopy images rely on supervised machine learning, which requires laborious manual annotation of training data. Here we present a self-supervised method based on time arrow prediction pre-t ...

Springer International Publishing Ag2023

Cross-resolution Face Recognition via Identity-Preserving Network and Knowledge Distillation

Touradj Ebrahimi, Yuhang Lu

Cross-resolution face recognition has become a challenging problem for modern deep face recognition systems. It aims at matching a low-resolution probe image with high-resolution gallery images registered in a database. Existing methods mainly leverage pri ...

2023

Detecting Anomalies and Obstacles in Road Scenes

Krzysztof Maciej Lis

We address the problem of segmenting anomalies and unusual obstacles in road scenes for the purpose of self-driving safety. The objects in question are not present in the common training sets as it is not feasible to collect and annotate examples for every ...

EPFL2023

Differentiable Physically Based Rendering: Algorithms, Systems and Applications

Merlin Eléazar Nimier-David

Physically based rendering methods can create photorealistic images by simulating the propagation and interaction of light in a virtual scene. Given a scene description including the shape of objects, participating media, material properties, etc., the sim ...

EPFL2022

On combining denoising with learning-based image decoding

Touradj Ebrahimi, Michela Testolina

Noise is an intrinsic part of any sensor and is present, in various degrees, in any content that has been captured in real life environments. In imaging applications, several pre- and post-processing solutions have been proposed to cope with noise in captu ...

SPIE2022

Attribute Prediction as Multiple Instance Learning

Devis Tuia, Diego Marcos Gonzalez

Attribute-based representations help machine learning models perform tasks based on human understandable concepts, allowing a closer human-machine collaboration. However, learning attributes that accurately reflect the content of an image is not always str ...

Journal of Machine Learning Research Inc.2022

reference data for "A Critical Comparison of Annual Glare Simulation Methods"

Jan Wienold, Stephen William Wasilewski

Scene and reference results files for: "A Critical Comparison of Annual Glare Simulation Methods" Stephen Wasilewski, Jan Wienold, Marilyne Andersen 2022 Buildsim Nordic, Copenhagen Contents: 01-06*.tar.gz: reference simulation image archives, one ...

Zenodo2022

Efficient and Accurate Physically-Based Differentiable Rendering

Delio Aleardo Vicini

Physically-based rendering algorithms generate photorealistic images of virtual scenes. By simulating light paths in a scene, complex physical effects such as shadows, reflections and volumetric scattering can be reproduced. Over the last decade, physicall ...

EPFL2022

X-ray imaging detector for radiological applications adapted to the context and requirements of low- and middle-income countries

Jean-Philippe Thiran, René Salathé, Klaus Benedikt Schönenberger, Mario Andres Chavarria Varon, Hubert Lucien Blanchard, Sébastien Emmanuel Blanc

This paper describes the development of a novel medical x-ray imaging system adapted to the needs and constraints of low- and middle-income countries. The developed system is based on an indirect conversion chain: a scintillator plate produces visible ligh ...

2022

Digital twins for post-earthquake damage assessment of free-standing buildings including damage information

Katrin Beyer, Radhakrishna Achanta, Bryan German Pantoja Rosero, Amir Rezaie

We present a pipeline for the automatic generation of digital twins of free-standing buildings for damage assessment. Our method takes multiple view images of the target building as input and processes them to produce a 3D model in levels of detail (LOD) f ...

2022

Time Dependent Image Generation of Plants from Incomplete Sequences with CNN-Transformer

Marc Conrad Russwurm

Data imputation of incomplete image sequences is an essential prerequisite for analyzing and monitoring all development stages of plants in precision agriculture. For this purpose, we propose a conditional Wasserstein generative adversarial network TransGr ...

SPRINGER INTERNATIONAL PUBLISHING AG2022

Templates for 3D Object Pose Estimation Revisited: Generalization to New Objects and Robustness to Occlusions

Mathieu Salzmann, Vincent Lepetit, Yinlin Hu

We present a method that can recognize new objects and estimate their 3D pose in RGB images even under partial occlusions. Our method requires neither a training phase on these objects nor real images depicting them, only their CAD models. It relies on a s ...

IEEE COMPUTER SOC2022

Counting People by Estimating People Flows

Pascal Fua, Mathieu Salzmann, Weizhe Liu

Modern methods for counting people in crowded scenes rely on deep networks to estimate people densities in individual images. As such, only very few take advantage of temporal consistency in video sequences, and those that do only impose weak smoothness co ...

2022

Parameter-free rendering of single-molecule localization microscopy data for parameter-free resolution estimation

Aleksandra Radenovic, Adrien Charles-François Raymond Descloux, Kristin Stefanie Grussmayer

Localization microscopy is a super-resolution imaging technique that relies on the spatial and temporal separation of blinking fluorescent emitters. These blinking events can be individually localized with a precision significantly smaller than the classic ...

2021