Publications related to A Low-Dimensional Function Space for Efficient Spectral Upsampling

Aggregating Spatial and Photometric Context for Photometric Stereo

Photometric stereo, a computer vision technique for estimating the 3D shape of objects through images captured under varying illumination conditions, has been a topic of research for nearly four decades. In its general formulation, photometric stereo is an ...

EPFL2024

Modular segmentation, spatial analysis and visualization of volume electron microscopy datasets

Martin Weigert

Volume electron microscopy is the method of choice for the in situ interrogation of cellular ultrastructure at the nanometer scale, and with the increase in large raw image datasets generated, improving computational strategies for image segmentation and s ...

Nature Portfolio2024

Advancing Self-Supervised Deep Learning for 3D Scene Understanding

Seyed Mohammad Mahdi Johari

Recent advancements in deep learning have revolutionized 3D computer vision, enabling the extraction of intricate 3D information from 2D images and video sequences. This thesis explores the application of deep learning in three crucial challenges of 3D com ...

EPFL2024

Accurate color characterization of solar photovoltaic modules for building integration

Christophe Ballif, Antonin Faes, Jordi Escarre Palou, Alessandro Francesco Aldo Virtuani, Alejandro Borja Block

Accurate and reproducible color characterization is essential for colored building integrated photovoltaic products, both for manufacturing quality control and assessing long-term color stability. However, existing characterization techniques struggle to a ...

Pergamon-Elsevier Science Ltd2023

A Full-Wave Reference Simulator for Computing Surface Reflectance

Mengqi Xia

Computing light reflection from rough surfaces is an important topic in computer graphics. Reflection models developed based on geometric optics fail to capture wave effects such as diffraction and interference, while existing models based on physical opti ...

ASSOC COMPUTING MACHINERY2023

Retraction-based numerical methods for continuation, interpolation and time integration on manifolds

Axel Elie Joseph Séguin

The goal of this thesis is the development and the analysis of numerical methods for problems where the unknown is a curve on a smooth manifold. In particular, the thesis is structured around the three following problems: homotopy continuation, curve inter ...

EPFL2023

Differentiable Physically Based Rendering: Algorithms, Systems and Applications

Merlin Eléazar Nimier-David

Physically based rendering methods can create photorealistic images by simulating the propagation and interaction of light in a virtual scene. Given a scene description including the shape of objects, participating media, material properties, etc., the sim ...

EPFL2022

WikiArtVectors: Style and Color Representations of Artworks for Cultural Analysis via Information Theoretic Measures

Bhargav Srinivasa Desikan

With the increase in massive digitized datasets of cultural artefacts, social and cultural scientists have an unprecedented opportunity for the discovery and expansion of cultural theory. The WikiArt dataset is one such example, with over 250,000 high qual ...

MDPI2022

Unsupervised Visual Entity Abstraction towards 2D and 3D Compositional Models

Beril Besbinar

Object-centric learning has gained significant attention over the last years as it can serve as a powerful tool to analyze complex scenes as a composition of simpler entities. Well-established tasks in computer vision, such as object detection or instance ...

EPFL2022

Sub-micrometer morphology of human atherosclerotic plaque revealed by synchrotron radiation-based mu CT-A comparison with histology

Anne Bonnin, Goran Lovric

Histology is a long standing and well-established gold standard for pathological characterizations. In recent years however, synchrotron radiation-based micro-computed tomography (SR mu CT) has become a tool for extending the imaging of two-dimensional thi ...

PUBLIC LIBRARY SCIENCE2022

Gazebo Fluids: SPH-based simulation of fluid interaction with articulated rigid body dynamics

Auke Ijspeert, Jonathan Patrick Arreguit O'Neill, Wei Wang, Emmanouil Angelidis

Physical simulation is an indispensable component of robotics simulation platforms that serves as the basis for a plethora of research directions. Looking strictly at robotics, the common characteristic of the most popular physics engines, such as ODE, DAR ...

IEEE2022

The Height of Chitinous Ridges Alone Produces the Entire Structural Color Palette

Hemant Kumar Raut

The colorful wings of butterflies result from the interaction between light and the intricate chitinous nanostructures on butterflies’ scales. This study demonstrates that just by reproducing the chitinous ridges present in butterfly scales (i.e., without ...

2022

Image-based geometric digital twinning for stone masonry elements

Katrin Beyer, Bryan German Pantoja Rosero, Savvas Saloustros

We present an image-based pipeline for generating geometrical digital twins (GDTs) of stone masonry elements with detail down to the stone level. For this purpose, we acquire RGB images of the individual stones and of the wall during the construction phase ...

2022

Perceptual Quality of Point Clouds with application to Compression

Evangelos Alexiou

Modern information technologies and human-centric communication systems employ advanced content representations for richer portrayals of the real world. The newly adopted imaging modalities offer additional information cues and permit the depiction of real ...

EPFL2021

Path Replay Backpropagation: Differentiating Light Paths using Constant Memory and Linear Time

Sébastien Nicolas Speierer, Wenzel Alban Jakob, Delio Aleardo Vicini

Differentiable physically-based rendering has become an indispensable tool for solving inverse problems involving light. Most applications in this area jointly optimize a large set of scene parameters to minimize an objective function, in which case revers ...

ASSOC COMPUTING MACHINERY2021

Monte Carlo Estimators for Differential Light Transport

Sébastien Nicolas Speierer, Wenzel Alban Jakob, Tizian Lucien Zeltner

Physically based differentiable rendering algorithms propagate derivatives through realistic light transport simulations and have applications in diverse areas including inverse reconstruction and machine learning. Recent progress has led to unbiased metho ...

ASSOC COMPUTING MACHINERY2021

Light Path Gradients for Forward and Inverse Rendering

Tizian Lucien Zeltner

Physically based rendering is a process for photorealistic digital image synthesis and one of the core problems in computer graphics. It involves simulating the light transport, i.e. the emission, propagation, and scattering of light through a virtual scen ...

EPFL2021

Raytraverse: Navigating the Lightfield to Enhance Climate-Based Daylight Modeling

Marilyne Andersen, Jan Wienold, Stephen William Wasilewski

We propose a new method for climate-based daylight modeling (CBDM) based on simulating and evaluating only the most important features. By adaptively sampling the temporal lightfield that describes daylight in buildings, our method escapes the curse of dim ...

2021

A Non-Exponential Transmittance Model for Volumetric Scene Representations

Wenzel Alban Jakob, Delio Aleardo Vicini

We introduce a novel transmittance model to improve the volumetric representation of 3D scenes. The model can represent opaque surfaces in the volumetric light transport framework. Volumetric representations are useful for complex scenes, and become increa ...

ASSOC COMPUTING MACHINERY2021

Spectral Measurement and Classification in the Era of Big Data

Marilyne Andersen, Forrest Simon Webler

The measurement and classification of light is essential across many scientific disciplines. Devices used to measure light range from the highly precise scanning spectroradiometers to the more practical compact multichannel filter-array type imaging sensor ...

2021