Publications associées à Fast Adaptive Elliptical Filtering Using Box Splines

Aggregating Spatial and Photometric Context for Photometric Stereo

Photometric stereo, a computer vision technique for estimating the 3D shape of objects through images captured under varying illumination conditions, has been a topic of research for nearly four decades. In its general formulation, photometric stereo is an ...

EPFL2024

Text as a Richer Source of Supervision in Semantic Segmentation Tasks

Devis Tuia, Valérie Zermatten, Lloyd Haydn Hughes, Javiera Francisca Castillo Navarro

This paper introduces TACOSS a text-image alignment approach that allows explainable land cover semantic segmentation by directly integrating semantic concepts encoded from texts. TACOSS combines convolutional neural networks for visual feature extraction ...

The Institute of Electrical and Electronics Engineers, Inc2023

3D reconstruction of curvilinear one-dimensional objects viewed in transmission electron microscopy

Gulnaz Ganeeva

To obtain a more complete understanding of material microstructure at the nanoscale and to gain profound insights into their properties, there is a growing need for more efficient and precise methods that can streamline the process of 3D imaging using a tr ...

EPFL2023

Towards learning-based denoising of light fields

Touradj Ebrahimi, Michela Testolina, Tomás Soares De Carvalho Feith

In recent years, new emerging immersive imaging modalities, e.g. light fields, have been receiving growing attention, becoming increasingly widespread over the years. Light fields are often captured through multi-camera arrays or plenoptic cameras, with th ...

2023

Automated neuron tracking inside moving and deforming C. elegans using deep learning and targeted augmentation

Sahand Jamal Rahi, Kseniia Korchagina

Reading out neuronal activity from three-dimensional (3D) functional imaging requires segmenting and tracking individual neurons. This is challenging in behaving animals if the brain moves and deforms. The traditional approach is to train a convolutional n ...

Nature Portfolio2023

Attribute Prediction as Multiple Instance Learning

Devis Tuia, Diego Marcos Gonzalez

Attribute-based representations help machine learning models perform tasks based on human understandable concepts, allowing a closer human-machine collaboration. However, learning attributes that accurately reflect the content of an image is not always str ...

2022

Determining crack kinematics from imaged crack patterns

Katrin Beyer, Amir Rezaie, Bryan German Pantoja Rosero, Ketson Roberto Maximiano Dos Santos

Determining the relationship between the cause of damage and the subsequent structural behavior of infrastructure systems requires an accurate characterization of the propagation of cracks, which represents the evolution of the damage state. When no inform ...

2022

Deploying an Instance Segmentation Algorithm to Implement Social Distancing for Prosthetic Vision

Silvestro Micera, Daniela De Luca

The COVID-19 pandemic outbreak is causing a dramatic worsening in the already complicated living conditions of blind and visually impaired individuals. Social distancing is the most effective strategy to limit virus spread, but is extremely difficult for b ...

IEEE2022

Differentiable inverse rendering based on radiative backpropagation

Merlin Eléazar Nimier-David, Wenzel Alban Jakob

A computer-implemented inverse rendering method is provided. The method comprises: computing an adjoint image by differentiating an objective function that evaluates the quality of a rendered image, image elements of the adjoint image encoding the sensitiv ...

2021

Deep Image Restoration: Between Data Fidelity and Learned Priors

Majed El Helou

Image restoration reconstructs, as faithfully as possible, an original image from a potentially degraded version of it. Image degradations can be of various types, for instance haze, unwanted reflections, optical or spectral aberrations, or other physicall ...

EPFL2021

Optimizing Latent Space Directions For GAN-based Local Image Editing

Sabine Süsstrunk, Ehsan Pajouheshgar, Tong Zhang

Generative Adversarial Network (GAN) based localized image editing can suffer from ambiguity between semantic attributes. We thus present a novel objective function to evaluate the locality of an image edit. By introducing the supervision from a pre-traine ...

IEEE2021

Tracking and Relative Localization of Drone Swarms With a Vision-Based Headset

Dario Floreano, Giuseppe Loianno, Maxim Pavliv, Fabrizio Schiano

We address the detection, tracking, and relative localization of the agents of a drone swarm from a human perspective using a headset equipped with a single camera and an Inertial Measurement Unit (IMU). We train and deploy a deep neural network detector o ...

2021

Networks of Coupled VO2 Oscillators for Neuromorphic Computing

Elisabetta Corti

Neuromorphic computing is a wide research field aimed to the realization of brain-inspired hardware, apt to tackle computation of unstructured data more efficiently than currently done with standard computational units. Oscillatory neural networks are know ...

EPFL2021

Context-Aware Image Super-Resolution Using Deep Neural Networks

Mohammad Saeed Rad

Image super-resolution is a classic ill-posed computer vision and image processing problem, addressing the question of how to reconstruct a high-resolution image from its low-resolution counterpart. Current state-of-the-art methods have improved the perfor ...

EPFL2021

Joint Segmentation and Path Classification of Curvilinear Structures

Pascal Fua, Agata Justyna Mosinska, Mateusz Kozinski

Detection of curvilinear structures in images has long been of interest. One of the most challenging aspects of this problem is inferring the graph representation of the curvilinear network. Most existing delineation approaches first perform binary segment ...

2020

Learning stereo reconstruction with deep neural networks

Stepan Tulyakov

Stereo reconstruction is a problem of recovering a 3d structure of a scene from a pair of images of the scene, acquired from different viewpoints. It has been investigated for decades and many successful methods were developed. The main drawback of these ...

EPFL2020

Benefiting from Multitask Learning to Improve Single Image Super-Resolution

Jean-Philippe Thiran, Mohammad Saeed Rad, Claudiu-Cristian Musat, Hazim Kemal Ekenel

Despite significant progress toward super resolving more realistic images by deeper convolutional neural networks (CNNs), reconstructing fine and natural textures still remains a challenging problem. Recent works on single image super resolution (SISR) are ...

2020

An edge detector based on artificial neural network with application to hybrid Compact-WENO finite difference schemes

Jan Sickmann Hesthaven, Zhen Gao

A new approach is proposed to detect edges based on an artificial neural network (ANN). Some elementary continuous and discontinuous functions interpolated in the polynomial space and their continuity are used as the training sets to train a back propagati ...

Springer/Plenum2020

Spatially-Variant CNN-Based Point Spread Function Estimation for Blind Deconvolution and Depth Estimation in Optical Microscopy

Michael Stefan Daniel Liebling, Adrian Shajkofci

Optical microscopy is an essential tool in biology and medicine. Imaging thin, yet non-flat objects in a single shot (without relying on more sophisticated sectioning setups) remains challenging as the shallow depth of field that comes with high-resolution ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2020

A deep learning framework for matching of SAR and optical imagery

Devis Tuia, Sylvain Lobry, Lloyd Haydn Hughes

SAR and optical imagery provide highly complementary information about observed scenes. A combined use of these two modalities is thus desirable in many data fusion scenarios. However, any data fusion task requires measurements to be accurately aligned. Wh ...

2020