We present a real-time system that can draw virtual patterns or images on deforming real objects by estimating both the deformations and the shading parameters. We show that this is what is required to render the virtual elements so that they blend convinc ...

2005

Learning to Align Sequential Actions in the Wild

Pascal Fua, Bugra Tekin, Weizhe Liu

State-of-the-art methods for self-supervised sequential action alignment rely on deep networks that find correspon- dences across videos in time. They either learn frame-to- frame mapping across sequences, which does not leverage temporal information, or a ...

IEEE COMPUTER SOC2022

Tubular Geodesics using Oriented Flux: An ITK Implementation

Pascal Fua, Engin Türetken, Fethallah Benmansour

This document describes an ITK implementation of an interactive method for tracing curvilinear structures. The basic tools provided in this framework are an oriented flux-based tubularity measure and a geodesic path tracer that uses the fast marching algor ...

2013

Detecting the Unexpected via Image Resynthesis

Pascal Fua, Mathieu Salzmann, Krzysztof Maciej Lis, Krishna Kanth Nakka

Classical semantic segmentation methods, including the recent deep learning ones, assume that all classes observed at test time have been seen during training. In this paper, we tackle the more realistic scenario where unexpected objects of unknown classes ...

IEEE2019

Modeling Brain Circuitry over a Wide Range of Scales

Pascal Fua, Graham Knott

If we are ever to unravel the mysteries of brain function at its most fundamental level, we will need a precise understanding of how its component neurons connect to each other. Electron Microscopes (EM) can now provide the nanometer resolution that is nee ...

Frontiers Research Foundation2015

Reconstructing Evolving Tree Structures in Time Lapse Sequences

Pascal Fua, Engin Türetken, Raphael Sznitman, Przemyslaw Rafal Glowacki, Jan Kybic

We propose an approach to reconstructing tree structures that evolve over time in 2D images and 3D image stacks such as neuronal axons or plant branches. Instead of reconstructing structures in each image independently, we do so for all images simultaneous ...

2014

Self-supervised Segmentation via Background Inpainting

Pascal Fua, Mathieu Salzmann, Helge Jochen Rhodin, Isinsu Katircioglu, Victor Constantin

While supervised object detection and segmentation methods achieve impressive accuracy, they generalize poorly to images whose appearance significantly differs from the data they have been trained on. To address this when annotating data is prohibitively e ...

2022

Detecting Road Obstacles by Erasing Them

Pascal Fua, Mathieu Salzmann, Sina Honari, Krzysztof Maciej Lis

Vehicles can encounter a myriad of obstacles on the road, and it is impossible to record them all beforehand to train a detector. Instead, we select image patches and inpaint them with the surrounding road texture, which tends to remove obstacles from thos ...

2024

CLOAF: CoLlisiOn-Aware Human Flow

Pascal Fua, Martin Pierre Engilberge, Andrey Davydov

Even the best current algorithms for estimating body 3D shape and pose yield results that include body self- intersections. In this paper, we present CLOAF, which exploits the diffeomorphic nature of Ordinary Differential Equations to eliminate such self-i ...

IEEE2024

On Triangulation as a Form of Self-Supervision for 3D Human Pose Estimation

Pascal Fua, Sina Honari, Leonardo Citraro, Soumava Kumar Roy

Supervised approaches to 3D pose estimation from single images are remarkably effective when labeled data is abundant. However, as the acquisition of ground-truth 3D labels is labor intensive and time consuming, recent attention has shifted towards semi- a ...

IEEE2022

Detecting Flying Objects using a Single Moving Camera

Pascal Fua, Vincent Lepetit, Artem Rozantsev

We propose an approach for detecting flying objects such as Unmanned Aerial Vehicles (UAVs) and aircrafts when they occupy a small portion of the field of view, possibly moving against complex backgrounds, and are filmed by a camera that itself moves. We a ...

2017

Context-Aware Crowd Counting

Pascal Fua, Mathieu Salzmann, Weizhe Liu

State-of-the-art methods for counting people in crowded scenes rely on deep networks to estimate crowd density. They typically use the same filters over the whole image or over large image patches. Only then do they estimate local scale to compensate for p ...

IEEE/CVF2019

[DEMO] Tracking Texture-less, Shiny Objects with Descriptor Fields

Pascal Fua, Vincent Lepetit, Kwang Moo Yi, Alberto Crivellaro, Yannick Verdie

Our demo demonstrates the method we published at CVPR this year for tracking specular and poorly textured objects, and lets the visitors experiment with it and with their own patterns. Our approach only requires a standard monocular camera (no need for a d ...

2014

Eigendecomposition-free Training of Deep Networks with Zero Eigenvalue-based Losses

Pascal Fua, Mathieu Salzmann, Kwang Moo Yi, Yinlin Hu, Zheng Dang

Many classical Computer Vision problems, such as essential matrix computation and pose estimation from 3D to 2D correspondences, can be solved by ﬁnding the eigenvector corresponding to the smallest, or zero, eigenvalue of a matrix representing a linear sy ...

2018