Publications related to A Variational Aggregation Framework for Patch-Based Optical Flow Estimation

Advancing Self-Supervised Deep Learning for 3D Scene Understanding

Recent advancements in deep learning have revolutionized 3D computer vision, enabling the extraction of intricate 3D information from 2D images and video sequences. This thesis explores the application of deep learning in three crucial challenges of 3D com ...

EPFL2024

Aggregating Spatial and Photometric Context for Photometric Stereo

David Honzátko

Photometric stereo, a computer vision technique for estimating the 3D shape of objects through images captured under varying illumination conditions, has been a topic of research for nearly four decades. In its general formulation, photometric stereo is an ...

EPFL2024

CLIP the Gap: A Single Domain Generalization Approach for Object Detection

Mathieu Salzmann, Martin Pierre Engilberge, Vidit Vidit

Single Domain Generalization (SDG) tackles the problem of training a model on a single source domain so that it generalizes to any unseen target domain. While this has been well studied for image classification, the literature on SDG object detection remai ...

Ieee Computer Soc2023

Burst Vision Using Single-Photon Cameras

Edoardo Charbon, Paul Mos, Mohit Gupta

Single-photon avalanche diodes (SPADs) are novel image sensors that record the arrival of individual photons at extremely high temporal resolution. In the past, they were only available as single pixels or small-format arrays, for various active imaging ap ...

IEEE COMPUTER SOC2023

Text as a Richer Source of Supervision in Semantic Segmentation Tasks

Devis Tuia, Valérie Zermatten, Lloyd Haydn Hughes, Javiera Francisca Castillo Navarro

This paper introduces TACOSS a text-image alignment approach that allows explainable land cover semantic segmentation by directly integrating semantic concepts encoded from texts. TACOSS combines convolutional neural networks for visual feature extraction ...

The Institute of Electrical and Electronics Engineers, Inc2023

Unsupervised Visual Entity Abstraction towards 2D and 3D Compositional Models

Beril Besbinar

Object-centric learning has gained significant attention over the last years as it can serve as a powerful tool to analyze complex scenes as a composition of simpler entities. Well-established tasks in computer vision, such as object detection or instance ...

EPFL2022

MultiMAE: Multi-modal Multi-task Masked Autoencoders

Amir Roshan Zamir, Roman Christian Bachmann, David Mizrahi, Andrei Atanov

We propose a pre-training strategy called Multi-modal Multi-task Masked Autoencoders (MultiMAE). It differs from standard Masked Autoencoding in two key aspects: I) it can optionally accept additional modalities of information in the input besides the RGB ...

SPRINGER INTERNATIONAL PUBLISHING AG2022

DepthInSpace: Exploitation and Fusion of Multiple Video Frames for Structured-Light Depth Estimation

François Fleuret, Camilla Carta

We present DepthInSpace, a self-supervised deep-learning method for depth estimation using a structured-light camera. The design of this method is motivated by the commercial use case of embedded depth sensors in nowadays smartphones. We first propose to u ...

IEEE2021

VIODE: A Simulated Dataset to Address the Challenges of Visual-Inertial Odometry in Dynamic Environments

Dario Floreano, Fabian Maximilian Schilling, Valentin Wüest, Koji Minoda

Dynamic environments such as urban areas are still challenging for popular visual-inertial odometry (VIO) algorithms. Existing datasets typically fail to capture the dynamic nature of these environments, therefore making it difficult to quantitatively eval ...

2021

MULLS: Versatile LiDAR SLAM via Multi-metric Linear Least Square

Yue Pan, Yujie He

The rapid development of autonomous driving and mobile mapping calls for off-the-shelf LiDAR SLAM solutions that are adaptive to LiDARs of different specifications on various complex scenarios. To this end, we propose MULLS, an efficient, low-drift, and ve ...

IEEE2021

STC-GAN: Spatio-Temporally Coupled Generative Adversarial Networks for Predictive Scene Parsing

Jie Luo, Yiyu Wang, Mengshi Qi

Predictive scene parsing is a task of assigning pixel-level semantic labels to a future frame of a video. It has many applications in vision-based artificial intelligent systems, e.g., autonomous driving and robot navigation. Although previous work has sho ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2020

Beyond Cameras: Real-Time High-Resolution 3D and Panoramic MultiView Vision Systems with Their Applications

Bilal Demir

The cameras are invented by imitating the human visual system to capture the scene. The camera technologies have been substantially advanced in recent years. 108 MP resolution with 100x hybrid zoom has become standard features for smartphone flagships. In ...

EPFL2020

Learning and leveraging shared domain semantics to counteract visual domain shifts

Róger Bermúdez Chacón

One of the main limitations of artificial intelligence today is its inability to adapt to unforeseen circumstances. Machine Learning (ML), due to its data-driven nature, is particularly susceptible to this. ML relies on observations in order to learn impli ...

EPFL2020

Variational Methods for Human Modeling

Timur Bagautdinov

A large part of computer vision research is devoted to building models and algorithms aimed at understanding human appearance and behaviour from images and videos. Ultimately, we want to build automated systems that are at least as capable as people when i ...

EPFL2018

Learning Robust Features and Latent Representations for Single View 3D Pose Estimation of Humans and Objects

Bugra Tekin

Estimating the 3D poses of rigid and articulated bodies is one of the fundamental problems of Computer Vision. It has a broad range of applications including augmented reality, surveillance, animation and human-computer interaction. Despite the ever-growin ...

EPFL2018

Mean-Field methods for Structured Deep-Learning in Computer Vision

Pierre Bruno Baqué

In recent years, Machine Learning based Computer Vision techniques made impressive progress. These algorithms proved particularly efficient for image classification or detection of isolated objects. From a probabilistic perspective, these methods can predi ...

EPFL2018

Large-Scale Image Segmentation with Convolutional Networks

Pedro Henrique Oliveira Pinheiro

Object recognition is one of the most important problems in computer vision. However, visual recognition poses many challenges when tried to be reproduced by artificial systems. A main challenge is the problem of variability: objects can appear across huge ...

EPFL2017

Spline Shape Processing : Representation, Learning, and Modeling

Daniel Andreas Schmitter

In this thesis, we present a novel generic and unifying framework for data-adaptive shape modeling. Our work is motivated by the raising need for powerful geometric modeling kernels that are required for shape characterization in biomedical imaging. The on ...

EPFL2017

Motion Vector Estimation of Textureless Objects Exploiting Reaction-Diffusion Cellular Automata

Alexandre Schmid, Kazuyoshi Ishimura

Conventional motion estimation algorithms extract motion vectors from image sequences based on the image's local-brightness differences in consecutive images. Therefore, motion vectors are extracted along the moving edges formed by moving objects over thei ...

Old City Publishing Inc2016

Learning to Match Aerial Images with Deep Attentive Architectures

Pascal Fua, Eduard Trulls Fortuny, Hani Altwaijry

Image matching is a fundamental problem in Computer Vision. In the context of feature-based matching, SIFT and its variants have long excelled in a wide array of applications. However, for ultra-wide baselines, as in the case of aerial images captured unde ...

2016