Publication

Using A Priori Knowledge to Improve Scene Understanding

Related publications (32)

MultiMAE: Multi-modal Multi-task Masked Autoencoders

Amir Roshan Zamir, Roman Christian Bachmann, David Mizrahi, Andrei Atanov

We propose a pre-training strategy called Multi-modal Multi-task Masked Autoencoders (MultiMAE). It differs from standard Masked Autoencoding in two key aspects: I) it can optionally accept additional modalities of information in the input besides the RGB ...

SPRINGER INTERNATIONAL PUBLISHING AG2022

Determining crack kinematics from imaged crack patterns

Katrin Beyer, Amir Rezaie, Bryan German Pantoja Rosero, Ketson Roberto Maximiano Dos Santos

Determining the relationship between the cause of damage and the subsequent structural behavior of infrastructure systems requires an accurate characterization of the propagation of cracks, which represents the evolution of the damage state. When no inform ...

2022

A Stepwise Domain Adaptive Segmentation Network With Covariate Shift Alleviation for Remote Sensing Imagery

Yunpeng Li, Yinlin Hu, Rui Song, Jingyu Li

Semantic segmentation for remote sensing images (RSI) is critical for the Earth monitoring system. However, the covariate shift between RSI datasets under different capture conditions cannot be alleviated by directly using the unsupervised domain adaptatio ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2022

Pedestrian Stop and Go Forecasting with Hybrid Feature Fusion

Alexandre Massoud Alahi, Taylor Ferdinand Mordan, Dongxu Guo

Forecasting pedestrians' future motions is essential for autonomous driving systems to safely navigate in urban areas. However, existing prediction algorithms often overly rely on past observed trajectories and tend to fail around abrupt dynamic changes, s ...

2022

Digital twins for post-earthquake damage assessment of free-standing buildings including damage information

Radhakrishna Achanta, Katrin Beyer, Amir Rezaie, Bryan German Pantoja Rosero

We present a pipeline for the automatic generation of digital twins of free-standing buildings for damage assessment. Our method takes multiple view images of the target building as input and processes them to produce a 3D model in levels of detail (LOD) f ...

2022

Long Term Motion Prediction Using Keyposes

Pascal Fua, Mathieu Salzmann, Sena Kiciroglu, Wei Wang

Long term human motion prediction is essential in safety-critical applications such as human-robot interaction and autonomous driving. In this paper we show that to achieve long term forecasting, predicting human pose at every time instant is unnecessary. ...

IEEE2022

Learning to Represent and Reconstruct 3D Deformable Objects

Jan Bednarík

Representing and reconstructing 3D deformable shapes are two tightly linked problems that have long been studied within the computer vision field. Deformable shapes are truly ubiquitous in the real world, whether be it specific object classes such as human ...

EPFL2022

PlaceNet: A multi-scale semantic-aware model for visual loop closure detection

Hussein Fadl Hassan Hassan Osman

Loop closure detection helps simultaneous localization and mapping systems reduce map and state uncertainty via recognizing previously visited places along the path of a mobile robot. However, visual loop closure detection is susceptible to scenes with dyn ...

PERGAMON-ELSEVIER SCIENCE LTD2022

Deploying an Instance Segmentation Algorithm to Implement Social Distancing for Prosthetic Vision

Silvestro Micera, Daniela De Luca

The COVID-19 pandemic outbreak is causing a dramatic worsening in the already complicated living conditions of blind and visually impaired individuals. Social distancing is the most effective strategy to limit virus spread, but is extremely difficult for b ...

IEEE2022

Unsupervised Visual Entity Abstraction towards 2D and 3D Compositional Models

Beril Besbinar

Object-centric learning has gained significant attention over the last years as it can serve as a powerful tool to analyze complex scenes as a composition of simpler entities. Well-established tasks in computer vision, such as object detection or instance ...

EPFL2022

The Vulnerability of Semantic Segmentation Networks to Adversarial Attacks in Autonomous Driving: Enhancing Extensive Environment Sensing

Peter Clemens Schlicht

Enabling autonomous driving (AD) can be considered one of the biggest challenges in today?s technology. AD is a complex task accomplished by several functionalities, with environment perception being one of its core functions. Environment perception is usu ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2021

MULLS: Versatile LiDAR SLAM via Multi-metric Linear Least Square

Yue Pan, Yujie He

The rapid development of autonomous driving and mobile mapping calls for off-the-shelf LiDAR SLAM solutions that are adaptive to LiDARs of different specifications on various complex scenarios. To this end, we propose MULLS, an efficient, low-drift, and ve ...

IEEE2021