Publications related to Robust Articulated-ICP for Real-Time Hand Tracking

Test-time adaptation for 6D pose tracking

We propose a test -time adaptation for 6D object pose tracking that learns to adapt a pre -trained model to track the 6D pose of novel objects. We consider the problem of 6D object pose tracking as a 3D keypoint detection and matching task and present a mo ...

Elsevier Sci Ltd2024

Aggregating Spatial and Photometric Context for Photometric Stereo

David Honzátko

Photometric stereo, a computer vision technique for estimating the 3D shape of objects through images captured under varying illumination conditions, has been a topic of research for nearly four decades. In its general formulation, photometric stereo is an ...

EPFL2024

Ex uno plures: how to construct high-speed movies of collapsing cavitation bubbles from a single image

Mohamed Farhat, Armand Baptiste Sieber, Davide Bernardo Preso

The time-resolved visualization of the dynamics of a cavitation bubble usually requires the use of expensive high-speed cameras, which often provide a limited spatial resolution. In the present study, we propose an alternative to these high-speed imaging t ...

Springer2023

Towards learning-based denoising of light fields

Touradj Ebrahimi, Michela Testolina, Tomás Soares De Carvalho Feith

In recent years, new emerging immersive imaging modalities, e.g. light fields, have been receiving growing attention, becoming increasingly widespread over the years. Light fields are often captured through multi-camera arrays or plenoptic cameras, with th ...

2023

From finger animation to full-body embodiment of avatars with different morphologies and proportions

Mathias Guy Delahaye

VR (Virtual Reality) is a real-time simulation that creates the subjective illusion of being in a virtual world. This thesis explores how integrating the user's body and fingers can be achieved and beneficial for the user to experience VR. At the advent of ...

EPFL2023

Real-Time Localization for Closed-Loop Control of Assistive Furniture

Auke Ijspeert, Alexandre Massoud Alahi, George Adaimi, Chuanfang Ning, Lixuan Tang, Anastasia Bolotnikova

For people with limited mobility, navigating in cluttered indoor environment is challenging. In this work, we propose a mobile assistive furniture suite that is designed to ease the life of people with special needs in indoor movement. To enable intelligen ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2023

Diff3DHPE: A Diffusion Model for 3D Human Pose Estimation

Tong Zhang

Accurately estimating 3D human pose (3D HPE) and joint locations using only 2D keypoints is challenging. The noise in the predictions produced by conventional 2D human pose estimators often impeded the accuracy. In this paper, we present a diffusion-based ...

Ieee Computer Soc2023

Robust Isometric Non-Rigid Structure-From-Motion

Shaifali Parashar

Non-Rigid Structure-from-Motion (NRSfM) reconstructs a deformable 3D object from keypoint correspondences established between monocular 2D images. Current NRSfM methods lack statistical robustness, which is the ability to cope with correspondence errors. T ...

IEEE COMPUTER SOC2022

On the benefit of concurrent adjustment of active and passive optical sensors with GNSS & raw inertial data

Jan Skaloud, Davide Antonio Cucci, Kyriaki Mouzakidou

In airborne laser scanning a high-frequency trajectory solution is typically determined from inertial sensors and employed to directly geo-reference the acquired laser points. When low-cost MEMS inertial sensors are used, such as in lightweight unmanned ae ...

2022

Using Animal Motion Capture to Learn Neural Representations

Semih Günel

Understanding behavior from neural activity is a fundamental goal in neuroscience. It has practical applications in building robust brain-machine interfaces, human-computer interaction, and assisting patients with neurological disabilities. Despite the eve ...

EPFL2022

LiftPose3D, a deep learning-based approach for transforming two-dimensional to three-dimensional poses in laboratory animals

Pascal Fua, Pavan P Ramdya, Helge Jochen Rhodin, Semih Günel, Victor Lobato Rios, Daniel Eduardo Morales Garza, Marco Pietro Abrate, Adám Gosztolai

LiftPose3D infers three-dimensional poses from two-dimensional data or from limited three-dimensional data. The approach is illustrated for videos of behaving Drosophila, mice, rats and macaques. ...

NATURE PORTFOLIO2021

Tracking and Relative Localization of Drone Swarms With a Vision-Based Headset

Dario Floreano, Giuseppe Loianno, Maxim Pavliv, Fabrizio Schiano

We address the detection, tracking, and relative localization of the agents of a drone swarm from a human perspective using a headset equipped with a single camera and an Inertial Measurement Unit (IMU). We train and deploy a deep neural network detector o ...

2021

Model-based 3D Face Reconstruction

Christophe René Joseph Ecabert

The human face plays an essential role in social interactions as it brings information about someone's identity, state of mind, or mood. People are, by nature, very good at catching this non-spoken information. Therefore, scientists have been interested in ...

EPFL2021

Perceiving Humans: from Monocular 3D Localization to Social Distancing

Alexandre Massoud Alahi, Sven Kreiss, Lorenzo Bertoni

Perceiving humans in the context of Intelligent Transportation Systems (ITS) often relies on multiple cameras or expensive LiDAR sensors. In this work, we present a new cost-effective vision-based method that perceives humans' locations in 3D and their bod ...

IEEE Institute of Electrical and Electronics Engineers2022

AcinoSet: A 3D Pose Estimation Dataset and Baseline Models for Cheetahs in the Wild

Mackenzie Mathis, Alexander Mathis

Animals are capable of extreme agility, yet understanding their complex dynamics, which have ecological, biomechanical and evolutionary implications, remains challenging. Being able to study this incredible agility will be critical for the development of n ...

IEEE2021

Learning stereo reconstruction with deep neural networks

Stepan Tulyakov

Stereo reconstruction is a problem of recovering a 3d structure of a scene from a pair of images of the scene, acquired from different viewpoints. It has been investigated for decades and many successful methods were developed. The main drawback of these ...

EPFL2020

Beyond Cameras: Real-Time High-Resolution 3D and Panoramic MultiView Vision Systems with Their Applications

Bilal Demir

The cameras are invented by imitating the human visual system to capture the scene. The camera technologies have been substantially advanced in recent years. 108 MP resolution with 100x hybrid zoom has become standard features for smartphone flagships. In ...

EPFL2020

Graph-based regularization of inverse problems in imaging

Mattia Rossi

As of today, the extension of the human visual capabilities to machines remains both a cornerstone and an open challenge in the attempt to develop intelligent systems. On the one hand, the development of more and more sophisticated imaging devices, capable ...

EPFL2020

Real-time camera pose estimation for sports fields

Pascal Fua, Charles Dubout, Horesh Beny Ben Shitrit, Pablo Marquez Neila, Stefano Savarè, Leonardo Citraro

Given an image sequence featuring a portion of a sports field filmed by a moving and uncalibrated camera, such as the one of the smartphones, our goal is to compute automatically in real time the focal length and extrinsic camera parameters for each image ...

2020

Camera Calibration Models and Methods for Corridor Mapping with UAVs

Jan Skaloud, Davide Antonio Cucci, Emmanuel Pierre Quentin Clédat

Camera calibration refers to the modeling of the relationship between the coordinates of object points and their projections on the image plane. This is usually done by parametric models that describe the physical properties of the lens systems and camera ...

2020