Publications associées à HeadFusion: 360 degrees Head Pose Tracking Combining 3D Morphable Model and 3D Reconstruction

Publications associées (29)

Diff3DHPE: A Diffusion Model for 3D Human Pose Estimation

Accurately estimating 3D human pose (3D HPE) and joint locations using only 2D keypoints is challenging. The noise in the predictions produced by conventional 2D human pose estimators often impeded the accuracy. In this paper, we present a diffusion-based ...

Ieee Computer Soc2023

Saliency prediction in 360° architectural scenes: Performance and impact of daylight variations

Marilyne Andersen, Sabine Süsstrunk, Caroline Karmann, Kynthia Chamilothori, Seungryong Kim, Bahar Aydemir

Saliency models are image-based prediction models that estimate human visual attention. Such models, when applied to architectural spaces, could pave the way for design decisions where visual attention is taken into account. In this study, we tested the pe ...

2023

3D reconstruction of curvilinear one-dimensional objects viewed in transmission electron microscopy

Gulnaz Ganeeva

To obtain a more complete understanding of material microstructure at the nanoscale and to gain profound insights into their properties, there is a growing need for more efficient and precise methods that can streamline the process of 3D imaging using a tr ...

EPFL2023

2.5 Hz sample rate time-domain near-infrared optical tomography based on SPAD-camera image tissue hemodynamics

Edoardo Charbon, Scott Anthony Lindner

Tim-domain near-infrared optical tomography (TD NIROT) techniques based on diffuse light were gaining performance over the last years. They are capable of imaging tissue at several centimeters depth and reveal clinically relevant information, such as tissu ...

OPTICAL SOC AMER2022

Digital twins for post-earthquake damage assessment of free-standing buildings including damage information

Katrin Beyer, Radhakrishna Achanta, Bryan German Pantoja Rosero, Amir Rezaie

We present a pipeline for the automatic generation of digital twins of free-standing buildings for damage assessment. Our method takes multiple view images of the target building as input and processes them to produce a 3D model in levels of detail (LOD) f ...

2022

LiftPose3D, a deep learning-based approach for transforming two-dimensional to three-dimensional poses in laboratory animals

Pascal Fua, Pavan P Ramdya, Helge Jochen Rhodin, Semih Günel, Victor Lobato Rios, Adám Gosztolai, Daniel Eduardo Morales Garza

LiftPose3D infers three-dimensional poses from two-dimensional data or from limited three-dimensional data. The approach is illustrated for videos of behaving Drosophila, mice, rats and macaques. ...

Nature Publishing Group2021

Accurate Nod and 3D Gaze Estimation for Social Interaction Analysis

Yu Yu

Non-verbal behaviours play an important role in human communication since it can indicate human attention, serve as communication cue in interactions, or even reveal higher level personal constructs. For instance, head nod, a common non-verbal behaviour, c ...

EPFL2020

Multi-View Triangulation: Systematic Comparison and an Improved Method

Peng Song

Triangulation is an important task in the 3D reconstruction of computer vision. It seems simple to find the position of a point in 3D space when its 2D perspective projections in multi-view images are given and the corresponding camera projection matrices ...

2020

Neural Scene Decomposition for Multi-Person Motion Capture

Pascal Fua, Mathieu Salzmann, Helge Jochen Rhodin, Isinsu Katircioglu, Victor Constantin

Learning general image representations has proven key to the success of many computer vision tasks. For example, many approaches to image understanding problems rely on deep networks that were initially trained on ImageNet, mostly because the learned featu ...

IEEE2019

Learning Robust Features and Latent Representations for Single View 3D Pose Estimation of Humans and Objects

Bugra Tekin

Estimating the 3D poses of rigid and articulated bodies is one of the fundamental problems of Computer Vision. It has a broad range of applications including augmented reality, surveillance, animation and human-computer interaction. Despite the ever-growin ...

EPFL2018

Learning-Based Compressive MRI

Volkan Cevher, Jonathan Mark Scarlett, Yen-Huan Li, Baran Gözcü, Rabeeh Karimi Mahabadi

In the area of magnetic resonance imaging (MRI), an extensive range of non-linear reconstruction algorithms have been proposed that can be used with general Fourier subsampling patterns. However, the design of these subsampling patterns has typically been ...

Institute of Electrical and Electronics Engineers2018

Learning to Reconstruct Texture-less Deformable Surfaces from a Single View

Pascal Fua, Mathieu Salzmann, Jan Bednarík

Recent years have seen the development of mature solutions for reconstructing deformable surfaces from a single image, provided that they are relatively well-textured. By contrast, recovering the 3D shape of texture-less surfaces remains an open problem, a ...

IEEE2018

3D Bpconvnet To Reconstruct Parallel Mri

Michaël Unser, Kyong Hwan Jin

In recent years, compressed sensing techniques have been applied to the reconstruction of parallel magnetic resonance (MR) images. Particularly for 3D MR signal, it is crucial to acquire fewer samples to reduce the distortions caused by long-time acquisiti ...

IEEE2018

Learning to Reconstruct Texture-less Deformable Surfaces from a Single View

Pascal Fua, Mathieu Salzmann, Jan Bednarík

Recent years have seen the development of mature solutions for reconstructing deformable surfaces from a single image, provided that they are relatively well-textured. By contrast, recovering the 3D shape of texture-less surfaces remains an open problem, a ...

2018

Flight Dynamics-based Recovery of a UAV Trajectory using Ground Cameras

Pascal Fua, Artem Rozantsev

We propose a new method to estimate the 6-dof trajectory of a flying object such as a quadrotor UAV within a 3D airspace monitored using multiple fixed ground cameras. It is based on a new structure from motion formulation for the 3D reconstruction of a si ...

Ieee2017

Physics-based Reconstruction and Animation of Humans

Alexandru Eugen Ichim

Creating digital representations of humans is of utmost importance for applications ranging from entertainment (video games, movies) to human-computer interaction and even psychiatrical treatments. What makes building credible digital doubles difficult is ...

EPFL2017

Electrical impedance tomography: Amplitudes of cardiac related impedance changes in the lung are highly position dependent

Michael Graf

Background Electrical impedance tomography (EIT) is used on the thorax to measure impedance changes due to the presence of air and blood in the lung. This experimental study was performed to investigate the effect of posture on cardiac and respiratory rela ...

Public Library of Science2017

Vision-Based Unmanned Aerial Vehicle Detection and Tracking for Sense and Avoid Systems

Krishna Raj Sapkota, Pascal Fua, Denis Gillet, Alcherio Martinoli, Vincent Lepetit, Steven Adriaan Roelofsen, Artem Rozantsev

We propose an approach for on-line detection of small Unmanned Aerial Vehicles (UAVs) and estimation of their relative positions and velocities in the 3D environment from a single moving camera in the context of sense and avoid systems. This problem is cha ...

Ieee2016

A Combined Approach Toward Consistent Reconstructions of Indoor Spaces Based on 6D RGB-D Odometry and KinectFusion

Nadia Barbara Figueroa Fernandez

We propose a 6D RGB-D odometry approach that finds the relative camera pose between consecutive RGB-D frames by keypoint extraction and feature matching both on the RGB and depth image planes. Furthermore, we feed the estimated pose to the highly accurate ...

Assoc Computing Machinery2015

Registration of single landscape photographs with 3D landscape models

Timothée Produit

Terrestrial imagery found in public databases is an alternative and complementary data source for environmental studies. Compared to usual data source, such as airborne images, terrestrial pictures may have higher temporal and spatial resolutions. They are ...

EPFL2015