Publications associées à Semantic parametric body shape estimation from noisy depth sequences

Test-time adaptation for 6D pose tracking

We propose a test -time adaptation for 6D object pose tracking that learns to adapt a pre -trained model to track the 6D pose of novel objects. We consider the problem of 6D object pose tracking as a 3D keypoint detection and matching task and present a mo ...

Elsevier Sci Ltd2024

From finger animation to full-body embodiment of avatars with different morphologies and proportions

Mathias Guy Delahaye

VR (Virtual Reality) is a real-time simulation that creates the subjective illusion of being in a virtual world. This thesis explores how integrating the user's body and fingers can be achieved and beneficial for the user to experience VR. At the advent of ...

EPFL2023

AN UNSUPERVISED METHOD FOR THE DETECTION OF AND TRACKING OF TARGETS IN SPOTLIGHT MODE SAR IMAGES

Lloyd Haydn Hughes

Taking advantage of Capella's ability to dwell on a target for an extended period of time (nominally 30s) in its spotlight (SP) mode, an unsupervised methodology for detecting moving targets in this data is presented in this paper. By colourizing short seg ...

IEEE2023

A Wearable Smart Glove and Its Application of Pose and Gesture Detection to Sign Language Classification

Josephine Anna Eleanor Hughes

Advances in soft sensors coupled with machine learning are enabling increasingly capable wearable systems. Since hand motion in particular can convey useful information for developing intuitive interfaces, glove-based systems can have a significant impact ...

Institute of Electrical and Electronics Engineers Inc.2022

Using Animal Motion Capture to Learn Neural Representations

Semih Günel

Understanding behavior from neural activity is a fundamental goal in neuroscience. It has practical applications in building robust brain-machine interfaces, human-computer interaction, and assisting patients with neurological disabilities. Despite the eve ...

EPFL2022

Temporal Representation Learning on Monocular Videos for 3D Human Pose Estimation

Pascal Fua, Mathieu Salzmann, Victor Constantin, Helge Jochen Rhodin, Sina Honari

In this paper we propose an unsupervised feature extraction method to capture temporal information on monocular videos, where we detect and encode subject of interest in each frame and leverage contrastive self-supervised (CSS) learning to extract rich lat ...

2022

Encoder-Decoder Models for Human Segmentation and Motion Analysis

Isinsu Katircioglu

Detecting people from 2D images and analyzing their motion in 3D have been long standing computer vision problems central to numerous applications such as autonomous driving and athletic training. Recently, with the availability of large amounts of trainin ...

EPFL2022

An analysis of the impacts of green mobility strategies and technologies on different European energy system

François Maréchal, Tuong-Van Nguyen, Jonas Schnidrig

A successful decarbonization of the European Union, coupled with a high integration of renewable energy and ambitious targets for energy efficiency, can only be reached with a significant contribution from transport. This sector currently represents a quar ...

2021

Preventing Breaks in Embodiment in Immersive Virtual Reality

Thibault Serge Mario Porssut

Virtual reality (VR) is immersive not only because of visual integration, but because we can act and perform in a virtual environment (VE). Beyond the mere fact that a VR system provides images computed directly from the users' viewpoint in stereoscopy, it ...

EPFL2021

Tracking and Relative Localization of Drone Swarms With a Vision-Based Headset

Dario Floreano, Giuseppe Loianno, Maxim Pavliv, Fabrizio Schiano

We address the detection, tracking, and relative localization of the agents of a drone swarm from a human perspective using a headset equipped with a single camera and an Inertial Measurement Unit (IMU). We train and deploy a deep neural network detector o ...

2021

Accurate Nod and 3D Gaze Estimation for Social Interaction Analysis

Yu Yu

Non-verbal behaviours play an important role in human communication since it can indicate human attention, serve as communication cue in interactions, or even reveal higher level personal constructs. For instance, head nod, a common non-verbal behaviour, c ...

EPFL2020

Hough Forest With Optimized Leaves for Global Hand Pose Estimation With Arbitrary Postures

Daniel Thalmann, Hui Liang, Jun Lee

Vision-based hand pose estimation is important in human-computer interaction. While many recent works focus on full degree-of-freedom hand pose estimation, robust estimation of global hand pose remains a challenging problem. This paper presents a novel alg ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2019

Real-Time 3D Hand Pose Estimation with 3D Convolutional Neural Networks

Daniel Thalmann, Hui Liang

In this paper, we present a novel method for real-time 3D hand pose estimation from single depth images using 3D Convolutional Neural Networks (CNNs). Image-based features extracted by 2D CNNs are not directly suitable for 3D hand pose estimation due to th ...

IEEE COMPUTER SOC2019

Training Algorithms for Multiple Object Tracking

Andrii Maksai

Multiple object tracking is a crucial Computer Vision Task. It aims at locating objects of interest in the image sequences, maintaining their identities, and identifying their trajectories over time. A large portion of current research focuses on tracking ...

EPFL2019

Evaluating and Interpreting Deep Convolutional Neural Networks via Non-negative Matrix Factorization

Edo Collins

With ever greater computational resources and more accessible software, deep neural networks have become ubiquitous across industry and academia. Their remarkable ability to generalize to new samples defies the conventional view, which holds that complex, ...

EPFL2019

Learning Robust Features and Latent Representations for Single View 3D Pose Estimation of Humans and Objects

Bugra Tekin

Estimating the 3D poses of rigid and articulated bodies is one of the fundamental problems of Computer Vision. It has a broad range of applications including augmented reality, surveillance, animation and human-computer interaction. Despite the ever-growin ...

EPFL2018

Real-Time Generative Hand Modeling and Tracking

Anastasia Tkach

In our everyday life we interact with the surrounding environment using our hands. A main focus of recent research has been to bring such interaction to virtual objects, such as the ones projected in virtual reality devices, or super-imposed as holograms i ...

EPFL2018

Learning Monocular 3D Human Pose Estimation from Multi-view Images

Pascal Fua, Mathieu Salzmann, Frédéric Meyer, Victor Constantin, Isinsu Katircioglu, Helge Jochen Rhodin

Accurate 3D human pose estimation from single images is possible with sophisticated deep-net architectures that have been trained on very large datasets. However, this still leaves open the problem of capturing motions for which no such database exists. Ma ...

IEEE2018

Physics-based Reconstruction and Animation of Humans

Alexandru Eugen Ichim

Creating digital representations of humans is of utmost importance for applications ranging from entertainment (video games, movies) to human-computer interaction and even psychiatrical treatments. What makes building credible digital doubles difficult is ...

EPFL2017

Measuring upper limb function in children with hemiparesis with 3D inertial sensors

Kamiar Aminian, Cyntia Duc, Farzin Dadashi, Fabien Massé

Upper limb assessments in children with hemiparesis rely on clinical measurements, which despite standardization are prone to error. Recently, 3D movement analysis using optoelectronic setups has been used to measure upper limb movement, but generalization ...

Springer Verlag2017