Publications related to Full-body performance animation with Sequential Inverse Kinematics

From finger animation to full-body embodiment of avatars with different morphologies and proportions

VR (Virtual Reality) is a real-time simulation that creates the subjective illusion of being in a virtual world. This thesis explores how integrating the user's body and fingers can be achieved and beneficial for the user to experience VR. At the advent of ...

EPFL2023

Real-time Self-contact Retargeting of Avatars down to Finger Level

Ronan Boulic, Bruno Herbelin, Mathias Guy Delahaye

We interact with the world through a body that includes hands and fingers. Likewise, providing an avatar allowing the control of a virtual body with fingers is an important step to improve the user experience in VR. When the user and their avatar skeleton ...

The Eurographics Association2023

Seeing Photons in Color

Claudio Bruschini, Edoardo Charbon, Paul Mos, Mohit Gupta

Megapixel single-photon avalanche diode (SPAD) arrays have been developed recently, opening up the possibility of deploying SPADs as general-purpose passive cameras for photography and computer vision. However, most previous work on SPADs has been limited ...

ASSOC COMPUTING MACHINERY2023

Statistical Emulation of Neural Simulators: Application to Neocortical L2/3 Large Basket Cells

Idan Segev, Werner Alfons Hilda Van Geit, Oren Amsalem

Many scientific systems are studied using computer codes that simulate the phenomena of interest. Computer simulation enables scientists to study a broad range of possible conditions, generating large quantities of data at a faster rate than the laboratory ...

FRONTIERS MEDIA SA2022

XNect: Real-time Multi-Person 3D Motion Capture with a Single RGB Camera

Pascal Fua, Gerard Pons Moll, Helge Jochen Rhodin

We present a real-time approach for multi-person 3D motion capture at over 30 fps using a single RGB camera. It operates successfully in generic scenes which may contain occlusions by objects and by other people. Our method operates in subsequent stages. T ...

2020

Head motion measurement and correction using FID navigators

Tobias Kober, Maryna Volodimirivna Waszak

Purpose: To develop a novel framework for rapid, intrinsic head motion measurement in MRI using FID navigators (FIDnavs) from a multichannel head coil array. ...

WILEY2019

Reconciling Being in-Control vs. Being Helped for the Execution of Complex Movements in VR

Ronan Boulic, Bruno Herbelin, Thibault Serge Mario Porssut

Performing motor tasks in virtual environments is best achieved with motion capture and animation of a 3D character that participants control in real time and perceive as being their avatar in the virtual environment. A strong Sense of Embodiment (SoE) for ...

IEEE2019

No time for drifting: Comparing performance and applicability of signal detrending algorithms for real-time fMRI

Dimitri Nestor Alice Van De Ville, Frank Scharnowski, Yury Koush, Rotem Roza Kopel

As a consequence of recent technological advances in the field of functional magnetic resonance imaging (fMRI), results can now be made available in real-time. This allows for novel applications such as online quality assurance of the acquisition, intra-op ...

2019

The role of optic flow pooling in insect flight control in cluttered environments

Dario Floreano, Julien Jean Denis Nicolas Lecoeur, Emily Baird

Flight through cluttered environments, such as forests, poses great challenges for animals and machines alike because even small changes in flight path may lead to collisions with nearby obstacles. When flying along narrow corridors, insects use the magnit ...

Nature Research2019

Real-Time Generative Hand Modeling and Tracking

Anastasia Tkach

In our everyday life we interact with the surrounding environment using our hands. A main focus of recent research has been to bring such interaction to virtual objects, such as the ones projected in virtual reality devices, or super-imposed as holograms i ...

EPFL2018

Physics-based Reconstruction and Animation of Humans

Alexandru Eugen Ichim

Creating digital representations of humans is of utmost importance for applications ranging from entertainment (video games, movies) to human-computer interaction and even psychiatrical treatments. What makes building credible digital doubles difficult is ...

EPFL2017

Phace: Physics-based Face Modeling and Animation

Ladislav Kavan, Mark Pauly, Alexandru Eugen Ichim

We present a novel physics-based approach to facial animation. Contrary to commonly used generative methods, our solution computes facial expressions by minimizing a set of non-linear potential energies that model the physical interaction of passive flesh, ...

2017

Online Generative Model Personalization for Hand Tracking

Mark Pauly, Anastasia Tkach, Andrea Tagliasacchi, Edoardo Remelli

We present a new algorithm for real-time hand tracking on commodity depth-sensing devices. Our method does not require a user-specific calibration session, but rather learns the geometry as the user performs live in front of the camera, thus enabling seaml ...

Assoc Computing Machinery2017

Building and Animating User-Specific Volumetric Face Rigs

Ladislav Kavan, Mark Pauly, Alexandru Eugen Ichim, Merlin Eléazar Nimier-David

Currently, the two main approaches to realistic facial animation are 1) blendshape models and 2) physics-based simulation. Blendshapes are fast and directly controllable, but it is not easy to incorporate features such as dynamics, collision resolution, or ...

The Eurographics Association2016

Template-based Monocular 3-D Shape Reconstruction And Tracking Using Laplacian Meshes

Tien Dat Ngo

This thesis addresses the problem of recovering the 3-D shape of a deformable object in single images, or image sequences acquired by a monocular video camera, given that a 3-D template shape and a template image of the object are available. While being a ...

EPFL2016

Precise and Responsive Performance Animation for Embodied Immersive Interactions

Eray Molla

The recent advances in immersive display technologies offer a unique opportunity for providing intuitive interaction techniques easing the user involvement in the Virtual Environment. This trend underlines the great potential of Performance Animation espec ...

EPFL2016

Online modeling for real-time facial animation

Sofien Bouaziz, Mark Pauly

Embodiments relate to a method for real-time facial animation, and a processing device for real-time facial animation. The method includes providing a dynamic expression model, receiving tracking data corresponding to a facial expression of a user, estimat ...

2016

Realtime Face Tracking and Animation

Sofien Bouaziz

Capturing and processing human geometry, appearance, and motion is at the core of computer graphics, computer vision, and human-computer interaction. The high complexity of human geometry and motion dynamics, and the high sensitivity of the human visual sy ...

EPFL2015

Dynamic 3D Avatar Creation from Hand-held Video Input

Sofien Bouaziz, Mark Pauly, Alexandru Eugen Ichim

We present a complete pipeline for creating fully rigged, personalized 3D facial avatars from hand-held video. Our system faithfully recovers facial expression dynamics of the user by adapting a blendshape template to an image sequence of recorded expressi ...

Assoc Computing Machinery2015

Real-Time High-Resolution Multiple-Camera Depth Map Estimation Hardware and Its Applications

Abdulkadir Akin

Depth information is used in a variety of 3D based signal processing applications such as autonomous navigation of robots and driving systems, object detection and tracking, computer games, 3D television, and free view-point synthesis. These applications r ...

EPFL2015