Publications related to Online modeling for real-time facial animation

Related publications (32)

Test-time adaptation for 6D pose tracking

We propose a test -time adaptation for 6D object pose tracking that learns to adapt a pre -trained model to track the 6D pose of novel objects. We consider the problem of 6D object pose tracking as a 3D keypoint detection and matching task and present a mo ...

Elsevier Sci Ltd2024

Secure Interface Design Leveraging Hardware/Software Support

Atri Bhattacharyya

Computer systems rely heavily on abstraction to manage the exponential growth of complexity across hardware and software. Due to practical considerations of compatibility between components of these complex systems across generations, developers have favou ...

EPFL2024

From finger animation to full-body embodiment of avatars with different morphologies and proportions

Mathias Guy Delahaye

VR (Virtual Reality) is a real-time simulation that creates the subjective illusion of being in a virtual world. This thesis explores how integrating the user's body and fingers can be achieved and beneficial for the user to experience VR. At the advent of ...

EPFL2023

Real-time actuation of a dielectric elastomer actuator neuroprosthesis for facial paralysis

Yves Perriard, Yoan René Cyrille Civet, Thomas Guillaume Martinez, Stefania Maria Aliki Konstantinidi, Armando Matthieu Walter, Amine Benouhiba

Facial paralysis is a highly burdening condition, resulting in a patient's inability to move his mimic musculature on one or both sides of his face. This condition compromises the patient's communication and facial expressions, and thus dramatically reduce ...

2023

Real-time Self-contact Retargeting of Avatars down to Finger Level

Ronan Boulic, Bruno Herbelin, Mathias Guy Delahaye

We interact with the world through a body that includes hands and fingers. Likewise, providing an avatar allowing the control of a virtual body with fingers is an important step to improve the user experience in VR. When the user and their avatar skeleton ...

The Eurographics Association2023

lifex-ep: a robust and efficient software for cardiac electrophysiology simulations

Alfio Quarteroni, Francesco Regazzoni, Stefano Pagani

Background: Simulating the cardiac function requires the numerical solution of multi-physics and multi-scale mathematical models. This underscores the need for streamlined, accurate, and high-performance computational tools. Despite the dedicated endeavors ...

BMC2023

Adapting Haptic Feedback for Guided Meditation

Nicolas Henchoz, Cédric Duchene, Andreas Sonderegger, Emily Clare Groves, Romain Simon Collaud, Yoann Pierre Douillet

Technology supporting meditation is a multimillion-dollar market that continues to grow. There is also strong academic interest to understand and improve the impact technology can have for the user experience of practitioners. However, little work investig ...

2023

Rapid motion estimation and correction using self-encoded FID navigators in 3D radial MRI

Tobias Kober, Davide Piccini

Purpose: To develop a self-navigated motion compensation strategy for 3D radial MRI that can compensate for continuous head motion by measuring rigid body motion parameters with high temporal resolution from the central k-space acquisition point (self-enco ...

Wiley2023

SporTran: A code to estimate transport coefficients from the cepstral analysis of (multivariate) current time series

Loris Ercole

SporTran is a Python utility designed to estimate generic transport coefficients in extended systems, based on the Green-Kubo theory of linear response and the recently introduced cepstral analysis of the current time series generated by molecular dynamics ...

ELSEVIER2022

A Wearable Smart Glove and Its Application of Pose and Gesture Detection to Sign Language Classification

Josephine Anna Eleanor Hughes

Advances in soft sensors coupled with machine learning are enabling increasingly capable wearable systems. Since hand motion in particular can convey useful information for developing intuitive interfaces, glove-based systems can have a significant impact ...

Institute of Electrical and Electronics Engineers Inc.2022

Dynamic Personalized Ranking

Jérémie Rappaz

Personalized ranking methods are at the core of many systems that learn to produce recommendations from user feedbacks. Their primary objective is to identify relevant items from very large vocabularies and to assist users in discovering new content. These ...

EPFL2022

Matching Seqlets: An Unsupervised Approach for Locality Preserving Sequence Matching

Pascal Fua, Xinchao Wang

In this paper, we propose a novel unsupervised approach for sequence matching by explicitly accounting for the locality properties in the sequences. In contrast to conventional approaches that rely on frame-to-frame matching, we conduct matching using sequ ...

2021

Model-based 3D Face Reconstruction

Christophe René Joseph Ecabert

The human face plays an essential role in social interactions as it brings information about someone's identity, state of mind, or mood. People are, by nature, very good at catching this non-spoken information. Therefore, scientists have been interested in ...

EPFL2021

Preventing Breaks in Embodiment in Immersive Virtual Reality

Thibault Serge Mario Porssut

Virtual reality (VR) is immersive not only because of visual integration, but because we can act and perform in a virtual environment (VE). Beyond the mere fact that a VR system provides images computed directly from the users' viewpoint in stereoscopy, it ...

EPFL2021

Recommending Burgers based on Pizza Preferences: Addressing Data Sparsity with a Product of Experts

Martin Milenkoski, Diego Matteo Antognini, Claudiu-Cristian Musat

In this paper, we describe a method to tackle data sparsity and create recommendations in domains with limited knowledge about user preferences. We expand the variational autoencoder collaborative filtering from a single-domain to a multi-domain setting. T ...

2021

Neural Design Space Exploration

Pierre Dillenbourg, Richard Lee Davis, Kevin Gonyop Kim, Wei Jiang

We have developed a new tool that makes it possible for people with zero programming experience to intentionally and meaningfully explore the latent space of a GAN. This tool was developed to provide a means for designers to explore the "design space" of t ...

2021

How Florist Apprentices Explore Bouquet Designs: Supporting Design Space Exploration for Vocational Students

Pierre Dillenbourg, Kevin Gonyop Kim, Catharine Regina Monika Maria Oertel Genannt Bierbach

Context: Exploring the design space is an important process in a design task. In this study, we considered design space exploration for the learners in vocational education and training (VET). The goal of the study was to investigate how they explore the d ...

2021

Multi-Step Critiquing User Interface for Recommender Systems

Boi Faltings, Diego Matteo Antognini, Diana Andreea Petrescu

Recommendations with personalized explanations have been shown to increase user trust and perceived quality and help users make better decisions. Moreover, such explanations allow users to provide feedback by critiquing them. Several algorithms for recomme ...

ASSOC COMPUTING MACHINERY2021

Online Dating Quantification Practices: A Human-Machine Learning Process

Jessica Carolina Pidoux

The phenomenon of online dating via web and mobile phone applications involves several actors: graphical interfaces, developers, algorithmic systems for user matching, and users. These actors have been studied in parallel by the social sciences and by comp ...

EPFL2021

Towards Recognizing Emotion in the Latent Space

Emotion recognition is usually achieved by collecting features (physiological signals, events, facial expressions, etc.) to predict an emotional ground truth. This ground truth is arguably unreliable due to its subjective nature. In this paper, we introduc ...

IEEE2021