Publications associées à Real-time Self-contact Retargeting of Avatars down to Finger Level

From finger animation to full-body embodiment of avatars with different morphologies and proportions

VR (Virtual Reality) is a real-time simulation that creates the subjective illusion of being in a virtual world. This thesis explores how integrating the user's body and fingers can be achieved and beneficial for the user to experience VR. At the advent of ...

EPFL2023

Agency Deficits in a Human Genetic Model of Schizophrenia: Insights From 22q11DS Patients

Olaf Blanke, Oliver Alan Kannape, Mariia Kaliuzhna, Roy Salomon, Maude Schneider, Henrique Galvan Debarba, Nathan Quentin Faivre

Schizophrenia is a chronic and disabling mental illness characterized by a disordered sense of self. Current theories suggest that deficiencies in the sense of control over one’s actions (Sense of Agency, SoA) may underlie some of the symptoms of schizophr ...

2022

Preventing Breaks in Embodiment in Immersive Virtual Reality

Thibault Serge Mario Porssut

Virtual reality (VR) is immersive not only because of visual integration, but because we can act and perform in a virtual environment (VE). Beyond the mere fact that a VR system provides images computed directly from the users' viewpoint in stereoscopy, it ...

EPFL2021

Drift-Free Foot Orientation Estimation in Running Using Wearable IMU

Kamiar Aminian, Frédéric Meyer, Benoît Mariani, Grégoire Millet, Mathieu Pascal Falbriard

This study aimed to introduce and validate a new method to estimate and correct the orientation drift measured from foot-worn inertial sensors. A modified strap-down integration (MSDI) was proposed to decrease the orientation drift, which, in turn, was fur ...

2020

Does scaling player size skew one’s ability to correctly evaluate object sizes in a virtual environment?

Ronan Boulic, Bruno Herbelin, Mathias Guy Delahaye

This paper presents the results of a study performed in order to evaluate whether a navigation technique, based on scaling the user’s avatar, impacts the user’s ability to correctly assess the size of virtual objects in a virtual environment. This study wa ...

Association for Computing Machinery2020

Reconciling Being in-Control vs. Being Helped for the Execution of Complex Movements in VR

Ronan Boulic, Bruno Herbelin, Thibault Serge Mario Porssut

Performing motor tasks in virtual environments is best achieved with motion capture and animation of a 3D character that participants control in real time and perceive as being their avatar in the virtual environment. A strong Sense of Embodiment (SoE) for ...

IEEE2019

Compression and visual quality assessment for light field contents

Irene Viola

Since its invention in the 19th century, photography has allowed to create durable images of the world around us by capturing the intensity of light that flows through a scene, first analogically by using light-sensitive material, and then, with the advent ...

EPFL2019

Context-based Quality of Experience in Immersive Multimedia

Anne-Flore Nicole Marie Perrin

Since 1895, when the Lumière brothers came out with the projected cinematograph, motion pictures and more generally multimedia contents have considerably improved and are still experiencing a very dynamic development. Advances involved improving various mo ...

EPFL2019

Subjective Evaluation of 360-degree Sensory Experiences

Pascal Frossard, Roberto Gerson De Albuquerque Azevedo

Traditionally, most multimedia content has been developed to stimulate two of the human senses, i.e., sight and hearing. Due to recent technological advancements, however, innovative services have been developed that provide more realistic, immersive, and ...

IEEE2019

MAMUT: Multi-Agent Reinforcement Learning for Efficient Real-Time Multi-User Video Transcoding

David Atienza Alonso, Marina Zapater Sancho, Arman Iranfar, Luis Maria Costero Valero

Real-time video transcoding has recently raised as a valid alternative to address the ever-increasing demand for video contents in servers' infrastructures in current multi-user environments. High Efficiency Video Coding (HEVC) makes efficient online trans ...

IEEE2019

The Critical Role of Self-Contact for Embodiment in Virtual Reality

Ronan Boulic, Bruno Herbelin, Eray Molla, Sidney Bovet, Henrique Galvan Debarba

With the broad range of motion capture devices available on the market, it is now commonplace to directly control the limb movement of an avatar during immersion in a virtual environment. Here, we study how the subjective experience of embodying a full-bod ...

2018

Real-Time Generative Hand Modeling and Tracking

Anastasia Tkach

In our everyday life we interact with the surrounding environment using our hands. A main focus of recent research has been to bring such interaction to virtual objects, such as the ones projected in virtual reality devices, or super-imposed as holograms i ...

EPFL2018

A novel methodology for quality assessment of voxelized point clouds

Touradj Ebrahimi, Evangelos Alexiou

Recent trends in multimedia technologies indicate a significant growth of interest for new imaging modalities that aim to provide immersive experiences by increasing the engagement of the user with the content. Among other solutions, point clouds denote an ...

SPIE-INT SOC OPTICAL ENGINEERING2018

FlyJacket: An Upper Body Soft Exoskeleton for Immersive Drone Control

Dario Floreano, David Atienza Alonso, Carine Rognon, Alexandre Thierry Cherpillod, Fabio Isidoro Tiberio Dell'Agnola, Stefano Mintchev

Most human–drone interfaces, such as joysticks and remote controllers, require attention and developed skills during teleoperation. Wearable interfaces could enable a more natural and intuitive control of drones, which would make this technology accessible ...

2018

Physics-based Reconstruction and Animation of Humans

Alexandru Eugen Ichim

Creating digital representations of humans is of utmost importance for applications ranging from entertainment (video games, movies) to human-computer interaction and even psychiatrical treatments. What makes building credible digital doubles difficult is ...

EPFL2017

Online Generative Model Personalization for Hand Tracking

Mark Pauly, Anastasia Tkach, Andrea Tagliasacchi, Edoardo Remelli

We present a new algorithm for real-time hand tracking on commodity depth-sensing devices. Our method does not require a user-specific calibration session, but rather learns the geometry as the user performs live in front of the camera, thus enabling seaml ...

Assoc Computing Machinery2017

Phace: Physics-based Face Modeling and Animation

Ladislav Kavan, Mark Pauly, Alexandru Eugen Ichim

We present a novel physics-based approach to facial animation. Contrary to commonly used generative methods, our solution computes facial expressions by minimizing a set of non-linear potential energies that model the physical interaction of passive flesh, ...

2017

Prospective head motion correction using FID-guided on-demand image navigators

Reto Meuli, Rolf Gruetter, Bénédicte Marie Maréchal, Guillaume Bonnier, Gunnar Krüger, Tobias Kober, Tom Hilbert, Maryna Volodimirivna Waszak, Pavel Falkovskiy

PURPOSE: We suggest a motion correction concept that employs free-induction-decay (FID) navigator signals to continuously monitor motion and to guide the acquisition of image navigators for prospective motion correction following motion detection. METHODS: ...

Wiley-Blackwell2017

SPA: Sparse Photorealistic Animation Using a Single RGB-D Camera

Ronan Boulic, Eray Molla, Jingyu Yang, Kun Li

Photorealistic animation is a desirable technique for computer games and movie production. We propose a new method to synthesize plausible videos of human actors with new motions using a single cheap RGB-D camera. A small database is captured in a usual of ...

Ieee-Inst Electrical Electronics Engineers Inc2017

Virtual Zero Gravity Impact on Internal Gravity Model

Ronan Boulic, Bruno Herbelin, Elisa Canzoneri

This project investigates the impact of a virtual zero gravity experience on the human gravity model. In the planned experiment, subjects are immersed with HMD and full body motion capture in a virtual world exhibiting either normal gravity or the apparent ...

Ieee Computer Soc2017