Dynamic 3D Avatar Creation from Hand-held Video Input

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

VR (Virtual Reality) is a real-time simulation that creates the subjective illusion of being in a virtual world. This thesis explores how integrating the user's body and fingers can be achieved and beneficial for the user to experience VR. At the advent of ...

We interact with the world through a body that includes hands and fingers. Likewise, providing an avatar allowing the control of a virtual body with fingers is an important step to improve the user experience in VR. When the user and their avatar skeleton ...

In recent years, there has been a significant revolution in the field of deep learning, which has demonstrated its effectiveness in automatically capturing intricate patterns from large datasets. However, the majority of these successes in Computer Vision ...

Reading out neuronal activity from three-dimensional (3D) functional imaging requires segmenting and tracking individual neurons. This is challenging in behaving animals if the brain moves and deforms. The traditional approach is to train a convolutional n ...

Non-Rigid Structure-from-Motion (NRSfM) reconstructs a deformable 3D object from keypoint correspondences established between monocular 2D images. Current NRSfM methods lack statistical robustness, which is the ability to cope with correspondence errors. T ...

In this thesis, we advocate that Computer-Aided Engineering could benefit from a Geometric Deep Learning revolution, similarly to the way that Deep Learning revolutionized Computer Vision. To do so, we consider a variety of Computer-Aided Engineering pr ...

The potential of underground CO2 storage relies on the sealing efficiency of an overlaying caprock that acts as a geological barrier. Shales are considered as potential caprock formations thanks to their favourable hydro-mechanical properties. In this work ...

Physically-based rendering algorithms generate photorealistic images of virtual scenes. By simulating light paths in a scene, complex physical effects such as shadows, reflections and volumetric scattering can be reproduced. Over the last decade, physicall ...

We present an image-based pipeline for generating geometrical digital twins (GDTs) of stone masonry elements with detail down to the stone level. For this purpose, we acquire RGB images of the individual stones and of the wall during the construction phase ...

Reconstructing 3D shape from 2D sketches has long been an open problem because the sketches only provide very sparse and ambiguous information. In this paper, we use an encoder/decoder architecture for the sketch to mesh translation. When integrated into a ...

The research on ion-measuring devices has seen a rapid expansion in the last years as a consequence of the growing interest in wearable sensors for biofluids analysis and in portable devices for remote or in-line water and food quality monitoring. As a res ...

A computer-implemented method, computer program product and computer system (100) for editing a configuration of a physical entity (30) to configure a future operating mode of a physical entity. A GUI component (200) provides a visual representation of a t ...

Recent years have seen spectacular developments in the domain of nano-optics. Alongside the well-known techniques of super-resolution microscopy progress in nanofabrication has enabled important improvements in the fields of optical imaging and spectros ...

Performing motor tasks in virtual environments is best achieved with motion capture and animation of a 3D character that participants control in real time and perceive as being their avatar in the virtual environment. A strong Sense of Embodiment (SoE) for ...

Robotic teleoperation is fundamental to augment the resilience, precision, and force of robots with the cognition of the operator. However, current interfaces, such as joysticks and remote controllers, are often complicated to handle since they require cog ...

AIRSpec is a platform consisting of several chemometric packages developed for analysis of Fourier transform infrared (FTIR) spectra of atmospheric aerosols. The packages are accessible through a browser-based interface, which also generates the necessary ...

In this paper, we present a series of studies on using Rubik's Twist, a type of low-cost twistable artefact, to create haptic proxies for various hand-graspable VR objects. Our pilot studies validated the feasibility and effectiveness of Rubik's-Twist-base ...

Creating digital representations of humans is of utmost importance for applications ranging from entertainment (video games, movies) to human-computer interaction and even psychiatrical treatments. What makes building credible digital doubles difficult is ...

Photorealistic animation is a desirable technique for computer games and movie production. We propose a new method to synthesize plausible videos of human actors with new motions using a single cheap RGB-D camera. A small database is captured in a usual of ...

We present a novel physics-based approach to facial animation. Contrary to commonly used generative methods, our solution computes facial expressions by minimizing a set of non-linear potential energies that model the physical interaction of passive flesh, ...

Dynamic 3D Avatar Creation from Hand-held Video Input

Chat with Graph Search

From finger animation to full-body embodiment of avatars with different morphologies and proportions

Real-time Self-contact Retargeting of Avatars down to Finger Level

Deep Learning for 3D Surface Modelling and Reconstruction

Automated neuron tracking inside moving and deforming C. elegans using deep learning and targeted augmentation

Robust Isometric Non-Rigid Structure-From-Motion

Synthesis and Analysis of 3D shapes with Geometric Deep Learning in Computer-Aided Engineering

Evaluating CO2 breakthrough in a shaly a caprock material: a multi-scale experimental approach

Efficient and Accurate Physically-Based Differentiable Rendering

Image-based geometric digital twinning for stone masonry elements

Sketch2Mesh: Reconstructing and Editing 3D Shapes from Sketches

All-Solid-State Ion-Selective Electrodes: A Tutorial for Correct Practice

System and method for user data input to modify operating mode configurations

Physics of optically driven nanojunctions

Reconciling Being in-Control vs. Being Helped for the Execution of Complex Movements in VR

Wearable Technologies for Embodied Human-Robot Interaction

An open platform for Aerosol InfraRed Spectroscopy analysis - AIRSpec

HapTwist: Creating Interactive Haptic Proxies in Virtual Reality Using Low-cost Twistable Artefacts

Physics-based Reconstruction and Animation of Humans

SPA: Sparse Photorealistic Animation Using a Single RGB-D Camera

Phace: Physics-based Face Modeling and Animation