Realtime Face Tracking and Animation

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

The digitization of 3D deformable objects remains a significant challenge in computer graphics and vision, particularly in the accurate modeling of garments. Garments exhibit complex shape variability, non-rigid deformations, and frequent self-occlusion, m ...

Photorealistic synthetic data and novel rendering techniques significantly advanced computer vision research. However, datasets focused on computer vision applications cannot be easily applied to robotics because they typically lack physics-related informa ...

Faithful human performance capture and free-view rendering from sparse RGB observations is a long-standing problem in Vision and Graphics. The main challenges are the lack of observations and the inherent ambiguities of the setting, e.g. occlusions and dep ...

Jointly estimating hand and object shape facilitates the grasping task in human-to-robot handovers. Relying on handcrafted prior knowledge about the geometric structure of the object fails when generalising to unseen objects, and depth sensors fail to dete ...

Recent advancements in deep learning have revolutionized 3D computer vision, enabling the extraction of intricate 3D information from 2D images and video sequences. This thesis explores the application of deep learning in three crucial challenges of 3D com ...

Photometric stereo, a computer vision technique for estimating the 3D shape of objects through images captured under varying illumination conditions, has been a topic of research for nearly four decades. In its general formulation, photometric stereo is an ...

In recent years, there has been a significant revolution in the field of deep learning, which has demonstrated its effectiveness in automatically capturing intricate patterns from large datasets. However, the majority of these successes in Computer Vision ...

We propose a semantic shape editing method to edit 3D triangle meshes using parametric implicit surface templates, benefiting from the many advantages offered by analytical implicit representations, such as infinite resolution and boolean or blending opera ...

VR (Virtual Reality) is a real-time simulation that creates the subjective illusion of being in a virtual world. This thesis explores how integrating the user's body and fingers can be achieved and beneficial for the user to experience VR. At the advent of ...

Silicate glasses have played a major role as structural and functional materials in human civilization since ancient Egypt. Despite their widespread use and importance in modern society, silica glasses with complex geometries are only fabricated in automat ...

We interact with the world through a body that includes hands and fingers. Likewise, providing an avatar allowing the control of a virtual body with fingers is an important step to improve the user experience in VR. When the user and their avatar skeleton ...

In this thesis we explore the applications of projective geometry, a mathematical theory of the relation between 3D scenes and their 2D images, in modern learning-based computer vision systems. This is an interesting research question which contradicts the ...

Current post-earthquake damage assessment methodologies are not only time-consuming but also subjective in nature and difficult to document. Recent advancements in artificial intelligence and technological devices make it possible to accomplish this task a ...

The optical domain presents potential avenues for enhancing both computing and communication due to its inherent properties of bandwidth, parallelism, and energy efficiency. This research focuses on harnessing 3-Dimensional (3D) diffractive optics for nove ...

Computing light reflection from rough surfaces is an important topic in computer graphics. Reflection models developed based on geometric optics fail to capture wave effects such as diffraction and interference, while existing models based on physical opti ...

Turning pass-through network architectures into iterative ones, which use their own output as input, is a well-known approach for boosting performance. In this paper, we argue that such architectures offer an additional benefit: The convergence rate of the ...

Objective. A key challenge of virtual reality (VR) applications is to maintain a reliable human-avatar mapping. Users may lose the sense of controlling (sense of agency), owning (sense of body ownership), or being located (sense of self-location) inside th ...

Neural decoding of the visual system is a subject of research interest, both to understand how the visual system works and to be able to use this knowledge in areas, such as computer vision or brain-computer interfaces. Spike-based decoding is often used, ...

Deep learning has revolutionized the field of computer vision, a success largely attributable to the growing size of models, datasets, and computational power. Simultaneously, a critical pain point arises as several computer vision applications are deploye ...

We propose a test -time adaptation for 6D object pose tracking that learns to adapt a pre -trained model to track the 6D pose of novel objects. We consider the problem of 6D object pose tracking as a 3D keypoint detection and matching task and present a mo ...

Realtime Face Tracking and Animation

Chat with Graph Search

Neural Garment Modeling

GRADE: Generating Realistic and Dynamic Environments for robotics research with Isaac Sim

MetaCap: Meta-learning Priors from Multi-view Imagery for Sparse-View Human Performance Capture and Rendering

Stereo Hand-Object Reconstruction for Human-to-Robot Handover

Advancing Self-Supervised Deep Learning for 3D Scene Understanding

Aggregating Spatial and Photometric Context for Photometric Stereo

Deep Learning for 3D Surface Modelling and Reconstruction

Semantic Shape Editing with Parametric Implicit Templates

From finger animation to full-body embodiment of avatars with different morphologies and proportions

Multimaterial Volumetric Printing of Silica-Based Glasses

Real-time Self-contact Retargeting of Avatars down to Finger Level

Incorporating Projective Geometry into Deep Learning

Automated post-earthquake damage assessment of stone masonry buildings integrating machine learning, computer vision, and physics-based modeling

3D diffractive optics for linear interconnects and nonlinear processing

A Full-Wave Reference Simulator for Computing Surface Reflectance

Enabling Uncertainty Estimation in Iterative Neural Networks

Customizing the human-avatar mapping based on EEG error related potentials during avatar-based interaction

Predicting Visual Stimuli From Cortical Response Recorded With Wide-Field Imaging in a Mouse

Fast and Future: Towards Efficient Forecasting in Video Semantic Segmentation

Test-time adaptation for 6D pose tracking