Publication

Real-time interactive modeling and scalable multiple object tracking for AR

Publications associées (29)

Test-time adaptation for 6D pose tracking

We propose a test -time adaptation for 6D object pose tracking that learns to adapt a pre -trained model to track the 6D pose of novel objects. We consider the problem of 6D object pose tracking as a 3D keypoint detection and matching task and present a mo ...

Elsevier Sci Ltd2024

TTool: A Supervised Artificial Intelligence-Assisted Visual Pose Detector for Tool Heads in Augmented Reality Woodworking

Yves Weinand, Julien Gamerro, Andrea Settimi, Florian Aymanns, Naravich Chutisilp

We present TimberTool (TTool v2.1.1), a software designed for woodworking tasks assisted by augmented reality (AR), emphasizing its essential function of the real-time localization of a tool head’s poses within camera frames. The localization process, a fu ...

2024

Aggregating Spatial and Photometric Context for Photometric Stereo

David Honzátko

Photometric stereo, a computer vision technique for estimating the 3D shape of objects through images captured under varying illumination conditions, has been a topic of research for nearly four decades. In its general formulation, photometric stereo is an ...

EPFL2024

Match Normalization: Learning-Based Point Cloud Registration for 6D Object Pose Estimation in the Real World

Mathieu Salzmann, Zheng Dang

In this work, we tackle the task of estimating the 6D pose of an object from point cloud data. While recent learning-based approaches have shown remarkable success on synthetic datasets, we have observed them to fail in the presence of real-world data. We ...

Ieee Computer Soc2024

3D diffractive optics for linear interconnects and nonlinear processing

Niyazi Ulas Dinç

The optical domain presents potential avenues for enhancing both computing and communication due to its inherent properties of bandwidth, parallelism, and energy efficiency. This research focuses on harnessing 3-Dimensional (3D) diffractive optics for nove ...

EPFL2024

Semantic Shape Editing with Parametric Implicit Templates

Uday Kusupati

We propose a semantic shape editing method to edit 3D triangle meshes using parametric implicit surface templates, benefiting from the many advantages offered by analytical implicit representations, such as infinite resolution and boolean or blending opera ...

ACM Association for Computing Machinery2024

Advancing Self-Supervised Deep Learning for 3D Scene Understanding

Seyed Mohammad Mahdi Johari

Recent advancements in deep learning have revolutionized 3D computer vision, enabling the extraction of intricate 3D information from 2D images and video sequences. This thesis explores the application of deep learning in three crucial challenges of 3D com ...

EPFL2024

High-Resolution Modeling Without Computation Slowdown for PETALE in CROCUS

Andreas Pautz, Vincent Pierre Lamirand, Thomas Jean-François Ligonnet, Axel Guy Marie Laureau

In a collaboration between Ecole Polytechnique Fédérale de Lausanne (EPFL) and CEA, in the fall of 2020, the experimental Programme d’Étude en Transmission de l’Acier Lourd et ses Eléments (PETALE) was successfully carried out in the CROCUS reactor of EPFL ...

2024

Additively manufactured stretchable zipping electrostatic actuators

Giulio Grasso

The use of soft and stretchable materials allows the development of adaptive robotic systems and human-machine interfaces that are more natural and comfortable to interact with. One of the application fields that benefits the most from these compliant mate ...

EPFL2024

Formal Foundations of Capture Tracking

Aleksander Slawomir Boruch-Gruszecki

Type systems are a device for verifying properties of programs without running them. Many programming languages used in the industry have always had a type system, while others were initially created without a type system and later adopted one, when the ad ...

EPFL2024

Customizing the human-avatar mapping based on EEG error related potentials during avatar-based interaction

Ronan Boulic, Ricardo Andres Chavarriaga Lozano, Bruno Herbelin, José del Rocio Millán Ruiz, Olaf Blanke, Fumiaki Iwane, Thibault Serge Mario Porssut

Objective. A key challenge of virtual reality (VR) applications is to maintain a reliable human-avatar mapping. Users may lose the sense of controlling (sense of agency), owning (sense of body ownership), or being located (sense of self-location) inside th ...

2024

Deep Learning for 3D Surface Modelling and Reconstruction

Benoît Alain René Guillard

In recent years, there has been a significant revolution in the field of deep learning, which has demonstrated its effectiveness in automatically capturing intricate patterns from large datasets. However, the majority of these successes in Computer Vision ...

EPFL2023

Automated post-earthquake damage assessment of stone masonry buildings integrating machine learning, computer vision, and physics-based modeling

Bryan German Pantoja Rosero

Current post-earthquake damage assessment methodologies are not only time-consuming but also subjective in nature and difficult to document. Recent advancements in artificial intelligence and technological devices make it possible to accomplish this task a ...

EPFL2023

Projector-based augmented stacking framework for irregularly shaped objects

Yves Weinand, Katrin Beyer, Julien Gamerro, Andrea Settimi, Qianqing Wang, Edward Carlo Giorgio Andò

Augmented reality in additive fabrication is predominantly applied to the manufacturing of structures from regularly shaped materials. Our work however embraces natural heterogeneity, by focusing on the assembly of irregularly shaped elements such as miner ...

2023

Machine-Learning-Enhanced Procedural Modeling for 4D Historical Cities Reconstruction

Frédéric Kaplan, Isabella Di Lenardo, Rémi Guillaume Petitpierre, Beatrice Vaienti

The generation of 3D models depicting cities in the past holds great potential for documentation and educational purposes. However, it is often hindered by incomplete historical data and the specialized expertise required. To address these challenges, we p ...

2023

From finger animation to full-body embodiment of avatars with different morphologies and proportions

Mathias Guy Delahaye

VR (Virtual Reality) is a real-time simulation that creates the subjective illusion of being in a virtual world. This thesis explores how integrating the user's body and fingers can be achieved and beneficial for the user to experience VR. At the advent of ...

EPFL2023

Automated neuron tracking inside moving and deforming C. elegans using deep learning and targeted augmentation

Sahand Jamal Rahi, Kseniia Korchagina

Reading out neuronal activity from three-dimensional (3D) functional imaging requires segmenting and tracking individual neurons. This is challenging in behaving animals if the brain moves and deforms. The traditional approach is to train a convolutional n ...

Nature Portfolio2023

The Metaverse as a Virtual Model of Platform Urbanism: Its Converging AIoT, XReality, Neurotech, and Nanobiotech and Their Applications, Challenges, and Risks

Simon Elias Bibri

With their exponentially rising computational power, digital platforms are heralding a new era of hybrid intelligence. There has recently been much enthusiasm and hype that the Metaverse has the potential to unlock hybrid intelligence. This is premised on ...

MDPI2023

3D reconstruction of curvilinear one-dimensional objects viewed in transmission electron microscopy

Gulnaz Ganeeva

To obtain a more complete understanding of material microstructure at the nanoscale and to gain profound insights into their properties, there is a growing need for more efficient and precise methods that can streamline the process of 3D imaging using a tr ...

EPFL2023

ISP: Multi-Layered Garment Draping with Implicit Sewing Patterns

Pascal Fua, Benoît Alain René Guillard, Ren Li

Many approaches to draping individual garments on human body models are realistic, fast, and yield outputs that are differentiable with respect to the body shape on which they are draped. However, they are either unable to handle multi-layered clothing, wh ...

2023