Publications associées à Multiple 3D Object Tracking for Augmented Reality

Match Normalization: Learning-Based Point Cloud Registration for 6D Object Pose Estimation in the Real World

In this work, we tackle the task of estimating the 6D pose of an object from point cloud data. While recent learning-based approaches have shown remarkable success on synthetic datasets, we have observed them to fail in the presence of real-world data. We ...

Ieee Computer Soc2024

TTool: A Supervised Artificial Intelligence-Assisted Visual Pose Detector for Tool Heads in Augmented Reality Woodworking

Yves Weinand, Julien Gamerro, Andrea Settimi, Florian Aymanns, Naravich Chutisilp

We present TimberTool (TTool v2.1.1), a software designed for woodworking tasks assisted by augmented reality (AR), emphasizing its essential function of the real-time localization of a tool head’s poses within camera frames. The localization process, a fu ...

2024

Wave-momentum shaping for moving objects in heterogeneous and dynamic media

Stefan Rotter, Romain Christophe Rémy Fleury, Bakhtiyar Orazbayev, Matthieu Francis Malléjac

Light and sound waves can move objects through the transfer of linear or angular momentum, which has led to the development of optical and acoustic tweezers, with applications ranging from biomedical engineering to quantum optics. Although impressive manip ...

2024

Test-time adaptation for 6D pose tracking

Andrea Cavallaro

We propose a test -time adaptation for 6D object pose tracking that learns to adapt a pre -trained model to track the 6D pose of novel objects. We consider the problem of 6D object pose tracking as a 3D keypoint detection and matching task and present a mo ...

Elsevier Sci Ltd2024

Electroadhesive gripping system and method for gripping an object

Herbert Shea, Krishna Manaswi Digumarti, Vito Cacucciolo

An electroadhesive gripping system and a method for gripping and manipulating an object are disclosed. The invention provides a novel approach particularly useful to pick fabrics or otherwise flat and flexible objects including a method relying on electroa ...

2023

Chaotic microcomb inertia-free parallel ranging

Tobias Kippenberg, Anton Stroganov, Anton Lukashchuk

Ever growing pixel acquisition rates in the fields of augmented reality, autonomous driving and robotics have increased interest in solid state beam scanning without moving parts. Modern photonic integrated laser ranging advances towards passive beam steer ...

AIP Publishing2023

Learning Transformations To Reduce the Geometric Shift in Object Detection

Mathieu Salzmann, Martin Pierre Engilberge, Vidit Vidit

The performance of modern object detectors drops when the test distribution differs from the training one. Most of the methods that address this focus on object appearance changes caused by, e.g., different illumination conditions, or gaps between syntheti ...

Ieee Computer Soc2023

CLIP the Gap: A Single Domain Generalization Approach for Object Detection

Mathieu Salzmann, Martin Pierre Engilberge, Vidit Vidit

Single Domain Generalization (SDG) tackles the problem of training a model on a single source domain so that it generalizes to any unseen target domain. While this has been well studied for image classification, the literature on SDG object detection remai ...

Ieee Computer Soc2023

Rigidity-Aware Detection for 6D Object Pose Estimation

Mathieu Salzmann, Yinlin Hu, Rui Song, Jingyu Li

Most recent 6D object pose estimation methods first use object detection to obtain 2D bounding boxes before actually regressing the pose. However, the general object detection methods they use are ill-suited to handle cluttered scenes, thus producing poor ...

Ieee Computer Soc2023

Affordance segmentation of hand-occluded containers from exocentric images

Andrea Cavallaro

Visual affordance segmentation identifies the surfaces of an object an agent can interact with. Common challenges for the identification of affordances are the variety of the geometry and physical properties of these surfaces as well as occlusions. In this ...

Ieee Computer Soc2023

Projector-based augmented stacking framework for irregularly shaped objects

Yves Weinand, Katrin Beyer, Julien Gamerro, Andrea Settimi, Qianqing Wang, Edward Carlo Giorgio Andò

Augmented reality in additive fabrication is predominantly applied to the manufacturing of structures from regularly shaped materials. Our work however embraces natural heterogeneity, by focusing on the assembly of irregularly shaped elements such as miner ...

2023

Non-contact robotic manipulation of floating objects: exploiting emergent limit cycles

Nana Obayashi, Josephine Anna Eleanor Hughes

The study of non-contact manipulation in water, and the ability to robotically control floating objects has gained recent attention due to wide-ranging potential applications, including the analysis of plastic pollution in the oceans and the optimization o ...

Frontiers Media Sa2023

The Metaverse as a Virtual Model of Platform Urbanism: Its Converging AIoT, XReality, Neurotech, and Nanobiotech and Their Applications, Challenges, and Risks

Simon Elias Bibri

With their exponentially rising computational power, digital platforms are heralding a new era of hybrid intelligence. There has recently been much enthusiasm and hype that the Metaverse has the potential to unlock hybrid intelligence. This is premised on ...

MDPI2023

A Stand-Alone Augmented Reality Intervention for Chronic Pain using Embodied Systolic Stimulation

Skander Mensi, Sylvain Cardin, Oliver Alan Kannape, Robert Leeb, Fabien Bourban, Alexis Dorier, Andrea Serino

Chronic pain presents a tremendous personal, societal, and financial burden. Treatment options are often limited to managing symptoms as opposed to treating the causes, and the consequences of pharmacological treatments can be immensely harmful as evidence ...

IEEE2023

Combination of dielectrophoretic and hydrodynamic traps for the controlled contact between cells or beads and application to adhesion assays

Clémentine Sophie Sarah Lipp

Multicellular organisms require very well organized and finely balanced cell-cell communication, adhesion and coordination to ensure the organisms homeostasis. These functions rely on specialized receptors placed at the cells membrane whose binding to thei ...

EPFL2023

Generative power of a protein language model trained on multiple sequence alignments

Umberto Lupo, Anne-Florence Raphaëlle Bitbol, Damiano Sgarbossa

Computational models starting from large ensembles of evolutionarily related protein sequences capture a representation of protein families and learn constraints associated to protein structure and function. They thus open the possibility for generating no ...

eLIFE SCIENCES PUBL LTD2023

Signal strength and integrated intensity in confocal and image scanning microscopy

Giorgio Tortarolo

The properties of signal strength and integrated intensity in a scanned imaging system are reviewed. These prop-erties are especially applied to confocal imaging systems, including image scanning microscopy. The integrated intensity, equal to the image of ...

Optica Publishing Group2023

cgNA+: A sequence-dependent coarse-grain model of double-stranded nucleic acids

Rahul Sharma

DNA mechanics plays a crucial role in many biological processes, including nucleosome positioning and protein-DNA interactions. It is believed that nature employs epigenetic modifications in DNA to further regulate gene expression. Moreover, double-strande ...

EPFL2023

Between digital and territorial turns: A forking path

Elena Cogato Lanza, Chiara Cavalieri

This chapter looks at the intertwined evolution of two different ideas throughout the past century: that of ‘territory’, that has been reshaped and redefined in the field of architecture and urbanism, and that of ‘digital’, that while becoming dominant, ha ...

Routledge2022

Unsupervised Visual Entity Abstraction towards 2D and 3D Compositional Models

Beril Besbinar

Object-centric learning has gained significant attention over the last years as it can serve as a powerful tool to analyze complex scenes as a composition of simpler entities. Well-established tasks in computer vision, such as object detection or instance ...

EPFL2022