Publications associées à Affordance segmentation of hand-occluded containers from exocentric images

Modular segmentation, spatial analysis and visualization of volume electron microscopy datasets

Volume electron microscopy is the method of choice for the in situ interrogation of cellular ultrastructure at the nanometer scale, and with the increase in large raw image datasets generated, improving computational strategies for image segmentation and s ...

Nature Portfolio2024

Generalization and Personalization of Machine Learning for Multimodal Mobile Sensing in Everyday Life

Lakmal Buddika Meegahapola

A range of behavioral and contextual factors, including eating and drinking behavior, mood, social context, and other daily activities, can significantly impact an individual's quality of life and overall well-being. Therefore, inferring everyday life aspe ...

EPFL2024

Customizing the human-avatar mapping based on EEG error related potentials during avatar-based interaction

Ronan Boulic, Ricardo Andres Chavarriaga Lozano, Bruno Herbelin, José del Rocio Millán Ruiz, Olaf Blanke, Fumiaki Iwane, Thibault Serge Mario Porssut

Objective. A key challenge of virtual reality (VR) applications is to maintain a reliable human-avatar mapping. Users may lose the sense of controlling (sense of agency), owning (sense of body ownership), or being located (sense of self-location) inside th ...

2024

Immersive VR for upper-extremity rehabilitation in patients with neurological disorders: a scoping review

Silvestro Micera, Elena Losanno

Background Neurological disorders, such as stroke and chronic pain syndromes, profoundly impact independence and quality of life, especially when affecting upper extremity (UE) function. While conventional physical therapy has shown effectiveness in provid ...

BioMed Central2024

Fast and Future: Towards Efficient Forecasting in Video Semantic Segmentation

Evann Pierre Guy Courdier

Deep learning has revolutionized the field of computer vision, a success largely attributable to the growing size of models, datasets, and computational power. Simultaneously, a critical pain point arises as several computer vision applications are deploye ...

EPFL2024

Land Cover Mapping From Multiple Complementary Experts Under Heavy Class Imbalance

Devis Tuia, Valérie Zermatten, Javiera Francisca Castillo Navarro, Xiaolong Lu

Deep learning has emerged as a promising avenue for automatic mapping, demonstrating high efficacy in land cover categorization through various semantic segmentation models. Nonetheless, the practical deployment of these models encounters important challen ...

Ieee-Inst Electrical Electronics Engineers Inc2024

Updates on moleculARweb, the Swiss Portal for Chemistry and Structural Biology Education Using Augmented and now also Virtual Reality

Luciano Andres Abriata, Fabio Jose Cortes Rodriguez

We present a new activity on the moleculARweb plat-form on molecular symmetry elements, two more languages, a new marker-less augmented reality mode, and a new virtual reality tool for VR headsets. ...

SWISS CHEMICAL SOC2023

The Metaverse as a Virtual Model of Platform Urbanism: Its Converging AIoT, XReality, Neurotech, and Nanobiotech and Their Applications, Challenges, and Risks

Simon Elias Bibri

With their exponentially rising computational power, digital platforms are heralding a new era of hybrid intelligence. There has recently been much enthusiasm and hype that the Metaverse has the potential to unlock hybrid intelligence. This is premised on ...

MDPI2023

'connEcted caesarean section': creating a virtual link between MOthers and their infanTs to ImprOve maternal childbirth experieNce - study protocol for a PILOT trial (e-motion-pilot)

Sandra Maria Marcadent, Karine Lepigeon, Fiona Corbaz, David Desseauve

IntroductionOne-third of mothers rate their childbirth as traumatic. The prevalence of childbirth-related post-traumatic stress disorder (CB-PTSD) is 4.7%. Skin-to-skin contact is a protective factor against CB-PTSD. However, during a caesarean section (CS ...

BMJ PUBLISHING GROUP2023

An immersive virtual reality system for ecological assessment of peripersonal and extrapersonal unilateral spatial neglect

Ravi Tej Sai Giridhar Tadi, Olaf Blanke, Andrea Serino, Roberta Ronchi

BackgroundUnilateral spatial neglect (USN) is a debilitating neuropsychological syndrome that often follows brain injury, in particular a stroke affecting the right hemisphere. In current clinical practice, the assessment of neglect is based on old-fashion ...

BioMed Central2023

Projector-based augmented stacking framework for irregularly shaped objects

Yves Weinand, Katrin Beyer, Julien Gamerro, Andrea Settimi, Qianqing Wang, Edward Carlo Giorgio Andò

Augmented reality in additive fabrication is predominantly applied to the manufacturing of structures from regularly shaped materials. Our work however embraces natural heterogeneity, by focusing on the assembly of irregularly shaped elements such as miner ...

2023

A Stand-Alone Augmented Reality Intervention for Chronic Pain using Embodied Systolic Stimulation

Skander Mensi, Sylvain Cardin, Oliver Alan Kannape, Robert Leeb, Fabien Bourban, Alexis Dorier, Andrea Serino

Chronic pain presents a tremendous personal, societal, and financial burden. Treatment options are often limited to managing symptoms as opposed to treating the causes, and the consequences of pharmacological treatments can be immensely harmful as evidence ...

IEEE2023

Physical Body Orientation Impacts Virtual Navigation Experience and Performance

Olaf Blanke, Hyukjun Moon, Emanuela De Falco, Hsin-Ping Wu

Most human navigation studies in MRI rely on virtual navigation. However, the necessary supine position in MRI makes it fundamentally different from daily ecological navigation. Nonetheless, until now, no study has assessed whether differences in physical ...

Soc Neuroscience2023

Chaotic microcomb inertia-free parallel ranging

Tobias Kippenberg, Anton Stroganov, Anton Lukashchuk

Ever growing pixel acquisition rates in the fields of augmented reality, autonomous driving and robotics have increased interest in solid state beam scanning without moving parts. Modern photonic integrated laser ranging advances towards passive beam steer ...

AIP Publishing2023

Revisiting Evaluation Metrics for Semantic Segmentation: Optimization and Evaluation of Fine-grained Intersection over Union

Devis Tuia, Zifu Wang

Semantic segmentation datasets often exhibit two types of imbalance: \textit{class imbalance}, where some classes appear more frequently than others and \textit{size imbalance}, where some objects occupy more pixels than others. This causes traditional eva ...

2023

Human Interactive Robotic Surfaces for Physical Immersion

Fabio Zuliani

Computers have long been augmenting human capabilities and communication, and with emerging technologies, physical immersion in virtual worlds is now attainable. These advancements push the boundaries of human potential, allowing designers, architects, eng ...

EPFL2023

Scale-Aware Test-Time Click Adaptation for Pulmonary Nodule and Mass Segmentation

Bo Du, Li Zhang, Zhigang Li, Jiancheng Yang

Pulmonary nodules and masses are crucial imaging features in lung cancer screening that require careful management in clinical diagnosis. Despite the success of deep learning-based medical image segmentation, the robust performance on various sizes of lesi ...

Springer International Publishing Ag2023

Text as a Richer Source of Supervision in Semantic Segmentation Tasks

Devis Tuia, Valérie Zermatten, Lloyd Haydn Hughes, Javiera Francisca Castillo Navarro

This paper introduces TACOSS a text-image alignment approach that allows explainable land cover semantic segmentation by directly integrating semantic concepts encoded from texts. TACOSS combines convolutional neural networks for visual feature extraction ...

The Institute of Electrical and Electronics Engineers, Inc2023

CLIP the Gap: A Single Domain Generalization Approach for Object Detection

Mathieu Salzmann, Martin Pierre Engilberge, Vidit Vidit

Single Domain Generalization (SDG) tackles the problem of training a model on a single source domain so that it generalizes to any unseen target domain. While this has been well studied for image classification, the literature on SDG object detection remai ...

Ieee Computer Soc2023

Automating the Design of Programmable Interconnect for Reconfigurable Architectures

Stefan Nikolic

With Moore's law coming to an end, increasingly more hope is being put in specialized hardware implemented on reconfigurable architectures such as Field-Programmable Gate Arrays (FPGAs). Yet, it is often neglected that these architectures themselves experi ...

EPFL2023