Publications associées à A Regression-based User Calibration Framework for Real-time Gaze Estimation

SVGC-AVA: 360-Degree Video Saliency Prediction With Spherical Vector-Based Graph Convolution and Audio-Visual Attention

Pascal Frossard, Li Wei, Chenglin Li, Qin Yang, Yuelei Li

Viewers of 360-degree videos are provided with both visual modality to characterize their surrounding views and audio modality to indicate the sound direction. Though both modalities are important for saliency prediction, little work has been done by joint ...

Ieee-Inst Electrical Electronics Engineers Inc2024

Investigating neural resource allocation in the sensorimotor control of extra limbs

Giulia Dominijanni

The rise of robotic body augmentation brings forth new developments that will transform robotics, human-machine interaction, and wearable electronics. Extra robotic limbs, although building upon restorative technologies, bring their own set of challenges i ...

EPFL2024

Predicting Visual Stimuli From Cortical Response Recorded With Wide-Field Imaging in a Mouse

Silvestro Micera, Daniela De Luca

Neural decoding of the visual system is a subject of research interest, both to understand how the visual system works and to be able to use this knowledge in areas, such as computer vision or brain-computer interfaces. Spike-based decoding is often used, ...

Ieee-Inst Electrical Electronics Engineers Inc2024

Saliency prediction in 360° architectural scenes: Performance and impact of daylight variations

Marilyne Andersen, Sabine Süsstrunk, Kynthia Chamilothori, Bahar Aydemir, Caroline Karmann, Seungryong Kim

Saliency models are image-based prediction models that estimate human visual attention. Such models, when applied to architectural spaces, could pave the way for design decisions where visual attention is taken into account. In this study, we tested the pe ...

2023

Towards Novel Evaluation Methods for Social Dialog Systems

Ekaterina Svikhnushina

Language has shaped human evolution and led to the desire to endow machines with language abilities. Recent advancements in natural language processing enable us to achieve this breakthrough in human-machine interaction. However, introducing conversational ...

EPFL2023

Community-based reconstruction and simulation of a full-scale model of region CA1 of rat hippocampus

Henry Markram, Felix Schürmann, James Gonzalo King, Srikanth Ramaswamy, Juan Bautista Hernando Vieites, Alexis Arnaudon, Eilif Benjamin Muller, Michael Reimann, Huanxiang Lu, Ying Shi, Marwan Muhammad Ahmed Abdellah, Vishal Sood, Jean-Denis Georges Emile Courcol, Werner Alfons Hilda Van Geit, Lida Kanari, Juan Luis Riquelme Roman, Michael Emiel Gevaert, Pramod Shivaji Kumbhar, Liesbeth Maria L Vanherpe, Armando Romani, Cyrille Pierre Henri Favreau, Michele Migliore, Mohameth François Sy, Szabolcs Kali, Judit Planas Carbonell, Genrich Ivaska, Sàra Sàray, Carmen Alina Lupascu, Rosanna Migliore, Audrey Mercer, András Ecker, Alberto Antonietti, Cristina Colangelo, Anna-Kristin Kaufmann, Julian Martin Budd, Elisabetta Giacalone, Thomas Brice Delemontex, Davide Bella, Fabien Petitjean, , , , ,

The Metaverse as a Virtual Model of Platform Urbanism: Its Converging AIoT, XReality, Neurotech, and Nanobiotech and Their Applications, Challenges, and Risks

Simon Elias Bibri

With their exponentially rising computational power, digital platforms are heralding a new era of hybrid intelligence. There has recently been much enthusiasm and hype that the Metaverse has the potential to unlock hybrid intelligence. This is premised on ...

MDPI2023

Prompting Large Language Models to Power Educational Chatbots

Denis Gillet, Sandy Ingram, Juan Carlos Farah, Fanny Kim-Lan Lasne

The recent rise in both popularity and performance of large language models has garnered considerable interest regarding their applicability to education. Technologies like ChatGPT, which can engage in human-like dialog, have already disrupted educational ...

Springer2023

Non-verbal Communication between Humans and Robots: Imitation, Mutual Understanding and Inferring Object Properties

Nuno Ricardo Ferreira Duarte

Humans can express their actions and intentions, resorting to verbal and/or non-verbal communication. In verbal communication, humans use language to express, in structured linguistic terms, the desired action they wish to perform. Non-verbal communication ...

EPFL2023

Human Interactive Robotic Surfaces for Physical Immersion

Fabio Zuliani

Computers have long been augmenting human capabilities and communication, and with emerging technologies, physical immersion in virtual worlds is now attainable. These advancements push the boundaries of human potential, allowing designers, architects, eng ...

EPFL2023

Adapting Haptic Feedback for Guided Meditation

Nicolas Henchoz, Cédric Duchene, Andreas Sonderegger, Romain Simon Collaud, Emily Clare Groves, Yoann Pierre Douillet

Technology supporting meditation is a multimillion-dollar market that continues to grow. There is also strong academic interest to understand and improve the impact technology can have for the user experience of practitioners. However, little work investig ...

2023

Discomfort glare from daylight: Influence of transmitted color and the eye's macular pigment

Sneha Jain

Designing architectural façades that allow sufficient daylight to create visually comfortable and pleasant environments is a challenging aspect of building design. It requires accounting for visual comfort and discomfort glare risks and understanding the f ...

EPFL2023

The Gaze Dialogue Model: Nonverbal Communication in HHI and HRI

Aude Billard, José Santos-Victor, Nuno Ricardo Ferreira Duarte

When humans interact with each other, eye gaze movements have to support motor control as well as communication. On the one hand, we need to fixate the task goal to retrieve visual information required for safe and precise action-execution. On the other ha ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2022

Questioning Wizard of Oz: Effects of Revealing the Wizard behind the Robot

Pierre Dillenbourg, Pierre Pravin Oppliger, Jauwairia Nasir, Barbara Bruno

Wizard of Oz, a very commonly employed technique in human-robot interaction, faces the criticism of being deceptive as the humans interacting with the robot are told, if at all, only at the end of their interaction that there was in fact a human behind the ...

IEEE2022

Robust Unsupervised Gaze Calibration Using Conversation and Manipulation Attention Priors

Jean-Marc Odobez, Rémy Alain Siegfried

Gaze estimation is a difficult task, even for humans. However, as humans, we are good at understanding a situation and exploiting it to guess the expected visual focus of attention of people, and we usually use this information to retrieve people's gaze. I ...

ASSOC COMPUTING MACHINERY2022

Experiencing virtual geographic environment in urban 3D participatory e-planning: A user perspective

Jens Ingensand, Thibaud Nicolas Chassin

The adoption of technology in urban participatory planning with tools such as Virtual Geographic Environments (VGE) promises a broader engagement of urban dwellers, which should ultimately lead to the creation of better cities. However, the authorities and ...

ELSEVIER2022

Do Children Adapt Their Perspective to a Robot When They Fail to Complete a Task?

Pierre Dillenbourg, Ana Paiva, Elmira Yadollahi

Spatial understanding and communication are essential skills in human interaction. An adequate understanding of others' spatial perspectives can increase the quality of the interaction, both perceptually and cognitively. In this paper, we take the first st ...

Assoc Computing Machinery2022

Assessing Experiences and Visual Perception in Train Station Environments with a Mobile Application and Eye Tracking

Andrea Regula Schneider

The Customer Experience Management at the Swiss Federal Railways (SBB) experiments with new technologies and methods to capture experiences and perceptions of passengers to design safe and customer friendly environments. First, a new methodological approac ...

2022

No Common Factor Underlying Decline of Visual Abilities in Mild Cognitive Impairment

Michael Herzog, Simona Adele Garobbio

Introduction Recent work has shown an association between cognitive and visual impairments and two main theories were advanced, namely the sensory deprivation and the common cause theories. Most studies considered only basic visual functions such as visual ...

2023

Exploring Spatial Perspective Taking in Human-Robot Interaction

Elmira Yadollahi

Humans often rely on their perspective taking skills to thrive within the world's complex relations and connections. An adequate understanding of others' spatial perspectives can increase the quality of the interaction, not only perceptually but also cogni ...

EPFL2021