Publications related to Robust Unsupervised Gaze Calibration Using Conversation and Manipulation Attention Priors

Related publications (32)

SVGC-AVA: 360-Degree Video Saliency Prediction With Spherical Vector-Based Graph Convolution and Audio-Visual Attention

Viewers of 360-degree videos are provided with both visual modality to characterize their surrounding views and audio modality to indicate the sound direction. Though both modalities are important for saliency prediction, little work has been done by joint ...

Ieee-Inst Electrical Electronics Engineers Inc2024

Investigating neural resource allocation in the sensorimotor control of extra limbs

Giulia Dominijanni

The rise of robotic body augmentation brings forth new developments that will transform robotics, human-machine interaction, and wearable electronics. Extra robotic limbs, although building upon restorative technologies, bring their own set of challenges i ...

EPFL2024

Predicting Visual Stimuli From Cortical Response Recorded With Wide-Field Imaging in a Mouse

Silvestro Micera

Neural decoding of the visual system is a subject of research interest, both to understand how the visual system works and to be able to use this knowledge in areas, such as computer vision or brain-computer interfaces. Spike-based decoding is often used, ...

Ieee-Inst Electrical Electronics Engineers Inc2024

Human Interactive Robotic Surfaces for Physical Immersion

Fabio Zuliani

Computers have long been augmenting human capabilities and communication, and with emerging technologies, physical immersion in virtual worlds is now attainable. These advancements push the boundaries of human potential, allowing designers, architects, eng ...

EPFL2023

Non-verbal Communication between Humans and Robots: Imitation, Mutual Understanding and Inferring Object Properties

Nuno Ricardo Ferreira Duarte

Humans can express their actions and intentions, resorting to verbal and/or non-verbal communication. In verbal communication, humans use language to express, in structured linguistic terms, the desired action they wish to perform. Non-verbal communication ...

EPFL2023

Implicit Distance Functions: Learning and Applications in Robotics

Mikhail Koptev

In this thesis, we address the complex issue of collision avoidance in the joint space of robots. Avoiding collisions with both the robot's own body parts and obstacles in the environment is a critical constraint in motion planning and is crucial for ensur ...

EPFL2023

Self-Correcting Quadratic Programming-Based Robot Control

Aude Billard, Farshad Khadivar, Konstantinos Chatzilygeroudis

Quadratic Programming (QP)-based controllers allow many robotic systems, such as humanoids, to successfully undertake complex motions and interactions. However, these approaches rely heavily on adequately capturing the underlying model of the environment a ...

2023

Saliency prediction in 360° architectural scenes: Performance and impact of daylight variations

Marilyne Andersen, Sabine Süsstrunk, Caroline Karmann, Kynthia Chamilothori, Seungryong Kim, Bahar Aydemir

Saliency models are image-based prediction models that estimate human visual attention. Such models, when applied to architectural spaces, could pave the way for design decisions where visual attention is taken into account. In this study, we tested the pe ...

2023

Accessible Soft Robotics Education with Re-configurable Balloon Robots

Josephine Anna Eleanor Hughes, Kieran Daniel Gilday, Yi-Shiun Wu

Soft robotics requires effective tools to educate the next generation of engineers and researchers. Stemming from a lack of universally accepted principles for education and with high barriers to entry in terms of fabrication and hardware, education to dat ...

IEEE2023

Geometric and Learning Methods for Robots to Navigate in Human Crowds with Application to Smart Mobility Devices

David Julian Gonon

The thesis at hand is concerned with robots' navigation in human crowds. Specifically, methods are developed for planning a mobile robot's local motion between pedestrians, and they are evaluated in experiments where a robot interacts with real pedestrians ...

EPFL2023

Recognizing distant faces

Lukas Vogelsang

As an 'early alerting' sense, one of the primary tasks for the human visual system is to recognize distant objects. In the specific context of facial identification, this ecologically important task has received surprisingly little attention. Most studies ...

PERGAMON-ELSEVIER SCIENCE LTD2023

Design for Test With Unreliable Memories by Restoring the Beauty of Randomness

Andreas Peter Burg, Reza Ghanaatian Jahromi, Marco Widmer

This article presents a design-for-test methodology for embedded memories. The methodology relies on a fully random fault model of post-fabrication errors, which results in a low-overhead test strategy. The methodology's effectiveness is demonstrated on an ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2022

Questioning Wizard of Oz: Effects of Revealing the Wizard behind the Robot

Pierre Dillenbourg, Barbara Bruno, Jauwairia Nasir

Wizard of Oz, a very commonly employed technique in human-robot interaction, faces the criticism of being deceptive as the humans interacting with the robot are told, if at all, only at the end of their interaction that there was in fact a human behind the ...

IEEE2022

Foot-Interfaces Control and Human-Robot Interaction in Four-Handed Manipulation

Jacob Hernandez Sanchez

Humans have a great capacity to perform complex manipulations. However, there are many tasks for which two hands are not enough, such as in surgery. For such tasks, a dyad of people is required. However, when not used to work together, a dyad collaboration ...

EPFL2022

The Gaze Dialogue Model: Nonverbal Communication in HHI and HRI

Aude Billard, José Santos-Victor, Nuno Ricardo Ferreira Duarte

When humans interact with each other, eye gaze movements have to support motor control as well as communication. On the one hand, we need to fixate the task goal to retrieve visual information required for safe and precise action-execution. On the other ha ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2022

Learning to Guide Online Multi-Contact Receding Horizon Planning

Sylvain Calinon, Teguh Santoso Lembono

In Receding Horizon Planning (RHP), it is critical that the motion being executed facilitates the completion of the task, e.g. building momentum to overcome large obstacles. This requires a value function to inform the desirability of robot states. However ...

IEEE2022

Long Term Motion Prediction Using Keyposes

Pascal Fua, Mathieu Salzmann, Wei Wang, Sena Kiciroglu

Long term human motion prediction is essential in safety-critical applications such as human-robot interaction and autonomous driving. In this paper we show that to achieve long term forecasting, predicting human pose at every time instant is unnecessary. ...

IEEE2022

A New Methodological Approach to Analyze Human Roles in Human-Robot Interaction Scenarios

Auke Ijspeert

The influence of robotics in the job market has socio-economic consequences and the inevitable loss of job positions, but in the Human-Robot Interaction (HRI) scenarios, where humans and robots work together, new jobs and business models will be created. T ...

IEEE2022

Active origami platforms for human-robot interactions

Frédéric Henri Vaskin Giraud

Robots are employed to assist humans in lengthy, challenging, and repetitive tasks. However, the fields of rehabilitation, haptics, and assistive robotics have shown a significant need to support and interact with people in their everyday life. To facilita ...

EPFL2022

Design of Hesitation Gestures for Nonverbal Human-Robot Negotiation of Conflicts

Aude Billard

When the question of who should get access to a communal resource first is uncertain, people often negotiate via nonverbal communication to resolve the conflict. What should a robot be programmed to do when such conflicts arise in Human-Robot Interaction? ...

ASSOC COMPUTING MACHINERY2021