Publication

Robust Unsupervised Gaze Calibration Using Conversation and Manipulation Attention Priors

Publications associées (29)

SVGC-AVA: 360-Degree Video Saliency Prediction With Spherical Vector-Based Graph Convolution and Audio-Visual Attention

Pascal Frossard, Li Wei, Chenglin Li, Qin Yang, Yuelei Li

Viewers of 360-degree videos are provided with both visual modality to characterize their surrounding views and audio modality to indicate the sound direction. Though both modalities are important for saliency prediction, little work has been done by joint ...

Ieee-Inst Electrical Electronics Engineers Inc2024

Investigating neural resource allocation in the sensorimotor control of extra limbs

Giulia Dominijanni

The rise of robotic body augmentation brings forth new developments that will transform robotics, human-machine interaction, and wearable electronics. Extra robotic limbs, although building upon restorative technologies, bring their own set of challenges i ...

EPFL2024

Predicting Visual Stimuli From Cortical Response Recorded With Wide-Field Imaging in a Mouse

Silvestro Micera, Daniela De Luca

Neural decoding of the visual system is a subject of research interest, both to understand how the visual system works and to be able to use this knowledge in areas, such as computer vision or brain-computer interfaces. Spike-based decoding is often used, ...

Ieee-Inst Electrical Electronics Engineers Inc2024

Human Interactive Robotic Surfaces for Physical Immersion

Fabio Zuliani

Computers have long been augmenting human capabilities and communication, and with emerging technologies, physical immersion in virtual worlds is now attainable. These advancements push the boundaries of human potential, allowing designers, architects, eng ...

EPFL2023

Non-verbal Communication between Humans and Robots: Imitation, Mutual Understanding and Inferring Object Properties

Nuno Ricardo Ferreira Duarte

Humans can express their actions and intentions, resorting to verbal and/or non-verbal communication. In verbal communication, humans use language to express, in structured linguistic terms, the desired action they wish to perform. Non-verbal communication ...

EPFL2023

Implicit Distance Functions: Learning and Applications in Robotics

Mikhail Koptev

In this thesis, we address the complex issue of collision avoidance in the joint space of robots. Avoiding collisions with both the robot's own body parts and obstacles in the environment is a critical constraint in motion planning and is crucial for ensur ...

EPFL2023

Self-Correcting Quadratic Programming-Based Robot Control

Aude Billard, Konstantinos Chatzilygeroudis, Farshad Khadivar

Quadratic Programming (QP)-based controllers allow many robotic systems, such as humanoids, to successfully undertake complex motions and interactions. However, these approaches rely heavily on adequately capturing the underlying model of the environment a ...

2023

Saliency prediction in 360° architectural scenes: Performance and impact of daylight variations

Marilyne Andersen, Sabine Süsstrunk, Kynthia Chamilothori, Bahar Aydemir, Caroline Karmann, Seungryong Kim

Saliency models are image-based prediction models that estimate human visual attention. Such models, when applied to architectural spaces, could pave the way for design decisions where visual attention is taken into account. In this study, we tested the pe ...

2023

Accessible Soft Robotics Education with Re-configurable Balloon Robots

Yi-Shiun Wu, Josephine Anna Eleanor Hughes, Kieran Daniel Gilday

Soft robotics requires effective tools to educate the next generation of engineers and researchers. Stemming from a lack of universally accepted principles for education and with high barriers to entry in terms of fabrication and hardware, education to dat ...

IEEE2023

Geometric and Learning Methods for Robots to Navigate in Human Crowds with Application to Smart Mobility Devices

David Julian Gonon

The thesis at hand is concerned with robots' navigation in human crowds. Specifically, methods are developed for planning a mobile robot's local motion between pedestrians, and they are evaluated in experiments where a robot interacts with real pedestrians ...

EPFL2023

Recognizing distant faces

Marin Vogelsang, Lukas Vogelsang

As an 'early alerting' sense, one of the primary tasks for the human visual system is to recognize distant objects. In the specific context of facial identification, this ecologically important task has received surprisingly little attention. Most studies ...

PERGAMON-ELSEVIER SCIENCE LTD2023

Questioning Wizard of Oz: Effects of Revealing the Wizard behind the Robot

Pierre Dillenbourg, Pierre Pravin Oppliger, Jauwairia Nasir, Barbara Bruno

Wizard of Oz, a very commonly employed technique in human-robot interaction, faces the criticism of being deceptive as the humans interacting with the robot are told, if at all, only at the end of their interaction that there was in fact a human behind the ...

IEEE2022

Foot-Interfaces Control and Human-Robot Interaction in Four-Handed Manipulation

Jacob Hernandez Sanchez

Humans have a great capacity to perform complex manipulations. However, there are many tasks for which two hands are not enough, such as in surgery. For such tasks, a dyad of people is required. However, when not used to work together, a dyad collaboration ...

EPFL2022

The Gaze Dialogue Model: Nonverbal Communication in HHI and HRI

Aude Billard, José Santos-Victor, Nuno Ricardo Ferreira Duarte

When humans interact with each other, eye gaze movements have to support motor control as well as communication. On the one hand, we need to fixate the task goal to retrieve visual information required for safe and precise action-execution. On the other ha ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2022

Learning to Guide Online Multi-Contact Receding Horizon Planning

Sylvain Calinon, Teguh Santoso Lembono

In Receding Horizon Planning (RHP), it is critical that the motion being executed facilitates the completion of the task, e.g. building momentum to overcome large obstacles. This requires a value function to inform the desirability of robot states. However ...

IEEE2022

Long Term Motion Prediction Using Keyposes

Pascal Fua, Mathieu Salzmann, Sena Kiciroglu, Wei Wang

Long term human motion prediction is essential in safety-critical applications such as human-robot interaction and autonomous driving. In this paper we show that to achieve long term forecasting, predicting human pose at every time instant is unnecessary. ...

IEEE2022

A New Methodological Approach to Analyze Human Roles in Human-Robot Interaction Scenarios

Auke Ijspeert

The influence of robotics in the job market has socio-economic consequences and the inevitable loss of job positions, but in the Human-Robot Interaction (HRI) scenarios, where humans and robots work together, new jobs and business models will be created. T ...

IEEE2022

Active origami platforms for human-robot interactions

Frédéric Henri Vaskin Giraud

Robots are employed to assist humans in lengthy, challenging, and repetitive tasks. However, the fields of rehabilitation, haptics, and assistive robotics have shown a significant need to support and interact with people in their everyday life. To facilita ...

EPFL2022

Tales from a Robotic World. How Intelligent Machines Will Shape Our Future

Dario Floreano, Nicola Nosengo

Stories from the future of intelligent machines—from rescue drones to robot spouses—and accounts of cutting-edge research that could make it all possible. Tech prognosticators promised us robots—autonomous humanoids that could carry out any number of tasks ...

MIT Press2022

Bio-inspired Reflex System for Learning Visual Information for Resilient Robotic Manipulation

Josephine Anna Eleanor Hughes, Kai Christian Junge

Humans have an incredible sense of self-preservation that is both instilled, and also learned through experience. One system which contributes to this is the pain and reflex system which both minimizes damage through involuntary reflex ac- tions and also s ...

2022