Publications associées à Towards the Use of Social Interaction Conventions as Prior for Gaze Model Adaptation

SVGC-AVA: 360-Degree Video Saliency Prediction With Spherical Vector-Based Graph Convolution and Audio-Visual Attention

Pascal Frossard, Li Wei, Chenglin Li, Qin Yang, Yuelei Li

Viewers of 360-degree videos are provided with both visual modality to characterize their surrounding views and audio modality to indicate the sound direction. Though both modalities are important for saliency prediction, little work has been done by joint ...

Ieee-Inst Electrical Electronics Engineers Inc2024

Detecting Anomalies and Obstacles in Road Scenes

Krzysztof Maciej Lis

We address the problem of segmenting anomalies and unusual obstacles in road scenes for the purpose of self-driving safety. The objects in question are not present in the common training sets as it is not feasible to collect and annotate examples for every ...

EPFL2023

The Gaze Dialogue Model: Nonverbal Communication in HHI and HRI

Aude Billard, José Santos-Victor, Nuno Ricardo Ferreira Duarte

When humans interact with each other, eye gaze movements have to support motor control as well as communication. On the one hand, we need to fixate the task goal to retrieve visual information required for safe and precise action-execution. On the other ha ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2022

Comparison between CIE 2° and 10° field photopic luminosity functions V(λ) for calculating daylight discomfort glare metrics

Marilyne Andersen, Jan Wienold, Sneha Jain

The spectral sensitivity of the average human eye in photopic conditions is represented by the photopic luminosity function V (λ). The CIE has established the photopic luminosity functions for the 2o and 10o visual fields for a standard observer applicable ...

2022

Modeling and Inferring Attention between Humans or for Human-Robot Interactions

Rémy Alain Siegfried

More and more intelligent systems have to interact with humans. In order to communicate efficiently, these systems need to perceive and understand us. A key factor of communication is the people's visual focus of attention (VFOA), which is useful to estima ...

EPFL2021

The time course of serial dependence: an interplay between perceptual decisions and task relevant representations

Michael Herzog, Gizay Ceylan, David Pascucci

In serial dependence (SD), features of a present stimulus are judged as similar to previously presented ones. This bias is often explained by a continuity field (CF) in perception, combining similar stimuli in an extended region of space (∼ 15°) and time ( ...

SAGE Publishing2021

3-Dimensional magnetic resonance imaging of the freely moving human eye

Jérôme Yerly, Silvio Ionta, Josefina Adriana Maria Bastiaansen, David Zeugin, João Pedro Forjaco Jorge, Benedetta Franceschiello, Lorenzo Di Sopra

Eye motion is a major confound for magnetic resonance imaging (MRI) in neuroscience or ophthalmology. Currently, solutions toward eye stabilisation include participants fixating or administration of paralytics/anaesthetics. We developed a novel MRI protoco ...

PERGAMON-ELSEVIER SCIENCE LTD2020

A Differential Approach for Gaze Estimation

Jean-Marc Odobez, Yu Yu, Gang Liu

Most non-invasive gaze estimation methods regress gaze directions directly from a single face or eye image. However, due to important variabilities in eye shapes and inner eye structures amongst individuals, universal models obtain limited accuracies and t ...

2021

Long-lasting feature integration

Leila Drissi Daoudi - Kleinbauer

In the classic model of vision, processing is local, feedforward and hierarchical. The first stages of the visual system are retinotopic, i.e., neighboring points in the outside world are mapped onto neighboring photoreceptors of the retina and this is pre ...

EPFL2020

Object identity determines trans-saccadic integration

Michael Herzog, Leila Drissi Daoudi - Kleinbauer

Humans make two to four rapid eye movements (saccades) per second, which, surprisingly, does not lead to abrupt changes in vision. To the contrary, we perceive a stable world. Hence, an important question is how information is integrated across saccades. T ...

2020

Eye Thought You Were Sick! Exploring Eye Behaviors for Cybersickness Detection in VR

Ronan Boulic, Nana Tian

Cybersickness induced through Virtual Reality (VR) applications is still one of its main barriers as it can induce unwanted side-effects in players, significantly hindering the overall experience. Despite the wealth of research available on this topic, it ...

ACM2020

ActiveMoCap: Optimized Viewpoint Selection for Active Human Motion Capture

Pascal Fua, Mathieu Salzmann, Sudipta Sinha, Sena Kiciroglu, Helge Jochen Rhodin

The accuracy of monocular 3D human pose estimation depends on the viewpoint from which the image is captured. While freely moving cameras, such as on drones, provide control over this viewpoint, automatically positioning them at the location which will yie ...

IEEE2020

Accurate Nod and 3D Gaze Estimation for Social Interaction Analysis

Yu Yu

Non-verbal behaviours play an important role in human communication since it can indicate human attention, serve as communication cue in interactions, or even reveal higher level personal constructs. For instance, head nod, a common non-verbal behaviour, c ...

EPFL2020

Stimuli-based Gaze Analytics to Enhance Motivation and Learning in MOOCs

Pierre Dillenbourg, Kshitij Sharma

The interaction with the various learners in a Massive Open Online Course (MOOC) is often complex. Contemporary MOOC learning analytics relate with click-streams, keystrokes and other user-input variables. Such variables however, do not always capture lear ...

IEEE2019

Investigating prospective memory via eye tracking: No evidence for a monitoring deficit in older adults

Michael Herzog, Marc Michael Lauffs

Prospective memory (PM) refers to remembering to perform intended actions in the future. Older adults in particular have been shown to be negatively affected by PM tasks that require a high amount of attentional resources (i.e., nonfocal tasks). This age-r ...

2019

Towards Modelling of Visual Saliency in Point Clouds for Immersive Applications

Touradj Ebrahimi, Evangelos Alexiou, Peisen Xu

Modelling human visual attention is of great importance in the field of computer vision and has been widely explored for 3D imaging. Yet, in the absence of ground truth data, it is unclear whether such predictions are in alignment with the actual human vie ...

2019

Microsaccades Distinguish Looking From Seeing

Andreas Sonderegger, Andrea Regula Schneider

Understanding our visual world requires both looking and seeing. Dissociation of these processes can result in the phenomenon of inattentional blindness or 'looking without seeing'. Concomitant errors in applied settings can be serious, and even deadly. Cu ...

INT GROUP EYE MOVEMENT RESEARCH2019

Discrete windows of feature integration

Michael Herzog, Adrien Christophe Doerig, Leila Drissi Daoudi - Kleinbauer

A car drives through the night. It is hard to estimate its color from single photoreceptor activity because photoreceptor activation is short and noisy. An efficient way to estimate the color is to average photoreceptor activities along the car’s motion tr ...

SAGE PUBLICATIONS LTD2019

Improving Few-Shot User-Specific Gaze Adaptation via Gaze Redirection Synthesis

Jean-Marc Odobez, Yu Yu, Gang Liu

As an indicator of human attention gaze is a subtle behavioral cue which can be exploited in many applications. However, inferring 3D gaze direction is challenging even for deep neural networks given the lack of large amount of data (groundtruthing gaze is ...

IEEE2019

Decoding Neural Correlates of Cognitive States to Enhance Driving Experience

Ricardo Andres Chavarriaga Lozano, José del Rocio Millán Ruiz, Marija Uscumlic, Zahra Khaliliardali, Sareh Saeedi, Lucian Andrei Gheorghe, Huaijian Zhang, Ruslan Aydarkhanov

Modern cars can support their drivers by assessing and autonomously performing different driving maneuvers based on information gathered by in-car sensors. We propose that brain–machine interfaces (BMIs) can provide complementary information that can ease ...

2018