Publications related to Gaze and discomfort glare, Part 1: Development of a gaze-driven photometry

SVGC-AVA: 360-Degree Video Saliency Prediction With Spherical Vector-Based Graph Convolution and Audio-Visual Attention

Pascal Frossard, Li Wei, Chenglin Li, Qin Yang, Yuelei Li

Viewers of 360-degree videos are provided with both visual modality to characterize their surrounding views and audio modality to indicate the sound direction. Though both modalities are important for saliency prediction, little work has been done by joint ...

Ieee-Inst Electrical Electronics Engineers Inc2024

The Gaze Dialogue Model: Nonverbal Communication in HHI and HRI

Aude Billard, José Santos-Victor, Nuno Ricardo Ferreira Duarte

When humans interact with each other, eye gaze movements have to support motor control as well as communication. On the one hand, we need to fixate the task goal to retrieve visual information required for safe and precise action-execution. On the other ha ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2022

Modeling and Inferring Attention between Humans or for Human-Robot Interactions

Rémy Alain Siegfried

More and more intelligent systems have to interact with humans. In order to communicate efficiently, these systems need to perceive and understand us. A key factor of communication is the people's visual focus of attention (VFOA), which is useful to estima ...

EPFL2021

A Differential Approach for Gaze Estimation

Jean-Marc Odobez, Yu Yu, Gang Liu

Most non-invasive gaze estimation methods regress gaze directions directly from a single face or eye image. However, due to important variabilities in eye shapes and inner eye structures amongst individuals, universal models obtain limited accuracies and t ...

2021

Long-lasting feature integration

Leila Drissi Daoudi - Kleinbauer

In the classic model of vision, processing is local, feedforward and hierarchical. The first stages of the visual system are retinotopic, i.e., neighboring points in the outside world are mapped onto neighboring photoreceptors of the retina and this is pre ...

EPFL2020

Improving Few-Shot User-Specific Gaze Adaptation via Gaze Redirection Synthesis

Jean-Marc Odobez, Yu Yu, Gang Liu

As an indicator of human attention gaze is a subtle behavioral cue which can be exploited in many applications. However, inferring 3D gaze direction is challenging even for deep neural networks given the lack of large amount of data (groundtruthing gaze is ...

IEEE2019

Towards the Use of Social Interaction Conventions as Prior for Gaze Model Adaptation

Jean-Marc Odobez, Rémy Alain Siegfried, Yu Yu

Gaze is an important non-verbal cue involved in many facets of social interactions like communication, attentiveness or attitudes. Nevertheless, extracting gaze directions visually and remotely usually suffers large errors because of low resolution images, ...

ACM2017

A Regression-based User Calibration Framework for Real-time Gaze Estimation

Jean-Philippe Thiran, Nuri Murat Arar, Hua Gao

Eye movements play a very significant role in human computer interaction (HCI) as they are natural and fast, and contain important cues for human cognitive state and visual attention. Over the last two decades, many techniques have been proposed to accurat ...

Institute of Electrical and Electronics Engineers2017

Sleep-dependent consolidation of face recognition and its relationship to REM sleep duration, REM density and Stage 2 sleep spindles

Christian O'Reilly

Face recognition is a highly specialized capability that has implicit and explicit memory components. Studies show that learning tasks with facial components are dependent on rapid eye movement and non-rapid eye movement sleep features, including rapid eye ...

Wiley2017

Gaze Responsive Visual Comfort: New Findings On Gaze Behaviour In A Daylit Office Space In Relation To Glare

Marilyne Andersen, Mandana Sarey Khanie, Jan Wienold

Using a newly developed gaze-driven methodology for discomfort glare assessments, we studied gaze behaviour in different glare conditions. The study was done in a series of experiments where gaze behaviour of the participants were recorded using eye-tracki ...

Cie Central Bureau2016

Estimating Fusion Weights of a Multi-Camera Eye Tracking System by Leveraging User Calibration Data

Jean-Philippe Thiran, Nuri Murat Arar

Cross-ratio (CR)-based eye tracking has been attracting much interest due to its simple setup, yet its accuracy is lower than that of the model-based approaches. In order to improve the estimation accuracy, a multi-camera setup can be exploited rather than ...

Assoc Computing Machinery2016

Retina Color-Opponency Based Pursuit Implemented Through Spiking Neural Networks in the Neurorobotics Platform

Marc-Oliver Gewaltig, Egidio Falotico, Lorenzo Vannucci, Paul Levi, Georg Hinkel, Stefan Ulbrich, Ugo Albanese, Murat Kirtay, Alessandro Ambrosano

The 'red-green' pathway of the retina is classically recognized as one of the retinal mechanisms allowing humans to gather color information from light, by combining information from L-cones and M-cones in an opponent way. The precise retinal circuitry tha ...

Springer Int Publishing Ag2016

Evaluation of Color Mapping Algorithms in Different Color Spaces

Touradj Ebrahimi

The color gamut supported by current commercial displays is only a subset of the full spectrum of colors visible by the human eye. In High-Definition (HD) television technology, the scope of the supported colors covers 35.9% of the full visible gamut. For ...

Spie-Int Soc Optical Engineering2016

Human responsive daylighting in offices : a gaze-driven approach for dynamic discomfort glare assessment

Mandana Sarey Khanie

This dissertation proposes a novel gaze-driven approach for dynamic discomfort glare assessments as a first step towards understanding human responsive comfort with respect to daylight. The objective was to observe the natural gaze behaviour in relation to ...

EPFL2015

3D Gaze Estimation from Remote RGB-D Sensors

Kenneth Alberto Funes Mora

The development of systems able to retrieve and characterise the state of humans is important for many applications and fields of study. In particular, as a display of attention and interest, gaze is a fundamental cue in understanding people activities, be ...

EPFL2015

Attention Driven Foveated Video Quality Assessment

Touradj Ebrahimi

Contrast sensitivity of the human visual system to visual stimuli can be significantly affected by several mechanisms, e. g., vision foveation and attention. Existing studies on foveation based video quality assessment only take into account static foveati ...

Ieee-Inst Electrical Electronics Engineers Inc2014

A new device for dynamic luminance mapping and glare risk assessment in buildings

Laurent Deschamps, Jean-Louis Scartezzini, Apiparn Borisuit

High dynamic range imaging has been shown to be a reliable tool to assess luminance maps and glare risk probability in buildings. However, there are some limitations of image capturing time, especially when dealing with highly dynamic and contrasted daylig ...

Spie-Int Soc Optical Engineering2012

Investigating Gaze of Children with ASD in Naturalistic Settings

Aude Billard, Basilio Noris, Nouchine Hadjikhani

Background: Visual behavior is known to be atypical in Autism Spectrum Disorders (ASD). Monitor-based eye-tracking studies have measured several of these atypicalities in individuals with Autism. While atypical behaviors are known to be accentuated during ...

Public Library of Science2012

Dual Eye-Tracking Methods for the Study of Remote Collaborative Problem Solving

Marc-Antoine Nüssli

Applied eye-tracking has been extensively used for the study of psychological processes. More recently, some researchers have used this technique to study the interaction between people by tracking and analyzing eye-movements of two persons synchronously. ...

EPFL2011

Machine Vision-Based Analysis of Gaze and Visual Context : an Application to Visual Behavior of Children with Autism Spectrum Disorders

Basilio Noris

Visual behavior, and specifically gaze directed at objects and people, is a fundamental cue for understanding how children with Autism Spectrum Disorder (ASD) experience and respond to social interaction. Indeed atypical behaviors such as averting the gaze ...

EPFL2011