Publications related to Eye-tracking and artificial intelligence to enhance motivation and learning

Non-verbal Communication between Humans and Robots: Imitation, Mutual Understanding and Inferring Object Properties

Humans can express their actions and intentions, resorting to verbal and/or non-verbal communication. In verbal communication, humans use language to express, in structured linguistic terms, the desired action they wish to perform. Non-verbal communication ...

EPFL2023

Saliency prediction in 360° architectural scenes: Performance and impact of daylight variations

Marilyne Andersen, Sabine Süsstrunk, Kynthia Chamilothori, Bahar Aydemir, Caroline Karmann, Seungryong Kim

Saliency models are image-based prediction models that estimate human visual attention. Such models, when applied to architectural spaces, could pave the way for design decisions where visual attention is taken into account. In this study, we tested the pe ...

2023

Learning a QoE Metric from Social Media and Gaming Footage

Aikaterini Argyraki, Catalina Paz Alvarez Inostroza

Defining a universal metric for Quality of Experience (QoE) is notoriously hard due to the complex relationship between low-level performance metrics and user satisfaction. The most common metric, the Mean Opinion Score (MOS), has well-known biases and inc ...

2023

The Gaze Dialogue Model: Nonverbal Communication in HHI and HRI

Aude Billard, José Santos-Victor, Nuno Ricardo Ferreira Duarte

When humans interact with each other, eye gaze movements have to support motor control as well as communication. On the one hand, we need to fixate the task goal to retrieve visual information required for safe and precise action-execution. On the other ha ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2022

How Florist Apprentices Explore Bouquet Designs: Supporting Design Space Exploration for Vocational Students

Pierre Dillenbourg, Kevin Gonyop Kim, Catharine Regina Monika Maria Oertel Genannt Bierbach

Context: Exploring the design space is an important process in a design task. In this study, we considered design space exploration for the learners in vocational education and training (VET). The goal of the study was to investigate how they explore the d ...

2021

Modeling and Inferring Attention between Humans or for Human-Robot Interactions

Rémy Alain Siegfried

More and more intelligent systems have to interact with humans. In order to communicate efficiently, these systems need to perceive and understand us. A key factor of communication is the people's visual focus of attention (VFOA), which is useful to estima ...

EPFL2021

Exploring Spatial Perspective Taking in Human-Robot Interaction

Elmira Yadollahi

Humans often rely on their perspective taking skills to thrive within the world's complex relations and connections. An adequate understanding of others' spatial perspectives can increase the quality of the interaction, not only perceptually but also cogni ...

EPFL2021

Accurate Nod and 3D Gaze Estimation for Social Interaction Analysis

Yu Yu

Non-verbal behaviours play an important role in human communication since it can indicate human attention, serve as communication cue in interactions, or even reveal higher level personal constructs. For instance, head nod, a common non-verbal behaviour, c ...

EPFL2020

Towards everyday brain-computer interfacing through decoding visual cognition

Ruslan Aydarkhanov

Decoding visual cognition from non-invasive measurements of brain activity has shown valuable applications. Vision-based Brain-Computer Interfaces (BCI) systems extend from spellers to database search and spatial navigation. Despite the high performance of ...

EPFL2020

Stimuli-based Gaze Analytics to Enhance Motivation and Learning in MOOCs

Pierre Dillenbourg, Kshitij Sharma

The interaction with the various learners in a Massive Open Online Course (MOOC) is often complex. Contemporary MOOC learning analytics relate with click-streams, keystrokes and other user-input variables. Such variables however, do not always capture lear ...

IEEE2019

Teaching Practical DSP with Off-the-Shelf Hardware and Free Software

Paolo Prandoni, Adrien Guillaume Olivier Hoffet, Eric Bezzam

In this paper we describe our approach to teaching applied digital signal processing (DSP) using freely-available software and inexpensive off-the-shelf hardware components. The pedagogical framework is built around simple real-time audio processing algori ...

IEEE2019

Towards Modelling of Visual Saliency in Point Clouds for Immersive Applications

Touradj Ebrahimi, Evangelos Alexiou, Peisen Xu

Modelling human visual attention is of great importance in the field of computer vision and has been widely explored for 3D imaging. Yet, in the absence of ground truth data, it is unclear whether such predictions are in alignment with the actual human vie ...

2019

Reverse-Engineering Satire, or "Paper on Computational Humor Accepted despite Making Serious Advances"

Robert West

Humor is an essential human trait. Efforts to understand humor have called out links between humor and the foundations of cognition, as well as the importance of humor in social engagement. As such, it is a promising and important subject of study, with re ...

ASSOC ADVANCEMENT ARTIFICIAL INTELLIGENCE2019

When and why performance goals predict exploitation behaviors: An achievement goal complex analysis of the selection function of assessment

Fabrizio Butera, Hamza Sehaqui, Kevin Fahrni, David Nguyen, Martin Jobin, Nicolas Sommet

We adopted an achievement goal complex framework (studying achievement goals and reasons connected to goals) to determine when and why performance goals predict exploitation of others' knowledge. We hypothesized that: (i) when selective assessment is used ...

SPRINGER/PLENUM PUBLISHERS2019

Augmented Reality to Facilitate a Conceptual Understanding of Statics in Vocational Education

Lorenzo Lucignano

At the core of the contribution of this dissertation there is an augmented reality (AR) environment, StaticAR, that supports the process of learning the fundamentals of statics in vocational classrooms, particularly in carpentry ones. Vocational apprentice ...

EPFL2018

Robust Eye Tracking Based on Adaptive Fusion of Multiple Cameras

Nuri Murat Arar

Eye and gaze movements play an essential role in identifying individuals' emotional states, cognitive activities, interests, and attention among other behavioral traits. Besides, they are natural, fast, and implicitly reflect the targets of interest, which ...

EPFL2017

Detecting Collaborative Dynamics Using Mobile Eye-Trackers

Guillaume Zufferey, Sébastien Cuendet, Pierre Dillenbourg, Bertrand Roland Schneider, Kshitij Sharma

: Prior work has successfully described how low and high-performing dyads of students differ in terms of their visual synchronization (e.g., Barron, 2000; Jermann, Mullins, Nuessli & Dillenbourg, 2011). But there is far less work analyzing the diversity of ...

2016

Estimating Fusion Weights of a Multi-Camera Eye Tracking System by Leveraging User Calibration Data

Jean-Philippe Thiran, Nuri Murat Arar

Cross-ratio (CR)-based eye tracking has been attracting much interest due to its simple setup, yet its accuracy is lower than that of the model-based approaches. In order to improve the estimation accuracy, a multi-camera setup can be exploited rather than ...

Assoc Computing Machinery2016

Gaze Analysis methods for Learning Analytics

Kshitij Sharma

Eye-tracking had been shown to be predictive of expertise, task-based success, task-difficulty, and the strategies involved in problem solving, both in the individual and collaborative settings. In learning analytics, eye-tracking could be used as a powerf ...

EPFL2015

Are All Pixels Equally Important? Towards Multi-Level Salient Object Detection

Gökhan Yildirim

When we look at our environment, we primarily pay attention to visually distinctive objects. We refer to these objects as visually important or salient. Our visual system dedicates most of its processing resources to analyzing these salient objects. An ana ...

EPFL2015