Publications related to Eye-tracking and artificial intelligence to enhance motivation and learning

Related publications (30)

Saliency prediction in 360° architectural scenes: Performance and impact of daylight variations

Marilyne Andersen, Sabine Süsstrunk, Caroline Karmann, Kynthia Chamilothori, Seungryong Kim, Bahar Aydemir

Saliency models are image-based prediction models that estimate human visual attention. Such models, when applied to architectural spaces, could pave the way for design decisions where visual attention is taken into account. In this study, we tested the pe ...

2023

Non-verbal Communication between Humans and Robots: Imitation, Mutual Understanding and Inferring Object Properties

Nuno Ricardo Ferreira Duarte

Humans can express their actions and intentions, resorting to verbal and/or non-verbal communication. In verbal communication, humans use language to express, in structured linguistic terms, the desired action they wish to perform. Non-verbal communication ...

EPFL2023

Learning a QoE Metric from Social Media and Gaming Footage

Aikaterini Argyraki, Catalina Paz Alvarez Inostroza

Defining a universal metric for Quality of Experience (QoE) is notoriously hard due to the complex relationship between low-level performance metrics and user satisfaction. The most common metric, the Mean Opinion Score (MOS), has well-known biases and inc ...

2023

The Gaze Dialogue Model: Nonverbal Communication in HHI and HRI

Aude Billard, José Santos-Victor, Nuno Ricardo Ferreira Duarte

When humans interact with each other, eye gaze movements have to support motor control as well as communication. On the one hand, we need to fixate the task goal to retrieve visual information required for safe and precise action-execution. On the other ha ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2022

Explainability and Graph Learning From Social Interactions

Ali H. Sayed, Stefan Vlaski, Valentina Shumovskaia, Konstantinos Ntemos

Social learning algorithms provide models for the formation of opinions over social networks resulting from local reasoning and peer-to-peer exchanges. Interactions occur over an underlying graph topology, which describes the flow of information among the ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2022

How Florist Apprentices Explore Bouquet Designs: Supporting Design Space Exploration for Vocational Students

Pierre Dillenbourg, Kevin Gonyop Kim, Catharine Regina Monika Maria Oertel Genannt Bierbach

Context: Exploring the design space is an important process in a design task. In this study, we considered design space exploration for the learners in vocational education and training (VET). The goal of the study was to investigate how they explore the d ...

2021

Modeling and Inferring Attention between Humans or for Human-Robot Interactions

Rémy Alain Siegfried

More and more intelligent systems have to interact with humans. In order to communicate efficiently, these systems need to perceive and understand us. A key factor of communication is the people's visual focus of attention (VFOA), which is useful to estima ...

EPFL2021

Exploring Spatial Perspective Taking in Human-Robot Interaction

Elmira Yadollahi

Humans often rely on their perspective taking skills to thrive within the world's complex relations and connections. An adequate understanding of others' spatial perspectives can increase the quality of the interaction, not only perceptually but also cogni ...

EPFL2021

AlloHaptic: Robot-Mediated Haptic Collaboration for Learning Linear Functions

Pierre Dillenbourg, Barbara Bruno, Wafa Monia Benkaouar Johal, Aditi Kothiyal, Hala Khodr

Collaborative learning appears in a joint intellectual efforts of individuals to understand an object of knowledge collectively. In their search for understanding the problems, meanings, and solutions, learners employ different multi-modal strategies. In t ...

IEEE2020

Accurate Nod and 3D Gaze Estimation for Social Interaction Analysis

Yu Yu

Non-verbal behaviours play an important role in human communication since it can indicate human attention, serve as communication cue in interactions, or even reveal higher level personal constructs. For instance, head nod, a common non-verbal behaviour, c ...

EPFL2020

Towards everyday brain-computer interfacing through decoding visual cognition

Ruslan Aydarkhanov

Decoding visual cognition from non-invasive measurements of brain activity has shown valuable applications. Vision-based Brain-Computer Interfaces (BCI) systems extend from spellers to database search and spatial navigation. Despite the high performance of ...

EPFL2020

Stimuli-based Gaze Analytics to Enhance Motivation and Learning in MOOCs

Pierre Dillenbourg, Kshitij Sharma

The interaction with the various learners in a Massive Open Online Course (MOOC) is often complex. Contemporary MOOC learning analytics relate with click-streams, keystrokes and other user-input variables. Such variables however, do not always capture lear ...

IEEE2019

The dynamics of motor learning through the formation of internal models

Camilla Pierella

A medical student learning to perform a laparoscopic procedure or a recently paralyzed user of a powered wheelchair must learn to operate machinery via interfaces that translate their actions into commands for an external device. Since the user’s actions a ...

2019

Teaching Practical DSP with Off-the-Shelf Hardware and Free Software

Paolo Prandoni, Eric Bezzam, Adrien Guillaume Olivier Hoffet

In this paper we describe our approach to teaching applied digital signal processing (DSP) using freely-available software and inexpensive off-the-shelf hardware components. The pedagogical framework is built around simple real-time audio processing algori ...

IEEE2019

Towards Modelling of Visual Saliency in Point Clouds for Immersive Applications

Touradj Ebrahimi, Evangelos Alexiou

Modelling human visual attention is of great importance in the field of computer vision and has been widely explored for 3D imaging. Yet, in the absence of ground truth data, it is unclear whether such predictions are in alignment with the actual human vie ...

2019

Reverse-Engineering Satire, or "Paper on Computational Humor Accepted despite Making Serious Advances"

Robert West

Humor is an essential human trait. Efforts to understand humor have called out links between humor and the foundations of cognition, as well as the importance of humor in social engagement. As such, it is a promising and important subject of study, with re ...

ASSOC ADVANCEMENT ARTIFICIAL INTELLIGENCE2019

When and why performance goals predict exploitation behaviors: An achievement goal complex analysis of the selection function of assessment

Martin Jobin, David Nguyen, Fabrizio Butera, Hamza Sehaqui

We adopted an achievement goal complex framework (studying achievement goals and reasons connected to goals) to determine when and why performance goals predict exploitation of others' knowledge. We hypothesized that: (i) when selective assessment is used ...

SPRINGER/PLENUM PUBLISHERS2019

Augmented Reality to Facilitate a Conceptual Understanding of Statics in Vocational Education

Lorenzo Lucignano

At the core of the contribution of this dissertation there is an augmented reality (AR) environment, StaticAR, that supports the process of learning the fundamentals of statics in vocational classrooms, particularly in carpentry ones. Vocational apprentice ...

EPFL2018

Accelerated Sensorimotor Learning of Compliant Movement Primitives

Auke Ijspeert, Tadej Petric, Luca Colasanto

Autonomous trajectory generation through generalization requires a database of motion, which can be difficult and time consuming to obtain. In this paper, we propose a method for autonomous expansion of a database for the generation of compliant and accura ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2018

Robust Eye Tracking Based on Adaptive Fusion of Multiple Cameras

Nuri Murat Arar

Eye and gaze movements play an essential role in identifying individuals' emotional states, cognitive activities, interests, and attention among other behavioral traits. Besides, they are natural, fast, and implicitly reflect the targets of interest, which ...

EPFL2017