Publications related to From Sentence to Emotion: a real-time 3D graphics metaphor of emotions extracted from text

Related publications (34)

An immersive virtual reality tool for assessing left and right unilateral spatial neglect

Olaf Blanke, Andrea Serino, Roberta Ronchi

The reported rate of the occurrence of unilateral spatial neglect (USN) is highly variable likely due to the lack of validity and low sensitivity of classical tools used to assess it. Virtual reality (VR) assessments try to overcome these limitations by pr ...

Wiley2024

Generalization and Personalization of Machine Learning for Multimodal Mobile Sensing in Everyday Life

Lakmal Buddika Meegahapola

A range of behavioral and contextual factors, including eating and drinking behavior, mood, social context, and other daily activities, can significantly impact an individual's quality of life and overall well-being. Therefore, inferring everyday life aspe ...

EPFL2024

Customizing the human-avatar mapping based on EEG error related potentials during avatar-based interaction

Olaf Blanke, José del Rocio Millán Ruiz, Ronan Boulic, Ricardo Andres Chavarriaga Lozano, Bruno Herbelin, Fumiaki Iwane, Thibault Serge Mario Porssut

Objective. A key challenge of virtual reality (VR) applications is to maintain a reliable human-avatar mapping. Users may lose the sense of controlling (sense of agency), owning (sense of body ownership), or being located (sense of self-location) inside th ...

2024

Advancing Self-Supervised Deep Learning for 3D Scene Understanding

Seyed Mohammad Mahdi Johari

Recent advancements in deep learning have revolutionized 3D computer vision, enabling the extraction of intricate 3D information from 2D images and video sequences. This thesis explores the application of deep learning in three crucial challenges of 3D com ...

EPFL2024

Neural signatures of visuo-motor integration during human-robot interactions

Olaf Blanke, Hannes Bleuler, Giulio Rognini, Fosco Bernasconi, Silvia Marchesotti

Visuo-motor integration shapes our daily experience and underpins the sense of feeling in control over our actions. The last decade has seen a surge in robotically and virtually mediated interactions, whereby bodily actions ultimately result in an artifici ...

FRONTIERS MEDIA SA2023

Updates on moleculARweb, the Swiss Portal for Chemistry and Structural Biology Education Using Augmented and now also Virtual Reality

Luciano Andres Abriata, Fabio Jose Cortes Rodriguez

We present a new activity on the moleculARweb plat-form on molecular symmetry elements, two more languages, a new marker-less augmented reality mode, and a new virtual reality tool for VR headsets. ...

SWISS CHEMICAL SOC2023

Affordance segmentation of hand-occluded containers from exocentric images

Andrea Cavallaro

Visual affordance segmentation identifies the surfaces of an object an agent can interact with. Common challenges for the identification of affordances are the variety of the geometry and physical properties of these surfaces as well as occlusions. In this ...

Ieee Computer Soc2023

Validating functional redundancy with mixed generative adversarial networks

Quoc Viet Hung Nguyen, Thành Tâm Nguyên, Thanh Trung Huynh

Data redundancy has been one of the most important problems in data-intensive applications such as data mining and machine learning. Removing data redundancy brings many benefits in efficient data updating, effective data storage, and error-free query proc ...

ELSEVIER2023

Empathetic Conversational Agents for Distress Support

Kalpani Anuradha Welivita

Due to the increasing demands of today's fast-paced world, mental health concerns are on the rise, which necessitates innovative approaches to provide support to those in need. Open-domain conversational agents known as chatbots, offer a unique opportunit ...

EPFL2023

Compassion and Engineering Students’ Moral Reasoning: The Emotional Experience of Engineering Ethics Cases

Roland John Tormey, Nihat Kotluk

Background: There has been an increase in interest in emotion in engineering and science ethics education. There is also evidence that emotional content in case studies may improve students’ learning and enhance awareness, understanding, and motivation con ...

American Society for Engineering Education2023

'connEcted caesarean section': creating a virtual link between MOthers and their infanTs to ImprOve maternal childbirth experieNce - study protocol for a PILOT trial (e-motion-pilot)

Sandra Maria Marcadent

IntroductionOne-third of mothers rate their childbirth as traumatic. The prevalence of childbirth-related post-traumatic stress disorder (CB-PTSD) is 4.7%. Skin-to-skin contact is a protective factor against CB-PTSD. However, during a caesarean section (CS ...

BMJ PUBLISHING GROUP2023

Automated neuron tracking inside moving and deforming C. elegans using deep learning and targeted augmentation

Ariane Andrée Marie Delrocq, Sahand Jamal Rahi

Reading out neuronal activity from three-dimensional (3D) functional imaging requires segmenting and tracking individual neurons. This is challenging in behaving animals if the brain moves and deforms. The traditional approach is to train a convolutional n ...

Nature Publishing Group2023

Academic boredom(s): a person-centered investigation

Alexandra Corina Niculescu

Should we refer to boredom or boredoms? Research on the emotion of boredom sets itself apart from studies on other emotions by posing the question: is boredom a singular concept or does it have multiple facets? In this manuscript presenting empirical resea ...

2023

Projector-based augmented stacking framework for irregularly shaped objects

Katrin Beyer, Yves Weinand, Julien Gamerro, Edward Carlo Giorgio Andò, Andrea Settimi, Qianqing Wang

Augmented reality in additive fabrication is predominantly applied to the manufacturing of structures from regularly shaped materials. Our work however embraces natural heterogeneity, by focusing on the assembly of irregularly shaped elements such as miner ...

2023

ms3: A parser for MuseScore files, serving as data factory for annotated music corpora

Martin Alois Rohrmeier, Johannes Hentschel

The Python library ms3 makes scores (symbolic representations of music) operational for computational approaches by representing their contents as sets of tabular files. Music scores represent relations between sounding events by graphical means. The Free ...

2023

A Wearable Smart Glove and Its Application of Pose and Gesture Detection to Sign Language Classification

Josephine Anna Eleanor Hughes

Advances in soft sensors coupled with machine learning are enabling increasingly capable wearable systems. Since hand motion in particular can convey useful information for developing intuitive interfaces, glove-based systems can have a significant impact ...

Institute of Electrical and Electronics Engineers Inc.2022

Making the collective knowledge of chemistry open and machine actionable

Berend Smit, Luc Patiny, Kevin Maik Jablonka

Large amounts of data are generated in chemistry labs-nearly all instruments record data in a digital form, yet a considerable proportion is also captured non-digitally and reported in ways non-accessible to both humans and their computational agents. Chem ...

NATURE PORTFOLIO2022

Cockroach: an open-source tool for point cloud processing in cad

Yves Weinand, Julien Gamerro, Andrea Settimi, Petras Vestartas

In the architecture, engineering and construction (AEC) sector, the use of point cloud data is not a novelty. Usually employed to retrieve data for inspecting construction sites or retrofitting pre-existing buildings, sensors like LiDAR cameras have been k ...

Association for Computer-Aided Architectural Design Research in Asia (CAADRIA)2022

Towards Empathetic Open-Domain Chatbots

Yubo Xie

The research community of dialog generation has been interested in incorporating emotional information into the design of open-domain dialog systems ever since neural networks (sequence-to-sequence models in particular) were adopted for modeling dialogs. T ...

EPFL2022

Serab: A Multi-Lingual Benchmark For Speech Emotion Recognition

Pierre Anton Beckmann

Recent developments in speech emotion recognition (SER) often leverage deep neural networks (DNNs). Comparing and benchmarking different DNN models can often be tedious due to the use of different datasets and evaluation protocols. To facilitate the proces ...

IEEE2022