Publications related to Multimodal Dataset for Assessment of Quality of Experience in Immersive Multimedia

An insular cortex - lateral amygdala network in fear learning

Animals are capable of evaluating sensory cues for possible threats and adapting their behaviours accordingly. Fear learning is an evolutionarily conserved behaviour crucial for animal survival, during which sensory percepts with a negative reinforcing qua ...

EPFL2022

Sound Field Reconstruction in a room through Sparse Recovery and its application in Room Modal Equalization

Vu Thach Pham

The acoustics of a room often refer to the quality of the room in terms of sound recording as well as sound reproduction. At low frequencies, where the wavelengths are of the same order of magnitude with the dimensions of the room, due to the standing wave ...

EPFL2021

Electrical Signal Modeling in Cochlear Implants. Study of Temperature and Humidity Effects

Maria-Alexandra Paun

The present paper discusses the climatic effects of humidity and temperature on cochlear implant functioning and the quality of the electrical sound signal. MATLAB Simulink simulations were prepared, offering insights into signal behavior under such climat ...

MDPI2021

Low frequency sound field reconstruction in a non-rectangular room using a small number of microphones

Hervé Lissek, Vu Thach Pham

An accurate knowledge of the sound field distribution inside a room is required to identify and optimally locate corrective measures for room acoustics. However, the spatial recovery of the sound field would result in an impractically high number of microp ...

2020

Good Vibrations and Unknown Excitations

Dalia Salem Hassan Fahmy El Badawy

Inspired by the human ability to localize sounds, even with only one ear, as well as to recognize objects using active echolocation, we investigate the role of sound scattering and prior knowledge in regularizing ill-posed inverse problems in acoustics. In ...

EPFL2020

Context-based Quality of Experience in Immersive Multimedia

Anne-Flore Nicole Marie Perrin

Since 1895, when the Lumière brothers came out with the projected cinematograph, motion pictures and more generally multimedia contents have considerably improved and are still experiencing a very dynamic development. Advances involved improving various mo ...

EPFL2019

Subjective Evaluation of 360-degree Sensory Experiences

Pascal Frossard, Roberto Gerson De Albuquerque Azevedo

Traditionally, most multimedia content has been developed to stimulate two of the human senses, i.e., sight and hearing. Due to recent technological advancements, however, innovative services have been developed that provide more realistic, immersive, and ...

IEEE2019

Between the Lines: On the Explicit and Implicit in Writing and Building

Matthew Skjonsberg

Narratives employed when writing about a place and building a place have a central theme in common: both weave between the human, personal and emotional experience of place and the physical, spatial and atmospheric place – a dialogue between the inner and ...

2018

Low Frequency Sound Field Reconstruction in Non-rectangular Room: A Numerical Validation

Hervé Lissek, Etienne Thierry Jean-Luc Rivet, Vu Thach Pham

Characterization of sound fields in rooms has always been a challenging task. A faithful reconstruction of sound fields in rooms generally would require an impractically high number of microphones. At low frequencies, where sound field can be modeled as a ...

2018

Indoor environment as a multi-sensory experience: visual and thermal factor interactions

Marilyne Andersen, Giorgia Chinazzo, Jan Wienold

In our daily lives we are exposed simultaneously to multiple sensory stimuli, such as visual, thermal, acoustic and olfactory. Experienced together, they shape our perception of the environment and determine our comfort. In indoor environments, stimuli are ...

2018

Unconscious integration of multisensory bodily inputs in the peripersonal space shapes bodily self-consciousness

Olaf Blanke, Roy Salomon, Jean-Paul Noel, Andrea Serino, Marta Lukowska, Nathan Quentin Faivre

Recent studies have highlighted the role of multisensory integration as a key mechanism of self-consciousness. In particular, integration of bodily signals within the peripersonal space (PPS) underlies the experience of the self in a body we own (self-iden ...

Elsevier2017

Binary Sparse Coding of Convolutive Mixtures for Sound Localization and Separation via Spatialization

Hervé Bourlard, Afsaneh Asaei, Mohammadjavad Taghizadeh, Volkan Cevher, Saeid Haghighatshoar

We propose a sparse coding approach to address the problem of source-sensor localization and speech reconstruction. This approach relies on designing a dictionary of spatialized signals by projecting the microphone array recordings into the array manifolds ...

Institute of Electrical and Electronics Engineers2016

Wearable multimodal tactile interfaces for augmenting haptic perception

Simon Gallo

Haptic feedback has been used to faithfully restitute the haptic sense lacking during telemanipulation, but also for providing auxiliary information via the haptic channel to restore functional perception of missing or damaged senses, e.g. sensory substitu ...

EPFL2016

Multimodal stimulus coding by a gustatory sensory neuron in Drosophila larvae

Philippe Renaud

Accurate perception of taste information is crucial for animal survival. In adult Drosophila, gustatory receptor neurons (GRNs) perceive chemical stimuli of one specific gustatory modality associated with a stereotyped behavioural response, such as aversio ...

Nature Publishing Group2016

A sound diffusion system for directional sound enhancement

Xavier Falourd, Hervé Lissek, Alexandre Delidais, Alain Dufaux, Baptiste Crettaz, Patrick Marmaroli, Cédric Monchâtre

A loudspeaker array is described including several circular sound emitters that are bunked. One circular sound emitter can be either a circular array of loudspeakers (kind 1) or a toroidal loudspeaker (kind 2). The loudspeaker array can be composed of circ ...

André Roland S.A.2015

Through the Hourglass: A Faithful Audiovisual Reconstruction of the Old Montreux Casino

Martin Vetterli

In architecture, space is traditionally understood as a cumulus of forms, colors and textures that form a conceived area, or-in other words-architectural space design is mainly achieved by following visual concepts. The human experience of space, however, ...

Springer2015

Spatial Sound Localization via Multipath Euclidean Distance Matrix Recovery

Hervé Bourlard, Afsaneh Asaei, Mohammadjavad Taghizadeh, Philip Neil Garner, Saeid Haghighatshoar

A novel localization approach is proposed in order to find the position of an individual source using recordings of a single microphone in a reverberant enclosure. The multipath propagation is modeled by multiple virtual microphones as images of the actual ...

Ieee-Inst Electrical Electronics Engineers Inc2015

Audio-based Positioning and Target Localization for Swarms of Micro Aerial Vehicles

Meysam Basiri

Swarms of autonomous MAVs show great potential in many diverse applications. In a search and rescue mission, a group of MAVs could quickly reach disaster areas by flying over obstacles, cluttered and inaccessible terrains, and work in parallel to detect an ...

EPFL2015

Optimal Selection of Adaptive Streaming Representations

Pascal Frossard, Laura Toni

Adaptive streaming addresses the increasing and heterogenous demand of multimedia content over the Internet by offering several encoded versions for each video sequence. Each version (or representation) has a different resolution and bit rate, aimed at a s ...

Association for Computing Machinery2015

Emotion Detection and Recognition based on Brain and Peripheral Physiological Signals

Eleni Kroupi

Emotions affect and determine social relationships and interactions, memory and creativity, and influence the mechanisms of rational thinking and decision making. The influence of emotion on decision making has gained attention in computer science. By d ...

EPFL2014