Publications related to Using entropy as a stream reliability estimate for audio-visual speech recognition

Related publications (30)

Probing and modulating inter-areal coupling in the cortical visual motion processing pathway with non-invasive brain stimulation

In the last few years, stroke ranked as the second most common cause of death and is the third most significant condition affecting disability-adjusted life years (DALYs) worldwide. Being the most prevalent and quality of life impacting post-stroke symptom ...

EPFL2024

Alpha peak frequency affects visual performance beyond temporal resolution

Michael Herzog, Maya Roinishvili, David Pascucci, Maëlan Quentin Menétrey

Recent work suggests that the individual alpha peak frequency (IAPF) reflects the temporal resolution of visual processing: individuals with higher IAPF can segregate stimuli at shorter intervals compared to those with lower IAPF. However, this evidence ma ...

2024

Serial Dependence in Human Visual Perception and Decision-Making

Gizay Ceylan

Decisions about a current visual stimulus are systematically biased by recently encountered stimuli, a phenomenon known as serial dependence. In human vision, for instance, we tend to report the features of current images as more similar â i.e., an attra ...

EPFL2024

Seebeck Coefficient of Ionic Conductors from Bayesian Regression Analysis

Paolo Pegolo

We propose a novel approach to evaluating the ionic Seebeck coefficient in electrolytes from relatively short equilibrium molecular dynamics simulations, based on the Green-Kubo theory of linear response and Bayesian regression analysis. By exploiting the ...

Amer Chemical Soc2024

SVGC-AVA: 360-Degree Video Saliency Prediction With Spherical Vector-Based Graph Convolution and Audio-Visual Attention

Pascal Frossard

Viewers of 360-degree videos are provided with both visual modality to characterize their surrounding views and audio modality to indicate the sound direction. Though both modalities are important for saliency prediction, little work has been done by joint ...

Ieee-Inst Electrical Electronics Engineers Inc2024

Predicting Visual Stimuli From Cortical Response Recorded With Wide-Field Imaging in a Mouse

Silvestro Micera

Neural decoding of the visual system is a subject of research interest, both to understand how the visual system works and to be able to use this knowledge in areas, such as computer vision or brain-computer interfaces. Spike-based decoding is often used, ...

Ieee-Inst Electrical Electronics Engineers Inc2024

Temporal aspects of feature integration in vision

Lukas Vogelsang

To fully comprehend visual perception, we need to necessarily understand its temporal dimension. Our visual environment is highly dynamic, requiring the processing and integration of temporal signals in order to make sense of it. Many processes, such as th ...

EPFL2024

Technosignatures Longevity and Lindy's Law

Claudio Grimaldi

The probability of detecting technosignatures (i.e., evidence of technological activity beyond Earth) increases with their longevity, or the time interval over which they manifest. Therefore, the assumed distribution of longevities has some bearing on the ...

Iop Publishing Ltd2024

Instabilities in Elastic and Magneto-Elastic Beams and Shells: from Shell Buckling to the Design of a Programmable Braille Reader

Arefeh Abbasi

In this thesis, we conduct a comprehensive investigation into structural instabilities of both elastic and magneto-elastic beams and shells, resulting in a creative proposal to design a programmable braille reader. Methodologically, we combine numerical si ...

EPFL2024

On distributional autoregression and iterated transportation

Victor Panaretos, Laya Ghodrati

We consider the problem of defining and fitting models of autoregressive time series of probability distributions on a compact interval of Double-struck capital R. An order-1 autoregressive model in this context is to be understood as a Markov chain, where ...

Wiley2024

Information Spectrum Converse for Minimum Entropy Couplings and Functional Representations

Yanina Yurina Shkel, Anuj Kumar Yadav

Given two jointly distributed random variables (X,Y), a functional representation of X is a random variable Z independent of Y, and a deterministic function g(⋅,⋅) such that X=g(Y,Z). The problem of finding a minimum entropy functional representation is kn ...

2023

Convolutional neural network classifies visual stimuli from cortical response recorded with wide-field imaging in mice

Silvestro Micera

Objective. The optic nerve is a good location for a visual neuroprosthesis. It can be targeted when a subject cannot receive a retinal prosthesis and it is less invasive than a cortical implant. The effectiveness of an electrical neuroprosthesis depends on ...

IOP Publishing Ltd2023

Investigating the Serotonergic Modulation of Orientation Tuning of Neurons in Primary Visual Cortex of Anesthetized Mice

Parviz Ghaderi

Introduction: Sensory processing is profoundly regulated by brain neuromodulatory systems. One of the main neuromodulators is serotonin which influences higher cognitive functions, such as different aspects of perceptual processing. Accordingly, malfunctio ...

Iran Univ Medical Sciences2023

Sparse Autoencoders for Speech Modeling and Recognition

Selen Hande Kabil

Speech recognition-based applications upon the advancements in artificial intelligence play an essential role to transform most aspects of modern life. However, speech recognition in real-life conditions (e.g., in the presence of overlapping speech, varyin ...

EPFL2023

Novel Methods For Detection And Analysis Of Atypical Aspects In Speech

Julian David Fritsch

Atypical aspects in speech concern speech that deviates from what is commonly considered normal or healthy. In this thesis, we propose novel methods for detection and analysis of these aspects, e.g. to monitor the temporary state of a speaker, diseases tha ...

EPFL2023

Engineering random spin models with atoms in a high-finesse cavity

Jean-Philippe Brantut, Nick Jacob Sauerwein, Tigrane Arthur Cantat Moltrecht, Francesca Orsi

Random spin models play a key role in our understanding of disorder and complex many-body systems. Two all-to-all interacting, disordered models have now been realized using a cavity quantum electrodynamics platform. ...

NATURE PORTFOLIO2023

Beyond the ultradeep frontier fields and legacy observations (BUFFALO): a high-resolution strong plus weak-lensing view of Abell 370

David Richard Harvey

The HST treasury programme BUFFALO provides extended wide-field imaging of the six Hubble Frontier Fields galaxy clusters. Here we present the combined strong and weak-lensing analysis of Abell 370, a massive cluster at z = 0.375. From the reconstructed to ...

OXFORD UNIV PRESS2023

Two antagonistic response regulators control Pseudomonas aeruginosa polarization during mechanotaxis

Alexandre Louis André Persat, Lorenzo Anton-Louis Talà, Xavier Jean-Yves Pierrat, Zaïnebe Dhirani, Marco Julian Kühn

The opportunistic pathogen Pseudomonas aeruginosa adapts to solid surfaces to enhance virulence and infect its host. Type IV pili (T4P), long and thin filaments that power surface-specific twitching motility, allow single cells to sense surfaces and contro ...

WILEY2023

Deep Generative Models for Autonomous Driving: from Motion Forecasting to Realistic Image Synthesis

Saeed Saadatnejad

Forecasting is a capability inherent in humans when navigating. Humans routinely plan their paths, considering the potential future movements of those around them. Similarly, to achieve comparable sophistication and safety, autonomous systems must embrace ...

EPFL2023

Resource aware pricing for electric vehicle charging

Nils Gustav Nilsson

Electric vehicle charging facilities offer their capacity constrained electric charge and parking to users for a fee. As electric vehicle adoption grows, so too does the potential for excessive resource utilization. In this paper, we study how prices set b ...

PERGAMON-ELSEVIER SCIENCE LTD2023