Using entropy as a stream reliability estimate for audio-visual speech recognition

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

In the last few years, stroke ranked as the second most common cause of death and is the third most significant condition affecting disability-adjusted life years (DALYs) worldwide. Being the most prevalent and quality of life impacting post-stroke symptom ...

Recent work suggests that the individual alpha peak frequency (IAPF) reflects the temporal resolution of visual processing: individuals with higher IAPF can segregate stimuli at shorter intervals compared to those with lower IAPF. However, this evidence ma ...

Decisions about a current visual stimulus are systematically biased by recently encountered stimuli, a phenomenon known as serial dependence. In human vision, for instance, we tend to report the features of current images as more similar â i.e., an attra ...

We propose a novel approach to evaluating the ionic Seebeck coefficient in electrolytes from relatively short equilibrium molecular dynamics simulations, based on the Green-Kubo theory of linear response and Bayesian regression analysis. By exploiting the ...

Viewers of 360-degree videos are provided with both visual modality to characterize their surrounding views and audio modality to indicate the sound direction. Though both modalities are important for saliency prediction, little work has been done by joint ...

Neural decoding of the visual system is a subject of research interest, both to understand how the visual system works and to be able to use this knowledge in areas, such as computer vision or brain-computer interfaces. Spike-based decoding is often used, ...

To fully comprehend visual perception, we need to necessarily understand its temporal dimension. Our visual environment is highly dynamic, requiring the processing and integration of temporal signals in order to make sense of it. Many processes, such as th ...

The probability of detecting technosignatures (i.e., evidence of technological activity beyond Earth) increases with their longevity, or the time interval over which they manifest. Therefore, the assumed distribution of longevities has some bearing on the ...

We study a robust auction design problem with a minimax regret objective, where a seller seeks a mechanism for selling multiple items to multiple anonymous bidders with additive values. The seller knows that the bidders' values range over a box uncertainty ...

In this thesis, we conduct a comprehensive investigation into structural instabilities of both elastic and magneto-elastic beams and shells, resulting in a creative proposal to design a programmable braille reader. Methodologically, we combine numerical si ...

Conscious perception is preceded by long periods of unconscious processing. These periods are crucial for analyzing temporal information and for solving the many ill-posed problems of vision. An important question is what starts and ends these windows and ...

We propose a statistically optimal approach to construct data-driven decisions for stochastic optimization problems. Fundamentally, a data-driven decision is simply a function that maps the available training data to a feasible action. It can always be exp ...

We consider the problem of defining and fitting models of autoregressive time series of probability distributions on a compact interval of Double-struck capital R. An order-1 autoregressive model in this context is to be understood as a Markov chain, where ...

Distributionally robust chance constrained programs minimize a deterministic cost function subject to the satisfaction of one or more safety conditions with high probability, given that the probability distribution of the uncertain problem parameters affec ...

Given two jointly distributed random variables (X,Y), a functional representation of X is a random variable Z independent of Y, and a deterministic function g(⋅,⋅) such that X=g(Y,Z). The problem of finding a minimum entropy functional representation is kn ...

In this work, we consider the problem of estimating the probability distribution, the quantile or the conditional expectation above the quantile, the so called conditional-value-at-risk, of output quantities of complex random differential models by the MLM ...

Introduction Recent work has shown an association between cognitive and visual impairments and two main theories were advanced, namely the sensory deprivation and the common cause theories. Most studies considered only basic visual functions such as visual ...

Introduction: Sensory processing is profoundly regulated by brain neuromodulatory systems. One of the main neuromodulators is serotonin which influences higher cognitive functions, such as different aspects of perceptual processing. Accordingly, malfunctio ...

Speech recognition-based applications upon the advancements in artificial intelligence play an essential role to transform most aspects of modern life. However, speech recognition in real-life conditions (e.g., in the presence of overlapping speech, varyin ...

Atypical aspects in speech concern speech that deviates from what is commonly considered normal or healthy. In this thesis, we propose novel methods for detection and analysis of these aspects, e.g. to monitor the temporary state of a speaker, diseases tha ...

Using entropy as a stream reliability estimate for audio-visual speech recognition

Chat with Graph Search

Probing and modulating inter-areal coupling in the cortical visual motion processing pathway with non-invasive brain stimulation

Alpha peak frequency affects visual performance beyond temporal resolution

Serial Dependence in Human Visual Perception and Decision-Making

Seebeck Coefficient of Ionic Conductors from Bayesian Regression Analysis

SVGC-AVA: 360-Degree Video Saliency Prediction With Spherical Vector-Based Graph Convolution and Audio-Visual Attention

Predicting Visual Stimuli From Cortical Response Recorded With Wide-Field Imaging in a Mouse

Temporal aspects of feature integration in vision

Technosignatures Longevity and Lindy's Law

Regret Minimization and Separation in Multi-Bidder Multi-Item Auctions

Instabilities in Elastic and Magneto-Elastic Beams and Shells: from Shell Buckling to the Design of a Programmable Braille Reader

Temporal windows of unconscious processing cannot easily be disrupted

A Pareto Dominance Principle for Data-Driven Optimization

On distributional autoregression and iterated transportation

On Approximations of Data-Driven Chance Constrained Programs over Wasserstein Balls

Information Spectrum Converse for Minimum Entropy Couplings and Functional Representations

Quantifying uncertain system outputs via the multi-level Monte Carlo method --- distribution and robustness measures

No Common Factor Underlying Decline of Visual Abilities in Mild Cognitive Impairment

Investigating the Serotonergic Modulation of Orientation Tuning of Neurons in Primary Visual Cortex of Anesthetized Mice

Sparse Autoencoders for Speech Modeling and Recognition

Novel Methods For Detection And Analysis Of Atypical Aspects In Speech