Publications related to Multi-pose lipreading and audio-visual speech recognition

Related publications (31)

Predicting Visual Stimuli From Cortical Response Recorded With Wide-Field Imaging in a Mouse

Neural decoding of the visual system is a subject of research interest, both to understand how the visual system works and to be able to use this knowledge in areas, such as computer vision or brain-computer interfaces. Spike-based decoding is often used, ...

Ieee-Inst Electrical Electronics Engineers Inc2024

Probing and modulating inter-areal coupling in the cortical visual motion processing pathway with non-invasive brain stimulation

Michele Bevilacqua

In the last few years, stroke ranked as the second most common cause of death and is the third most significant condition affecting disability-adjusted life years (DALYs) worldwide. Being the most prevalent and quality of life impacting post-stroke symptom ...

EPFL2024

Random matrix methods for high-dimensional machine learning models

Antoine Philippe Michel Bodin

In the rapidly evolving landscape of machine learning research, neural networks stand out with their ever-expanding number of parameters and reliance on increasingly large datasets. The financial cost and computational resources required for the training p ...

EPFL2024

Decoding electroencephalographic responses to visual stimuli compatible with electrical stimulation

Silvestro Micera, Laura Toni, Fiorenzo Artoni, Simone Romeni

Electrical stimulation of the visual nervous system could improve the quality of life of patients affected by acquired blindness by restoring some visual sensations, but requires careful optimization of stimulation parameters to produce useful perceptions. ...

Aip Publishing2024

SVGC-AVA: 360-Degree Video Saliency Prediction With Spherical Vector-Based Graph Convolution and Audio-Visual Attention

Pascal Frossard

Viewers of 360-degree videos are provided with both visual modality to characterize their surrounding views and audio modality to indicate the sound direction. Though both modalities are important for saliency prediction, little work has been done by joint ...

Ieee-Inst Electrical Electronics Engineers Inc2024

Serial Dependence in Human Visual Perception and Decision-Making

Gizay Ceylan

Decisions about a current visual stimulus are systematically biased by recently encountered stimuli, a phenomenon known as serial dependence. In human vision, for instance, we tend to report the features of current images as more similar â i.e., an attra ...

EPFL2024

Alpha peak frequency affects visual performance beyond temporal resolution

Michael Herzog, Maya Roinishvili, David Pascucci, Maëlan Quentin Menétrey

Recent work suggests that the individual alpha peak frequency (IAPF) reflects the temporal resolution of visual processing: individuals with higher IAPF can segregate stimuli at shorter intervals compared to those with lower IAPF. However, this evidence ma ...

2024

Weak correlations between visual abilities in healthy older adults, despite long-term performance stability

Michael Herzog, Simona Adele Garobbio

Using batteries of visual tests, most studies have found that there are only weak correlations between the performance levels of the tests. Factor analysis has confirmed these results. This means that a participant excelling in one test may rank low in ano ...

2024

Course Design - A Visual and Modular Approach

Marc Laperrouza

This book has been designed for instructors in higher education or adult training who wish to develop a new course or revise an existing one. It adopts a practical, visual, and modular approach based on the principle of constructive alignment. At its heart ...

EPFL Press2024

Temporal aspects of feature integration in vision

Lukas Vogelsang

To fully comprehend visual perception, we need to necessarily understand its temporal dimension. Our visual environment is highly dynamic, requiring the processing and integration of temporal signals in order to make sense of it. Many processes, such as th ...

EPFL2024

Variability is the rule: Neurophysiology and contextual visual processing in schizophrenia

Dario Alejandro Gordillo Lopez

Traditionally, studies in schizophrenia research employ a single experimental paradigm. The results typically demonstrate a significant difference between patients and controls. Subsequent studies aim to describe the underlying abnormal mechanism at the ge ...

EPFL2024

Machine learning models for prediction of electrochemical properties in supercapacitor electrodes using MXene and graphene nanoplatelets

Mohammad Khaja Nazeeruddin

Herein, machine learning (ML) models using multiple linear regression (MLR), support vector regression (SVR), random forest (RF) and artificial neural network (ANN) are developed and compared to predict the output features viz. specific capacitance (Csp), ...

Elsevier Science Sa2024

On distributional autoregression and iterated transportation

Victor Panaretos, Laya Ghodrati

We consider the problem of defining and fitting models of autoregressive time series of probability distributions on a compact interval of Double-struck capital R. An order-1 autoregressive model in this context is to be understood as a Markov chain, where ...

Wiley2024

Aggregating Spatial and Photometric Context for Photometric Stereo

David Honzátko

Photometric stereo, a computer vision technique for estimating the 3D shape of objects through images captured under varying illumination conditions, has been a topic of research for nearly four decades. In its general formulation, photometric stereo is an ...

EPFL2024

VDM-based navigation for Delta-wing UAVs: Models, calibration, implementation

Pasquale Longobardi

Autonomous navigation of small UAVs is typically based on the integration of inertial navigation systems (INS) together with global navigation satellite systems (GNSS). However, GNSS signals can face various forms of interference affecting their continuous ...

EPFL2024

Iterative removal of sources to model the turbulent electromotive force

Salim Bennouna, Abhijit Bhausaheb Bendre

We describe a novel method to compute the components of dynamo tensors from direct magnetohydrodynamic (MHD) simulations. Our method relies upon an extension and generalization of the standard H & ouml;gbom CLEAN algorithm widely used in radio astronomy to ...

Oxford Univ Press2024

Reliable uncertainties: Error correlation, rotated error bars, and linear regressions in three-isotope plots and beyond

Reto Georg Trappitsch

Correlated errors of experimental data are a common but often neglected problem in physical sciences. Various tools are provided here for thorough propagation of uncertainties in cases of correlated errors. Discussed are techniques especially applicable to ...

ELSEVIER2023

Convolutional neural network classifies visual stimuli from cortical response recorded with wide-field imaging in mice

Silvestro Micera

Objective. The optic nerve is a good location for a visual neuroprosthesis. It can be targeted when a subject cannot receive a retinal prosthesis and it is less invasive than a cortical implant. The effectiveness of an electrical neuroprosthesis depends on ...

IOP Publishing Ltd2023

Recognizing distant faces

Lukas Vogelsang

As an 'early alerting' sense, one of the primary tasks for the human visual system is to recognize distant objects. In the specific context of facial identification, this ecologically important task has received surprisingly little attention. Most studies ...

PERGAMON-ELSEVIER SCIENCE LTD2023

The role of the visual field size in artificial vision

Diego Ghezzi

Objective. Artificial vision has been and still is the subject of intense research. The ultimate goal is to help blind people in their daily life. Approaches to artificial vision, including visual prostheses and optogenetics, have strongly focused on resto ...

IOP Publishing Ltd2023