Publications related to Visual feature analysis for audio-visual speech recognition

Related publications (38)

Video-evoked neuromarkers of visual function in age-related macular degeneration

Angela Ingrid Renton, Dimitri Nestor Alice Van De Ville

Neural markers of visual function in age-related macular degeneration (AMD) allow clinicians and researchers to directly evaluate the functional changes in visual processing which occur as a result of the progressive loss of afferent input from the macula. ...

Frontiers Media SA2025

Using Virtual Reality to Improve Prosthetic Vision in Daily Life

Sandrine Brikh

Blindness remains one of the most impairing disabilities worldwide, profoundly affecting independence, social participation, and quality of life. While assistive technologies offer partial support, they do not restore visual function. Retinal prostheses re ...

EPFL2025

Feature-based encoding of face identity by single neurons in the human amygdala and hippocampus

Emanuela De Falco

Neurons in the human amygdala and hippocampus are classically thought to encode a person’s identity invariant to visual features. However, it remains largely unknown how visual information from higher visual cortical areas is translated into such a semanti ...

2025

Posterior-Based Analysis of Spatio-Temporal Features for Sign Language Assessment

Neha Tarigopula

Sign Language conveys information through multiple channels composed of manual (handshape, hand movement) and non-manual (facial expression, mouthing, body posture) components. Sign language assessment involves giving granular feedback to a learner, in ter ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2025

Mental State Recognition Deficits Linked to Brain Changes in Parkinson's Disease Without Dementia

Francesca Saviola

Recent studies have reported social cognitive deficits, particularly in emotional processing, in Parkinson's disease (PD). However, a comprehensive characterization of these deficits and their underlying neural correlates remains elusive. Therefore, this s ...

2025

Interact with Earth Observation Images using AI: Transparent Methods and Evaluation for Visual Question Answering

Christel Marie Tartini-Chappuis

Now is an exciting time for the domain of Earth observation (EO), with a multitude of diverse sensors looking at the planet from satellites, airplanes or drones. The volume of imagery acquired is massive, and hold great potential for a variety of applicati ...

EPFL2025

Probing and modulating inter-areal coupling in the cortical visual motion processing pathway with non-invasive brain stimulation

Michele Bevilacqua

In the last few years, stroke ranked as the second most common cause of death and is the third most significant condition affecting disability-adjusted life years (DALYs) worldwide. Being the most prevalent and quality of life impacting post-stroke symptom ...

EPFL2024

SVGC-AVA: 360-Degree Video Saliency Prediction With Spherical Vector-Based Graph Convolution and Audio-Visual Attention

Pascal Frossard

Viewers of 360-degree videos are provided with both visual modality to characterize their surrounding views and audio modality to indicate the sound direction. Though both modalities are important for saliency prediction, little work has been done by joint ...

Ieee-Inst Electrical Electronics Engineers Inc2024

Serial Dependence in Human Visual Perception and Decision-Making

Gizay Ceylan

Decisions about a current visual stimulus are systematically biased by recently encountered stimuli, a phenomenon known as serial dependence. In human vision, for instance, we tend to report the features of current images as more similar â i.e., an attra ...

EPFL2024

Decoding electroencephalographic responses to visual stimuli compatible with electrical stimulation

Silvestro Micera, Laura Toni, Fiorenzo Artoni, Simone Romeni

Electrical stimulation of the visual nervous system could improve the quality of life of patients affected by acquired blindness by restoring some visual sensations, but requires careful optimization of stimulation parameters to produce useful perceptions. ...

Aip Publishing2024

Predicting Visual Stimuli From Cortical Response Recorded With Wide-Field Imaging in a Mouse

Silvestro Micera

Neural decoding of the visual system is a subject of research interest, both to understand how the visual system works and to be able to use this knowledge in areas, such as computer vision or brain-computer interfaces. Spike-based decoding is often used, ...

Ieee-Inst Electrical Electronics Engineers Inc2024

Subjective performance evaluation of bitrate allocation strategies for MPEG and JPEG Pleno point cloud compression

Touradj Ebrahimi, Michela Testolina, Davi Nachtigall Lazzarotto

The recent rise in interest in point clouds as an imaging modality has motivated standardization groups such as JPEG and MPEG to launch activities aiming at developing compression standards for point clouds. Lossy compression usually introduces visual arti ...

Springer2024

Temporal aspects of feature integration in vision

Lukas Vogelsang

To fully comprehend visual perception, we need to necessarily understand its temporal dimension. Our visual environment is highly dynamic, requiring the processing and integration of temporal signals in order to make sense of it. Many processes, such as th ...

EPFL2024

Beyond rhythmic sampling: The long-lasting effects of alpha oscillations in visual processing

Maëlan Quentin Menétrey

Alpha oscillations represent the brain's electrical activity in the frequency range of 8 to 13 Hz. They are often considered to be the rhythm of conscious perception, rhythmically modulating the processing of sensory inputs. This interpretation has been dr ...

EPFL2024

Performing and Detecting Backdoor Attacks on Face Recognition Algorithms

Alexander Carl Unnervik

The field of biometrics, and especially face recognition, has seen a wide-spread adoption the last few years, from access control on personal devices such as phones and laptops, to automated border controls such as in airports. The stakes are increasingly ...

EPFL2024

Template Inversion Attack Using Synthetic Face Images Against Real Face Recognition Systems

Hatef Otroshi Shahreza

In this paper, we use synthetic data and propose a new method for template inversion attacks against face recognition systems. We use synthetic data to train a face reconstruction model to generate high-resolution (i.e., 1024 x 1024) face images from facia ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2024

The Current State of the OBI DICT Project: A Bilingual e-Dictionary of Oracle-Bone Inscriptions with AI Image Recognition

Shuo Wen

This article reports on the current state of the OBI DICT project, a bilingual e-dictionary of oracle-bone inscriptions (OBI), incorporating artificial intelligence (AI) image recognition technology. It first provides a brief overview of the development of ...

Buro Van Die Wat2024

Course Design - A Visual and Modular Approach

Marc Laperrouza

This book has been designed for instructors in higher education or adult training who wish to develop a new course or revise an existing one. It adopts a practical, visual, and modular approach based on the principle of constructive alignment. At its heart ...

EPFL Press2024

Visual complexity of urban streetscapes: human vs computer vision

Pietro Florio

Understanding visual complexity of urban environments may improve urban design strategies and limit visual pollution due to advertising, road signage, telecommunication systems and machinery. This paper aims at quantifying visual complexity specifically in ...

Springer2024

PRO-Face C: Privacy-Preserving Recognition of Obfuscated Face via Feature Compensation

Touradj Ebrahimi, Lin Yuan, Xiao Pu

The advancement of face recognition technology has delivered substantial societal advantages. However, it has also raised global privacy concerns due to the ubiquitous collection and potential misuse of individuals' facial data. This presents a notable par ...

Ieee-Inst Electrical Electronics Engineers Inc2024