Low-Dimensional Motion Features for Audio-Visual Speech Recognition

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

Predicting the evolution of systems with spatio-temporal dynamics in response to external stimuli is essential for scientific progress. Traditional equations-based approaches leverage first principles through the numerical approximation of differential equ ...

Video DeepFakes are fake media created with Deep Learning (DL) that manipulate a person’s expression or identity. Most current DeepFake detection methods analyze each frame independently, ignoring inconsistencies and unnatural movements between frames. Som ...

Photometric stereo, a computer vision technique for estimating the 3D shape of objects through images captured under varying illumination conditions, has been a topic of research for nearly four decades. In its general formulation, photometric stereo is an ...

The remarkable ability of deep learning (DL) models to approximate high-dimensional functions from samples has sparked a revolution across numerous scientific and industrial domains that cannot be overemphasized. In sensitive applications, the good perform ...

Speech recognition-based applications upon the advancements in artificial intelligence play an essential role to transform most aspects of modern life. However, speech recognition in real-life conditions (e.g., in the presence of overlapping speech, varyin ...

Atypical aspects in speech concern speech that deviates from what is commonly considered normal or healthy. In this thesis, we propose novel methods for detection and analysis of these aspects, e.g. to monitor the temporary state of a speaker, diseases tha ...

Integration across space and time is essential for the analysis of motion, low contrast, and many more stimuli. A crucial question is what determines the duration of integration. Based on classical models of decision-making, one might expect that integrati ...

Does gravity affect decision-making? This question comes into sharp focus as plans for interplanetary human space missions solidify. In the framework of Bayesian brain theories, gravity encapsulates a strong prior, anchoring agents to a reference frame via ...

VR (Virtual Reality) is a real-time simulation that creates the subjective illusion of being in a virtual world. This thesis explores how integrating the user's body and fingers can be achieved and beneficial for the user to experience VR. At the advent of ...

Human motion analysis and synthesis is integral to many computer vision applications, from autonomous driving to sports analysis. In this thesis, we address several problems in this domain. First we consider active viewpoint selection for pose estimation w ...

The thesis at hand is concerned with robots' navigation in human crowds. Specifically, methods are developed for planning a mobile robot's local motion between pedestrians, and they are evaluated in experiments where a robot interacts with real pedestrians ...

In the current era of big data, aggregation queries on high-dimensional datasets are frequently utilized to uncover hidden patterns, trends, and correlations critical for effective business decision-making. Data cubes facilitate such queries by employing p ...

In light of steady progress in machine learning, automatic speech recognition (ASR) is entering more and more areas of our daily life, but people with dysarthria and other speech pathologies are left behind. Their voices are underrepresented in the trainin ...

Self-supervised learning (SSL) models use only the intrinsic structure of a given signal, independent of its acoustic domain, to extract essential information from the input to an embedding space. This implies that the utility of such representations is no ...

Principal component analysis (PCA) is an essential algorithm for dimensionality reduction in many data science domains. We address the problem of performing a federated PCA on private data distributed among multiple data providers while ensuring data confi ...

The use of meteorological radars to study snowfall microphysical properties and processes is well established, in particular via a few distinct techniques: the use of radar polarimetry, of multi-frequency radar measurements, and of the radar Doppler spectr ...

The respiratory system is an integral part of human speech production. As a consequence, there is a close relation between respiration and speech signal, and the produced speech signal carries breathing pattern related information. Speech can also be gener ...

Many pathologies cause impairments in the speech production mechanism resulting in reduced speech intelligibility and communicative ability. To assist the clinical diagnosis, treatment and management of speech disorders, automatic pathological speech asses ...

Voice activity detection (VAD) is an important pre-processing step for speech technology applications. The task consists of deriving segment boundaries of audio signals which contain voicing information. In recent years, it has been shown that voice source ...

Being able to understand how optical forces emerge from the interaction of light with matter is paramount for controlling the motion of nanoparticles as well as powering nanomotors. The purpose of this work is to uncover the physical mechanisms at the orig ...

Low-Dimensional Motion Features for Audio-Visual Speech Recognition

Chat with Graph Search

Learning the intrinsic dynamics of spatio-temporal processes through Latent Dynamics Networks

Efficient Temporally-Aware DeepFake Detection using H.264 Motion Vectors

Aggregating Spatial and Photometric Context for Photometric Stereo

Towards Trustworthy Deep Learning for Image Reconstruction

Sparse Autoencoders for Speech Modeling and Recognition

Novel Methods For Detection And Analysis Of Atypical Aspects In Speech

Processing load, and not stimulus evidence, determines the duration of unconscious visual feature integration

Microgravity induces overconfidence in perceptual decision-making

From finger animation to full-body embodiment of avatars with different morphologies and proportions

Automated Human Motion Analysis and Synthesis

Geometric and Learning Methods for Robots to Navigate in Human Crowds with Application to Smart Mobility Devices

Interactive-time Exploration, Querying, and Analysis of Large High-dimensional Datasets

On matching data and model in LF-MMI-based dysarthric speech recognition

Can Self-Supervised Neural Representations Pre-Trained on Human Speech distinguish Animal Callers?

Scalable and Privacy-Preserving Federated Principal Component Analysis

Dual-frequency spectral radar retrieval of snowfall microphysics: a physics-driven deep-learning approach

On Breathing Pattern Information in Synthetic Speech

Automatic pathological speech assessment

Unsupervised Voice Activity Detection by Modeling Source and System Information using Zero Frequency Filtering

Explanation of Optical Force and Torque on Nanomotors as the Interplay of Huygens Sources