Publications related to Two-level bimodal association for audio-visual speech recognition

Related publications (29)

Global existence for perturbations of the 2D stochastic Navier-Stokes equations with space-time white noise

We prove global in time well-posedness for perturbations of the 2D stochastic Navier-Stokes equations partial derivative( t)u + u center dot del u = Delta u - del p + sigma + xi, u(0, center dot ) = u(0),div (u) = 0, driven by additive space-time white noi ...

Springernature2024

Predicting Visual Stimuli From Cortical Response Recorded With Wide-Field Imaging in a Mouse

Silvestro Micera

Neural decoding of the visual system is a subject of research interest, both to understand how the visual system works and to be able to use this knowledge in areas, such as computer vision or brain-computer interfaces. Spike-based decoding is often used, ...

Ieee-Inst Electrical Electronics Engineers Inc2024

Exploiting the Signal-Leak Bias in Diffusion Models

Athanasios Fitsios, Sabine Süsstrunk, Radhakrishna Achanta, Mahmut Sami Arpa, Martin Nicolas Everaert

There is a bias in the inference pipeline of most diffusion models. This bias arises from a signal leak whose distribution deviates from the noise distribution, creating a discrepancy between training and inference processes. We demonstrate that this signa ...

2024

WINC: A Wireless IoT Network for Multi-Noise Source Cancellation

Haitham Al Hassanieh, Junfeng Guan

This paper introduces Wireless IoT-based Noise Cancellation (WINC) which defines a framework for leveraging a wireless network of IoT microphones to enhance active noise cancellation in noise-canceling headphones. The IoT microphones forward ambient noise ...

Assoc Computing Machinery2023

Data for: "A Neural-Network-Based Convex Regularizer for Inverse Problems"

Michaël Unser, Alexis Marie Frederic Goujon, Pakshal Narendra Bohra, Sebastian Jonas Neumayer, Stanislas Ducotterd

Data for: "A Neural-Network-Based Convex Regularizer for Inverse Problems". The corresponding scripts can be accessed on GitHub (https://github.com/axgoujon/convex_ridge_regularizers). The data is organized as follows: - ct_data_sets.tar.gz: contains prepr ...

Zenodo2023

Robust tunable acoustic impedance control on electroacoustic resonators for aircraft noise reduction

Maxime Volery

Air traffic noise emissions are responsible for a significant part of the overall environmental noise, especially in the vicinity of airports. Exposure to environmental noise is known to negatively impact health and to be associated with cardiovascular dis ...

EPFL2023

Multi-agent Learning with Privacy Guarantees

Elsa Rizk

A multi-agent system consists of a collection of decision-making or learning agents subjected to streaming observations from some real-world phenomenon. The goal of the system is to solve some global learning or optimization problem in a distributed or dec ...

EPFL2023

Disentangling 1/f noise from confined ion dynamics

Théo Denis Tobias Emmerich

Ion transport through biological and solid-state nanochannels is known to be a highly noisy process. The power spectrum of current fluctuations is empirically known to scale like the inverse of frequency, following the long-standing yet poorly understood H ...

ROYAL SOC CHEMISTRY2023

Robust Collaborative Learning with Linear Gradient Overhead

Rachid Guerraoui, Nirupam Gupta, Rafaël Benjamin Pinot, Le Nguyen Hoang, Sadegh Farhadkhani, John Stephan

Collaborative learning algorithms, such as distributed SGD (or D-SGD), are prone to faulty machines that may deviate from their prescribed algorithm because of software or hardware bugs, poisoned data or malicious behaviors. While many solutions have been ...

PLMR2023

Observation of non-reciprocal harmonic conversion in real sounds

Romain Christophe Rémy Fleury, Hervé Lissek, Xinxin Guo

Reciprocity guarantees that in most media, sound transmission is symmetric between two points of space when the location of the source and receiver are interchanged. This fundamental law can be broken in non-linear media, often at the cost of detrimental i ...

2023

Aerosol optical absorption coefficients at seven wavelengths in 10 min resolution measured in the Swiss container during MOSAiC 2019/2020

Julia Schmale, Ivo Fabio Beck, Lubna Dada, Benjamin Jérémy Laurent Heutte

This dataset contains aerosol optical absorption coefficients at seven different wavelengths (babs(λ)), averaged to 10 min time resolution, measured during the year-long MOSAiC expedition from October 2019 to September 2020. The measurements were performed ...

Zenodo2023

Localized model order reduction and domain decomposition methods for coupled heterogeneous systems

Jan Sickmann Hesthaven, Niccolo' Discacciati

We propose a model order reduction technique to accurately approximate the behavior of multi-component systems without any a-priori knowledge of the coupled model. In the offline phase, we construct independent surrogate models by solving the local problem ...

Wiley2023

Ultrabroadband sound control with deep-subwavelength plasmacoustic metalayers

Romain Christophe Rémy Fleury, Hervé Lissek, Stanislav Sergeev

Controlling audible sound requires inherently broadband and subwavelength acoustic solutions, which are to date, crucially missing. This includes current noise absorption methods, such as porous materials or acoustic resonators, which are typically ineffic ...

Nature Research2023

Sparse Autoencoders for Speech Modeling and Recognition

Selen Hande Kabil

Speech recognition-based applications upon the advancements in artificial intelligence play an essential role to transform most aspects of modern life. However, speech recognition in real-life conditions (e.g., in the presence of overlapping speech, varyin ...

EPFL2023

Universal and adaptive methods for robust stochastic optimization

Ali Kavis

Within the context of contemporary machine learning problems, efficiency of optimization process depends on the properties of the model and the nature of the data available, which poses a significant problem as the complexity of either increases ad infinit ...

EPFL2023

Optimizing Sales Forecasting, Inventory, Pricing and Sourcing Decisions

Yara Kayyali El Alem

In this thesis we address various factors that contribute both theoretically and practically to mitigating supply demand mismatches. The thesis is composed of three chapters, where each chapter is an independent scientific paper. In the first paper, we dev ...

EPFL2023

Optimal digital filter selection for remote photoplethysmography (rPPG) signal conditioning

Ata Jedari Golparvar

Remote photoplethysmography (rPPG) using camera-based imaging has shown excellent potential recently in vital signs monitoring due to its contactless nature. However, the optimum filter selection for pre-processing rPPG data in signal conditioning is still ...

IOP Publishing Ltd2023

Functional data analysis with rough sample paths?

Victor Panaretos, Neda Mohammadi Jouzdani

Functional data are typically modeled as sample paths of smooth stochastic processes in order to mitigate the fact that they are often observed discretely and noisily, occasionally irregularly and sparsely. The smoothness assumption is imposed to allow for ...

TAYLOR & FRANCIS LTD2024

Model-based constraints for trajectory determination of quad-copters: Design, calibration & merits for direct orientation

Jan Skaloud, Davide Antonio Cucci, Kenneth Joseph Paul

This paper proposes a novel method to improve georeferencing of airborne laser scanning by improved trajectory estimation using Vehicle Dynamic Model. In Vehicle Dynamic Model (VDM), the relationship between the dynamics of the platform and control inputs ...

2023

Machine Learning Methods for Robust Uncertainty Quantification and Controller Approximation

Emilio Maddalena

This thesis is situated at the crossroads between machine learning and control engineering. Our contributions are both theoretical, through proposing a new uncertainty quantification methodology in a kernelized context; and experimental, through investigat ...

EPFL2023