Publications related to Dynamic modality weighting for multi-stream HMMs in Audio- Visual Speech Recognition

Related publications (32)

Global existence for perturbations of the 2D stochastic Navier-Stokes equations with space-time white noise

We prove global in time well-posedness for perturbations of the 2D stochastic Navier-Stokes equations partial derivative( t)u + u center dot del u = Delta u - del p + sigma + xi, u(0, center dot ) = u(0),div (u) = 0, driven by additive space-time white noi ...

Springernature2024

Exploiting the Signal-Leak Bias in Diffusion Models

Athanasios Fitsios, Sabine Süsstrunk, Radhakrishna Achanta, Mahmut Sami Arpa, Martin Nicolas Everaert

There is a bias in the inference pipeline of most diffusion models. This bias arises from a signal leak whose distribution deviates from the noise distribution, creating a discrepancy between training and inference processes. We demonstrate that this signa ...

2024

The Privacy Power of Correlated Noise in Decentralized Learning

Rachid Guerraoui, Martin Jaggi, Youssef Allouah, Anastasiia Koloskova

Decentralized learning is appealing as it enables the scalable usage of large amounts of distributed data and resources (without resorting to any central entity), while promoting privacy since every user minimizes the direct exposure of their data. Yet, wi ...

PMLR2024

Less Conservatism, Stronger Robustness: Iterative Robust Gain-Scheduled Path Following Control of Autonomous Bus With Unstructured and Changing Dynamics

Denis Gillet

Path-following control is a critical technology for autonomous vehicles. However, time-varying parameters, parametric uncertainties, external disturbances, and complicated environments significantly challenge autonomous driving. We propose an iterative rob ...

Ieee-Inst Electrical Electronics Engineers Inc2024

WINC: A Wireless IoT Network for Multi-Noise Source Cancellation

Haitham Al Hassanieh, Junfeng Guan

This paper introduces Wireless IoT-based Noise Cancellation (WINC) which defines a framework for leveraging a wireless network of IoT microphones to enhance active noise cancellation in noise-canceling headphones. The IoT microphones forward ambient noise ...

Assoc Computing Machinery2023

Disentangling 1/f noise from confined ion dynamics

Théo Denis Tobias Emmerich

Ion transport through biological and solid-state nanochannels is known to be a highly noisy process. The power spectrum of current fluctuations is empirically known to scale like the inverse of frequency, following the long-standing yet poorly understood H ...

ROYAL SOC CHEMISTRY2023

Optimal digital filter selection for remote photoplethysmography (rPPG) signal conditioning

Ata Jedari Golparvar

Remote photoplethysmography (rPPG) using camera-based imaging has shown excellent potential recently in vital signs monitoring due to its contactless nature. However, the optimum filter selection for pre-processing rPPG data in signal conditioning is still ...

IOP Publishing Ltd2023

Robust tunable acoustic impedance control on electroacoustic resonators for aircraft noise reduction

Maxime Volery

Air traffic noise emissions are responsible for a significant part of the overall environmental noise, especially in the vicinity of airports. Exposure to environmental noise is known to negatively impact health and to be associated with cardiovascular dis ...

EPFL2023

Universal and adaptive methods for robust stochastic optimization

Ali Kavis

Within the context of contemporary machine learning problems, efficiency of optimization process depends on the properties of the model and the nature of the data available, which poses a significant problem as the complexity of either increases ad infinit ...

EPFL2023

Functional data analysis with rough sample paths?

Victor Panaretos, Neda Mohammadi Jouzdani

Functional data are typically modeled as sample paths of smooth stochastic processes in order to mitigate the fact that they are often observed discretely and noisily, occasionally irregularly and sparsely. The smoothness assumption is imposed to allow for ...

TAYLOR & FRANCIS LTD2024

Multi-agent Learning with Privacy Guarantees

Elsa Rizk

A multi-agent system consists of a collection of decision-making or learning agents subjected to streaming observations from some real-world phenomenon. The goal of the system is to solve some global learning or optimization problem in a distributed or dec ...

EPFL2023

Model-based constraints for trajectory determination of quad-copters: Design, calibration & merits for direct orientation

Jan Skaloud, Davide Antonio Cucci, Kenneth Joseph Paul

This paper proposes a novel method to improve georeferencing of airborne laser scanning by improved trajectory estimation using Vehicle Dynamic Model. In Vehicle Dynamic Model (VDM), the relationship between the dynamics of the platform and control inputs ...

2023

Towards Robust Monitoring of the Laser Powder Bed Fusion Process based on Acoustic Emission combined with Machine Learning Solutions

Rita Drissi Daoudi

Laser Powder Bed Fusion (LPBF) is an Additive Manufacturing (AM) process consolidating parts layer by layer, from a metallic powder bed. It allows no limitation in terms of geometry and is therefore of particular interest to various industries. Metallic LP ...

EPFL2023

Data for: "A Neural-Network-Based Convex Regularizer for Inverse Problems"

Michaël Unser, Alexis Marie Frederic Goujon, Pakshal Narendra Bohra, Sebastian Jonas Neumayer, Stanislas Ducotterd

Data for: "A Neural-Network-Based Convex Regularizer for Inverse Problems". The corresponding scripts can be accessed on GitHub (https://github.com/axgoujon/convex_ridge_regularizers). The data is organized as follows: - ct_data_sets.tar.gz: contains prepr ...

Zenodo2023

A Neural-Network-Based Convex Regularizer for Inverse Problems

Michaël Unser, Alexis Marie Frederic Goujon, Pakshal Narendra Bohra, Sebastian Jonas Neumayer, Stanislas Ducotterd

The emergence of deep-learning-based methods to solve image-reconstruction problems has enabled a significant increase in quality. Unfortunately, these new methods often lack reliability and explainability, and there is a growing interest to address these ...

2023

Optimizing Sales Forecasting, Inventory, Pricing and Sourcing Decisions

Yara Kayyali El Alem

In this thesis we address various factors that contribute both theoretically and practically to mitigating supply demand mismatches. The thesis is composed of three chapters, where each chapter is an independent scientific paper. In the first paper, we dev ...

EPFL2023

Observation of non-reciprocal harmonic conversion in real sounds

Romain Christophe Rémy Fleury, Hervé Lissek, Xinxin Guo

Reciprocity guarantees that in most media, sound transmission is symmetric between two points of space when the location of the source and receiver are interchanged. This fundamental law can be broken in non-linear media, often at the cost of detrimental i ...

2023

Improving algal bloom detection using spectroscopic analysis and machine learning: A case study in a large artificial reservoir, South Korea

Thanh Trung Huynh

The prediction of algal blooms using traditional water quality indicators is expensive, labor-intensive, and timeconsuming, making it challenging to meet the critical requirement of timely monitoring for prompt management. Using optical measures for foreca ...

ELSEVIER2023

Ultrabroadband sound control with deep-subwavelength plasmacoustic metalayers

Romain Christophe Rémy Fleury, Hervé Lissek, Stanislav Sergeev

Controlling audible sound requires inherently broadband and subwavelength acoustic solutions, which are to date, crucially missing. This includes current noise absorption methods, such as porous materials or acoustic resonators, which are typically ineffic ...

Nature Research2023

Robust Collaborative Learning with Linear Gradient Overhead

Rachid Guerraoui, Nirupam Gupta, Rafaël Benjamin Pinot, Le Nguyen Hoang, Sadegh Farhadkhani, John Stephan

Collaborative learning algorithms, such as distributed SGD (or D-SGD), are prone to faulty machines that may deviate from their prescribed algorithm because of software or hardware bugs, poisoned data or malicious behaviors. While many solutions have been ...

PLMR2023