Publications related to On dynamic stream weighting for Audio-Visual Speech Recognition

Related publications (34)

Embedded solution to detect and classify head level objects using stereo vision for visually impaired people with audio feedback

Klaus Benedikt Schönenberger, Mario Andres Chavarria Varon

This work presents an embedded solution for detecting and classifying head-level objects using stereo vision to assist blind individuals. A custom dataset was created, featuring five classes of head-level objects, selected based on a survey of visually imp ...

Nature Research2025

Weighting Pseudo-labels via High-Activation Feature Index Similarity and Object Detection for Semi-supervised Segmentation

Minh Hieu Lê

Semi-supervised semantic segmentation methods leverage unlabeled data by pseudo-labeling them. Thus the success of these methods hinges on the reliability of the pseudo-labels. Existing methods mostly choose high-confidence pixels in an effort to avoid err ...

Springer Science and Business Media Deutschland GmbH2025

Interacting with Annotated and Synchronized Music Corpora on the Dezrann Web Platform

Johannes Hentschel

Open datasets with annotated corpora are crucial to foster research in music information retrieval (MIR) studies and to disseminate knowledge towards musicians and the general public. Many groups have published corpora, at times accompanied by specific vis ...

Ubiquity Press, Ltd.2025

Post-correction of Historical Text Transcripts with Large Language Models: An Exploratory Study

Frédéric Kaplan, Maud Ehrmann, Matteo Romanello, Sven Nicolas Yoann Najem-Meyer, Emanuela Boros

The quality of automatic transcription of heritage documents, whether from printed, manuscripts or audio sources, has a decisive impact on the ability to search and process historical texts. Although significant progress has been made in text recognition ( ...

Association for Computational Linguistics2024

Sparse Autoencoders for Speech Modeling and Recognition

Selen Hande Kabil

Speech recognition-based applications upon the advancements in artificial intelligence play an essential role to transform most aspects of modern life. However, speech recognition in real-life conditions (e.g., in the presence of overlapping speech, varyin ...

EPFL2023

Novel Methods For Detection And Analysis Of Atypical Aspects In Speech

Julian David Fritsch

Atypical aspects in speech concern speech that deviates from what is commonly considered normal or healthy. In this thesis, we propose novel methods for detection and analysis of these aspects, e.g. to monitor the temporary state of a speaker, diseases tha ...

EPFL2023

On matching data and model in LF-MMI-based dysarthric speech recognition

Enno Hermann

In light of steady progress in machine learning, automatic speech recognition (ASR) is entering more and more areas of our daily life, but people with dysarthria and other speech pathologies are left behind. Their voices are underrepresented in the trainin ...

EPFL2023

A Virtual Simulation-Pilot Agent for Training of Air Traffic Controllers

Petr Motlicek, Juan Pablo Zuluaga Gomez

In this paper we propose a novel virtual simulation-pilot engine for speeding up air traffic controller (ATCo) training by integrating different state-of-the-art artificial intelligence (AI)-based tools. The virtual simulation-pilot engine receives spoken ...

MDPI2023

Observation of non-reciprocal harmonic conversion in real sounds

Romain Christophe Rémy Fleury, Hervé Lissek, Xinxin Guo

Reciprocity guarantees that in most media, sound transmission is symmetric between two points of space when the location of the source and receiver are interchanged. This fundamental law can be broken in non-linear media, often at the cost of detrimental i ...

2023

The Impact of Data Persistence Bias on Social Media Studies

Tugrulcan Elmas

Social media studies often collect data retrospectively to analyze public opinion. Social media data may decay over time and such decay may prevent the collection of the complete dataset. As a result, the collected dataset may differ from the complete data ...

Assoc Computing Machinery2023

Explanation of Face Recognition via Saliency Maps

Touradj Ebrahimi, Yuhang Lu

Despite the significant progress in recent years, deep face recognition is often treated as a "black box" and has been criticized for lacking explainability. It becomes increasingly important to understand the characteristics and decisions of deep face rec ...

2023

Can Self-Supervised Neural Representations Pre-Trained on Human Speech distinguish Animal Callers?

Mathew Magimai Doss, Eklavya Sarkar

Self-supervised learning (SSL) models use only the intrinsic structure of a given signal, independent of its acoustic domain, to extract essential information from the input to an embedding space. This implies that the utility of such representations is no ...

ISCA2023

An Automatic Speaker Clustering Pipeline for the Air Traffic Communication Domain

Juan Pablo Zuluaga Gomez

In air traffic management (ATM), voice communications are critical for ensuring the safe and efficient operation of aircraft. The pertinent voice communications-air traffic controller (ATCo) and pilot-are usually transmitted in a single channel, which pose ...

2023

Lausanne Historical Censuses Dataset HTR 35k

Rémi Guillaume Petitpierre, Lucas Arnaud André Rappo, Marion Kramer

This training dataset includes a total of 34,913 manually transcribed text segments. It is dedicated to the handwritten text recognition (HTR) of historical sources, typically tabular records, such as censuses. This dataset is based on a sample of 83 pages ...

Zenodo2023

How to Boost Face Recognition with StyleGAN?

Nikita Durasov

State-of-the-art face recognition systems require vast amounts of labeled training data. Given the priority of privacy in face recognition applications, the data is limited to celebrity web crawls, which have issues such as limited numbers of identities. O ...

Ieee Computer Soc2023

Bertraffic: Bert-Based Joint Speaker Role And Speaker Change Detection For Air Traffic Control Communications

Petr Motlicek, Juan Pablo Zuluaga Gomez

Automatic speech recognition (ASR) allows transcribing the communications between air traffic controllers (ATCOs) and aircraft pilots. The transcriptions are used later to extract ATC named entities, e.g., aircraft callsigns. One common challenge is speech ...

IEEE2022

Johann Sebastian Bach – The Chorales

Martin Alois Rohrmeier, Johannes Hentschel, Ioannis Rammos

This is a README file for a data repository originating from the DCML corpus initiative and serves as welcome page for both the GitHub repo

Zenodo2023

Serab: A Multi-Lingual Benchmark For Speech Emotion Recognition

Pierre Anton Beckmann

Recent developments in speech emotion recognition (SER) often leverage deep neural networks (DNNs). Comparing and benchmarking different DNN models can often be tedious due to the use of different datasets and evaluation protocols. To facilitate the proces ...

IEEE2022

Recognizing distant faces

Lukas Vogelsang

As an 'early alerting' sense, one of the primary tasks for the human visual system is to recognize distant objects. In the specific context of facial identification, this ecologically important task has received surprisingly little attention. Most studies ...

PERGAMON-ELSEVIER SCIENCE LTD2023

Controllability and Interpretability in Affective Speech Synthesis

Bastian Schnell

Thanks to Deep Learning Text-To-Speech (TTS) has achieved high audio quality with large databases. But at the same time the complex models lost any ability to control or interpret the generation process. For the big challenge of affective TTS it is infeasi ...

EPFL2022