Publications related to The ICSI RT-09 Speaker Diarization System

Unsupervised Voice Activity Detection by Modeling Source and System Information using Zero Frequency Filtering

Voice activity detection (VAD) is an important pre-processing step for speech technology applications. The task consists of deriving segment boundaries of audio signals which contain voicing information. In recent years, it has been shown that voice source ...

ISCA2022

Multisensory haptic system and method

Olaf Blanke, Simon Gallo, Giulio Rognini

A computer-implemented method for operating a haptic device, the haptic device comprising a plurality of tactile displays configured to provide haptic stimuli to a user, the method including the steps of (a) processing an audio signal derived from an audio ...

2020

ASAP: a Dataset of Aligned Scores and Performances for Piano Transcription

Andrew Philip McLeod

In this paper we present Aligned Scores and Performances (ASAP): a new dataset of 222 digital musical scores aligned with 1068 performances (more than 92 hours) of Western classical piano music.The scores are provided as paired MusicXML files and quantized ...

2020

Sparse and Parametric Modeling with Applications to Acoustics and Audio

Helena Peic Tukuljac

Recent advances in signal processing, machine learning and deep learning with sparse intrinsic structure of data have paved the path for solving inverse problems in acoustics and audio. The main task of this thesis was to bridge the gap between the powerfu ...

EPFL2020

Inpainting of Long Audio Segments With Similarity Graphs

Nathanaël Perraudin

We present a novel method for the compensation of long duration data loss in audio signals, in particular music. The concealment of such signal defects is based on a graph that encodes signal structure in terms of time-persistent spectral similarity. A sui ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2018

Experimental evaluation of speech enhancement methods in remote microphone systems for hearing aids

Hervé Lissek, Gilles André Courtois, Vincent Pierre Olivier Grimaldi, Ina Kodrasi

Enhancing speech intelligibility for hearing-impaired subjects in complex acoustic conditions is still a challenging topic of research. To mitigate the detrimental effects of background noise and reverberation, current hearing instruments incorporate vario ...

European Acoustics Association2018

System fusion and speaker linking for longitudinal diarization of TV shows

Hervé Bourlard, Petr Motlicek

Performing speaker diarization while uniquely identifying the speakers in a collection of audio recordings is a challenging task. Based on our previous work on speaker diarization and linking, we developed a system for diarizing longitudinal TV show data s ...

IEEE2016

Hearing assistance system

Hervé Lissek, Patrick Marmaroli, Gilles André Courtois

There is provided a hearing assistance system, comprising a transmission unit (10) comprising a microphone arrangement (17) for capturing audio signals from a voice of a speaker ( 11 ) using the transmission unit and being adapted to transmit the audio sig ...

2016

Audiovisual Diarization Of People In Video Content

Audio-Visual People Diarization (AVPD) is an original framework that simultaneously improves audio, video, and audiovisual diarization results. Following a literature review of people diarization for both audio and video content and their limitations, whic ...

2014

Implementation of a binaural localization algorithm in hearing aids: Specifications and achievable solutions

Hervé Lissek, Patrick Marmaroli, Gilles André Courtois

This article introduces the constraints and issues related to the implementation of a binaural localization algorithm on a pair of hearing aids. The algorithm should improve the rendering of the spatial information available in the audio signals, which are ...

2014

On dynamic stream weighting for Audio-Visual Speech Recognition

Jean-Philippe Thiran, Mihai Gurban, Virginia Estellers Casas

The integration of audio and visual information improves speech recognition performance, specially in the presence of noise. In these circumstances it is necessary to introduce audio and visual weights to control the contribution of each modality to the re ...

2012

Audio-Visual Object Extraction using Graph Cuts

Pierre Vandergheynst, Anna Llagostera Casanovas

We propose a novel method to automatically extract the audio-visual objects that are present in a scene. First, the synchrony between related events in audio and video channels is exploited to identify the possible locations of the sound sources. Video reg ...

Institute of Electrical and Electronics Engineers2012

Distributed audio coding for wireless hearing aids

Martin Vetterli, Olivier Roy

The aim of the invention is to provide inter-channel level differences ICLD related to audio signals for hearing aids. This aim is achieved by a method for computing ICLD from a first and second audio source signals, the first source signal being wired wit ...

2011

Wearable systems for audio, visual and gaze monitoring

Aude Billard, Jean-Baptiste Keller, Basilio Noris

A non-obtrusive portable device, wearable from infancy through adulthood, mounted with i) a set of two or more optical device(s) providing visual and audio information as perceived by the user ii) an actuated mirror or optical device returning visual infor ...

2011

Audio-Visual Fusion : New Methods and Applications

Anna Llagostera Casanovas

The perception that we have about the world is influenced by elements of diverse nature. Indeed humans tend to integrate information coming from different sensory modalities to better understand their environment. Following this observation, scientists hav ...

EPFL2011

Audio-driven Nonlinear Video Diffusion

Pierre Vandergheynst, Anna Llagostera Casanovas

In this paper we present a novel nonlinear video diffusion approach based on the fusion of information in audio and video channels. Both modalities are efficiently combined into a diffusion coefficient that integrates the basic assumption in this domain, i ...

Institute of Electrical and Electronics Engineers2011

Blind Audio-Visual Source Separation based on Sparse Redundant Representations

Pierre Vandergheynst, Gianluca Monaci, Rémi Gribonval, Anna Llagostera Casanovas

In this paper we propose a novel method which is able to detect and separate audio-visual sources present in a scene. Our method exploits the correlation between the video signal captured with a camera and a synchronously recorded one-microphone audio trac ...

2010

Autoregressive Models of Amplitude Modulations in Audio Compression

Hynek Hermansky, Sriram Ganapathy, Petr Motlicek

We present a scalable medium bit-rate wide-band audio coding technique based on frequency domain linear prediction (FDLP). FDLP is an efficient method for representing the long-term amplitude modulations of speech/audio signals using autoregressive models. ...

2010

Method and Device for Removing Echo in an Audio Signal

Christof Faller

Acoustic echo control and noise suppression is an important part of any "handsfree" telecommunication system, such as telephony or audio or video conferencing systems. Bandwidth and computational complexity constraints have prevented that stereo or multi-c ...

2010

Overcoming Asynchrony in Audio-Visual Speech Recognition

Jean-Philippe Thiran, Virginia Estellers Casas

In this paper we propose two alternatives to overcome the natural asynchrony of modalities in Audio-Visual Speech Recognition. We first investigate the use of asynchronous statistical models based on Dynamic Bayesian Networks with different levels of async ...

2010