Publications associées à Reliability-based decision fusion in multimodal biometric verification systems

Keep Sensors in Check: Disentangling Country-Level Generalization Issues in Mobile Sensor-Based Models with Diversity Scores

Daniel Gatica-Perez, Lakmal Buddika Meegahapola

Machine learning models trained with passive sensor data from mobile devices can be used to perform various inferences pertaining to activity recognition, context awareness, and health and well-being. Prior work has improved inference performance through t ...

Assoc Computing Machinery2023

Personalized Productive Engagement Recognition in Robot-Mediated Collaborative Learning

Jauwairia Nasir, Barbara Bruno

In this paper, we propose and compare personalized models for Productive Engagement (PE) recognition. PE is defined as the level of engagement that maximizes learning. Previously, in the context of robot-mediated collaborative learning, a framework of prod ...

2022

Multimodal person recognition in audio-visual streams

Do Hoang Nam Le

Multimedia databases are growing rapidly in size in the digital age. To increase the value of these data and to enhance the user experience, there is a need to make these videos searchable through automatic indexing. Because people appearing and talking in ...

EPFL2019

Trustworthy Biometric Verification under Spoofing Attacks : Application to the Face Mode

Ivana Chingovska

The need for automation of the identity recognition process for a vast number of applications resulted in great advancement of biometric systems in the recent years. Yet, many studies indicate that these systems suffer from vulnerabilities to spoofing (pre ...

EPFL2016

Spoofing Face Recognition with 3D Masks

Sébastien Marcel

Spoofing is the act of masquerading as a valid user by falsifying data to gain an illegitimate access. Vulnerability of recognition systems to spoofing attacks (presentation attacks) is still an open security issue in biometrics domain and among all biomet ...

2014

Wordless Sounds: Robust Speaker Diarization using Privacy-Preserving Audio Representations

Hervé Bourlard, Daniel Gatica-Perez, Sree Hari Krishnan Parthasarathi

This paper investigates robust privacy-sensitive audio features for speaker diarization in multiparty conversations: ie., a set of audio features having low linguistic information for speaker diarization in a single and multiple distant microphone scenario ...

2013

Cross-pollination of normalisation techniques from speaker to face authentication using Gaussian mixture models

Sébastien Marcel

This paper applies score and feature normalization techniques to parts-based Gaussian mixture model (GMM) face authentication. In particular, we propose to utilize techniques that are well established in state-of-the-art speaker authentication, and apply t ...

2012

The Multiscenario Multienvironment BioSecure Multimodal Database (BMDB)

Jean Hennebert, Jonas Richiardi, Andrzej Drygajlo, Norman Hoon Thian Poh

A new multimodal biometric database designed and acquired within the framework of the European BioSecure Network of Excellence is presented. It is comprised of more than 600 individuals acquired simultaneously in three scenarios: 1) over the Internet, 2) i ...

2010

Multimodal feature extraction and fusion for audio-visual speech recognition

Mihai Gurban

Multimodal signal processing analyzes a physical phenomenon through several types of measures, or modalities. This leads to the extraction of higher-quality and more reliable information than that obtained from single-modality signals. The advantage is two ...

EPFL2009

Visual feature analysis for audio-visual speech recognition

Ivana Arsic de Heras Ciechomska

Humans perceive their surrounding environment in a multimodal manner by using multi-sensory inputs combined in a coordinated way. Various studies in psychology and cognitive science indicate the multimodal nature of human speech production and perception. ...

EPFL2008

A collaborative approach to image segmentation and behavior recognition from image sequences

Laura Ioana Gui

Visual behavior recognition is currently a highly active research area. This is due both to the scientific challenge posed by the complexity of the task, and to the growing interest in its applications, such as automated visual surveillance, human-computer ...

EPFL2008

Low-level grounding in a multimodal mobile service robot conversational system using graphical models

Jonas Richiardi, Andrzej Drygajlo, Plamen Prodanov, Anil Alexander

The main task of a service robot with a voice-enabled communication interface is to engage a user in dialogue providing an access to the services it is designed for. In managing such interaction, inferring the user goal (intention) from the request for a s ...

Springer-Verlag2008

A multimodal pattern recognition framework for speaker detection

Patricia Besson

Speaker detection is an important component of a speech-based user interface. Audiovisual speaker detection, speech and speaker recognition or speech synthesis for example find multiple applications in human-computer interaction, multimedia content indexin ...

EPFL2007

Using Chimeric Users to Construct Fusion Classifiers in Biometric Authentication Tasks: An Investigation

Samy Bengio, Norman Hoon Thian Poh

Chimeric users have recently been proposed in the field of biometric person authentication as a way to overcome the problem of lack of real multimodal biometric databases as well as an important privacy issue -- the fact that too many biometric modalities ...

IEEE2006

Face detection and verification using local binary patterns

Yann Rodriguez

This thesis proposes a robust Automatic Face Verification (AFV) system using Local Binary Patterns (LBP). AFV is mainly composed of two modules: Face Detection (FD) and Face Verification (FV). The purpose of FD is to determine whether there are any face in ...

EPFL2006

Error Handling in Multimodal Biometric Systems using Reliability Measures

Plamen Prodanov

In this paper, we present a framework for predicting and correcting classification decision errors based on modality reliability measures in a multimodal biometric system. In our experiments we use face and speech experts based on a recently proposed frame ...

IEEE2005