Publications associées à Class-specific classifiers in audio-visual speech recognition

Keep Sensors in Check: Disentangling Country-Level Generalization Issues in Mobile Sensor-Based Models with Diversity Scores

Daniel Gatica-Perez, Lakmal Buddika Meegahapola

Machine learning models trained with passive sensor data from mobile devices can be used to perform various inferences pertaining to activity recognition, context awareness, and health and well-being. Prior work has improved inference performance through t ...

Assoc Computing Machinery2023

On the Recognition Performance of BioHashing on state-of-the-art Face Recognition models

Sébastien Marcel, Hatef Otroshi Shahreza

Face recognition has become a popular authentication tool in recent years. Modern state-of-the-art (SOTA) face recognition methods rely on deep neural networks, which extract discriminative features from face images. Although these methods have high recogn ...

IEEE2021

Trustworthy Face Recognition: Improving Generalization of Deep Face Presentation Attack Detection

Amir Mohammadi

The extremely high recognition accuracy achieved by modern, convolutional neural network (CNN) based face recognition (FR) systems has contributed significantly to the adoption of such systems in a variety of applications, from mundane activities like unlo ...

EPFL2020

Multimodal person recognition in audio-visual streams

Do Hoang Nam Le

Multimedia databases are growing rapidly in size in the digital age. To increase the value of these data and to enhance the user experience, there is a need to make these videos searchable through automatic indexing. Because people appearing and talking in ...

EPFL2019

On Learning to Identify Genders from Raw Speech Signal Using CNNs

Hannah Muckenhirn, Selen Hande Kabil

Automatic Gender Recognition (AGR) is the task of identifying the gender of a speaker given a speech signal. Standard approaches extract features like fundamental frequency and cepstral features from the speech signal and train a binary classifier. Inspire ...

ISCA-INT SPEECH COMMUNICATION ASSOC2018

Visual speech recognition : from traditional to deep learning frameworks

Marina Zimmermann

Speech is the most natural means of communication for humans. Therefore, since the beginning of computers it has been a goal to interact with machines via speech. While there have been gradual improvements in this field over the decades, and with recent dr ...

EPFL2018

Tree-structured Classifier for Acceleration-based Activity and Gesture Recognition on Smartwatches

Karl Aberer, Julien Eberle, Dipanjan Chakraborty

This paper proposes a new method for recognizing both activities and gestures by using acceleration data collected on a smartwatch. While both activity recognition techniques and gesture recognition techniques employ acceleration data, these techniques are ...

Ieee2016

Manitest: Are classifiers really invariant?

Pascal Frossard, Alhussein Fawzi

Invariance to geometric transformations is a highly desirable property of automatic classifiers in many image recognition tasks. Nevertheless, it is unclear to which extent state-of-the-art classifiers are invariant to basic transformations such as rotatio ...

2015

Impact of Tone-mapping Algorithms on Subjective and Objective Face Recognition in HDR Images

Touradj Ebrahimi

Crowdsourcing is a popular tool for conducting subjective evaluations in uncontrolled environments and at low cost. In this paper, a crowdsourcing study is conducted to investigate the impact of High Dynamic Range (HDR) imaging on subjective face recogniti ...

2015

Semi-Supervised Method for Multi-Category Emotion Recognition in Tweets

Pearl Pu Faltings, Valentina Sintsova, Claudiu-Cristian Musat

Each tweet is limited to 140 characters. This constraint surprisingly makes Twitter a more spontaneous platform to express our emotions. Detecting emotions and correctly classifying them automatically is an increasingly important task if we want to underst ...

2014

Saliency-based representations and multi-component classifiers for visual scene recognition

Marco Fornoni

Visual scene recognition deals with the problem of automatically recognizing the high-level semantic concept describing a given image as a whole, such as the environment in which the scene is occurring (e.g. a mountain), or the event that is taking place ( ...

EPFL2014

Unsupervised adaptation for acceleration-based activity recognition: Robustness to sensor displacement and rotation

Ricardo Andres Chavarriaga Lozano, José del Rocio Millán Ruiz, Hamidreza Bayati

A common assumption in activity recognition is that the system remains unchanged between its design and its posterior operation. However, many factors affect the data distribution between two different experimental sessions. One of these factors is the pot ...

Springer Verlag2013

Dynamic Classifier Fusion for Multi-sensory Activity Recognition

Hesam Sagha

Nowadays, many systems rely on fusing different sources of information to recognize human activities and gestures, speech, or brain activities for applications in areas such as clinical practice, and health care and Human Computer Interaction (HCI). Typica ...

EPFL2013

Robust Log-Energy Estimation and its Dynamic Change Enhancement for In-car Speech Recognition

Hervé Bourlard, Weifeng Li

The log-energy parameter, typically derived from a full-band spectrum, is a critical feature commonly used in automatic speech recognition (ASR) systems. However, log-energy is difficult to estimate reliably in the presence of background noise. In this pap ...

Ieee-Inst Electrical Electronics Engineers Inc2013

Data-Driven Enhancement of State Mapping-Based Cross-Lingual Speaker Adaptation

Hui Liang

The thesis work was motivated by the goal of developing personalized speech-to-speech translation and focused on one of its key component techniques – cross-lingual speaker adaptation for text-to-speech synthesis. A personalized speech-to-speech translator ...

EPFL2012

On dynamic stream weighting for Audio-Visual Speech Recognition

Jean-Philippe Thiran, Mihai Gurban, Virginia Estellers Casas

The integration of audio and visual information improves speech recognition performance, specially in the presence of noise. In these circumstances it is necessary to introduce audio and visual weights to control the contribution of each modality to the re ...

2012

Multi-pose lipreading and audio-visual speech recognition

Jean-Philippe Thiran, Virginia Estellers Casas

In this article, we study the adaptation of visual and audio-visual speech recognition systems to non-ideal visual conditions. We focus on overcoming the effects of a changing pose of the speaker, a problem encountered in natural situations where the speak ...

2012

Unsupervised adaptation to on-body sensor displacement in acceleration-based activity recognition

Ricardo Andres Chavarriaga Lozano, José del Rocio Millán Ruiz, Hamidreza Bayati

A common assumption in activity recognition is that the system remains unchanged between its design and its posterior operation. However, many factors can affect the data distribution between two different experimental sessions including sensor displacemen ...

Ieee Computer Soc Press, Customer Service Center, Po Box 3014, 10662 Los Vaqueros Circle, Los Alamitos, Ca 90720-1264 Usa2011

Ensemble creation and reconfiguration for activity recognition: An information theoretic approach

Ricardo Andres Chavarriaga Lozano, José del Rocio Millán Ruiz, Hesam Sagha

Technological advances in sensing and portable computing devices and wireless communication has lead to an increase in the number and variety of sensing enabled devices (e.g. smartphones or sensing garments). Pervasive computing and activity recognition sy ...

Ieee Service Center, 445 Hoes Lane, Po Box 1331, Piscataway, Nj 08855-1331 Usa2011

Boosting Localized Features for Speaker and Speech Recognition

Anindya Roy

In this thesis, we propose a novel approach for speaker and speech recognition involving localized, binary, data-driven features. The proposed approach is largely inspired by similar localized approaches in the computer vision domain. The success of these ...

EPFL2011