Class-specific classifiers in audio-visual speech recognition

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

Machine learning models trained with passive sensor data from mobile devices can be used to perform various inferences pertaining to activity recognition, context awareness, and health and well-being. Prior work has improved inference performance through t ...

Face recognition has become a popular authentication tool in recent years. Modern state-of-the-art (SOTA) face recognition methods rely on deep neural networks, which extract discriminative features from face images. Although these methods have high recogn ...

The extremely high recognition accuracy achieved by modern, convolutional neural network (CNN) based face recognition (FR) systems has contributed significantly to the adoption of such systems in a variety of applications, from mundane activities like unlo ...

Multimedia databases are growing rapidly in size in the digital age. To increase the value of these data and to enhance the user experience, there is a need to make these videos searchable through automatic indexing. Because people appearing and talking in ...

Automatic Gender Recognition (AGR) is the task of identifying the gender of a speaker given a speech signal. Standard approaches extract features like fundamental frequency and cepstral features from the speech signal and train a binary classifier. Inspire ...

Speech is the most natural means of communication for humans. Therefore, since the beginning of computers it has been a goal to interact with machines via speech. While there have been gradual improvements in this field over the decades, and with recent dr ...

This paper proposes a new method for recognizing both activities and gestures by using acceleration data collected on a smartwatch. While both activity recognition techniques and gesture recognition techniques employ acceleration data, these techniques are ...

Invariance to geometric transformations is a highly desirable property of automatic classifiers in many image recognition tasks. Nevertheless, it is unclear to which extent state-of-the-art classifiers are invariant to basic transformations such as rotatio ...

Crowdsourcing is a popular tool for conducting subjective evaluations in uncontrolled environments and at low cost. In this paper, a crowdsourcing study is conducted to investigate the impact of High Dynamic Range (HDR) imaging on subjective face recogniti ...

Each tweet is limited to 140 characters. This constraint surprisingly makes Twitter a more spontaneous platform to express our emotions. Detecting emotions and correctly classifying them automatically is an increasingly important task if we want to underst ...

Visual scene recognition deals with the problem of automatically recognizing the high-level semantic concept describing a given image as a whole, such as the environment in which the scene is occurring (e.g. a mountain), or the event that is taking place ( ...

A common assumption in activity recognition is that the system remains unchanged between its design and its posterior operation. However, many factors affect the data distribution between two different experimental sessions. One of these factors is the pot ...

Nowadays, many systems rely on fusing different sources of information to recognize human activities and gestures, speech, or brain activities for applications in areas such as clinical practice, and health care and Human Computer Interaction (HCI). Typica ...

The log-energy parameter, typically derived from a full-band spectrum, is a critical feature commonly used in automatic speech recognition (ASR) systems. However, log-energy is difficult to estimate reliably in the presence of background noise. In this pap ...

The thesis work was motivated by the goal of developing personalized speech-to-speech translation and focused on one of its key component techniques – cross-lingual speaker adaptation for text-to-speech synthesis. A personalized speech-to-speech translator ...

The integration of audio and visual information improves speech recognition performance, specially in the presence of noise. In these circumstances it is necessary to introduce audio and visual weights to control the contribution of each modality to the re ...

In this article, we study the adaptation of visual and audio-visual speech recognition systems to non-ideal visual conditions. We focus on overcoming the effects of a changing pose of the speaker, a problem encountered in natural situations where the speak ...

A common assumption in activity recognition is that the system remains unchanged between its design and its posterior operation. However, many factors can affect the data distribution between two different experimental sessions including sensor displacemen ...

Technological advances in sensing and portable computing devices and wireless communication has lead to an increase in the number and variety of sensing enabled devices (e.g. smartphones or sensing garments). Pervasive computing and activity recognition sy ...

In this thesis, we propose a novel approach for speaker and speech recognition involving localized, binary, data-driven features. The proposed approach is largely inspired by similar localized approaches in the computer vision domain. The success of these ...

Class-specific classifiers in audio-visual speech recognition

Chat with Graph Search

Keep Sensors in Check: Disentangling Country-Level Generalization Issues in Mobile Sensor-Based Models with Diversity Scores

On the Recognition Performance of BioHashing on state-of-the-art Face Recognition models

Trustworthy Face Recognition: Improving Generalization of Deep Face Presentation Attack Detection

Multimodal person recognition in audio-visual streams

On Learning to Identify Genders from Raw Speech Signal Using CNNs

Visual speech recognition : from traditional to deep learning frameworks

Tree-structured Classifier for Acceleration-based Activity and Gesture Recognition on Smartwatches

Manitest: Are classifiers really invariant?

Impact of Tone-mapping Algorithms on Subjective and Objective Face Recognition in HDR Images

Semi-Supervised Method for Multi-Category Emotion Recognition in Tweets

Saliency-based representations and multi-component classifiers for visual scene recognition

Unsupervised adaptation for acceleration-based activity recognition: Robustness to sensor displacement and rotation

Dynamic Classifier Fusion for Multi-sensory Activity Recognition

Robust Log-Energy Estimation and its Dynamic Change Enhancement for In-car Speech Recognition

Data-Driven Enhancement of State Mapping-Based Cross-Lingual Speaker Adaptation

On dynamic stream weighting for Audio-Visual Speech Recognition

Multi-pose lipreading and audio-visual speech recognition

Unsupervised adaptation to on-body sensor displacement in acceleration-based activity recognition

Ensemble creation and reconfiguration for activity recognition: An information theoretic approach

Boosting Localized Features for Speaker and Speech Recognition