Explainable Phonology-based Approach for Sign Language Recognition and Assessment

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

Transformer models such as GPT generate human-like language and are predictive of human brain responses to language. Here, using functional-MRI-measured brain responses to 1,000 diverse sentences, we first show that a GPT-based encoding model can predict t ...

Atypical aspects in speech concern speech that deviates from what is commonly considered normal or healthy. In this thesis, we propose novel methods for detection and analysis of these aspects, e.g. to monitor the temporary state of a speaker, diseases tha ...

This article presents assessment methods for the hydromorphological effectiveness of sediment augmentation measures downstream of dams. First, we describe different ways of quantifying hydromorphological effectiveness based on typical objectives of sedimen ...

Language has shaped human evolution and led to the desire to endow machines with language abilities. Recent advancements in natural language processing enable us to achieve this breakthrough in human-machine interaction. However, introducing conversational ...

Speech recognition-based applications upon the advancements in artificial intelligence play an essential role to transform most aspects of modern life. However, speech recognition in real-life conditions (e.g., in the presence of overlapping speech, varyin ...

Advances in soft sensors coupled with machine learning are enabling increasingly capable wearable systems. Since hand motion in particular can convey useful information for developing intuitive interfaces, glove-based systems can have a significant impact ...

The objective of this study was to evaluate the effect of Motor Imagery (MI) training on language comprehension. In line with literature suggesting an intimate relationship between the language and the motor system, we proposed that a MI-training could imp ...

The respiratory system is an integral part of human speech production. As a consequence, there is a close relation between respiration and speech signal, and the produced speech signal carries breathing pattern related information. Speech can also be gener ...

One of the many purposes for which social robots are designed is education, and there have been many attempts to systematize their potential in this field. What these attempts have in common is the recognition that learning can be supported in a variety of ...

Many pathologies cause impairments in the speech production mechanism resulting in reduced speech intelligibility and communicative ability. To assist the clinical diagnosis, treatment and management of speech disorders, automatic pathological speech asses ...

The minimum amount of shear reinforcement to be provided in reinforced concrete members has been a topic of debate and research for decades without reaching a consensus. Defining such values is however instrumental to build in an economic manner and to saf ...

Speech signal conveys several kinds of information such as a message, speaker identity, emotional state of the speaker and social state of the speaker. Automatic speech assessment is a broad area that refers to using automatic methods to predict human judg ...

Subword modeling for zero-resource languages aims to learn low-level representations of speech audio without using transcriptions or other resources from the target language (such as text corpora or pronunciation dictionaries). A good representation should ...

This research occurred in a special context where Kazakhstan's recent decision to switch from Cyrillic to the Latin-based alphabet has resulted in challenges connected to teaching literacy, addressing a rare combination of research hypotheses and technical ...

Language independent query-by-example spoken term detection (QbE-STD) is the problem of retrieving audio documents from an archive, which contain a spoken query provided by a user. This is usually casted as a hypothesis testing and pattern matching problem ...

In hidden Markov model (HMM) based automatic speech recognition (ASR) system, modeling the statistical relationship between the acoustic speech signal and the HMM states that represent linguistically motivated subword units such as phonemes is a crucial st ...

A fully-labelled dataset of Arabic Sign Language (ArSL) images is developed for research related to sign language recognition. The dataset will provide researcher the opportunity to investigate and develop automated systems for the deaf and hard of hearing ...

Language acquisition theories classically distinguish passive language understanding from active language production. However, recent findings show that brain areas such as Broca's region are shared in language understanding and production. Furthermore, th ...

We address the problem of automatically predicting group performance on a task, using multimodal features derived from the group conversation. These include acoustic features extracted from the speech signal, and linguistic features derived from the conver ...

Speech is the most natural means of communication for humans. Therefore, since the beginning of computers it has been a goal to interact with machines via speech. While there have been gradual improvements in this field over the decades, and with recent dr ...

Explainable Phonology-based Approach for Sign Language Recognition and Assessment

Chat with Graph Search

Driving and suppressing the human language network using large language models

Novel Methods For Detection And Analysis Of Atypical Aspects In Speech

Assessment of the hydromorphological effectiveness of sediment augmentation measures downstream of dams

Towards Novel Evaluation Methods for Social Dialog Systems

Sparse Autoencoders for Speech Modeling and Recognition

A Wearable Smart Glove and Its Application of Pose and Gesture Detection to Sign Language Classification

Kinesthetic motor-imagery training improves performance on lexical-semantic access

On Breathing Pattern Information in Synthetic Speech

Social/dialogical roles of social robots in supporting children's learning of language and literacy-A review and analysis of innovative roles

Automatic pathological speech assessment

Influence of amount of shear reinforcement and its post-yield response on the shear resistance of reinforced concrete members

Novel Methods for Incorporating Prior Knowledge for Automatic Speech Assessment

Multilingual and Unsupervised Subword Modeling for Zero-Resource Languages

A Comparison of Social Robot to Tablet and Teacher in a New Script Learning Context

Language Independent Query by Example Spoken Term Detection

End-to-End Acoustic Modeling using Convolutional Neural Networks for HMM-based Automatic Speech Recognition

ArASL: Arabic Alphabets Sign Language Dataset

Social babbling: The emergence of symbolic gestures and words

Predicting Group Performance in Task-Based Interaction

Visual speech recognition : from traditional to deep learning frameworks