The use of intracranial recordings to decode human language: Challenges and opportunities

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

We introduce BLAP, a model capable of generating high-quality captions for music. BLAP leverages a fine-tuned CLAP audio encoder and a pre-trained Flan-T5 large language model. To achieve effective cross-modal alignment between music and language, BLAP uti ...

Marmoset monkeys encode vital information in their calls and serve as a surrogate model for neuro-biologists to understand the evolutionary origins of human vocal communication. Traditionally analyzed with signal processing-based features, recent approache ...

Electrical stimulation of the visual nervous system could improve the quality of life of patients affected by acquired blindness by restoring some visual sensations, but requires careful optimization of stimulation parameters to produce useful perceptions. ...

Subcortical brain structures such as the basal ganglia or the thalamus are involved in regulating motor and cognitive behavior. However, their contribution to perceptual consciousness is still unclear, due to the inherent difficulties of recording subcorti ...

Transformer models such as GPT generate human-like language and are predictive of human brain responses to language. Here, using functional-MRI-measured brain responses to 1,000 diverse sentences, we first show that a GPT-based encoding model can predict t ...

Proprioception tells the brain the state of the body based on distributed sensors in the body. However, the principles that govern proprioceptive processing from those distributed sensors are poorly understood. Here, we employ a task-driven neural network ...

Neuroprostheses have been used clinically for decades, to help restore or preserve brain functions, when pharmaceutical treatments are inefficient. Although great progress in the field has been made over the years to interface with the nervous system, surf ...

Recently, cutting-edge brain-machine interfaces (BMIs) have revealed the potential of decoders such as recurrent neural networks (RNNs) in predicting attempted handwriting [1] or speech [2], enabling rapid communication recovery after paralysis. However, c ...

The ability to reason, plan and solve highly abstract problems is a hallmark of human intelligence. Recent advancements in artificial intelligence, propelled by deep neural networks, have revolutionized disciplines like computer vision and natural language ...

Topographical disorientation refers to the selective inability to orient oneself in familiar surroundings. However, to date its neural correlates remain poorly understood. Here we use quantitative lesion analysis and a lesion network mapping approach in or ...

This thesis presents an extensive exploration of neuroelectronic interfaces, focusing on microfabrication, in silico modeling, and their applications in designing and fabricating devices for neural interfacing. The research encompasses both peripheral nerv ...

In the last few years, stroke ranked as the second most common cause of death and is the third most significant condition affecting disability-adjusted life years (DALYs) worldwide. Being the most prevalent and quality of life impacting post-stroke symptom ...

Accurately predicting heart activity and other biological signals is crucial for diagnosis and monitoring. Given that speech is an outcome of multiple physiological systems, a significant body of work studied the acoustic correlates of heart activity. Rece ...

Motion forecasting is crucial in enabling autonomous vehicles to anticipate the future trajectories of surrounding agents. To do so, it requires solving mapping, detection, tracking, and then forecasting problems, in a multi-step pipeline. In this complex ...

Neural decoding of the visual system is a subject of research interest, both to understand how the visual system works and to be able to use this knowledge in areas, such as computer vision or brain-computer interfaces. Spike-based decoding is often used, ...

Reinforcement learning (RL) is crucial for learning to adapt to new environments. In RL, the prediction error is an important component that compares the expected and actual rewards. Dopamine plays a critical role in encoding these prediction errors. In my ...

To fully comprehend visual perception, we need to necessarily understand its temporal dimension. Our visual environment is highly dynamic, requiring the processing and integration of temporal signals in order to make sense of it. Many processes, such as th ...

Here we provide the neural data, activation and predictions for the best models and result dataframes of our article "Task-driven neural network models predict neural dynamics of proprioception". It contains the behavioral and neural experimental data (cu ...

The temporal variability of the thalamus in functional networks may provide valuable insights into the pathophysiology of schizophrenia. To address the complexity of the role of the thalamic nuclei in psychosis, we introduced micro-co-activation patterns ( ...

This article summarizes the recent advancements in the design, fabrication, and control of microrobotic devices for the diagnosis and treatment of brain disorders. With a focus on diverse actuation methods, we discuss how advancements in materials science ...

The use of intracranial recordings to decode human language: Challenges and opportunities

Chat with Graph Search

Bootstrapping Language-Audio Pre-training for Music Captioning

On the Utility of Speech and Audio Foundation Models for Marmoset Call Analysis

Decoding electroencephalographic responses to visual stimuli compatible with electrical stimulation

Subcortical correlates of consciousness with human single neuron recordings

Driving and suppressing the human language network using large language models

Task-driven neural network models predict neural dynamics of proprioception: Neural network model weights

Unraveling behavior and cortical signals to guide the development of soft neuroprostheses for auditory restoration and spreading depolarization

33.3 MiBMI: A 192/512-Channel 2.46mm² Miniaturized Brain-Machine Interface Chipset Enabling 31-Class Brain-to-Text Conversion Through Distinctive Neural Codes

Infusing structured knowledge priors in neural models for sample-efficient symbolic reasoning

The neural correlates of topographical disorientation-a lesion analysis study

Modeling, fabrication and validation of 3D neural interfaces for peripheral nerves and brain organoids

Probing and modulating inter-areal coupling in the cortical visual motion processing pathway with non-invasive brain stimulation

Predicting Heart Activity from Speech using Data-driven and Knowledge-based features

Towards Motion Forecasting with Real-World Perception Inputs: Are End-to-End Approaches Competitive?

Predicting Visual Stimuli From Cortical Response Recorded With Wide-Field Imaging in a Mouse

Unveiling the complexity of learning and decision-making

Temporal aspects of feature integration in vision

Task-driven neural network models predict neural dynamics of proprioception: Experimental data, activations and predictions of neural network models

Thalamic contributions to psychosis susceptibility: Evidence from co-activation patterns accounting for intra-seed spatial variability (μCAPs)

Small-scale robotic devices for medical interventions in the brain