Publications related to Mechanisms underlying reinforcement learning of motor skills

Related publications (35)

Membrane mechanics dictate axonal pearls-on-a-string morphology and function

Axons are ultrathin membrane cables that are specialized for the conduction of action potentials. Although their diameter is variable along their length, how their morphology is determined is unclear. Here, we demonstrate that unmyelinated axons of the mou ...

2025

Sequential Reasoning with Socially Caused Beliefs

Mert Kayaalp

Machine learning and artificial intelligence methods have achieved remarkable success, matching and even surpassing human capabilities in various complex tasks. However, many demonstrations have generally neglected a critical part of the intelligence that ...

EPFL2025

Non-invasive stimulation of the human striatum disrupts reinforcement learning of motor skills

Friedhelm Christoph Hummel, Takuya Morishita, Maximilian Jonas Wessel, Elena Beanato, Traian Popa, Pierre Theopistos Vassiliadis, Fabienne Windel, Esra Neufeld

Reinforcement feedback can improve motor learning, but the underlying brain mechanisms remain underexplored. In particular, the causal contribution of specific patterns of oscillatory activity within the human striatum is unknown. To address this question, ...

Nature Portfolio2024

Augmenting locomotor perception by remapping tactile foot sensation to the back

Nathanaël Yvon Ferraroli-Tissot-Daguette, Olaf Blanke, Mohamed Bouri, Oliver Alan Kannape, Atena Fadaeijouybari, Selim Jean Habiby Alaoui

Background :Sensory reafferents are crucial to correct our posture and movements, both reflexively and in a cognitively driven manner. They are also integral to developing and maintaining a sense of agency for our actions. In cases of compromised reafferen ...

BioMed Central2024

Uncovering interactions between Descending Neurons as a functional principle of behavioural control

Jonas Friedrich Braun

Animals, including humans, exhibit a remarkable variety of complex behaviours. How the nervous system controls all these behaviours ranging from simple, stereotyped movements to flexible, adaptive actions is a central questions of neuroscience. One of the ...

EPFL2024

Unraveling behavior and cortical signals to guide the development of soft neuroprostheses for auditory restoration and spreading depolarization

Emilie Cornelia Maria Revol

Neuroprostheses have been used clinically for decades, to help restore or preserve brain functions, when pharmaceutical treatments are inefficient. Although great progress in the field has been made over the years to interface with the nervous system, surf ...

EPFL2024

Organ Neuroprosthetics: Connecting Transplanted and Artificial Organs with the Nervous System

Silvestro Micera

Implantable neural interfaces with the central and peripheral nervous systems are currently used to restore sensory, motor, and cognitive functions in disabled people with very promising results. They have also been used to modulate autonomic activities to ...

Wiley2024

A method and system for optimizing design, implantation, and stimulation protocols of electrodes stimulating the nervous system

Silvestro Micera, Simone Romeni

A method for optimizing at least one of a geometry, an implantation procedure, and/or stimulation protocol of one or more electrodes for an electrical stimulation of a target structure in a nervous system of a living being by a computer device, the method ...

2024

Predicting the long-term collective behaviour of fish pairs with deep learning

Francesco Mondada, Alexandre Massoud Alahi, Vaios Papaspyros

Modern computing has enhanced our understanding of how social interactions shape collective behaviour in animal societies. Although analytical models dominate in studying collective behaviour, this study introduces a deep learning model to assess social in ...

2024

Large-scale in-silico analysis of CSF dynamics within the subarachnoid space of the optic nerve

Gilles Fourestey

BackgroundImpaired cerebrospinal fluid (CSF) dynamics is involved in the pathophysiology of neurodegenerative diseases of the central nervous system and the optic nerve (ON), including Alzheimer's and Parkinson's disease, as well as frontotemporal dementia ...

BMC2024

Learning-based Hierarchical Control: Emulating the Central Nervous System for Bio-Inspired Legged Robot Locomotion

Auke Ijspeert, Guillaume Denis Antoine Bellegarda, Milad Shafiee Ashtiani

Animals possess a remarkable ability to navigate challenging terrains, achieved through the interplay of various pathways between the brain, central pattern generators (CPGs) in the spinal cord, and musculoskeletal system. Traditional bioinspired control f ...

Institute of Electrical and Electronics Engineers Inc.2024

Seeking the new, learning from the unexpected: Computational models of surprise and novelty in the brain

Alireza Modirshanechi

Human babies have a natural desire to interact with new toys and objects, through which they learn how the world around them works, e.g., that glass shatters when dropped, but a rubber ball does not. When their predictions are proven incorrect, such as whe ...

EPFL2024

Probing and modulating inter-areal coupling in the cortical visual motion processing pathway with non-invasive brain stimulation

Michele Bevilacqua

In the last few years, stroke ranked as the second most common cause of death and is the third most significant condition affecting disability-adjusted life years (DALYs) worldwide. Being the most prevalent and quality of life impacting post-stroke symptom ...

EPFL2024

Generalization and Personalization of Machine Learning for Multimodal Mobile Sensing in Everyday Life

Lakmal Buddika Meegahapola

A range of behavioral and contextual factors, including eating and drinking behavior, mood, social context, and other daily activities, can significantly impact an individual's quality of life and overall well-being. Therefore, inferring everyday life aspe ...

EPFL2024

Accelerometry as a tool for measuring the effects of transcranial magnetic stimulation

Pierre Theopistos Vassiliadis

Objective: We predicted that accelerometry would be a viable alternative to electromyography (EMG) for assessing fundamental Transcranial Magnetic Stimulation (TMS) measurements (e.g. Resting Motor Threshold (RMT), recruitment curves, latencies). New Metho ...

Elsevier2024

Resource-Efficient Continual Learning for Personalized Online Seizure Detection

Amirhossein Shahbazinia, David Atienza Alonso, Giovanni Ansaloni, Flavio Ponzina, José Angel Miranda Calero, Jonathan Dan

Epilepsy, a major neurological disease, requires careful diagnosis and treatment. However, the detection of epileptic seizures remains a significant challenge. Current clinical practice relies on expert analysis of EEG signals, a process that is time-consu ...

IEEE2024

Trio preserves motor synapses and prolongs motor ability during aging

Evelyne Ruchti, Brian Donal McCabe, Wei Jiao, Soumya Banerjee, Greta Limoni, Samuel William Vernon, Marine Van Campenhoudt

The decline of motor ability is a hallmark feature of aging and is accompanied by degeneration of motor synaptic terminals. Consistent with this, Drosophila motor synapses undergo characteristic age -dependent structural fragmentation co -incident with dim ...

Cell Press2024

Social Opinion Formation and Decision Making Under Communication Trends

Ali H. Sayed, Virginia Bordignon, Mert Kayaalp

This work studies the learning process over social networks under partial and random information sharing. In traditional social learning models, agents exchange full belief information with each other while trying to infer the true state of nature. We stud ...

Ieee-Inst Electrical Electronics Engineers Inc2024

Unveiling the complexity of learning and decision-making

Wei-Hsiang Lin

Reinforcement learning (RL) is crucial for learning to adapt to new environments. In RL, the prediction error is an important component that compares the expected and actual rewards. Dopamine plays a critical role in encoding these prediction errors. In my ...

EPFL2024

An objective skill assessment framework for microsurgical anastomosis based on ALI scores

Aude Billard, Kunpeng Yao, Soheil Gholami

IntroductionThe current assessment and standardization of microsurgical skills are subjective, posing challenges in reliable skill evaluation. We aim to address these limitations by developing a quantitative and objective framework for accurately assessing ...

Springer Wien2024