Lecture

Reward-based Learning: Cellular Mechanisms

Graph Chat

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

Description

This lecture covers reward-based learning in neuronal networks, focusing on the dopamine reward signal, dopaminergic innervation of the striatum, and the role of striatal projection neurons. It also discusses dopamine modulation of synaptic plasticity, the whisker detection task, and the cell-type-specific function of striatal neurons. The instructor explains dopamine learning in the whisker detection task and the mechanisms underlying reward-based learning, emphasizing the reinforcement of synaptic circuits driving goal-directed behavior.

In MOOC

Cellular Mechanisms of Brain Function

The function of the brain is to govern behavior, and the aim of this course is to causally link biophysical mechanisms with simple behaviors studied in mice. The brain processes information through the concerted activity of many neurons, which communicate with each other through synapses organised in highly dynamic networks. The first goal of the course is to gain a detailed understanding of the structure and function of the fundamental building blocks of the mammalian brain, its synapses and neurons (Weeks

Official source

Quiz

Ontological neighbourhood

Biology

Cell biology: Neurotransmission

Related concepts (32)

Medium spiny neuron

Medium spiny neurons (MSNs), also known as spiny projection neurons (SPNs), are a special type of GABAergic inhibitory cell representing 95% of neurons within the human striatum, a basal ganglia structure. Medium spiny neurons have two primary phenotypes (characteristic types): D1-type MSNs of the direct pathway and D2-type MSNs of the indirect pathway. Most striatal MSNs contain only D1-type or D2-type dopamine receptors, but a subpopulation of MSNs exhibit both phenotypes.

Striatum

The striatum, or corpus striatum (also called the striate nucleus), is a nucleus (a cluster of neurons) in the subcortical basal ganglia of the forebrain. The striatum is a critical component of the motor and reward systems; receives glutamatergic and dopaminergic inputs from different sources; and serves as the primary input to the rest of the basal ganglia. Functionally, the striatum coordinates multiple aspects of cognition, including both motor and action planning, decision-making, motivation, reinforcement, and reward perception.

Dopamine

Dopamine (DA, a contraction of 3,4-dihydroxyphenethylamine) is a neuromodulatory molecule that plays several important roles in cells. It is an organic chemical of the catecholamine and phenethylamine families. Dopamine constitutes about 80% of the catecholamine content in the brain. It is an amine synthesized by removing a carboxyl group from a molecule of its precursor chemical, L-DOPA, which is synthesized in the brain and kidneys. Dopamine is also synthesized in plants and most animals.

Dopamine receptor

Dopamine receptors are a class of G protein-coupled receptors that are prominent in the vertebrate central nervous system (CNS). Dopamine receptors activate different effectors through not only G-protein coupling, but also signaling through different protein (dopamine receptor-interacting proteins) interactions. The neurotransmitter dopamine is the primary endogenous ligand for dopamine receptors. Dopamine receptors are implicated in many neurological processes, including motivational and incentive salience, cognition, memory, learning, and fine motor control, as well as modulation of neuroendocrine signaling.

Basal ganglia

The basal ganglia (BG), or basal nuclei, are a group of subcortical nuclei, of varied origin, in the brains of vertebrates. In humans, and some primates, there are some differences, mainly in the division of the globus pallidus into an external and internal region, and in the division of the striatum. The basal ganglia are situated at the base of the forebrain and top of the midbrain. Basal ganglia are strongly interconnected with the cerebral cortex, thalamus, and brainstem, as well as several other brain areas.

Related lectures (39)

Untitled

Parkinson's Disease: Basal Ganglia Circuitry

Explores the basal ganglia circuitry in Parkinson's disease, covering structure, function, dopamine role, pathology, and treatments.

Untitled

Learning to Find a Goal

Delves into a biologically inspired version of Reinforcement Learning, focusing on maze navigation and the implementation of spiking neurons.

Untitled

Related concepts (32)