Neural Correlates of Reinforcement Learning: eligibility trace, reward prediction error, novelty and surprise

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

Rock cuttings from destructive boreholes are a common and cheaper source of drilling materials that can be used to determine underground geology compared to rock core samples. Classifying manually the series of cuttings can be a long and tedious process an ...

Wearable Sensor (WS)-based monitoring systems detect minute patient movements/ demands and abnormalities through periodic sensing and imaging. Sensor data observed over different intervals is not constant or available based on operating sequences. Due to v ...

Reservoir Computing (RC) has become popular in recent years thanks to its fast and efficient computational capabilities. Standard RC has been shown to be equivalent in the asymptotic limit to Recurrent Kernels, which helps in analyzing its expressive power ...

Precisely localizing anomalies in medical images remains a significant challenge due to their heterogeneous nature across modalities and organs. While initial efforts excelled in identifying prominent anomalies, detecting minute target lesions posed signif ...

Hyperbolic conservation laws play a critical role in various fields, including aerodynamics, physics, and oceanography. However, traditional physics-informed neural networks (PINNs), despite their remarkable capabilities in solving partial differential equ ...

Reinforcement learning (RL) is crucial for learning to adapt to new environments. In RL, the prediction error is an important component that compares the expected and actual rewards. Dopamine plays a critical role in encoding these prediction errors. In my ...

Human babies have a natural desire to interact with new toys and objects, through which they learn how the world around them works, e.g., that glass shatters when dropped, but a rubber ball does not. When their predictions are proven incorrect, such as whe ...

Reinforcement feedback can improve motor learning, but the underlying brain mechanisms remain underexplored. In particular, the causal contribution of specific patterns of oscillatory activity within the human striatum is unknown. To address this question, ...

Social behaviors such as cooperation are crucial for mammals. A deeper knowledge of the neuronal mechanisms underlying cooperation can be beneficial for people suffering from pathologies with impaired social behavior. Our aim was to study the brain activit ...

Epilepsy, a major neurological disease, requires careful diagnosis and treatment. However, the detection of epileptic seizures remains a significant challenge. Current clinical practice relies on expert analysis of EEG signals, a process that is time-consu ...

This work studies the learning process over social networks under partial and random information sharing. In traditional social learning models, agents exchange full belief information with each other while trying to infer the true state of nature. We stud ...

Here we provide the weights of the neural network policies used for the analysis presented in our article. The archives whose names start with a number (01 - 32) correspond to the 32 curriculum steps to train the Baoding Balls policy which ranked first at ...

Subcortical brain structures such as the basal ganglia or the thalamus are involved in regulating motor and cognitive behavior. However, their contribution to perceptual consciousness is still unclear, due to the inherent difficulties of recording subcorti ...

In this thesis we explore the applications of projective geometry, a mathematical theory of the relation between 3D scenes and their 2D images, in modern learning-based computer vision systems. This is an interesting research question which contradicts the ...

In humans and animals, surprise is a physiological reaction to an unexpected event, but how surprise can be linked to plausible models of neuronal activity is an open problem. We propose a self-supervised spiking neural network model where a surprise signa ...

Regression models often fail to generalize effectively in regions characterized by highly imbalanced label distributions. Previous methods for deep imbalanced regression rely on gradient-based weight updates, which tend to overfit in underrepresented regio ...

Electrical stimulation of the visual nervous system could improve the quality of life of patients affected by acquired blindness by restoring some visual sensations, but requires careful optimization of stimulation parameters to produce useful perceptions. ...

Modern computing has enhanced our understanding of how social interactions shape collective behaviour in animal societies. Although analytical models dominate in studying collective behaviour, this study introduces a deep learning model to assess social in ...

The ability to reason, plan and solve highly abstract problems is a hallmark of human intelligence. Recent advancements in artificial intelligence, propelled by deep neural networks, have revolutionized disciplines like computer vision and natural language ...

The upcoming Square Kilometre Array Observatory will produce images of neutral hydrogen distribution during the epoch of reionization by observing the corresponding 21-cm signal. However, the 21-cm signal will be subject to instrumental limitations such as ...

Neural Correlates of Reinforcement Learning: eligibility trace, reward prediction error, novelty and surprise

Chat with Graph Search

X-ray Micro-CT based characterization of rock cuttings with deep learning

Enhancing wearable sensor data analysis for patient health monitoring using allied data disparity technique and multi instance ensemble perceptron learning

Comparison of Reservoir Computing topologies using the Recurrent Kernel approach

Robust semantic learning for precise medical image segmentation

A coordinate transformation-based physics-informed neural networks for hyperbolic conservation laws

Unveiling the complexity of learning and decision-making

Seeking the new, learning from the unexpected: Computational models of surprise and novelty in the brain

Non-invasive stimulation of the human striatum disrupts reinforcement learning of motor skills

Involvement of prelimbic cortex neurons and related circuits in the acquisition of a cooperative learning by pairs of rats

Resource-Efficient Continual Learning for Personalized Online Seizure Detection

Social Opinion Formation and Decision Making Under Communication Trends

Acquiring musculoskeletal skills with curriculum-based reinforcement learning - model weights

Subcortical correlates of consciousness with human single neuron recordings

Incorporating Projective Geometry into Deep Learning

Fast adaptation to rule switching using neuronal surprise

IM-Context: In-Context Learning for Imbalanced Regression Tasks

Decoding electroencephalographic responses to visual stimuli compatible with electrical stimulation

Predicting the long-term collective behaviour of fish pairs with deep learning

Infusing structured knowledge priors in neural models for sample-efficient symbolic reasoning

Deep learning approach for identification of H II regions during reionization in 21-cm observations - II. Foreground contamination