Publications related to Neural Correlates of Reinforcement Learning: eligibility trace, reward prediction error, novelty and surprise

Related publications (36)

X-ray Micro-CT based characterization of rock cuttings with deep learning

Nils Frédérik Heiden Olsen, Alexandre Massoud Alahi, Pascal Turberg

Rock cuttings from destructive boreholes are a common and cheaper source of drilling materials that can be used to determine underground geology compared to rock core samples. Classifying manually the series of cuttings can be a long and tedious process an ...

2025

Enhancing wearable sensor data analysis for patient health monitoring using allied data disparity technique and multi instance ensemble perceptron learning

Zaffar Ahmed Shaikh

Wearable Sensor (WS)-based monitoring systems detect minute patient movements/ demands and abnormalities through periodic sensing and imaging. Sensor data observed over different intervals is not constant or available based on operating sequences. Due to v ...

Springer Science and Business Media LLC2025

Comparison of Reservoir Computing topologies using the Recurrent Kernel approach

Jonathan Yuelin Dong

Reservoir Computing (RC) has become popular in recent years thanks to its fast and efficient computational capabilities. Standard RC has been shown to be equivalent in the asymptotic limit to Recurrent Kernels, which helps in analyzing its expressive power ...

2025

Robust semantic learning for precise medical image segmentation

Seyedbehzad Bozorgtabar

Precisely localizing anomalies in medical images remains a significant challenge due to their heterogeneous nature across modalities and organs. While initial efforts excelled in identifying prominent anomalies, detecting minute target lesions posed signif ...

2025

A coordinate transformation-based physics-informed neural networks for hyperbolic conservation laws

Jan Sickmann Hesthaven

Hyperbolic conservation laws play a critical role in various fields, including aerodynamics, physics, and oceanography. However, traditional physics-informed neural networks (PINNs), despite their remarkable capabilities in solving partial differential equ ...

2025

Unveiling the complexity of learning and decision-making

Wei-Hsiang Lin

Reinforcement learning (RL) is crucial for learning to adapt to new environments. In RL, the prediction error is an important component that compares the expected and actual rewards. Dopamine plays a critical role in encoding these prediction errors. In my ...

EPFL2024

Seeking the new, learning from the unexpected: Computational models of surprise and novelty in the brain

Alireza Modirshanechi

Human babies have a natural desire to interact with new toys and objects, through which they learn how the world around them works, e.g., that glass shatters when dropped, but a rubber ball does not. When their predictions are proven incorrect, such as whe ...

EPFL2024

Non-invasive stimulation of the human striatum disrupts reinforcement learning of motor skills

Friedhelm Christoph Hummel, Takuya Morishita, Maximilian Jonas Wessel, Elena Beanato, Traian Popa, Pierre Theopistos Vassiliadis, Fabienne Windel, Esra Neufeld

Reinforcement feedback can improve motor learning, but the underlying brain mechanisms remain underexplored. In particular, the causal contribution of specific patterns of oscillatory activity within the human striatum is unknown. To address this question, ...

Nature Portfolio2024

Involvement of prelimbic cortex neurons and related circuits in the acquisition of a cooperative learning by pairs of rats

Maria del Carmen Sandi Perez, Elias Georges Gebara

Social behaviors such as cooperation are crucial for mammals. A deeper knowledge of the neuronal mechanisms underlying cooperation can be beneficial for people suffering from pathologies with impaired social behavior. Our aim was to study the brain activit ...

Springer2024

Resource-Efficient Continual Learning for Personalized Online Seizure Detection

Amirhossein Shahbazinia, David Atienza Alonso, Giovanni Ansaloni, Flavio Ponzina, José Angel Miranda Calero, Jonathan Dan

Epilepsy, a major neurological disease, requires careful diagnosis and treatment. However, the detection of epileptic seizures remains a significant challenge. Current clinical practice relies on expert analysis of EEG signals, a process that is time-consu ...

IEEE2024

Social Opinion Formation and Decision Making Under Communication Trends

Ali H. Sayed, Virginia Bordignon, Mert Kayaalp

This work studies the learning process over social networks under partial and random information sharing. In traditional social learning models, agents exchange full belief information with each other while trying to infer the true state of nature. We stud ...

Ieee-Inst Electrical Electronics Engineers Inc2024

Acquiring musculoskeletal skills with curriculum-based reinforcement learning - model weights

Abigaïl Rebecca Lise Ingster, Alexander Mathis, Alberto Silvio Chiappa

Here we provide the weights of the neural network policies used for the analysis presented in our article. The archives whose names start with a number (01 - 32) correspond to the 32 curriculum steps to train the Baoding Balls policy which ranked first at ...

Zenodo2024

Subcortical correlates of consciousness with human single neuron recordings

Olaf Blanke, Fosco Bernasconi, Nathan Quentin Faivre, Michael Eric Anthony Pereira

Subcortical brain structures such as the basal ganglia or the thalamus are involved in regulating motor and cognitive behavior. However, their contribution to perceptual consciousness is still unclear, due to the inherent difficulties of recording subcorti ...

2024

Incorporating Projective Geometry into Deep Learning

Michal Jan Tyszkiewicz

In this thesis we explore the applications of projective geometry, a mathematical theory of the relation between 3D scenes and their 2D images, in modern learning-based computer vision systems. This is an interesting research question which contradicts the ...

EPFL2024

Fast adaptation to rule switching using neuronal surprise

Wulfram Gerstner, Martin Louis Lucien Rémy Barry

In humans and animals, surprise is a physiological reaction to an unexpected event, but how surprise can be linked to plausible models of neuronal activity is an open problem. We propose a self-supervised spiking neural network model where a surprise signa ...

2024

IM-Context: In-Context Learning for Imbalanced Regression Tasks

Olga Fink, Ismail Nejjar

Regression models often fail to generalize effectively in regions characterized by highly imbalanced label distributions. Previous methods for deep imbalanced regression rely on gradient-based weight updates, which tend to overfit in underrepresented regio ...

Neural information processing systems foundation2024

Decoding electroencephalographic responses to visual stimuli compatible with electrical stimulation

Silvestro Micera, Laura Toni, Fiorenzo Artoni, Simone Romeni

Electrical stimulation of the visual nervous system could improve the quality of life of patients affected by acquired blindness by restoring some visual sensations, but requires careful optimization of stimulation parameters to produce useful perceptions. ...

Aip Publishing2024

Predicting the long-term collective behaviour of fish pairs with deep learning

Francesco Mondada, Alexandre Massoud Alahi, Vaios Papaspyros

Modern computing has enhanced our understanding of how social interactions shape collective behaviour in animal societies. Although analytical models dominate in studying collective behaviour, this study introduces a deep learning model to assess social in ...

2024

Infusing structured knowledge priors in neural models for sample-efficient symbolic reasoning

Mattia Atzeni

The ability to reason, plan and solve highly abstract problems is a hallmark of human intelligence. Recent advancements in artificial intelligence, propelled by deep neural networks, have revolutionized disciplines like computer vision and natural language ...

EPFL2024

Deep learning approach for identification of H II regions during reionization in 21-cm observations - II. Foreground contamination

Jean-Paul Richard Kneib, Emma Elizabeth Tolley, Michele Bianco, Tianyue Chen

The upcoming Square Kilometre Array Observatory will produce images of neutral hydrogen distribution during the epoch of reionization by observing the corresponding 21-cm signal. However, the 21-cm signal will be subject to instrumental limitations such as ...

Oxford Univ Press2024