Publications associées à Time course of prediction errors in sequential decision making

Publications associées (32)

Parsimonious Online Learning with Kernels and Random Features with Applications to Stochastic Optimal Control

This thesis explores stochastic optimal control through three interconnected contributions: a theoretical framework, and the development of two regression methods, POLK and POLRF, tailored to high-dimensional regression challenges in this domain. In the f ...

EPFL2025

High-Resolution Predictions of the Fuel and Cladding Temperatures for the 3D PWR Core with Artificial Neural Networks trained on CTF

Marianna Papadionysiou

High resolution multi-physics core solvers predict safety parameters on a local scale with high accuracy while simulating local heterogeneities and their consequences. To achieve this, large computational resources are needed which renders the extensive us ...

American Nuclear Society2025

Unveiling the complexity of learning and decision-making

Wei-Hsiang Lin

Reinforcement learning (RL) is crucial for learning to adapt to new environments. In RL, the prediction error is an important component that compares the expected and actual rewards. Dopamine plays a critical role in encoding these prediction errors. In my ...

EPFL2024

Seeking the new, learning from the unexpected: Computational models of surprise and novelty in the brain

Alireza Modirshanechi

Human babies have a natural desire to interact with new toys and objects, through which they learn how the world around them works, e.g., that glass shatters when dropped, but a rubber ball does not. When their predictions are proven incorrect, such as whe ...

EPFL2024

Customizing the human-avatar mapping based on EEG error related potentials during avatar-based interaction

Olaf Blanke, José del Rocio Millán Ruiz, Ronan Boulic, Ricardo Andres Chavarriaga Lozano, Bruno Herbelin, Fumiaki Iwane, Thibault Serge Mario Porssut

Objective. A key challenge of virtual reality (VR) applications is to maintain a reliable human-avatar mapping. Users may lose the sense of controlling (sense of agency), owning (sense of body ownership), or being located (sense of self-location) inside th ...

2024

Coupled Electromagnetic-Electrophysiological Modeling of Neural Circuits

Joseph Tharayil

Much of our knowledge about the brain is derived from extracellular recordings of the electric fields produced by neural activity. However, interpretation of these signals is nontrivial. In par- ticular, it is difficult to link macro-scale observations of ...

EPFL2024

Involvement of prelimbic cortex neurons and related circuits in the acquisition of a cooperative learning by pairs of rats

Maria del Carmen Sandi Perez, Elias Georges Gebara

Social behaviors such as cooperation are crucial for mammals. A deeper knowledge of the neuronal mechanisms underlying cooperation can be beneficial for people suffering from pathologies with impaired social behavior. Our aim was to study the brain activit ...

Springer2024

Non-invasive stimulation of the human striatum disrupts reinforcement learning of motor skills

Friedhelm Christoph Hummel, Takuya Morishita, Maximilian Jonas Wessel, Elena Beanato, Traian Popa, Pierre Theopistos Vassiliadis, Fabienne Windel, Esra Neufeld

Reinforcement feedback can improve motor learning, but the underlying brain mechanisms remain underexplored. In particular, the causal contribution of specific patterns of oscillatory activity within the human striatum is unknown. To address this question, ...

Nature Portfolio2024

White adipose tissue distribution and amount are associated with increased white matter connectivity

Jean-Philippe Thiran, Gabriel Girard, Elda Fischi Gomez, Philipp Johannes Koch

Obesity represents a significant public health concern and is linked to various comorbidities and cognitive impairments. Previous research indicates that elevated body mass index (BMI) is associated with structural changes in white matter (WM). However, a ...

Wiley2024

Incorporating Projective Geometry into Deep Learning

Michal Jan Tyszkiewicz

In this thesis we explore the applications of projective geometry, a mathematical theory of the relation between 3D scenes and their 2D images, in modern learning-based computer vision systems. This is an interesting research question which contradicts the ...

EPFL2024

Partial discharge localization in power transformer tanks using machine learning methods

Farhad Rachidi-Haeri, Marcos Rubinstein, Hamidreza Karami

This paper presents a comparison of machine learning (ML) methods used for three-dimensional localization of partial discharges (PD) in a power transformer tank. The study examines ML and deep learning (DL) methods, ranging from support vector machines (SV ...

Nature Publishing Group2024

Parental status and markers of brain and cellular age: A 3D convolutional network and classification study

Donal Patrick Hill

Recent research shows prominent effects of pregnancy and the parenthood transition on structural brain characteristics in humans. Here, we present a comprehensive study of how parental status and number of children born/fathered links to markers of brain a ...

Pergamon-Elsevier Science Ltd2024

The interplay between white adipose tissue, adipokines, and structural gray matter changes

Jean-Philippe Thiran, Gabriel Girard, Elda Fischi Gomez

The growing global obesity issue emphasizes the importance of understanding its health implications. Previous research has identified consistent alterations in gray matter (GM) volume in connection with obesity. Given the various implications of distinct f ...

Wiley2024

Neurobiological and metabolic basis of motivation and effort-based decision-making - A human 1H-MRS, fMRI and machine learning study

Arthur Barakat

Motivation is a multifaceted phenomenon that we explore within the framework of decision-making. Through this cognitive process, actions are directed towards specific goals by performing a trade-off between the cost and benefit of an action. The dorsomedia ...

EPFL2024

Social Opinion Formation and Decision Making Under Communication Trends

Ali H. Sayed, Virginia Bordignon, Mert Kayaalp

This work studies the learning process over social networks under partial and random information sharing. In traditional social learning models, agents exchange full belief information with each other while trying to infer the true state of nature. We stud ...

Ieee-Inst Electrical Electronics Engineers Inc2024

Health Prediction for Lithium-Ion Batteries Under Unseen Working Conditions

Florent Evariste Forest, Yunhong Che

Battery health prediction is significant while challenging for intelligent battery management. This article proposes a general framework for both short-term and long-term predictions of battery health under unseen dynamic loading and temperature conditions ...

Ieee-Inst Electrical Electronics Engineers Inc2024

Topics in statistical physics of high-dimensional machine learning

Hugo Chao Cui

In the past few years, Machine Learning (ML) techniques have ushered in a paradigm shift, allowing the harnessing of ever more abundant sources of data to automate complex tasks. The technical workhorse behind these important breakthroughs arguably lies in ...

EPFL2024

Understanding generalization and robustness in modern deep learning

Maksym Andriushchenko

In this thesis, we study two closely related directions: robustness and generalization in modern deep learning. Deep learning models based on empirical risk minimization are known to be often non-robust to small, worst-case perturbations known as adversari ...

EPFL2024

Optimization Algorithms for Decentralized, Distributed and Collaborative Machine Learning

Anastasiia Koloskova

Distributed learning is the key for enabling training of modern large-scale machine learning models, through parallelising the learning process. Collaborative learning is essential for learning from privacy-sensitive data that is distributed across various ...

EPFL2024

Transformers and Large Language Models for Chemistry and Drug Discovery

Philippe Schwaller, Andres Camilo Marulanda Bran

Language modeling has seen impressive progress over the last few years. The invention of the Transformer architecture sparked a revolution in many fields of machine learning, including breakthroughs in chemistry and biology. In this chapter, we explore how ...

Springer Nature2024