Publications associées à Reinforced Attention for Few-Shot Learning and Beyond

Unveiling the complexity of learning and decision-making

Reinforcement learning (RL) is crucial for learning to adapt to new environments. In RL, the prediction error is an important component that compares the expected and actual rewards. Dopamine plays a critical role in encoding these prediction errors. In my ...

EPFL2024

Seeking the new, learning from the unexpected: Computational models of surprise and novelty in the brain

Alireza Modirshanechi

Human babies have a natural desire to interact with new toys and objects, through which they learn how the world around them works, e.g., that glass shatters when dropped, but a rubber ball does not. When their predictions are proven incorrect, such as whe ...

EPFL2024

Multi-temporal forest monitoring in the Swiss Alps with knowledge-guided deep learning

Devis Tuia, Thiên-Anh Claris Nguyen, Marc Conrad Russwurm, Gaston Jean Lenczner

Monitoring forests, in particular their response to climate and land use change, requires studying long time scales. While efficient deep learning methods have been developed to process short time series of satellite imagery, leveraging long time series of ...

Elsevier Science Inc2024

Non-invasive stimulation of the human striatum disrupts reinforcement learning of motor skills

Elena Beanato, Esra Neufeld, Friedhelm Christoph Hummel, Takuya Morishita, Maximilian Jonas Wessel, Traian Popa, Pierre Theopistos Vassiliadis, Julie Duqué, Fabienne Windel

Reinforcement feedback can improve motor learning, but the underlying brain mechanisms remain underexplored. In particular, the causal contribution of specific patterns of oscillatory activity within the human striatum is unknown. To address this question, ...

Nature Portfolio2024

Reinforcement learning approach to control an inverted pendulum: A general framework for educational purposes

Jesus Sanchez Rodriguez

Machine learning is often cited as a new paradigm in control theory, but is also often viewed as empirical and less intuitive for students than classical model-based methods. This is particularly the case for reinforcement learning, an approach that does n ...

PUBLIC LIBRARY SCIENCE2023

Robust Collaborative Learning with Linear Gradient Overhead

Rachid Guerraoui, Le Nguyen Hoang, John Stephan, Sadegh Farhadkhani, Nirupam Gupta, Rafaël Benjamin Pinot

Collaborative learning algorithms, such as distributed SGD (or D-SGD), are prone to faulty machines that may deviate from their prescribed algorithm because of software or hardware bugs, poisoned data or malicious behaviors. While many solutions have been ...

PLMR2023

Striatal Dopamine Signals and Reward Learning

Carl Petersen, Sylvain Crochet, Mauro Pulin, Yanqi Liu, Christos Sourmpis, Parviz Ghaderi, Pol Bech Vilaseca, Meriam Malekzadeh, Anthony Pierre Robert Renard, Robin François Virginien Dard

We are constantly bombarded by sensory information and constantly making decisions on how to act. In order to optimally adapt behavior, we must judge which sequences of sensory inputs and actions lead to successful outcomes in specific circumstances. Neuro ...

Oxford Univ Press2023

Breaking the Curse of Dimensionality in Deep Neural Networks by Learning Invariant Representations

Leonardo Petrini

Artificial intelligence, particularly the subfield of machine learning, has seen a paradigm shift towards data-driven models that learn from and adapt to data. This has resulted in unprecedented advancements in various domains such as natural language proc ...

EPFL2023

Exploiting Explanations to Detect Misclassifications of Deep Learning Models in Power Grid Visual Inspection

Olga Fink, Giovanni Floreale

In the context of automatic visual inspection of infrastructures by drones, Deep Learning (DL) models are used to automatically process images for fault diagnostics. While explainable Artificial Intelligence (AI) algorithms can provide explanations to asse ...

Research Publishing2023

Survey experiments on economic expectations

Andreas Fuster

In this chapter, we discuss field experiments in surveys that are conducted with the purpose of learning about expectation formation and the link between expectations and behavior. We begin by reviewing the rationale for conducting experiments within surve ...

Academic Press2023

Saliency prediction in 360° architectural scenes: Performance and impact of daylight variations

Marilyne Andersen, Sabine Süsstrunk, Kynthia Chamilothori, Bahar Aydemir, Caroline Karmann, Seungryong Kim

Saliency models are image-based prediction models that estimate human visual attention. Such models, when applied to architectural spaces, could pave the way for design decisions where visual attention is taken into account. In this study, we tested the pe ...

2023

Estimating and Improving the Robustness of Attributions in Text

Ádám Dániel Ivánkay

End-to-end learning methods like deep neural networks have been the driving force in the remarkable progress of machine learning in recent years. However, despite their success, the deployment process of such networks in safety-critical use cases, such as ...

EPFL2023

Supervised learning and inference of spiking neural networks with temporal coding

Ana Stanojevic

The way biological brains carry out advanced yet extremely energy efficient signal processing remains both fascinating and unintelligible. It is known however that at least some areas of the brain perform fast and low-cost processing relying only on a smal ...

EPFL2023

Safe multi-agent deep reinforcement learning for joint bidding and maintenance scheduling of generation units

Olga Fink, Mina Montazeri

This paper proposes a safe reinforcement learning algorithm for generation bidding decisions and unit maintenance scheduling in a competitive electricity market environment. In this problem, each unit aims to find a bidding strategy that maximizes its reve ...

2023

Mechanisms underlying reinforcement learning of motor skills

Pierre Theopistos Vassiliadis

Motor learning allows animals, including human beings, to acquire skills that are es-sential for efficient interactions with the environment. This ability to learn new motor skills is of great practical relevance for daily-life activities (such as when lea ...

EPFL2023

Transformer Models for Vision

Jean-Baptiste Francis Marie Juliette Cordonnier

The recent developments of deep learning cover a wide variety of tasks such as image classification, text translation, playing go, and folding proteins. All these successful methods depend on a gradient-based learning algorithm to train a model on massive ...

EPFL2023

Class Specific Feature Disentanglement and Text Embeddings for Multi-label Generalized Zero Shot CXR Classification

Seyedbehzad Bozorgtabar

Robustness of medical image classification models is limited by its exposure to the candidate disease classes. Generalized zero shot learning (GZSL) aims at correctly predicting seen and unseen classes and most current GZSL approaches have focused on the s ...

Springer International Publishing Ag2023

Deep Learning Generalization with Limited and Noisy Labels

Mahsa Forouzesh

Deep neural networks have become ubiquitous in today's technological landscape, finding their way in a vast array of applications. Deep supervised learning, which relies on large labeled datasets, has been particularly successful in areas such as image cla ...

EPFL2023

Text as a Richer Source of Supervision in Semantic Segmentation Tasks

Devis Tuia, Valérie Zermatten, Lloyd Haydn Hughes, Javiera Francisca Castillo Navarro

This paper introduces TACOSS a text-image alignment approach that allows explainable land cover semantic segmentation by directly integrating semantic concepts encoded from texts. TACOSS combines convolutional neural networks for visual feature extraction ...

The Institute of Electrical and Electronics Engineers, Inc2023

Prompting Large Language Models to Power Educational Chatbots

Denis Gillet, Sandy Ingram, Juan Carlos Farah, Fanny Kim-Lan Lasne

The recent rise in both popularity and performance of large language models has garnered considerable interest regarding their applicability to education. Technologies like ChatGPT, which can engage in human-like dialog, have already disrupted educational ...

Springer2023