Lecture

Neuroscience Inspired Artificial Intelligence

Graph Chat

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

In course

PHYS-754: Lecture series on scientific machine learning

This lecture presents ongoing work on how scientific questions can be tackled using machine learning. Machine learning enables extracting knowledge from data computationally and in an automatized way. We will learn on examples how this is influencing the v ...

Description

This lecture presents a review paper on Neuroscience Inspired Artificial Intelligence, exploring the intertwined relationship between neuroscience and AI disciplines. It covers the historical development of deep learning, reinforcement learning, attention mechanisms, episodic memory, working memory, and continual learning. The lecture delves into how concepts from neuroscience have inspired AI algorithms, such as attention mechanisms for object classification tasks and the integration of episodic memory to enhance reinforcement learning. It also discusses the importance of dopamine in reward prediction error and the role of working memory in AI architectures. The presentation highlights the ongoing influence of neuroscience concepts on AI research, emphasizing the foundational inspiration derived from biological neural networks.

Instructors (10)

Michele Ceriotti

Michele Ceriotti received his Ph.D. in Physics from ETH Zürich in 2010. He spent three years in Oxford as a Junior Research Fellow at Merton College. Since 2013 he leads the laboratory for Computational Science and Modeling in the Institute of Materials at EPFL. His research revolves around the atomic-scale modelling of materials, based on the sampling of quantum and thermal fluctuations and on the use of machine learning to predict and rationalize structure-property relations. He has been awarded the IBM Research Forschungspreis in 2010, the Volker Heine Young Investigator Award in 2013, an ERC Starting Grant in 2016, and the IUPAP C10 Young Scientist Prize in 2018.

David Richard Harvey

Expertise CosmologyDark MatterGalaxy ClustersStrong Gravitational LensingWeak Gravitational Lensing I am an observational and theoretical astrophysicist at EPFL. My main area of research is dark matter and trying to understand its properties and dynamics. I love to use deep learning in my work and understand how fondation models and generative AI can help us understand the Universe. I am a member of Euclid and ARRAKIHS and the lead of the self interacting dark matter Key Project in Euclid. Outside of my r

Matthieu Wyart

Teaching & PhD Past EPFL PhD Students Riccardo Ravasio, Mario Geiger, Wencheng Ji, Leonardo Petrini, Umberto Maria Tomasini, Alessandro Favero Courses Systèmes complexes PHYS-343 This courses show how known (entropy, phase transitions) and new (glasses, percolation, avalanche-type response) physical concepts can be used in various fields (including Computer science, neuroscience, social sciences).

Anne-Florence Raphaëlle Bitbol

I was trained in physics, and always had a strong interest in biology. I am broadly interested in understanding biological phenomena in a quantitative way, through physical concepts and mathematical and computational tools. I investigate the relative impacts of optimization and historical contingency in biological evolution, both at the scale of protein sequences and at the scale of microbial populations.Here is my research group website.Curriculum vitae Here is my complete CV. Professional experience:Since

Official source

Ontological neighbourhood

Psychology

Basic psychology: Cognitive psychology

Related concepts (32)

Memory

Memory is the faculty of the mind by which data or information is encoded, stored, and retrieved when needed. It is the retention of information over time for the purpose of influencing future action. If past events could not be remembered, it would be impossible for language, relationships, or personal identity to develop. Memory loss is usually described as forgetfulness or amnesia. Memory is often understood as an informational processing system with explicit and implicit functioning that is made up of a sensory processor, short-term (or working) memory, and long-term memory.

Baddeley's model of working memory

Baddeley's model of working memory is a model of human memory proposed by Alan Baddeley and Graham Hitch in 1974, in an attempt to present a more accurate model of primary memory (often referred to as short-term memory). Working memory splits primary memory into multiple components, rather than considering it to be a single, unified construct. Baddeley & Hitch proposed their three-part working memory model as an alternative to the short-term store in Atkinson & Shiffrin's 'multi-store' memory model (1968).

Reinforcement learning

Reinforcement learning (RL) is an area of machine learning concerned with how intelligent agents ought to take actions in an environment in order to maximize the notion of cumulative reward. Reinforcement learning is one of three basic machine learning paradigms, alongside supervised learning and unsupervised learning. Reinforcement learning differs from supervised learning in not needing labelled input/output pairs to be presented, and in not needing sub-optimal actions to be explicitly corrected.

Neural network

A neural network can refer to a neural circuit of biological neurons (sometimes also called a biological neural network), a network of artificial neurons or nodes in the case of an artificial neural network. Artificial neural networks are used for solving artificial intelligence (AI) problems; they model connections of biological neurons as weights between nodes. A positive weight reflects an excitatory connection, while negative values mean inhibitory connections. All inputs are modified by a weight and summed.

Long-term memory

Long-term memory (LTM) is the stage of the Atkinson–Shiffrin memory model in which informative knowledge is held indefinitely. It is defined in contrast to short-term and working memory, which persist for only about 18 to 30 seconds. LTM is commonly labelled as "explicit memory" (declarative), as well as "episodic memory," "semantic memory," "autobiographical memory," and "implicit memory" (procedural memory). The idea of separate memories for short- and long-term storage originated in the 19th century.

Related lectures (45)

Neuroscience and ML

Explores the intersection between neuroscience and machine learning, discussing deep learning, reinforcement learning, memory systems, and the future of bridging machine and human-level intelligence.

The Hidden Convex Optimization Landscape of Deep Neural Networks

Explores the hidden convex optimization landscape of deep neural networks, showcasing the transition from non-convex to convex models.

Neuroscience and AI: Bridging the Gap

Explores the gap between AI and human intelligence through neuroscience-inspired models and algorithms.

Understanding Deep Learning

Explores deep learning fundamentals, including image classification, neural network working principles, and machine learning challenges.

Data-Driven Modeling in Neuroscience: Meenakshi Khosla