Lecture

Storage Capacity: Prototypes and Neuronal Dynamics

Graph Chat

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

Description

This lecture delves into the storage capacity of associative memory in networks of neurons, focusing on the learning and retention of multiple prototypes. By analyzing the interactions between patterns and neurons, the instructor explains the minimal conditions required for fixed points in the dynamics. The lecture explores the impact of too many prototypes on error rates and the proportional relationship between the number of stored prototypes and neurons. Additionally, it discusses the concept of memory load and the retrieval of memories without a centralized controller. The presentation also covers random walk models and standard deviations in the context of neuronal dynamics.

In MOOC

Neuronal Dynamics 2- Computational Neuroscience: Neuronal Dynamics of Cognition

This course gives an introduction to the field of theoretical and computational neuroscience with a focus on models of single neurons. Neurons encode information about stimuli in a sequence of short electrical pulses (spikes).

Official source

Ontological neighbourhood

Statistics

Statistical inference: Mathematical statistics

Related concepts (26)

Standard deviation

In statistics, the standard deviation is a measure of the amount of variation or dispersion of a set of values. A low standard deviation indicates that the values tend to be close to the mean (also called the expected value) of the set, while a high standard deviation indicates that the values are spread out over a wider range. Standard deviation may be abbreviated SD, and is most commonly represented in mathematical texts and equations by the lower case Greek letter σ (sigma), for the population standard deviation, or the Latin letter s, for the sample standard deviation.

Average absolute deviation

The average absolute deviation (AAD) of a data set is the average of the absolute deviations from a central point. It is a summary statistic of statistical dispersion or variability. In the general form, the central point can be a mean, median, mode, or the result of any other measure of central tendency or any reference value related to the given data set. AAD includes the mean absolute deviation and the median absolute deviation (both abbreviated as MAD). Several measures of statistical dispersion are defined in terms of the absolute deviation.

Deviation (statistics)

In mathematics and statistics, deviation is a measure of difference between the observed value of a variable and some other value, often that variable's mean. The sign of the deviation reports the direction of that difference (the deviation is positive when the observed value exceeds the reference value). The magnitude of the value indicates the size of the difference. Errors and residuals A deviation that is a difference between an observed value and the true value of a quantity of interest (where true value denotes the Expected Value, such as the population mean) is an error.

Median absolute deviation

In statistics, the median absolute deviation (MAD) is a robust measure of the variability of a univariate sample of quantitative data. It can also refer to the population parameter that is estimated by the MAD calculated from a sample. For a univariate data set X1, X2, ..., Xn, the MAD is defined as the median of the absolute deviations from the data's median : that is, starting with the residuals (deviations) from the data's median, the MAD is the median of their absolute values. Consider the data (1, 1, 2, 2, 4, 6, 9).

Standard error

The standard error (SE) of a statistic (usually an estimate of a parameter) is the standard deviation of its sampling distribution or an estimate of that standard deviation. If the statistic is the sample mean, it is called the standard error of the mean (SEM). The sampling distribution of a mean is generated by repeated sampling from the same population and recording of the sample means obtained. This forms a distribution of different means, and this distribution has its own mean and variance.

Related lectures (64)

Stochastic Processes: Review and Properties

Covers the review of random variables, probability density functions, variance, and Gaussian processes.

Learning of Associations MOOC: Neuronal Dynamics 2- Computational Neuroscience: Neuronal Dynamics of Cognition

Delves into associative memory, Hebbian learning, and hierarchical organization in neural networks.

Advanced Probability: Summary

Covers random variables, sample spaces, probability distributions, functions, expected value, variance, and estimations.

Statistics and visualisation of morphometric data MOOC: Simulation Neurocience

Covers statistical analysis and visualization of morphometric data, including discrimination between tree types and numpy calculations.

Hopfield Model: Memory and Dynamics MOOC: Neuronal Dynamics 2- Computational Neuroscience: Neuronal Dynamics of Cognition