Lecture

Principles of Self-Organization

Graph Chat

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

Description

This lecture covers the principles of self-organization in neural networks, focusing on how global order emerges from local interactions. Topics include receptive field development, Oja's Rule, ocular dominance columns, Kohonen Maps, and the functional role of cortical maps.

Official source

Related concepts (24)

Cortical homunculus

A cortical homunculus () is a distorted representation of the human body, based on a neurological "map" of the areas and proportions of the human brain dedicated to processing motor functions, or sensory functions, for different parts of the body. Nerve fibresconducting somatosensory information from all over the bodyterminate in various areas of the parietal lobe in the cerebral cortex, forming a representational map of the body. Findings from the 2010s and early 2020s began to call this interpretation into question, and research is ongoing in this field.

Self-organizing map

A self-organizing map (SOM) or self-organizing feature map (SOFM) is an unsupervised machine learning technique used to produce a low-dimensional (typically two-dimensional) representation of a higher dimensional data set while preserving the topological structure of the data. For example, a data set with variables measured in observations could be represented as clusters of observations with similar values for the variables.

Recurrent neural network

A recurrent neural network (RNN) is one of the two broad types of artificial neural network, characterized by direction of the flow of information between its layers. In contrast to uni-directional feedforward neural network, it is a bi-directional artificial neural network, meaning that it allows the output from some nodes to affect subsequent input to the same nodes. Their ability to use internal state (memory) to process arbitrary sequences of inputs makes them applicable to tasks such as unsegmented, connected handwriting recognition or speech recognition.

Cerebral cortex

The cerebral cortex, also known as the cerebral mantle, is the outer layer of neural tissue of the cerebrum of the brain in humans and other mammals. The cerebral cortex mostly consists of the six-layered neocortex, with just 10% consisting of allocortex. It is separated into two cortices, by the longitudinal fissure that divides the cerebrum into the left and right cerebral hemispheres. The two hemispheres are joined beneath the cortex by the corpus callosum. The cerebral cortex is the largest site of neural integration in the central nervous system.

Neural network

A neural network can refer to a neural circuit of biological neurons (sometimes also called a biological neural network), a network of artificial neurons or nodes in the case of an artificial neural network. Artificial neural networks are used for solving artificial intelligence (AI) problems; they model connections of biological neurons as weights between nodes. A positive weight reflects an excitatory connection, while negative values mean inhibitory connections. All inputs are modified by a weight and summed.

Related lectures (64)

Neural Networks: Training and Activation

Explores neural networks, activation functions, backpropagation, and PyTorch implementation.

Spatial Continuum: Field Equations MOOC: Neuronal Dynamics 2- Computational Neuroscience: Neuronal Dynamics of Cognition

Explores spatial continuum models, field equations, and coupling mechanisms in computational neuroscience.

Neural Networks: Two Layers Neural Network

Covers the basics of neural networks, focusing on the development from two layers neural networks to deep neural networks.

Cortical Connectivity: Neuronal Dynamics MOOC: Neuronal Dynamics 2- Computational Neuroscience: Neuronal Dynamics of Cognition

Explores neuronal dynamics in computational neuroscience, emphasizing population activity, cortical connectivity, and connectivity schemes in models.

Neural Networks: Multilayer Perceptrons