Spiking neural networkArtificial neural network Spiking neural networks (SNNs) are artificial neural networks that more closely mimic natural neural networks. In addition to neuronal and synaptic state, SNNs incorporate the concept of time into their operating model. The idea is that neurons in the SNN do not transmit information at each propagation cycle (as it happens with typical multi-layer perceptron networks), but rather transmit information only when a membrane potential—an intrinsic quality of the neuron related to its membrane electrical charge—reaches a specific value, called the threshold.
Meta-learning (computer science)Meta learning is a subfield of machine learning where automatic learning algorithms are applied to metadata about machine learning experiments. As of 2017, the term had not found a standard interpretation, however the main goal is to use such metadata to understand how automatic learning can become flexible in solving learning problems, hence to improve the performance of existing learning algorithms or to learn (induce) the learning algorithm itself, hence the alternative term learning to learn.
PaleoceneThe Paleocene, (ˈpæli.əsiːn,_-i.oʊ-,_ˈpeɪli- ) or Palaeocene, is a geological epoch that lasted from about 66 to 56 million years ago (mya). It is the first epoch of the Paleogene Period in the modern Cenozoic Era. The name is a combination of the Ancient Greek παλαιός palaiós meaning "old" and the Eocene Epoch (which succeeds the Paleocene), translating to "the old part of the Eocene". The epoch is bracketed by two major events in Earth's history.
EoceneThe Eocene (ˈiːəsiːn,_ˈiːoʊ- ) Epoch is a geological epoch that lasted from about 56 to 33.9 million years ago (Ma). It is the second epoch of the Paleogene Period in the modern Cenozoic Era. The name Eocene comes from the Ancient Greek ἠώς (ēṓs, "dawn") and καινός (kainós, "new") and refers to the "dawn" of modern ('new') fauna that appeared during the epoch. The Eocene spans the time from the end of the Paleocene Epoch to the beginning of the Oligocene Epoch.
MioceneThe Miocene (ˈmaɪ.əsiːn,_-oʊ- ) is the first geological epoch of the Neogene Period and extends from about (Ma). The Miocene was named by Scottish geologist Charles Lyell; the name comes from the Greek words μείων (, "less") and καινός (, "new") and means "less recent" because it has 18% fewer modern marine invertebrates than the Pliocene has. The Miocene is preceded by the Oligocene and is followed by the Pliocene. As Earth went from the Oligocene through the Miocene and into the Pliocene, the climate slowly cooled towards a series of ice ages.
Regularized least squaresRegularized least squares (RLS) is a family of methods for solving the least-squares problem while using regularization to further constrain the resulting solution. RLS is used for two main reasons. The first comes up when the number of variables in the linear system exceeds the number of observations. In such settings, the ordinary least-squares problem is ill-posed and is therefore impossible to fit because the associated optimization problem has infinitely many solutions.
Stability (learning theory)Stability, also known as algorithmic stability, is a notion in computational learning theory of how a machine learning algorithm output is changed with small perturbations to its inputs. A stable learning algorithm is one for which the prediction does not change much when the training data is modified slightly. For instance, consider a machine learning algorithm that is being trained to recognize handwritten letters of the alphabet, using 1000 examples of handwritten letters and their labels ("A" to "Z") as a training set.
Large language modelA large language model (LLM) is a language model characterized by its large size. Their size is enabled by AI accelerators, which are able to process vast amounts of text data, mostly scraped from the Internet. The artificial neural networks which are built can contain from tens of millions and up to billions of weights and are (pre-)trained using self-supervised learning and semi-supervised learning. Transformer architecture contributed to faster training.
Cross-entropyIn information theory, the cross-entropy between two probability distributions and over the same underlying set of events measures the average number of bits needed to identify an event drawn from the set if a coding scheme used for the set is optimized for an estimated probability distribution , rather than the true distribution . The cross-entropy of the distribution relative to a distribution over a given set is defined as follows: where is the expected value operator with respect to the distribution .
OligoceneThe Oligocene (ˈɒlᵻɡəsiːn,_-ɡoʊ- ) is a geologic epoch of the Paleogene Period and extends from about 33.9 million to 23 million years before the present (33.9 to 23.03Ma). As with other older geologic periods, the rock beds that define the epoch are well identified but the exact dates of the start and end of the epoch are slightly uncertain. The name Oligocene was coined in 1854 by the German paleontologist Heinrich Ernst Beyrich from his studies of marine beds in Belgium and Germany.
Elastic net regularizationIn statistics and, in particular, in the fitting of linear or logistic regression models, the elastic net is a regularized regression method that linearly combines the L1 and L2 penalties of the lasso and ridge methods. The elastic net method overcomes the limitations of the LASSO (least absolute shrinkage and selection operator) method which uses a penalty function based on Use of this penalty function has several limitations. For example, in the "large p, small n" case (high-dimensional data with few examples), the LASSO selects at most n variables before it saturates.
Aspect's experimentAspect's experiment was the first quantum mechanics experiment to demonstrate the violation of Bell's inequalities. Its 1982 result allowed for further validation of the quantum entanglement and locality principles. It also offered an experimental answer to Albert Einstein, Boris Podolsky, and Nathan Rosen's paradox which had been proposed about fifty years earlier. The experiment was led by French physicist Alain Aspect at the École supérieure d'optique in Orsay between 1980 and 1982.
