Large language modelA large language model (LLM) is a language model characterized by its large size. Their size is enabled by AI accelerators, which are able to process vast amounts of text data, mostly scraped from the Internet. The artificial neural networks which are built can contain from tens of millions and up to billions of weights and are (pre-)trained using self-supervised learning and semi-supervised learning. Transformer architecture contributed to faster training.
Linguistic universalA linguistic universal is a pattern that occurs systematically across natural languages, potentially true for all of them. For example, All languages have nouns and verbs, or If a language is spoken, it has consonants and vowels. Research in this area of linguistics is closely tied to the study of linguistic typology, and intends to reveal generalizations across languages, likely tied to cognition, perception, or other abilities of the mind.
Linguistic competenceIn linguistics, linguistic competence is the system of unconscious knowledge that one knows when they know a language. It is distinguished from linguistic performance, which includes all other factors that allow one to use one's language in practice. In approaches to linguistics which adopt this distinction, competence would normally be considered responsible for the fact that "I like ice cream" is a possible sentence of English, the particular proposition that it denotes, and the particular sequence of phones that it consists of.
Linguistic purismLinguistic purism or linguistic protectionism is the prescriptive practice of defining or recognizing one variety of a language as being purer or of intrinsically higher quality than other varieties. Linguistic purism was institutionalized through language academies (of which the 1572 Accademia della Crusca set a model example in Europe), and their decisions often have the force of law. The perceived or actual decline identified by the purists may take the form of a change of vocabulary, syncretism of grammatical elements, or loanwords.
Foundation modelsA foundation model (also called base model) is a large machine learning (ML) model trained on a vast quantity of data at scale (often by self-supervised learning or semi-supervised learning) such that it can be adapted to a wide range of downstream tasks. Foundation models have helped bring about a major transformation in how artificial intelligence (AI) systems are built, such as by powering prominent chatbots and other user-facing AI.
English languageEnglish is a West Germanic language in the Indo-European language family. It originated in early medieval England and, today, is the most spoken language in the world and the third most spoken native language, after Mandarin Chinese and Spanish. English is the most widely learned second language and is either the official language or one of the official languages in 59 sovereign states. There are more people who have learned English as a second language than there are native speakers.
Proto-Indo-European languageProto-Indo-European (PIE) is the reconstructed common ancestor of the Indo-European language family. No direct record of Proto-Indo-European exists; its proposed features have been derived by linguistic reconstruction from documented Indo-European languages. Far more work has gone into reconstructing PIE than any other proto-language, and it is the best understood of all proto-languages of its age.
Language modelA language model is a probabilistic model of a natural language that can generate probabilities of a series of words, based on text corpora in one or multiple languages it was trained on. Large language models, as their most advanced form, are a combination of feedforward neural networks and transformers. They have superseded recurrent neural network-based models, which had previously superseded the pure statistical models, such as word n-gram language model.
Dutch languageDutch (Nederlands ˈneːdərlɑnts), also known as Netherlandic or Netherlandish, is a West Germanic language spoken by about 25 million people as a first language and 5 million as a second language. It is the third most widely spoken Germanic language, after its close relatives German and English. Afrikaans is a separate but somewhat mutually intelligible daughter language spoken, to some degree, by at least 16 million people, mainly in South Africa and Namibia, evolving from the Cape Dutch dialects of Southern Africa.
Language acquisitionLanguage acquisition is the process by which humans acquire the capacity to perceive and comprehend language (in other words, gain the ability to be aware of language and to understand it), as well as to produce and use words and sentences to communicate. Language acquisition involves structures, rules, and representation. The capacity to use language successfully requires one to acquire a range of tools including phonology, morphology, syntax, semantics, and an extensive vocabulary.
Generative pre-trained transformerGenerative pre-trained transformers (GPT) are a type of large language model (LLM) and a prominent framework for generative artificial intelligence. The first GPT was introduced in 2018 by OpenAI. GPT models are artificial neural networks that are based on the transformer architecture, pre-trained on large data sets of unlabelled text, and able to generate novel human-like content. As of 2023, most LLMs have these characteristics and are sometimes referred to broadly as GPTs.
Language developmentLanguage development in humans is a process starting early in life. Infants start without knowing a language, yet by 10 months, babies can distinguish speech sounds and engage in babbling. Some research has shown that the earliest learning begins in utero when the fetus starts to recognize the sounds and speech patterns of its mother's voice and differentiate them from other sounds after birth. Typically, children develop receptive language abilities before their verbal or expressive language develops.
Mass comparisonMass comparison is a method developed by Joseph Greenberg to determine the level of genetic relatedness between languages. It is now usually called multilateral comparison. The method is rejected by most linguists , though not all. Some of the top-level relationships Greenberg named are now generally accepted, though they had already been posited by others (e.g. Afro-Asiatic and Niger–Congo). Others are accepted by many though disputed by some prominent specialists (e.g.
PerformanceA performance is an act of staging or presenting a play, concert, or other form of entertainment. It is also defined as the action or process of carrying out or accomplishing an action, task, or function. In the work place, job performance is the hypothesized conception or requirements of a role. There are two types of job performances: contextual and task. Task performance is dependent on cognitive ability, while contextual performance is dependent on personality.
Feature learningIn machine learning, feature learning or representation learning is a set of techniques that allows a system to automatically discover the representations needed for feature detection or classification from raw data. This replaces manual feature engineering and allows a machine to both learn the features and use them to perform a specific task. Feature learning is motivated by the fact that machine learning tasks such as classification often require input that is mathematically and computationally convenient to process.
Performance appraisalA performance appraisal, also referred to as a performance review, performance evaluation, (career) development discussion, or employee appraisal, sometimes shortened to "PA", is a periodic and systematic process whereby the job performance of an employee is documented and evaluated. This is done after employees are trained about work and settle into their jobs. Performance appraisals are a part of career development and consist of regular reviews of employee performance within organizations.
Cell cycle checkpointCell cycle checkpoints are control mechanisms in the eukaryotic cell cycle which ensure its proper progression. Each checkpoint serves as a potential termination point along the cell cycle, during which the conditions of the cell are assessed, with progression through the various phases of the cell cycle occurring only when favorable conditions are met. There are many checkpoints in the cell cycle, but the three major ones are: the G1 checkpoint, also known as the Start or restriction checkpoint or Major Checkpoint; the G2/M checkpoint; and the metaphase-to-anaphase transition, also known as the spindle checkpoint.
Psychological nativismIn the field of psychology, nativism is the view that certain skills or abilities are "native" or hard-wired into the brain at birth. This is in contrast to the "blank slate" or tabula rasa view, which states that the brain has inborn capabilities for learning from the environment but does not contain content such as innate beliefs. This factor contributes to the ongoing nature versus nurture dispute, one borne from the current difficulty of reverse engineering the subconscious operations of the brain, especially the human brain.
Learning disabilityLearning disability, learning disorder, or learning difficulty (British English) is a condition in the brain that causes difficulties comprehending or processing information and can be caused by several different factors. Given the "difficulty learning in a typical manner", this does not exclude the ability to learn in a different manner. Therefore, some people can be more accurately described as having a "learning difference", thus avoiding any misconception of being disabled with a possible lack of an ability to learn and possible negative stereotyping.
GrammaticalizationIn historical linguistics, grammaticalization (also known as grammatization or grammaticization) is a process of language change by which words representing objects and actions (i.e. nouns and verbs) become grammatical markers (such as affixes or prepositions). Thus it creates new function words from content words, rather than deriving them from existing bound, inflectional constructions. For example, the Old English verb willan 'to want', 'to wish' has become the Modern English auxiliary verb will, which expresses intention or simply futurity.
