Automatic summarizationAutomatic summarization is the process of shortening a set of data computationally, to create a subset (a summary) that represents the most important or relevant information within the original content. Artificial intelligence algorithms are commonly developed and employed to achieve this, specialized for different types of data. Text summarization is usually implemented by natural language processing methods, designed to locate the most informative sentences in a given document.
SyntaxIn linguistics, syntax (ˈsɪntæks ) is the study of how words and morphemes combine to form larger units such as phrases and sentences. Central concerns of syntax include word order, grammatical relations, hierarchical sentence structure (constituency), agreement, the nature of crosslinguistic variation, and the relationship between form and meaning (semantics). There are numerous approaches to syntax that differ in their central assumptions and goals.
Part-of-speech taggingIn corpus linguistics, part-of-speech tagging (POS tagging or PoS tagging or POST), also called grammatical tagging is the process of marking up a word in a text (corpus) as corresponding to a particular part of speech, based on both its definition and its context. A simplified form of this is commonly taught to school-age children, in the identification of words as nouns, verbs, adjectives, adverbs, etc. Once performed by hand, POS tagging is now done in the context of computational linguistics, using algorithms which associate discrete terms, as well as hidden parts of speech, by a set of descriptive tags.
Language familyA language family is a group of languages related through descent from a common ancestral language or parental language, called the proto-language of that family. The term "family" reflects the tree model of language origination in historical linguistics, which makes use of a metaphor comparing languages to people in a biological family tree, or in a subsequent modification, to species in a phylogenetic tree of evolutionary taxonomy. Linguists therefore describe the daughter languages within a language family as being genetically related.
Code coverageIn software engineering, code coverage is a percentage measure of the degree to which the source code of a program is executed when a particular test suite is run. A program with high test coverage has more of its source code executed during testing, which suggests it has a lower chance of containing undetected software bugs compared to a program with low test coverage. Many different metrics can be used to calculate test coverage. Some of the most basic are the percentage of program subroutines and the percentage of program statements called during execution of the test suite.
Knowledge extractionKnowledge extraction is the creation of knowledge from structured (relational databases, XML) and unstructured (text, documents, s) sources. The resulting knowledge needs to be in a machine-readable and machine-interpretable format and must represent knowledge in a manner that facilitates inferencing. Although it is methodically similar to information extraction (NLP) and ETL (data warehouse), the main criterion is that the extraction result goes beyond the creation of structured information or the transformation into a relational schema.
Standard languageA standard language (also standard variety, standard dialect, and standard) is a language variety that has undergone substantial codification of grammar and usage, although occasionally the term refers to the entirety of a language that includes a standardized form as one of its varieties. Typically, the language varieties that undergo substantive standardization are the dialects associated with centers of commerce and government.
EvaluationIn common usage, evaluation is a systematic determination and assessment of a subject's merit, worth and significance, using criteria governed by a set of standards. It can assist an organization, program, design, project or any other intervention or initiative to assess any aim, realisable concept/proposal, or any alternative, to help in decision-making; or to ascertain the degree of achievement or value in regard to the aim and objectives and results of any such action that has been completed.
Functional linguisticsFunctional linguistics is an approach to the study of language characterized by taking systematically into account the speaker's and the hearer's side, and the communicative needs of the speaker and of the given language community. Linguistic functionalism spawned in the 1920s to 1930s from Ferdinand de Saussure's systematic structuralist approach to language (1916). Functionalism sees functionality of language and its elements to be the key to understanding linguistic processes and structures.
GrammaticalizationIn historical linguistics, grammaticalization (also known as grammatization or grammaticization) is a process of language change by which words representing objects and actions (i.e. nouns and verbs) become grammatical markers (such as affixes or prepositions). Thus it creates new function words from content words, rather than deriving them from existing bound, inflectional constructions. For example, the Old English verb willan 'to want', 'to wish' has become the Modern English auxiliary verb will, which expresses intention or simply futurity.
TreebankIn linguistics, a treebank is a parsed text corpus that annotates syntactic or semantic sentence structure. The construction of parsed corpora in the early 1990s revolutionized computational linguistics, which benefitted from large-scale empirical data. The term treebank was coined by linguist Geoffrey Leech in the 1980s, by analogy to other repositories such as a seedbank or bloodbank. This is because both syntactic and semantic structure are commonly represented compositionally as a tree structure.
Grammatical conjugationIn linguistics, conjugation (ˌkɒndʒᵿˈɡeɪʃən) is the creation of derived forms of a verb from its principal parts by inflection (alteration of form according to rules of grammar). For instance, the verb break can be conjugated to form the words break, breaks, broke, broken and breaking. While English has a relatively simple conjugation, other languages such as French and Arabic or Spanish are more complex, with each verb having dozens of conjugated forms.
Germanic verbsThe Germanic language family is one of the language groups that resulted from the breakup of Proto-Indo-European (PIE). It in turn divided into North, West and East Germanic groups, and ultimately produced a large group of mediaeval and modern languages, most importantly: Danish, Norwegian, and Swedish (North); English, Dutch and German (West); and Gothic (East, extinct). The Germanic verb system lends itself to both descriptive (synchronic) and historical (diachronic) comparative analysis.
Natural language generationNatural language generation (NLG) is a software process that produces natural language output. A widely-cited survey of NLG methods describes NLG as "the subfield of artificial intelligence and computational linguistics that is concerned with the construction of computer systems than can produce understandable texts in English or other human languages from some underlying non-linguistic representation of information". While it is widely agreed that the output of any NLG process is text, there is some disagreement about whether the inputs of an NLG system need to be non-linguistic.
Semantic role labelingIn natural language processing, semantic role labeling (also called shallow semantic parsing or slot-filling) is the process that assigns labels to words or phrases in a sentence that indicates their semantic role in the sentence, such as that of an agent, goal, or result. It serves to find the meaning of the sentence. To do this, it detects the arguments associated with the predicate or verb of a sentence and how they are classified into their specific roles. A common example is the sentence "Mary sold the book to John.
Natural language processingNatural language processing (NLP) is an interdisciplinary subfield of linguistics and computer science. It is primarily concerned with processing natural language datasets, such as text corpora or speech corpora, using either rule-based or probabilistic (i.e. statistical and, most recently, neural network-based) machine learning approaches. The goal is a computer capable of "understanding" the contents of documents, including the contextual nuances of the language within them.
Auxiliary verbAn auxiliary verb (abbreviated ) is a verb that adds functional or grammatical meaning to the clause in which it occurs, so as to express tense, aspect, modality, voice, emphasis, etc. Auxiliary verbs usually accompany an infinitive verb or a participle, which respectively provide the main semantic content of the clause. An example is the verb have in the sentence I have finished my lunch. Here, the auxiliary have helps to express the perfect aspect along with the participle, finished.
Sentence processingSentence processing takes place whenever a reader or listener processes a language utterance, either in isolation or in the context of a conversation or a text. Many studies of the human language comprehension process have focused on reading of single utterances (sentences) without context. Extensive research has shown that language comprehension is affected by context preceding a given utterance as well as many other factors. Sentence comprehension has to deal with ambiguity in spoken and written utterances, for example lexical, structural, and semantic ambiguities.
Modal verbA modal verb is a type of verb that contextually indicates a modality such as a likelihood, ability, permission, request, capacity, suggestion, order, obligation, necessity, possibility or advice. Modal verbs generally accompany the base (infinitive) form of another verb having semantic content. In English, the modal verbs commonly used are can, could, may, might, shall, should, will, would, ought to, used to and dare A modal auxiliary verb gives information about the function of the main verb that it governs.
Nonfinite verbA nonfinite verb is a derivative form of a verb contrasted against finite verb forms in that they lack inflection for number or person, and in that they cannot perform action as the root of an independent clause. In English, nonfinite verbs include infinitives, participles and gerunds. Nonfinite verb forms in some other languages include converbs, gerundives and supines. The categories of mood, tense, and or voice may be absent from non-finite verb forms in some languages.
