Mediaspace scheduled maintenance: Aug 25, 2026 07:00 - 12:00 AM. During this time, videos will be temporarily unavailable. Check status updates.

Lecture

Mercer Theorem and Kernels

In course

EE-411: Fundamentals of inference and learning

This is an introductory course in the theory of statistics, inference, and machine learning, with an emphasis on theoretical understanding & practical exercises. The course will combine, and alternate, between mathematical theoretical foundations and prac ...

Description

This lecture covers the Mercer Theorem, Kernels, and their applications in machine learning, focusing on positive definite kernels, continuous functions, and the speed-up of kernel methods. It explains the concept of kernels, their properties, and how they can be used to efficiently solve complex problems.

Instructor

Florent Gérard Krzakala

Official source

Ontological neighbourhood

Mathematics

Algebra: Linear algebra

Related concepts (32)

Kernel (operating system)

The kernel is a computer program at the core of a computer's operating system and generally has complete control over everything in the system. It is the portion of the operating system code that is always resident in memory and facilitates interactions between hardware and software components. A full kernel controls all hardware resources (e.g. I/O, memory, cryptography) via device drivers, arbitrates conflicts between processes concerning such resources, and optimizes the utilization of common resources e.

Hybrid kernel

A hybrid kernel is an operating system kernel architecture that attempts to combine aspects and benefits of microkernel and monolithic kernel architectures used in operating systems. The traditional kernel categories are monolithic kernels and microkernels (with nanokernels and exokernels seen as more extreme versions of microkernels). The "hybrid" category is controversial, due to the similarity of hybrid kernels and ordinary monolithic kernels; the term has been dismissed by Linus Torvalds as simple marketing.

Monolithic kernel

A monolithic kernel is an operating system architecture where the entire operating system is working in kernel space. The monolithic model differs from other operating system architectures (such as the microkernel architecture) in that it alone defines a high-level virtual interface over computer hardware. A set of primitives or system calls implement all operating system services such as process management, concurrency, and memory management. Device drivers can be added to the kernel as modules.

Positive-definite kernel

In operator theory, a branch of mathematics, a positive-definite kernel is a generalization of a positive-definite function or a positive-definite matrix. It was first introduced by James Mercer in the early 20th century, in the context of solving integral operator equations. Since then, positive-definite functions and their various analogues and generalizations have arisen in diverse parts of mathematics.

Definite quadratic form

In mathematics, a definite quadratic form is a quadratic form over some real vector space V that has the same sign (always positive or always negative) for every non-zero vector of V. According to that sign, the quadratic form is called positive-definite or negative-definite. A semidefinite (or semi-definite) quadratic form is defined in much the same way, except that "always positive" and "always negative" are replaced by "never negative" and "never positive", respectively.

Related lectures (48)

Feature Maps and Kernels

Covers feature maps, Representer theorem, kernels, and RKHS in machine learning.

Linear Algebra in 3D: Images and Kernels

Explores linear applications in 3D, emphasizing images, kernels, and solution uniqueness in systems.

Kernel Methods: RKHS and Kernels

Explores RKHS, positive definite kernels, and the Moore-Aronszajn theorem in kernel methods.

Nonlinear SVM: Kernels and Dual Optimization

Explores transforming data with nonlinear maps, kernels, dual optimization, and interpreting SVM results.

Linear Transformations: Matrices and Kernels