Lecture

Binary Classification

Graph Chat

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

Description

This lecture focuses on the binary classification problem, where the goal is to find the best separating hyperplane to classify data points into two classes. The instructor explains the concept of maximizing the margin between classes using support vector machines and the mathematical optimization involved in determining the hyperplane.

In MOOC

IoT Systems and Industrial Applications with Design Thinking

Internet of Things (IoT) and smart connected devices have radically changed the way our world works and how companies operate and create new businesses. Do you want to learn about IoT fundamentals? This is a course for you! In this course we provide an overview of the underlaying IoT technologies and its business applications. This course is an introduction to IoT and explains why it is a continuously evolving concept with many industrial applications. You will learn the fundamental building blocks of IoT

Official source

Related concepts (20)

Support vector machine

In machine learning, support vector machines (SVMs, also support vector networks) are supervised learning models with associated learning algorithms that analyze data for classification and regression analysis. Developed at AT&T Bell Laboratories by Vladimir Vapnik with colleagues (Boser et al., 1992, Guyon et al., 1993, Cortes and Vapnik, 1995, Vapnik et al., 1997) SVMs are one of the most robust prediction methods, being based on statistical learning frameworks or VC theory proposed by Vapnik (1982, 1995) and Chervonenkis (1974).

Optimization problem

In mathematics, computer science and economics, an optimization problem is the problem of finding the best solution from all feasible solutions. Optimization problems can be divided into two categories, depending on whether the variables are continuous or discrete: An optimization problem with discrete variables is known as a discrete optimization, in which an object such as an integer, permutation or graph must be found from a countable set.

Mathematical optimization

Mathematical optimization (alternatively spelled optimisation) or mathematical programming is the selection of a best element, with regard to some criterion, from some set of available alternatives. It is generally divided into two subfields: discrete optimization and continuous optimization. Optimization problems arise in all quantitative disciplines from computer science and engineering to operations research and economics, and the development of solution methods has been of interest in mathematics for centuries.

Convex optimization

Convex optimization is a subfield of mathematical optimization that studies the problem of minimizing convex functions over convex sets (or, equivalently, maximizing concave functions over convex sets). Many classes of convex optimization problems admit polynomial-time algorithms, whereas mathematical optimization is in general NP-hard.

Combinatorial optimization

Combinatorial optimization is a subfield of mathematical optimization that consists of finding an optimal object from a finite set of objects, where the set of feasible solutions is discrete or can be reduced to a discrete set. Typical combinatorial optimization problems are the travelling salesman problem ("TSP"), the minimum spanning tree problem ("MST"), and the knapsack problem. In many such problems, such as the ones previously mentioned, exhaustive search is not tractable, and so specialized algorithms that quickly rule out large parts of the search space or approximation algorithms must be resorted to instead.

Related lectures (64)

SVM for Non-separable Datasets

Explains SVM for non-separable datasets, introducing slack variables and optimizing the margin for classification.

Support Vector Machines: SVM Basics

Covers the basics of Support Vector Machines, focusing on hard-margin and soft-margin formulations.

SVM - Principle: Linear Classifiers

Covers the history and applications of SVM, as well as the construction of linear classifiers and the concept of classifier margin.

Support Vector Machines

Introduces Support Vector Machines, covering Hinge Loss, hyperplane separation, and non-linear classification using kernels.

Optimization Methods: Theory Discussion