Lecture

Linear Binary Classification: Perceptron, SGD, Fisher's LDA

Graph Chat

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

Related lectures (64)

Universal Approximation Theorem: MLP

Covers Multi-Layer Perceptrons (MLP) and their application from classification to regression, including the Universal Approximation Theorem and challenges with gradients.

Discriminant Analysis: Bayes Rule

Covers the Bayes discriminant rule for allocating individuals to populations based on measurements and prior probabilities.

Textual Data Analysis: Classification & Dimensionality Reduction

Explores textual data classification, focusing on methods like Naive Bayes and dimensionality reduction techniques like Principal Component Analysis.

Dimensionality Reduction

Introduces artificial neural networks and explores various dimensionality reduction techniques like PCA, LDA, Kernel PCA, and t-SNE.

Support Vector Machines: Basics and Applications

Covers the basics of Support Vector Machines, including linear separability, hyperplanes, margins, and non-linear SVM with kernels.

Deep Generative Models: Part 2

Explores deep generative models, including mixtures of multinomials, PCA, deep autoencoders, convolutional autoencoders, and GANs.

Convolutional Neural Networks

Covers Convolutional Neural Networks, including layers, training strategies, standard architectures, tasks like semantic segmentation, and deep learning tricks.

Support Vector Machines

Introduces Support Vector Machines, covering Hinge Loss, hyperplane separation, and non-linear classification using kernels.

Classification with GMM

Explores the use of Gaussian Mixture Models for transitioning from clustering to classification, covering binary classification, parameter estimation, and optimal Bayes classifier.

Introduction to Supervised Learning: Classification and Perceptrons

Explores supervised learning through classification as a geometric problem and the concept of finding a separating surface.

Document Analysis: Topic Modeling

Explores document analysis, topic modeling, and generative models for data generation in machine learning.

Support Vector Machines: SVMs

Explores Support Vector Machines, covering hard-margin, soft-margin, hinge loss, risks comparison, and the quadratic hinge loss.

Linear Models: Classification

Explores linear models for classification, including logistic regression, decision boundaries, and support vector machines.

Perception: Image Classification Challenges

Covers image classification challenges, machine learning concepts, linear regression, and nearest neighbor approach in autonomous vehicles.

Stochastic Gradient Descent: Non-convex Optimization Techniques

Discusses Stochastic Gradient Descent and its application in non-convex optimization, focusing on convergence rates and challenges in machine learning.

Introduction to Machine Learning: Supervised Learning

Introduces supervised learning, covering classification, regression, model optimization, overfitting, and kernel methods.

Policy Gradient Methods: Reinforcement Learning Techniques

Provides an overview of policy gradient methods in reinforcement learning, focusing on the log-likelihood trick and the transition from batch to online learning.

Logistic Regression: Part 1

Introduces logistic regression for binary classification and explores multiclass classification using OvA and OvO strategies.

Deep Learning

Covers the fundamentals of deep learning, including data representations, bag of words, data pre-processing, artificial neural networks, and convolutional neural networks.

Linear Discriminant Analysis: Generative Methods

Covers Linear Discriminant Analysis (LDA) as a generative method for classification.