Lecture

Nearest Neighbor Classifier: Curse of Dimensionality

Graph Chat

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

Related lectures (64)

Supervised Learning: k-NN and Decision Trees

Introduces supervised learning with k-NN and decision trees, covering techniques, examples, and ensemble methods.

Kernel Methods: SVM and Regression

Introduces kernel methods like SVM and regression, covering concepts such as margin, support vector machine, curse of dimensionality, and Gaussian process regression.

Binary Classification by Regression: Decision Functions and Cost Functions

Explores binary classification by regression, decision functions, and various cost functions.

Nonparametric Regression

Covers nonparametric regression, scatterplot smoothing, kernel methods, and bias-variance tradeoff.

Understanding Data Attributes

Covers the analysis of various data attributes and linear regression models.

Document Analysis: Topic Modeling

Explores document analysis, topic modeling, and generative models for data generation in machine learning.

Universal Approximation Theorem: MLP

Covers Multi-Layer Perceptrons (MLP) and their application from classification to regression, including the Universal Approximation Theorem and challenges with gradients.

Unsupervised Learning: Dimensionality Reduction

Explores unsupervised learning techniques for reducing dimensions in data, emphasizing PCA, LDA, and Kernel PCA.

Support Vector Clustering: SVC

Introduces Support Vector Clustering (SVC) using a Gaussian kernel for high-dimensional feature space mapping and explains its constraints and Lagrangian.

Nearest Neighbor Rules: Part 2

Explores the Nearest Neighbor Rules, k-NN algorithm challenges, Bayes classifier, and k-means algorithm for clustering.

Mathematics of Data: Overview and Examples

Covers empirical risk minimization, statistical learning, and examples of cancer prediction, house pricing, and image generation.

Supervised Learning: Classification and Regression

Covers supervised learning, classification, regression, decision boundaries, overfitting, Perceptron, SVM, and logistic regression.

Landscape and Generalisation in Deep Learning

Explores the challenges and insights of deep learning, focusing on loss landscape, generalization, and feature learning.

Generalized Linear Regression: Classification

Explores Generalized Linear Regression, Classification, confusion matrices, ROC curves, and noise in data.

Receiver-Operator Characteristics: ROC Curves

Explains ROC curves, Precision-Recall curve, RMSLE, and model validation.

Machine Learning: Basics and Applications

Covers the basics of machine learning, including supervised and unsupervised learning, regression, classification, and clustering.

Generalized Linear Models

Covers probability, random variables, expectation, GLMs, hypothesis testing, and Bayesian statistics with practical examples.

Linear Models: Part 1

Covers linear models, including regression, derivatives, gradients, hyperplanes, and classification transition, with a focus on minimizing risk and evaluation metrics.

Lecture 03 (2024)

Non-parametric Regression: Smoothing Techniques

Explores non-parametric regression techniques, including splines, bias-variance tradeoff, orthogonal functions, wavelets, and modulation estimators.