Lecture

K-Nearest Neighbors & Feature Expansion

Graph Chat

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

Related lectures (64)

Linear Models & k-NN

Covers linear models, logistic regression, decision boundaries, k-NN, and practical applications in authorship attribution and image data analysis.

Linear Models: Basics

Introduces linear models in machine learning, covering basics, parametric models, multi-output regression, and evaluation metrics.

Introduction to Machine Learning

Covers the basics of machine learning, including supervised and unsupervised learning, linear regression, and classification.

Linear Regression: Theory and Applications

Covers the theory and practical applications of linear regression.

Optimization in Machine Learning: Gradient Descent

Covers optimization in machine learning, focusing on gradient descent for linear and logistic regression, stochastic gradient descent, and practical considerations.

Nonparametric Statistics: Bayesian Approach

Explores non-parametric statistics, Bayesian methods, and linear regression with a focus on kernel density estimation and posterior distribution.

Probabilistic Linear Regression

Explores probabilistic linear regression, covering joint and conditional probability, ridge regression, and overfitting mitigation.

Optimization Techniques: Gradient Method Overview

Discusses the gradient method for optimization, focusing on its application in machine learning and the conditions for convergence.

Feature Expansion and Kernel Methods

Explores feature expansion, kernel methods, SVM, and nonlinear classification in machine learning.

Linear Regression: Maximum Likelihood Approach

Covers linear regression topics including confidence intervals, variance, and maximum likelihood approach.

Linear Regression: Introduction and Training

Covers linear regression training to find the best line for given data points, essential for predicting house prices.

Linear Regression: Basics and Principle of Least Squares

Covers linear regression basics, focusing on minimizing error using the principle of least squares and includes an ANOVA table and practical example in R.

Linear Regression: Basics and Applications

Covers the basics of linear regression in machine learning, exploring its applications in predicting outcomes like birth weight and analyzing relationships between variables.

Neural Networks: Multilayer Learning

Covers the fundamentals of multilayer neural networks and deep learning, including back-propagation and network architectures like LeNet, AlexNet, and VGG-16.

Linear Models: Part 2

Covers linear models, binary and multi-class classification, and logistic regression with practical examples.

Validation and k-Nearest Neighbors Method

Introduces supervised learning concepts and the k-Nearest Neighbors method for classification and regression tasks.

Linear and Logistic Regression

Covers linear and logistic regression, including underfitting, overfitting, and performance metrics.

Linear & Weighted Regression

Covers linear and weighted regression, limitations, and introduces locally weighted regression for model-free regression.

Linear Regression Basics

Covers the basics of linear regression in machine learning, including model training, loss functions, and evaluation metrics.

Linear Regression: Absence or Presence of Covariates

Explores linear regression with and without covariates, covering models captured by independent distributions and tools like subspaces and orthogonal projections.