Lecture

K-Nearest Neighbors & Feature Expansion

Graph Chat

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

Related lectures (64)

Gradient Descent and Linear Regression

Covers stochastic gradient descent, linear regression, regularization, supervised learning, and the iterative nature of gradient descent.

Linear Regression: Least Squares

Delves into linear regression, emphasizing least squares estimation, residuals, and variance.

Bayesian Inference: Part 2

Explores Bayesian inference, multiclass classification, logistic regression, and linear regression inference.

Linear Regression: Basics and Applications

Covers the basics of linear regression in machine learning, exploring its applications in predicting outcomes like birth weight and analyzing relationships between variables.

Regression: Linear Models

Explores linear regression, least squares, residuals, and confidence intervals in regression models.

Optimization Techniques: Gradient Method Overview

Discusses the gradient method for optimization, focusing on its application in machine learning and the conditions for convergence.

Machine Learning: Supervised and Unsupervised Learning Techniques

Covers supervised and unsupervised learning techniques in machine learning, highlighting their applications in finance and environmental analysis.

Nearest Neighbor Rules: Part 2

Explores the Nearest Neighbor Rules, k-NN algorithm challenges, Bayes classifier, and k-means algorithm for clustering.

Linear and Logistic Regression

Introduces linear and logistic regression, covering parametric models, multi-output prediction, non-linearity, gradient descent, and classification applications.

Support Vector Regression: Principles and Optimization

Covers Support Vector Regression principles, optimization, and hyperparameters' influence on the fit.

Linear and Logistic Regression

Covers linear and logistic regression, including underfitting, overfitting, and performance metrics.

Machine Learning Fundamentals

Introduces machine learning basics, performance metrics, optimization techniques, and model evaluation.

Linear Models: Part 1

Covers linear models, including regression, derivatives, gradients, hyperplanes, and classification transition, with a focus on minimizing risk and evaluation metrics.

Loss Functions and Optimization

Explores loss functions, gradient descent, and step size impact on optimization in machine learning models, highlighting the delicate balance required for efficient convergence.

Linear Regression: Basics and Gradient Descent

Covers the basics of linear regression, including feature engineering, supervised vs. unsupervised learning, and minimizing the cost function.

Neural Networks: Multilayer Learning

Covers the fundamentals of multilayer neural networks and deep learning, including back-propagation and network architectures like LeNet, AlexNet, and VGG-16.

Machine learning: Basics of data-driven materials modeling

Covers dimensionality reduction and linear regression in data-driven materials modeling.

Linear Models for Classification

Covers linear models for classification, including SVM, decision boundaries, support vectors, and Lagrange duality.

Regression Trees and Ensemble Methods in Machine Learning

Discusses regression trees, ensemble methods, and their applications in predicting used car prices and stock returns.

Linear Regression: Basics and Principle of Least Squares

Covers linear regression basics, focusing on minimizing error using the principle of least squares and includes an ANOVA table and practical example in R.