Lecture

Kernel Regression: Weighted Average and Feature Maps

Graph Chat

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

Related lectures (64)

Decision Trees: Regression and Classification

Covers decision trees for regression and classification, explaining tree construction, feature selection, and criteria for induction.

Local Averaging Predictors

Covers local averaging predictors, including K-nearest neighbors and Nadaraya-Watson estimators, as well as local linear regression and its applications.

Statistics: Exploratory Data Analysis

Introduces statistics basics, including data analysis and probability theory, emphasizing central tendency, dispersion, and distribution shapes.

Nonparametric Regression: Local Polynomial Estimation

Explores nonparametric regression using local polynomial estimation to balance data fidelity and smoothness.

Neural Networks: Multilayer Perceptrons

Covers Multilayer Perceptrons, artificial neurons, activation functions, matrix notation, flexibility, regularization, regression, and classification tasks.

Kernel Methods: Recap and Applications

Covers polynomial feature expansion, kernel methods, data representations, normalization, and handling imbalanced data in machine learning.

Linear Regression: Multicollinearity, Outliers, Model Specification

Covers multicollinearity, outliers, model specification, and practical strategies in linear regression.

Supervised Learning: Linear Regression

Covers supervised learning with a focus on linear regression, including topics like digit classification, spam detection, and wind speed prediction.

Support Vector Clustering: SVC

Introduces Support Vector Clustering (SVC) using a Gaussian kernel for high-dimensional feature space mapping and explains its constraints and Lagrangian.

Dimensionality Reduction: PCA and LDA

Covers dimensionality reduction techniques like PCA and LDA, clustering methods, density estimation, and data representation.

Linear Regression: Basics and Gradient Descent

Covers the basics of linear regression, including feature engineering, supervised vs. unsupervised learning, and minimizing the cost function.

Linear Regression: Basics and Applications

Covers the basics of linear regression, from training to real-world applications and multi-output scenarios.

Regression: Interactive Lecture

Covers linear regression, weighted regression, locally weighted regression, support vector regression, noise handling, and eye mapping using SVR.

Machine Learning Fundamentals

Covers the fundamental principles and methods of machine learning, including supervised and unsupervised learning techniques.

Clustering & Density Estimation

Covers dimensionality reduction, clustering, and density estimation techniques, including PCA, K-means, GMM, and Mean Shift.

Nonlinear ML Algorithms

Introduces nonlinear ML algorithms, covering nearest neighbor, k-NN, polynomial curve fitting, model complexity, overfitting, and regularization.

Binary Classification by Regression: Decision Functions and Cost Functions

Explores binary classification by regression, decision functions, and various cost functions.

Machine Learning Review

Covers a review of machine learning concepts, including supervised learning, classification vs regression, linear models, kernel functions, support vector machines, dimensionality reduction, deep generative models, and cross-validation.

Regression Trees and Ensemble Methods in Machine Learning

Discusses regression trees, ensemble methods, and their applications in predicting used car prices and stock returns.

Introduction to Machine Learning: Regression Fundamentals

Introduces the fundamentals of regression in machine learning, covering course logistics, key concepts, and the importance of loss functions in model evaluation.