Lecture

Kernel Methods in Machine Learning: Kernel Regression and SVM

Graph Chat

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

Related lectures (64)

Machine Learning: Supervised and Unsupervised Learning Techniques

Covers supervised and unsupervised learning techniques in machine learning, highlighting their applications in finance and environmental analysis.

Cross-Validation: Techniques and Applications

Explores cross-validation, overfitting, regularization, and regression techniques in machine learning.

Neural Networks: Multilayer Perceptrons

Covers Multilayer Perceptrons, artificial neurons, activation functions, matrix notation, flexibility, regularization, regression, and classification tasks.

Kernel Methods: SVM and Regression

Introduces kernel methods like SVM and regression, covering concepts such as margin, support vector machine, curse of dimensionality, and Gaussian process regression.

Document Retrieval and Classification

Covers document retrieval, classification, sentiment analysis, and topic detection using TF-IDF matrices and contextualized word vectors like BERT.

Supervised Learning: Classification and Regression

Covers supervised learning, classification, regression, decision boundaries, overfitting, Perceptron, SVM, and logistic regression.

Estimation, Shrinkage and Penalization

Covers estimation, shrinkage, and penalization in statistics for data science, emphasizing the importance of balancing bias and variance in model estimation.

Kernel Methods and Regression

Covers kernel methods, kernel regression, RBF kernel, and SVM for classification.

Lecture 04 (2024)

Feature Expansion and Kernels

Covers feature expansion, kernels, SVM, and nonlinear classification in machine learning.

Bayesian Statistics: Regularization and Divergence

Covers Kullback-Leibler divergence, regularization, and Bayesian statistics to combat overfitting in machine learning models.

Cross-validation & Regularization

Explores polynomial curve fitting, kernel functions, and regularization techniques, emphasizing the importance of model complexity and overfitting.

Universal Approximation Theorem: MLP

Covers Multi-Layer Perceptrons (MLP) and their application from classification to regression, including the Universal Approximation Theorem and challenges with gradients.

Nonlinear ML Algorithms

Introduces nonlinear ML algorithms, covering nearest neighbor, k-NN, polynomial curve fitting, model complexity, overfitting, and regularization.

Bayesian Inference: Part 2

Explores Bayesian inference, multiclass classification, logistic regression, and linear regression inference.

Machine Learning Fundamentals

Introduces fundamental machine learning concepts, covering regression, classification, dimensionality reduction, and deep generative models.

Linear Regression: Basics MOOC: IoT Systems and Industrial Applications with Design Thinking

Covers the basics of linear regression, focusing on minimizing errors and predicting outputs.

Machine Learning in Molecular Dynamics

Explores the application of machine learning in molecular dynamics and materials, emphasizing the creation of meaningful features and the importance of generalizability.

Machine Learning Applications: Regression and Classification

Explores machine learning applications in materials modeling, covering regression, classification, and feature selection.

Optimization in Machine Learning: Gradient Descent

Covers optimization in machine learning, focusing on gradient descent for linear and logistic regression, stochastic gradient descent, and practical considerations.