Lecture

Decision Trees and Random Forests: Concepts and Applications

Graph Chat

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

Related lectures (64)

Gaussian Mixture Regression: Theory and Applications

Explores Gaussian mixture regression and overfitting with multiple Gauss functions.

Machine Learning Review

Covers a review of machine learning concepts, including supervised learning, classification vs regression, linear models, kernel functions, support vector machines, dimensionality reduction, deep generative models, and cross-validation.

Decision and regression trees

Explores decision and regression trees, impurity measures, learning algorithms, and implementations, including conditional inference trees and tree pruning.

Linear Regression

Covers the concept of linear regression, including polynomial regression and hyperparameters selection.

Machine Learning at the Atomic Scale

Explores simple models, electronic structure evaluation, and machine learning at the atomic scale.

Model Complexity and Overfitting in Machine Learning

Covers model complexity, overfitting, and strategies to select appropriate machine learning models.

Receiver-Operator Characteristics: ROC Curves

Explains ROC curves, Precision-Recall curve, RMSLE, and model validation.

Ensemble Methods: Random Forest

Explores random forests as a powerful ensemble method for classification, discussing bagging, stacking, boosting, and sampling strategies.

Neural Networks: Training and Activation

Explores neural networks, activation functions, backpropagation, and PyTorch implementation.

Nonlinear Supervised Learning

Explores the inductive bias of different nonlinear supervised learning methods and the challenges of hyper-parameter tuning.

Kernel Methods in Machine Learning: Kernel Regression and SVM

Discusses kernel methods in machine learning, focusing on kernel regression and support vector machines, including their formulations and applications.

Linear Models for Classification: Logistic Regression and SVM

Covers linear models for classification, focusing on logistic regression and support vector machines.

Regularization in Machine Learning

Explores Ridge and Lasso Regression for regularization in machine learning models, emphasizing hyperparameter tuning and visualization of parameter coefficients.

Ensemble Methods: Random Forests

Covers ensemble methods like random forests and Gaussian Naive Bayes, explaining how they improve prediction accuracy and estimate conditional Gaussian distributions.

Generalization in Deep Learning

Delves into the trade-off between model complexity and risk, generalization bounds, and the dangers of overfitting complex function classes.

Introduction to Machine Learning

Covers the basics of machine learning, including supervised and unsupervised learning, linear regression, and classification.

Linear Regression: Basics and Gradient Descent

Covers the basics of linear regression, including feature engineering, supervised vs. unsupervised learning, and minimizing the cost function.

Introduction to Machine Learning: Course Overview and Basics

Introduces the course structure and fundamental concepts of machine learning, including supervised learning and linear regression.

Linear Regression Basics

Covers the basics of linear regression in machine learning, including model training, loss functions, and evaluation metrics.

Gradient Descent and Linear Regression

Covers stochastic gradient descent, linear regression, regularization, supervised learning, and the iterative nature of gradient descent.