Mediaspace scheduled maintenance: Aug 25, 2026 07:00 - 12:00 AM. During this time, videos will be temporarily unavailable. Check status updates.

Concept

Gradient boosting

Related lectures (31)

Structured Classifications: Decision Trees and Boosting

Explores decision trees, overfitting elimination, boosting techniques, and their practical applications in predictive modeling.

Boosting: Adaboost Algorithm

Covers boosting with a focus on the Adaboost algorithm, forward stagewise additive modeling, and gradient tree boosting.

Decision Trees: Induction & Attributes

Explores decision trees, attribute selection, bias-variance tradeoff, and ensemble methods in machine learning.

Decision Trees and CLT's: Inference and Machine Learning

Explores decision trees, ensembles, CLT, inference, machine learning, diagnostic methods, boosting, and variance estimation.

Optimization in Machine Learning: Gradient Descent

Covers optimization in machine learning, focusing on gradient descent for linear and logistic regression, stochastic gradient descent, and practical considerations.

Advanced Machine Learning: Boosting

Covers weak learners in boosting, AdaBoost algorithm, drawbacks, simple weak learners, boosting variants, and Viola-Jones Haar-Like wavelets.

Decision Forests: Structure and Training

Covers decision forests, training, weak learners, entropy, boosting, 3D pose estimation, and practical applications.

RANSAC: Robust Outlier Detection and Applications

Explores the RANSAC algorithm for outlier detection and its diverse applications in Machine Learning.

Adaboost: Boosting Methods

Explains Adaboost algorithm for building strong classifiers from weak ones, with a focus on boosting methods and face detection.

Neural Networks: Training and Activation

Explores neural networks, activation functions, backpropagation, and PyTorch implementation.

Decision and regression trees

Explores decision and regression trees, impurity measures, learning algorithms, and implementations, including conditional inference trees and tree pruning.

MLPs: Multi-Layer Perceptrons

Introduces Multi-Layer Perceptrons (MLPs) and covers logistic regression, reformulation, gradient descent, AdaBoost, and practical applications.

Decision Trees: Overfitting and Randomization

Explores decision trees, overfitting, and randomization in supervised learning, emphasizing the importance of managing variance and feature selection.

Advanced Machine Learning: Bagging

Explores ensemble learning methods like Bagging and Boosting to improve model performance through aggregation and the selection of unstable models.

Stochastic Gradient Descent: Non-convex Optimization Techniques

Discusses Stochastic Gradient Descent and its application in non-convex optimization, focusing on convergence rates and challenges in machine learning.

Machine Learning Basics: Supervised and Unsupervised Learning

Covers the basics of machine learning, supervised and unsupervised learning, various techniques like k-nearest neighbors and decision trees, and the challenges of overfitting.

Nonlinear Supervised Learning

Explores the inductive bias of different nonlinear supervised learning methods and the challenges of hyper-parameter tuning.

Decision Trees and Boosting Log in to Mediaspace to watch this video

Explores decision trees in machine learning, their flexibility, impurity criteria, and introduces boosting methods like Adaboost.

Decision Trees and Boosting Log in to Mediaspace to watch this video

Introduces decision trees as a method for machine learning and explains boosting techniques for combining predictors.

Regression Trees and Ensemble Methods in Machine Learning Log in to Mediaspace to watch this video

Discusses regression trees, ensemble methods, and their applications in predicting used car prices and stock returns.